Sep 10 16:03:23.913685 ip-10-0-135-144 systemd[1]: Starting Kubernetes Kubelet... Sep 10 16:03:24.321899 ip-10-0-135-144 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 16:03:24.321899 ip-10-0-135-144 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 16:03:24.321899 ip-10-0-135-144 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 16:03:24.321899 ip-10-0-135-144 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 16:03:24.321899 ip-10-0-135-144 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 16:03:24.322804 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.321991 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 16:03:24.326736 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326716 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 16:03:24.326736 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326734 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 16:03:24.326829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326739 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 16:03:24.326829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326743 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 16:03:24.326829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326745 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 16:03:24.326829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326748 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 16:03:24.326829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326751 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 16:03:24.326829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326754 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 16:03:24.326829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326757 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 16:03:24.326829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326760 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 16:03:24.326829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326763 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 16:03:24.326829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326766 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 16:03:24.326829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326768 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 16:03:24.326829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326771 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 16:03:24.326829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326774 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 16:03:24.326829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326776 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 16:03:24.326829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326779 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 16:03:24.326829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326781 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 16:03:24.326829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326784 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 16:03:24.326829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326787 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 16:03:24.326829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326791 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 16:03:24.326829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326793 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 16:03:24.327615 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326796 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 16:03:24.327615 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326799 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 16:03:24.327615 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326801 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 16:03:24.327615 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326804 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 16:03:24.327615 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326807 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 16:03:24.327615 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326810 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 16:03:24.327615 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326813 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 16:03:24.327615 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326815 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 16:03:24.327615 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326818 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 16:03:24.327615 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326820 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 16:03:24.327615 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326823 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 16:03:24.327615 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326826 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 16:03:24.327615 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326828 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 16:03:24.327615 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326831 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 16:03:24.327615 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326834 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 16:03:24.327615 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326837 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 16:03:24.327615 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326840 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 16:03:24.327615 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326842 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 16:03:24.327615 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326845 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 16:03:24.327615 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326848 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 16:03:24.328343 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326851 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 16:03:24.328343 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326854 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 16:03:24.328343 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326856 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 16:03:24.328343 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326859 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 16:03:24.328343 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326861 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 16:03:24.328343 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326864 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 16:03:24.328343 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326867 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 16:03:24.328343 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326869 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 16:03:24.328343 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326872 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 16:03:24.328343 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326875 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 16:03:24.328343 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326877 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 16:03:24.328343 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326880 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 16:03:24.328343 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326882 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 16:03:24.328343 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326885 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 16:03:24.328343 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326889 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 16:03:24.328343 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326893 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 16:03:24.328343 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326896 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 16:03:24.328343 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326898 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 16:03:24.328343 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326902 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 16:03:24.329021 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326906 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 16:03:24.329021 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326909 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 16:03:24.329021 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326911 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 16:03:24.329021 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326914 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 16:03:24.329021 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326917 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 16:03:24.329021 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326920 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 16:03:24.329021 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326923 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 16:03:24.329021 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326925 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 16:03:24.329021 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326928 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 16:03:24.329021 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326931 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 16:03:24.329021 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326933 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 16:03:24.329021 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326936 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 16:03:24.329021 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326938 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 16:03:24.329021 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326941 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 16:03:24.329021 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326944 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 16:03:24.329021 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326947 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 16:03:24.329021 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326949 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 10 16:03:24.329021 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326955 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 16:03:24.329021 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326960 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 16:03:24.329714 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326963 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 16:03:24.329714 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326966 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 16:03:24.329714 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326969 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 16:03:24.329714 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326972 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 16:03:24.329714 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326974 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 16:03:24.329714 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326977 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 16:03:24.329714 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326980 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 16:03:24.329714 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326982 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 16:03:24.329714 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326984 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 16:03:24.329714 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326988 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 16:03:24.329714 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326991 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 16:03:24.329714 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326994 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 16:03:24.329714 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326996 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 16:03:24.329714 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.326999 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 16:03:24.329714 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327002 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 16:03:24.329714 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327005 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 16:03:24.329714 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327008 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 16:03:24.329714 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327011 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 16:03:24.329714 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327014 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 16:03:24.329714 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327753 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 16:03:24.330501 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327761 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 16:03:24.330501 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327765 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 16:03:24.330501 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327768 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 16:03:24.330501 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327771 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 16:03:24.330501 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327774 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 16:03:24.330501 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327777 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 16:03:24.330501 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327780 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 16:03:24.330501 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327783 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 10 16:03:24.330501 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327786 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 16:03:24.330501 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327790 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 16:03:24.330501 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327794 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 16:03:24.330501 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327798 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 16:03:24.330501 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327801 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 16:03:24.330501 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327804 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 16:03:24.330501 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327807 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 16:03:24.330501 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327809 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 16:03:24.330501 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327812 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 16:03:24.330501 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327815 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 16:03:24.330501 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327818 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 16:03:24.330501 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327821 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 16:03:24.331237 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327823 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 16:03:24.331237 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327826 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 16:03:24.331237 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327829 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 16:03:24.331237 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327832 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 16:03:24.331237 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327835 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 16:03:24.331237 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327838 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 16:03:24.331237 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327841 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 16:03:24.331237 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327843 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 16:03:24.331237 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327846 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 16:03:24.331237 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327849 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 16:03:24.331237 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327853 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 16:03:24.331237 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327857 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 16:03:24.331237 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327860 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 16:03:24.331237 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327863 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 16:03:24.331237 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327865 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 16:03:24.331237 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327869 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 16:03:24.331237 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327871 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 16:03:24.331237 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327874 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 16:03:24.331237 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327876 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 16:03:24.331237 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327879 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 16:03:24.331969 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327882 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 16:03:24.331969 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327884 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 16:03:24.331969 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327887 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 16:03:24.331969 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327889 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 16:03:24.331969 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327892 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 16:03:24.331969 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327895 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 16:03:24.331969 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327898 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 16:03:24.331969 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327900 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 16:03:24.331969 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327903 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 16:03:24.331969 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327906 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 16:03:24.331969 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327908 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 16:03:24.331969 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327911 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 16:03:24.331969 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327913 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 16:03:24.331969 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327916 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 16:03:24.331969 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327919 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 16:03:24.331969 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327922 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 16:03:24.331969 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327925 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 16:03:24.331969 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327927 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 16:03:24.331969 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327930 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 16:03:24.331969 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327932 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 16:03:24.332731 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327935 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 16:03:24.332731 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327937 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 16:03:24.332731 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327940 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 16:03:24.332731 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327943 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 16:03:24.332731 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327946 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 16:03:24.332731 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327949 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 16:03:24.332731 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327951 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 16:03:24.332731 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327954 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 16:03:24.332731 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327956 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 16:03:24.332731 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327959 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 16:03:24.332731 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327961 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 16:03:24.332731 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327964 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 16:03:24.332731 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327967 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 16:03:24.332731 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327970 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 16:03:24.332731 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327973 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 16:03:24.332731 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327976 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 16:03:24.332731 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327978 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 16:03:24.332731 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327981 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 16:03:24.332731 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327984 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 16:03:24.333436 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327987 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 16:03:24.333436 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327989 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 16:03:24.333436 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327992 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 16:03:24.333436 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327994 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 16:03:24.333436 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.327997 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 16:03:24.333436 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328000 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 16:03:24.333436 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328004 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 16:03:24.333436 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328007 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 16:03:24.333436 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328010 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 16:03:24.333436 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328012 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 16:03:24.333436 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328015 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 16:03:24.333436 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328018 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 16:03:24.333436 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328020 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 16:03:24.333436 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328023 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 16:03:24.333436 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328025 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 16:03:24.333436 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328029 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 16:03:24.333436 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328032 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 16:03:24.333436 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328035 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 16:03:24.333436 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328038 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 16:03:24.334126 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328421 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 10 16:03:24.334126 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328427 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 16:03:24.334126 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328431 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 16:03:24.334126 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328435 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 16:03:24.334126 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328438 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 16:03:24.334126 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328440 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 16:03:24.334126 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328443 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 16:03:24.334126 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328447 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 16:03:24.334126 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328451 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 16:03:24.334126 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328454 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 16:03:24.334126 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328457 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 16:03:24.334126 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328459 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 16:03:24.334126 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328463 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 16:03:24.334126 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328466 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 16:03:24.334126 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328469 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 16:03:24.334126 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328472 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 16:03:24.334126 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328475 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 16:03:24.334126 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328478 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 16:03:24.334126 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328481 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 16:03:24.334835 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328485 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 16:03:24.334835 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328488 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 16:03:24.334835 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328491 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 16:03:24.334835 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328494 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 16:03:24.334835 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328497 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 16:03:24.334835 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328500 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 16:03:24.334835 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328503 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 16:03:24.334835 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328506 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 16:03:24.334835 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328508 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 16:03:24.334835 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328511 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 16:03:24.334835 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328514 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 16:03:24.334835 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328517 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 16:03:24.334835 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328519 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 16:03:24.334835 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328522 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 16:03:24.334835 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328525 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 16:03:24.334835 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328528 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 16:03:24.334835 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328530 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 16:03:24.334835 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328533 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 16:03:24.334835 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328535 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 16:03:24.335742 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328538 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 16:03:24.335742 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328541 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 16:03:24.335742 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328543 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 16:03:24.335742 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328545 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 16:03:24.335742 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328548 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 16:03:24.335742 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328550 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 16:03:24.335742 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328553 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 16:03:24.335742 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328557 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 16:03:24.335742 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328559 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 16:03:24.335742 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328562 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 16:03:24.335742 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328564 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 16:03:24.335742 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328567 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 16:03:24.335742 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328569 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 16:03:24.335742 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328572 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 16:03:24.335742 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328575 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 16:03:24.335742 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328578 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 16:03:24.335742 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328580 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 16:03:24.335742 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328583 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 16:03:24.335742 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328585 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 16:03:24.335742 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328588 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 16:03:24.336469 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328590 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 16:03:24.336469 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328593 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 16:03:24.336469 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328595 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 16:03:24.336469 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328597 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 16:03:24.336469 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328600 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 16:03:24.336469 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328603 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 16:03:24.336469 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328605 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 16:03:24.336469 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328608 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 16:03:24.336469 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328611 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 16:03:24.336469 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328613 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 16:03:24.336469 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328616 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 16:03:24.336469 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328619 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 16:03:24.336469 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328622 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 16:03:24.336469 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328624 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 16:03:24.336469 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328627 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 16:03:24.336469 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328629 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 16:03:24.336469 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328632 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 16:03:24.336469 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328634 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 16:03:24.336469 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328637 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 16:03:24.336469 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328639 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 16:03:24.337186 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328642 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 16:03:24.337186 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328644 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 16:03:24.337186 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328647 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 16:03:24.337186 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328649 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 16:03:24.337186 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328652 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 16:03:24.337186 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328654 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 16:03:24.337186 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328657 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 16:03:24.337186 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328660 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 16:03:24.337186 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328662 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 16:03:24.337186 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328664 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 16:03:24.337186 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328667 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 16:03:24.337186 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328673 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 16:03:24.337186 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328675 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 16:03:24.337186 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328678 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 16:03:24.337186 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328680 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 16:03:24.337186 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328682 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 16:03:24.337186 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328685 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 16:03:24.337186 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328687 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 16:03:24.337186 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328690 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328692 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.328695 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328767 2578 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328801 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328808 2578 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328812 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328817 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328820 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328824 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328829 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328832 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328835 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328838 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328842 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328845 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328848 2578 flags.go:64] FLAG: --cgroup-root="" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328852 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328854 2578 flags.go:64] FLAG: --client-ca-file="" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328857 2578 flags.go:64] FLAG: --cloud-provider="external" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328860 2578 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328865 2578 flags.go:64] FLAG: --cluster-domain="" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328868 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328870 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 16:03:24.337928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328874 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328879 2578 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328882 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328885 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328888 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328891 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328894 2578 flags.go:64] FLAG: --contention-profiling="false" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328898 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328901 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328904 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328907 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328910 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328913 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328916 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328919 2578 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328922 2578 flags.go:64] FLAG: --enable-server="true" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328925 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328930 2578 flags.go:64] FLAG: --event-burst="100" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328934 2578 flags.go:64] FLAG: --event-qps="50" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328937 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328940 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328942 2578 flags.go:64] FLAG: --eviction-hard="" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328947 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328949 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328956 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 16:03:24.338856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328959 2578 flags.go:64] FLAG: --eviction-soft="" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328962 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328965 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328968 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328971 2578 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328974 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328976 2578 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328979 2578 flags.go:64] FLAG: --feature-gates="" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328985 2578 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328987 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328990 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328993 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328996 2578 flags.go:64] FLAG: --healthz-port="10248" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.328999 2578 flags.go:64] FLAG: --help="false" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329002 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-135-144.ec2.internal" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329005 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329008 2578 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329011 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329015 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329018 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329021 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329024 2578 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329027 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 16:03:24.339760 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329030 2578 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329034 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329037 2578 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329040 2578 flags.go:64] FLAG: --kube-reserved="" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329043 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329046 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329049 2578 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329052 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329054 2578 flags.go:64] FLAG: --lock-file="" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329059 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329061 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329064 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329070 2578 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329073 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329075 2578 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329078 2578 flags.go:64] FLAG: --logging-format="text" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329081 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329086 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329089 2578 flags.go:64] FLAG: --manifest-url="" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329091 2578 flags.go:64] FLAG: --manifest-url-header="" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329096 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329099 2578 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329103 2578 flags.go:64] FLAG: --max-pods="110" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329106 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329110 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 16:03:24.340640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329113 2578 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329116 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329119 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329122 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329125 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329132 2578 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329135 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329138 2578 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329142 2578 flags.go:64] FLAG: --pod-cidr="" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329145 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329150 2578 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329153 2578 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329156 2578 flags.go:64] FLAG: --pods-per-core="0" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329159 2578 flags.go:64] FLAG: --port="10250" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329162 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329165 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-028e5912363eced45" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329168 2578 flags.go:64] FLAG: --qos-reserved="" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329172 2578 flags.go:64] FLAG: --read-only-port="10255" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329175 2578 flags.go:64] FLAG: --register-node="true" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329178 2578 flags.go:64] FLAG: --register-with-taints="" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329182 2578 flags.go:64] FLAG: --registry-burst="10" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329185 2578 flags.go:64] FLAG: --registry-qps="5" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329187 2578 flags.go:64] FLAG: --reserved-cpus="" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329191 2578 flags.go:64] FLAG: --reserved-memory="" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329196 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 16:03:24.341630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329199 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329202 2578 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329205 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329208 2578 flags.go:64] FLAG: --runonce="false" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329211 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329214 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329217 2578 flags.go:64] FLAG: --seccomp-default="false" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329220 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329223 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329226 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329229 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329232 2578 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329235 2578 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329238 2578 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329241 2578 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329244 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329261 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329265 2578 flags.go:64] FLAG: --system-cgroups="" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329268 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329273 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329276 2578 flags.go:64] FLAG: --tls-cert-file="" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329279 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329286 2578 flags.go:64] FLAG: --tls-min-version="" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329289 2578 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329292 2578 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 16:03:24.342557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329303 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329306 2578 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329309 2578 flags.go:64] FLAG: --v="2" Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329313 2578 flags.go:64] FLAG: --version="false" Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329317 2578 flags.go:64] FLAG: --vmodule="" Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329321 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329325 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329457 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329462 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329465 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329468 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329471 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329473 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329477 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329479 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329482 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329484 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329487 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329489 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329492 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329494 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 16:03:24.343514 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329497 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 16:03:24.344306 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329500 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 16:03:24.344306 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329504 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 16:03:24.344306 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329507 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 16:03:24.344306 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329509 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 16:03:24.344306 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329512 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 16:03:24.344306 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329514 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 16:03:24.344306 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329517 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 16:03:24.344306 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329520 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 16:03:24.344306 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329522 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 16:03:24.344306 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329525 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 16:03:24.344306 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329527 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 16:03:24.344306 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329530 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 16:03:24.344306 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329533 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 16:03:24.344306 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329535 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 16:03:24.344306 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329538 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 16:03:24.344306 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329540 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 16:03:24.344306 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329544 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 16:03:24.344306 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329547 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 16:03:24.344306 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329549 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 16:03:24.344306 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329552 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 16:03:24.345038 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329554 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 16:03:24.345038 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329557 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 16:03:24.345038 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329559 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 16:03:24.345038 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329562 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 16:03:24.345038 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329565 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 16:03:24.345038 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329567 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 16:03:24.345038 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329570 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 16:03:24.345038 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329572 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 16:03:24.345038 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329575 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 16:03:24.345038 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329578 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 16:03:24.345038 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329580 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 16:03:24.345038 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329582 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 16:03:24.345038 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329585 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 16:03:24.345038 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329590 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 16:03:24.345038 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329595 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 16:03:24.345038 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329599 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 16:03:24.345038 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329603 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 16:03:24.345038 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329606 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 16:03:24.345038 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329608 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 16:03:24.345834 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329611 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 16:03:24.345834 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329614 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 16:03:24.345834 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329617 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 16:03:24.345834 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329619 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 16:03:24.345834 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329622 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 16:03:24.345834 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329625 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 16:03:24.345834 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329627 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 16:03:24.345834 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329630 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 16:03:24.345834 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329632 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 16:03:24.345834 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329637 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 16:03:24.345834 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329640 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 16:03:24.345834 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329642 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 16:03:24.345834 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329645 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 16:03:24.345834 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329647 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 16:03:24.345834 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329650 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 16:03:24.345834 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329652 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 16:03:24.345834 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329655 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 16:03:24.345834 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329658 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 16:03:24.345834 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329660 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 16:03:24.345834 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329663 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 16:03:24.346577 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329665 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 16:03:24.346577 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329668 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 16:03:24.346577 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329673 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 16:03:24.346577 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329678 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 16:03:24.346577 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329683 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 16:03:24.346577 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329686 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 16:03:24.346577 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329691 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 16:03:24.346577 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329694 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 16:03:24.346577 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329696 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 16:03:24.346577 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329699 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 16:03:24.346577 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329702 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 10 16:03:24.346577 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329704 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 16:03:24.346577 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329707 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 16:03:24.346577 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329710 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 16:03:24.346577 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329712 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 16:03:24.346577 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329715 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 16:03:24.346577 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329717 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 16:03:24.346577 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329720 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 16:03:24.346577 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329723 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 16:03:24.347311 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329726 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 16:03:24.347311 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329729 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 16:03:24.347311 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329733 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 16:03:24.347311 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329736 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 16:03:24.347311 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329739 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 16:03:24.347311 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.329742 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 16:03:24.347311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.329750 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 16:03:24.347311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.337781 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 16:03:24.347311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.337920 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 16:03:24.347311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.337939 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 16:03:24.347311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.337945 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 16:03:24.347311 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338004 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 16:03:24.347311 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338010 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 16:03:24.347311 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338014 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 16:03:24.347852 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338018 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 16:03:24.347852 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338022 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 16:03:24.347852 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338025 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 16:03:24.347852 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338028 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 16:03:24.347852 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338031 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 16:03:24.347852 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338035 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 16:03:24.347852 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338038 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 16:03:24.347852 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338041 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 16:03:24.347852 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338044 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 16:03:24.347852 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338047 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 16:03:24.347852 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338050 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 16:03:24.347852 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338053 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 16:03:24.347852 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338056 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 16:03:24.347852 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338058 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 16:03:24.347852 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338061 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 16:03:24.347852 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338063 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 16:03:24.347852 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338066 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 16:03:24.347852 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338070 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 16:03:24.347852 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338072 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 16:03:24.348603 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338075 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 16:03:24.348603 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338078 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 16:03:24.348603 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338081 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 16:03:24.348603 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338083 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 16:03:24.348603 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338085 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 16:03:24.348603 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338088 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 16:03:24.348603 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338091 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 16:03:24.348603 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338094 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 16:03:24.348603 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338097 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 16:03:24.348603 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338100 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 16:03:24.348603 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338103 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 16:03:24.348603 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338105 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 16:03:24.348603 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338108 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 16:03:24.348603 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338111 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 16:03:24.348603 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338113 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 16:03:24.348603 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338116 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 16:03:24.348603 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338118 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 16:03:24.348603 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338121 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 16:03:24.348603 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338124 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 16:03:24.348603 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338126 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 10 16:03:24.349366 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338129 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 16:03:24.349366 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338131 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 16:03:24.349366 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338134 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 16:03:24.349366 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338136 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 16:03:24.349366 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338139 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 16:03:24.349366 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338141 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 16:03:24.349366 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338144 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 16:03:24.349366 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338146 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 16:03:24.349366 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338149 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 16:03:24.349366 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338152 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 16:03:24.349366 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338155 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 16:03:24.349366 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338159 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 16:03:24.349366 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338162 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 16:03:24.349366 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338166 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 16:03:24.349366 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338168 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 16:03:24.349366 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338171 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 16:03:24.349366 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338174 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 16:03:24.349366 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338177 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 16:03:24.349366 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338180 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 16:03:24.350064 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338183 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 16:03:24.350064 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338186 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 16:03:24.350064 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338189 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 16:03:24.350064 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338191 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 16:03:24.350064 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338194 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 16:03:24.350064 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338197 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 16:03:24.350064 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338200 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 16:03:24.350064 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338202 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 16:03:24.350064 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338205 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 16:03:24.350064 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338208 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 16:03:24.350064 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338211 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 16:03:24.350064 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338215 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 16:03:24.350064 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338218 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 16:03:24.350064 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338221 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 16:03:24.350064 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338224 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 16:03:24.350064 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338227 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 16:03:24.350064 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338229 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 16:03:24.350064 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338232 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 16:03:24.350064 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338235 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 16:03:24.350064 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338238 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 16:03:24.350816 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338241 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 16:03:24.350816 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338244 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 16:03:24.350816 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338247 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 16:03:24.350816 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338264 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 16:03:24.350816 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338267 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 16:03:24.350816 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338270 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 16:03:24.350816 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338273 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 16:03:24.350816 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338276 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 16:03:24.350816 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338278 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 16:03:24.350816 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338282 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 16:03:24.350816 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338285 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 16:03:24.350816 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338288 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 16:03:24.350816 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338291 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 16:03:24.350816 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338294 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 16:03:24.350816 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338297 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 16:03:24.350816 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338300 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 16:03:24.350816 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338302 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 16:03:24.350816 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338305 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 16:03:24.351543 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.338310 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 16:03:24.351543 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338430 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 16:03:24.351543 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338435 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 16:03:24.351543 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338438 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 16:03:24.351543 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338441 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 16:03:24.351543 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338443 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 16:03:24.351543 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338446 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 16:03:24.351543 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338449 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 16:03:24.351543 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338451 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 16:03:24.351543 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338454 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 16:03:24.351543 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338457 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 16:03:24.351543 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338459 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 16:03:24.351543 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338462 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 16:03:24.351543 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338464 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 16:03:24.351543 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338467 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 16:03:24.352090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338469 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 16:03:24.352090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338472 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 16:03:24.352090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338474 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 16:03:24.352090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338477 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 16:03:24.352090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338479 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 16:03:24.352090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338482 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 16:03:24.352090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338484 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 16:03:24.352090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338487 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 16:03:24.352090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338489 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 16:03:24.352090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338492 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 16:03:24.352090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338494 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 16:03:24.352090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338497 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 16:03:24.352090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338500 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 16:03:24.352090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338502 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 16:03:24.352090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338505 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 16:03:24.352090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338507 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 16:03:24.352090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338510 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 16:03:24.352090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338512 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 16:03:24.352090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338515 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 16:03:24.352090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338517 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 16:03:24.352829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338520 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 16:03:24.352829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338522 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 16:03:24.352829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338525 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 16:03:24.352829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338528 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 16:03:24.352829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338530 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 16:03:24.352829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338533 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 16:03:24.352829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338535 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 16:03:24.352829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338538 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 16:03:24.352829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338540 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 16:03:24.352829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338543 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 16:03:24.352829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338545 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 16:03:24.352829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338548 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 16:03:24.352829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338550 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 16:03:24.352829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338552 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 16:03:24.352829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338555 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 16:03:24.352829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338557 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 16:03:24.352829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338560 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 16:03:24.352829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338562 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 16:03:24.352829 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338565 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 16:03:24.353555 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338569 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 16:03:24.353555 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338572 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 16:03:24.353555 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338575 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 16:03:24.353555 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338578 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 16:03:24.353555 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338580 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 16:03:24.353555 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338584 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 16:03:24.353555 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338586 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 16:03:24.353555 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338589 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 16:03:24.353555 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338591 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 16:03:24.353555 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338594 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 16:03:24.353555 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338597 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 16:03:24.353555 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338599 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 16:03:24.353555 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338602 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 16:03:24.353555 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338604 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 16:03:24.353555 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338607 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 16:03:24.353555 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338609 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 16:03:24.353555 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338613 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 16:03:24.353555 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338616 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 16:03:24.353555 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338619 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 16:03:24.354277 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338622 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 16:03:24.354277 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338625 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 16:03:24.354277 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338628 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 16:03:24.354277 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338630 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 16:03:24.354277 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338633 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 16:03:24.354277 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338635 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 16:03:24.354277 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338638 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 16:03:24.354277 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338640 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 16:03:24.354277 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338643 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 16:03:24.354277 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338645 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 16:03:24.354277 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338649 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 16:03:24.354277 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338652 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 16:03:24.354277 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338655 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 16:03:24.354277 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338658 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 16:03:24.354277 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338661 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 16:03:24.354277 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338664 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 16:03:24.354277 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338666 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 16:03:24.354277 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338692 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 16:03:24.354277 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338698 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 16:03:24.354277 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338702 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 10 16:03:24.355010 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338705 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 16:03:24.355010 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338708 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 16:03:24.355010 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338711 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 16:03:24.355010 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338713 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 16:03:24.355010 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338716 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 16:03:24.355010 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338718 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 16:03:24.355010 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:24.338721 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 16:03:24.355010 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.338726 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 16:03:24.355010 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.338843 2578 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 16:03:24.355010 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.341074 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 16:03:24.355010 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.342140 2578 server.go:1019] "Starting client certificate rotation" Sep 10 16:03:24.355010 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.342239 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 16:03:24.355010 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.342307 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 16:03:24.355558 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.344653 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 16:03:24.355558 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.345898 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 16:03:24.356241 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.356223 2578 log.go:25] "Validated CRI v1 runtime API" Sep 10 16:03:24.360646 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.360625 2578 log.go:25] "Validated CRI v1 image API" Sep 10 16:03:24.361553 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.361536 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 16:03:24.366072 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.366020 2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b51aee3b-1aa8-44dc-aafd-00bc0959858c:/dev/nvme0n1p4 bbbc1408-28c8-4c9a-8526-20d84613c8f4:/dev/nvme0n1p3] Sep 10 16:03:24.366179 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.366063 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 16:03:24.372641 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.372489 2578 manager.go:216] Machine: {Timestamp:2026-09-10 16:03:24.371706229 +0000 UTC m=+0.338705619 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100550 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26a1f0141d4a4ae4bcba6777979b45 SystemUUID:ec26a1f0-141d-4a4a-e4bc-ba6777979b45 BootID:31ed59ce-4204-4bc3-8476-585fdd5648ee Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4c:53:85:19:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4c:53:85:19:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:5c:c1:94:52:20 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 16:03:24.372641 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.372629 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 16:03:24.372805 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.372791 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 16:03:24.375362 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.375336 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 16:03:24.375514 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.375365 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-144.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 16:03:24.375838 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.375818 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 16:03:24.377073 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.377060 2578 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 16:03:24.377073 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.377074 2578 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 16:03:24.377143 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.377083 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 16:03:24.377880 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.377869 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 16:03:24.379199 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.379188 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 16:03:24.382281 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.382268 2578 state_mem.go:36] "Initialized new in-memory state store" Sep 10 16:03:24.382412 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.382402 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 16:03:24.382452 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.382432 2578 kubelet.go:486] "Attempting to sync node with API server" Sep 10 16:03:24.382452 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.382442 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 16:03:24.382523 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.382453 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 16:03:24.382523 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.382462 2578 kubelet.go:398] "Adding apiserver pod source" Sep 10 16:03:24.382523 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.382472 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 16:03:24.382854 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.382840 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 16:03:24.382904 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.382865 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 16:03:24.385115 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.385098 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 16:03:24.387610 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.387594 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 16:03:24.387693 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.387633 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 16:03:24.387825 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.387814 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 16:03:24.387874 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.387832 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 16:03:24.387874 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.387840 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 16:03:24.387874 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.387848 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 16:03:24.387874 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.387858 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 16:03:24.387874 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.387865 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 16:03:24.388458 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.388448 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 16:03:24.388497 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.388461 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 16:03:24.388497 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.388472 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 16:03:24.388497 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.388480 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 16:03:24.388497 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.388493 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 16:03:24.388597 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.388503 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 16:03:24.389989 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.389976 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 16:03:24.390042 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.389992 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 16:03:24.391926 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:24.391888 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 16:03:24.392004 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:24.391917 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-144.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 16:03:24.394649 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.394635 2578 server.go:1268] "Started kubelet" Sep 10 16:03:24.394862 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.394824 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 16:03:24.394926 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.394784 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 16:03:24.395509 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.395481 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 16:03:24.395610 ip-10-0-135-144 systemd[1]: Started Kubernetes Kubelet. Sep 10 16:03:24.397082 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.397066 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 16:03:24.398034 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.398009 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-szh9s" Sep 10 16:03:24.399365 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.399347 2578 server.go:310] "Adding debug handlers to kubelet server" Sep 10 16:03:24.400902 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.400881 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 16:03:24.401025 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.401008 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 16:03:24.401145 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:24.401086 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-144.ec2.internal\" not found" Sep 10 16:03:24.401621 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.401605 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 16:03:24.401621 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.401608 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 16:03:24.401736 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.401631 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 16:03:24.401886 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.401870 2578 reconstruct.go:97] "Volume reconstruction finished" Sep 10 16:03:24.401886 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.401886 2578 reconciler.go:29] "Reconciler: start to sync state" Sep 10 16:03:24.402000 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:24.401913 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 16:03:24.402239 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.402220 2578 factory.go:153] Registering CRI-O factory Sep 10 16:03:24.402239 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.402244 2578 factory.go:223] Registration of the crio container factory successfully Sep 10 16:03:24.402407 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.402316 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 16:03:24.402407 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.402326 2578 factory.go:55] Registering systemd factory Sep 10 16:03:24.402407 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.402335 2578 factory.go:223] Registration of the systemd container factory successfully Sep 10 16:03:24.402407 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.402352 2578 factory.go:103] Registering Raw factory Sep 10 16:03:24.402407 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.402380 2578 manager.go:1196] Started watching for new ooms in manager Sep 10 16:03:24.402785 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.402769 2578 manager.go:349] Starting recovery of all containers Sep 10 16:03:24.402847 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.402795 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-144.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 16:03:24.403015 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:24.402992 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 16:03:24.403203 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:24.403180 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-144.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 16:03:24.403977 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:24.402921 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-144.ec2.internal.18d401239a262220 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-144.ec2.internal,UID:ip-10-0-135-144.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-144.ec2.internal,},FirstTimestamp:2026-09-10 16:03:24.39460304 +0000 UTC m=+0.361602484,LastTimestamp:2026-09-10 16:03:24.39460304 +0000 UTC m=+0.361602484,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-144.ec2.internal,}" Sep 10 16:03:24.405921 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.405902 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-szh9s" Sep 10 16:03:24.415950 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.414232 2578 manager.go:354] Recovery completed Sep 10 16:03:24.419459 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.419418 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:03:24.421343 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.421320 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:03:24.421402 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.421359 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:03:24.421402 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.421370 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:03:24.421952 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.421939 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 16:03:24.421999 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.421952 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 16:03:24.421999 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.421968 2578 state_mem.go:36] "Initialized new in-memory state store" Sep 10 16:03:24.422058 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.421945 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:03:24.422774 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.422759 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:03:24.422852 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.422785 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:03:24.422852 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.422795 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:03:24.423230 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.423216 2578 policy_none.go:49] "None policy: Start" Sep 10 16:03:24.423309 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.423238 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 16:03:24.423309 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.423305 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 16:03:24.424422 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.424409 2578 policy_none.go:47] "Start" Sep 10 16:03:24.501812 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:24.501784 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-144.ec2.internal\" not found" Sep 10 16:03:24.501979 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.501926 2578 manager.go:337] "Starting Device Plugin manager" Sep 10 16:03:24.501979 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:24.501974 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 16:03:24.502081 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.501988 2578 server.go:87] "Starting device plugin registration server" Sep 10 16:03:24.502285 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.502272 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 16:03:24.502366 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.502287 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 16:03:24.502435 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.502416 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 16:03:24.502505 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.502488 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 16:03:24.502505 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.502497 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 16:03:24.504564 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:24.504460 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 16:03:24.504564 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:24.504520 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-144.ec2.internal\" not found" Sep 10 16:03:24.523813 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.523782 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 16:03:24.525196 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.525176 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 16:03:24.525302 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.525235 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 16:03:24.525302 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.525272 2578 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 16:03:24.525397 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:24.525317 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 16:03:24.528020 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.527995 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 16:03:24.602622 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.602512 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:03:24.603503 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.603484 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:03:24.603619 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.603517 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:03:24.603619 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.603531 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:03:24.603619 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.603557 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-144.ec2.internal" Sep 10 16:03:24.610968 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:24.610951 2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-144.ec2.internal\" not found" node="ip-10-0-135-144.ec2.internal" Sep 10 16:03:24.612040 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.612027 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-144.ec2.internal" Sep 10 16:03:24.612078 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:24.612048 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-144.ec2.internal\": node \"ip-10-0-135-144.ec2.internal\" not found" Sep 10 16:03:24.625397 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.625370 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-144.ec2.internal"] Sep 10 16:03:24.625474 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.625445 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:03:24.626348 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.626330 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:03:24.626435 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.626365 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:03:24.626435 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.626380 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:03:24.627663 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.627651 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:03:24.627827 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.627811 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal" Sep 10 16:03:24.627887 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.627848 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:03:24.628408 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.628384 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:03:24.628408 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.628398 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:03:24.628546 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.628413 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:03:24.628546 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.628423 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:03:24.628546 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.628427 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:03:24.628546 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.628436 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:03:24.629638 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.629622 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-144.ec2.internal" Sep 10 16:03:24.629702 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.629653 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:03:24.630352 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.630338 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:03:24.630405 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.630363 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:03:24.630405 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.630379 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:03:24.643354 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:24.643334 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-144.ec2.internal\" not found" Sep 10 16:03:24.655072 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:24.655050 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-144.ec2.internal\" not found" node="ip-10-0-135-144.ec2.internal" Sep 10 16:03:24.659550 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:24.659535 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-144.ec2.internal\" not found" node="ip-10-0-135-144.ec2.internal" Sep 10 16:03:24.703150 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.703114 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f6747baa96a83f589d64dbeaabcff6e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-144.ec2.internal\" (UID: \"2f6747baa96a83f589d64dbeaabcff6e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-144.ec2.internal" Sep 10 16:03:24.703150 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.703149 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23084555b3dc75f8c230ccb6a14d1674-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal\" (UID: \"23084555b3dc75f8c230ccb6a14d1674\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal" Sep 10 16:03:24.703326 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.703167 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23084555b3dc75f8c230ccb6a14d1674-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal\" (UID: \"23084555b3dc75f8c230ccb6a14d1674\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal" Sep 10 16:03:24.743717 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:24.743692 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-144.ec2.internal\" not found" Sep 10 16:03:24.803473 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.803443 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f6747baa96a83f589d64dbeaabcff6e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-144.ec2.internal\" (UID: \"2f6747baa96a83f589d64dbeaabcff6e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-144.ec2.internal" Sep 10 16:03:24.803473 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.803474 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23084555b3dc75f8c230ccb6a14d1674-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal\" (UID: \"23084555b3dc75f8c230ccb6a14d1674\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal" Sep 10 16:03:24.803603 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.803491 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23084555b3dc75f8c230ccb6a14d1674-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal\" (UID: \"23084555b3dc75f8c230ccb6a14d1674\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal" Sep 10 16:03:24.803603 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.803553 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f6747baa96a83f589d64dbeaabcff6e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-144.ec2.internal\" (UID: \"2f6747baa96a83f589d64dbeaabcff6e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-144.ec2.internal" Sep 10 16:03:24.803603 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.803562 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23084555b3dc75f8c230ccb6a14d1674-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal\" (UID: \"23084555b3dc75f8c230ccb6a14d1674\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal" Sep 10 16:03:24.803603 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.803585 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23084555b3dc75f8c230ccb6a14d1674-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal\" (UID: \"23084555b3dc75f8c230ccb6a14d1674\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal" Sep 10 16:03:24.844381 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:24.844353 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-144.ec2.internal\" not found" Sep 10 16:03:24.945136 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:24.945071 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-144.ec2.internal\" not found" Sep 10 16:03:24.958234 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.958207 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal" Sep 10 16:03:24.962819 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:24.962323 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-144.ec2.internal" Sep 10 16:03:25.045833 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:25.045790 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-144.ec2.internal\" not found" Sep 10 16:03:25.146328 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:25.146295 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-144.ec2.internal\" not found" Sep 10 16:03:25.246952 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:25.246858 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-144.ec2.internal\" not found" Sep 10 16:03:25.341406 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:25.341376 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 16:03:25.341850 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:25.341542 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 16:03:25.347670 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:25.347650 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-144.ec2.internal\" not found" Sep 10 16:03:25.407966 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:25.407915 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 15:58:25 +0000 UTC" deadline="2028-05-16 01:48:23.071877212 +0000 UTC" Sep 10 16:03:25.407966 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:25.407958 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14721h44m57.663921642s" Sep 10 16:03:25.448660 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:25.448625 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-144.ec2.internal\" not found" Sep 10 16:03:25.549356 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:25.549139 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-144.ec2.internal\" not found" Sep 10 16:03:25.649628 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:25.649594 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-144.ec2.internal\" not found" Sep 10 16:03:25.684439 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:25.684415 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 16:03:25.697342 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:25.697317 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 16:03:25.701797 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:25.701777 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-144.ec2.internal" Sep 10 16:03:25.710094 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:25.710055 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f6747baa96a83f589d64dbeaabcff6e.slice/crio-677b243a34fe52654c09bfa4fe11c0173a3f298faf25bef4d0bd54d5aa57da70 WatchSource:0}: Error finding container 677b243a34fe52654c09bfa4fe11c0173a3f298faf25bef4d0bd54d5aa57da70: Status 404 returned error can't find the container with id 677b243a34fe52654c09bfa4fe11c0173a3f298faf25bef4d0bd54d5aa57da70 Sep 10 16:03:25.710355 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:25.710328 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23084555b3dc75f8c230ccb6a14d1674.slice/crio-3454fbd3faae02ed75c724a110dfb4b0966cd57a4a468f6935c059f1ad0c8600 WatchSource:0}: Error finding container 3454fbd3faae02ed75c724a110dfb4b0966cd57a4a468f6935c059f1ad0c8600: Status 404 returned error can't find the container with id 3454fbd3faae02ed75c724a110dfb4b0966cd57a4a468f6935c059f1ad0c8600 Sep 10 16:03:25.712379 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:25.712360 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 16:03:25.714364 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:25.714343 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal" Sep 10 16:03:25.715666 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:25.715651 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 16:03:25.729416 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:25.729385 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 16:03:25.735550 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:25.735530 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 16:03:26.383793 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.383763 2578 apiserver.go:52] "Watching apiserver" Sep 10 16:03:26.395357 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.392975 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 16:03:26.395357 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.393853 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-62ksm","openshift-multus/multus-9dwmj","openshift-multus/multus-additional-cni-plugins-9mqzq","openshift-multus/network-metrics-daemon-mdf7t","openshift-network-operator/iptables-alerter-r8hld","openshift-ovn-kubernetes/ovnkube-node-ktbmj","kube-system/kube-apiserver-proxy-ip-10-0-135-144.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg","openshift-dns/node-resolver-jg5j2","openshift-image-registry/node-ca-8qvcj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal","openshift-network-diagnostics/network-check-target-ljtzt","kube-system/global-pull-secret-syncer-7bc6j","kube-system/konnectivity-agent-6qtzm"] Sep 10 16:03:26.396838 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.396812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.397936 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.397910 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.399373 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.399135 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6qtzm" Sep 10 16:03:26.399634 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.399613 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cwkvq\"" Sep 10 16:03:26.399860 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.399843 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 16:03:26.399934 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.399888 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 16:03:26.399934 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.399846 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 16:03:26.400971 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.400950 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 16:03:26.401062 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.401027 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 16:03:26.401121 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.400950 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 16:03:26.401173 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.401136 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 16:03:26.401551 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.401532 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w8hmh\"" Sep 10 16:03:26.401637 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.401616 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8qvcj" Sep 10 16:03:26.402000 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.401984 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 16:03:26.402083 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.402067 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 16:03:26.402498 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.402478 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 16:03:26.402498 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.402493 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hz7jt\"" Sep 10 16:03:26.403916 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.403897 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 16:03:26.404007 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.403906 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tw2vn\"" Sep 10 16:03:26.404094 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.404080 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:26.404174 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:26.404149 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:03:26.404238 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.404159 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 16:03:26.404238 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.404220 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 16:03:26.406566 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.406547 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.408834 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.408085 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r8hld" Sep 10 16:03:26.409384 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.409327 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 16:03:26.409384 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.409355 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 16:03:26.409521 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.409434 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 16:03:26.409662 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.409640 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 16:03:26.409662 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.409654 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 16:03:26.410538 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.410519 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f8mdj\"" Sep 10 16:03:26.410623 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.410539 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 16:03:26.410623 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.410563 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-hostroot\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.410623 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.410584 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-multus-conf-dir\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.410623 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.410600 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eddbd0df-ed01-4c8e-97c2-4600b940a4f4-agent-certs\") pod \"konnectivity-agent-6qtzm\" (UID: \"eddbd0df-ed01-4c8e-97c2-4600b940a4f4\") " pod="kube-system/konnectivity-agent-6qtzm" Sep 10 16:03:26.410623 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.410615 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f0d2a2d-ee8b-4b92-996b-7681ceb92064-host\") pod \"node-ca-8qvcj\" (UID: \"7f0d2a2d-ee8b-4b92-996b-7681ceb92064\") " pod="openshift-image-registry/node-ca-8qvcj" Sep 10 16:03:26.410818 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.410631 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fa87306a-d01f-4e6b-b860-65cd291d87c2-registration-dir\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.410818 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.410646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g946\" (UniqueName: \"kubernetes.io/projected/fa87306a-d01f-4e6b-b860-65cd291d87c2-kube-api-access-4g946\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.410818 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.410660 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-multus-socket-dir-parent\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.410818 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.410700 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-host-var-lib-cni-bin\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.410818 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.410732 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f0d2a2d-ee8b-4b92-996b-7681ceb92064-serviceca\") pod \"node-ca-8qvcj\" (UID: \"7f0d2a2d-ee8b-4b92-996b-7681ceb92064\") " pod="openshift-image-registry/node-ca-8qvcj" Sep 10 16:03:26.410818 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.410759 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fa87306a-d01f-4e6b-b860-65cd291d87c2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.410818 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.410802 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fa87306a-d01f-4e6b-b860-65cd291d87c2-device-dir\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.411104 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.410837 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-cnibin\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.411104 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.410861 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-host-var-lib-kubelet\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.411104 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.410933 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-host-run-multus-certs\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.411104 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.410955 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-etc-kubernetes\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.411104 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.410992 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rgjj\" (UniqueName: \"kubernetes.io/projected/453a4988-a513-4136-b24a-27acca168047-kube-api-access-2rgjj\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.411104 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.411015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eddbd0df-ed01-4c8e-97c2-4600b940a4f4-konnectivity-ca\") pod \"konnectivity-agent-6qtzm\" (UID: \"eddbd0df-ed01-4c8e-97c2-4600b940a4f4\") " pod="kube-system/konnectivity-agent-6qtzm" Sep 10 16:03:26.411104 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.411060 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-system-cni-dir\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.411104 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.411094 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-host-run-k8s-cni-cncf-io\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.411628 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.411131 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs\") pod \"network-metrics-daemon-mdf7t\" (UID: \"226aa2a7-ea44-4496-ab2d-1dae7592f64f\") " pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:26.411628 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.411162 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlb4t\" (UniqueName: \"kubernetes.io/projected/226aa2a7-ea44-4496-ab2d-1dae7592f64f-kube-api-access-xlb4t\") pod \"network-metrics-daemon-mdf7t\" (UID: \"226aa2a7-ea44-4496-ab2d-1dae7592f64f\") " pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:26.411628 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.411200 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cjf67\"" Sep 10 16:03:26.411628 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.411203 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fa87306a-d01f-4e6b-b860-65cd291d87c2-socket-dir\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.411628 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.411227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fa87306a-d01f-4e6b-b860-65cd291d87c2-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.411628 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.411267 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-multus-cni-dir\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.411628 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.411276 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 16:03:26.411628 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.411290 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-host-run-netns\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.411628 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.411311 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 16:03:26.411628 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.411316 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/453a4988-a513-4136-b24a-27acca168047-cni-binary-copy\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.411628 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.411339 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-host-var-lib-cni-multus\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.411628 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.411358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nr62\" (UniqueName: \"kubernetes.io/projected/7f0d2a2d-ee8b-4b92-996b-7681ceb92064-kube-api-access-5nr62\") pod \"node-ca-8qvcj\" (UID: \"7f0d2a2d-ee8b-4b92-996b-7681ceb92064\") " pod="openshift-image-registry/node-ca-8qvcj" Sep 10 16:03:26.411628 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.411397 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fa87306a-d01f-4e6b-b860-65cd291d87c2-sys-fs\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.411628 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.411425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/453a4988-a513-4136-b24a-27acca168047-multus-daemon-config\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.412306 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.411768 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 16:03:26.412362 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.412350 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jg5j2" Sep 10 16:03:26.413802 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.413782 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:26.414532 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.414511 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 16:03:26.414811 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.414795 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 16:03:26.415295 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.415171 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h44x4\"" Sep 10 16:03:26.415709 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.415372 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 16:03:26.415709 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.415446 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:26.415709 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:26.415507 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:03:26.416391 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.416359 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sc86q\"" Sep 10 16:03:26.416391 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.416380 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 16:03:26.416583 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.416566 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 16:03:26.417274 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.417151 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:26.417274 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:26.417220 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:03:26.418698 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.418678 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:26.421282 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.421265 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 16:03:26.421490 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.421475 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 16:03:26.421728 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.421712 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hqk4x\"" Sep 10 16:03:26.441455 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.441428 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cnrh9" Sep 10 16:03:26.448698 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.448673 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cnrh9" Sep 10 16:03:26.503274 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.503224 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 16:03:26.513103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512461 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-cnibin\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.513103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512504 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-host-run-multus-certs\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.513103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512528 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-etc-kubernetes\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.513103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512552 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rgjj\" (UniqueName: \"kubernetes.io/projected/453a4988-a513-4136-b24a-27acca168047-kube-api-access-2rgjj\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.513103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512576 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-system-cni-dir\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.513103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512599 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-host-run-k8s-cni-cncf-io\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.513103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512625 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlb4t\" (UniqueName: \"kubernetes.io/projected/226aa2a7-ea44-4496-ab2d-1dae7592f64f-kube-api-access-xlb4t\") pod \"network-metrics-daemon-mdf7t\" (UID: \"226aa2a7-ea44-4496-ab2d-1dae7592f64f\") " pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:26.513103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512654 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-var-lib-openvswitch\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.513103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-var-lib-kubelet\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:26.513103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512683 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-host-run-multus-certs\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.513103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512688 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-cnibin\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.513103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512721 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fa87306a-d01f-4e6b-b860-65cd291d87c2-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.513103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512732 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-host-run-k8s-cni-cncf-io\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.513103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512745 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-host-run-netns\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.513103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512756 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-etc-kubernetes\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.513103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512784 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-slash\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.513103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512787 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-host-run-netns\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.513103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512811 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-run-openvswitch\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.514311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512834 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.514311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512861 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e259ee0-6025-45f0-8a9e-a777f702b9ae-ovnkube-script-lib\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.514311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512883 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-systemd\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:26.514311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512907 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c3521be-b742-4374-b077-4ed94d0f8162-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:26.514311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512937 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/453a4988-a513-4136-b24a-27acca168047-cni-binary-copy\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.514311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512962 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-host-var-lib-cni-multus\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.514311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.512987 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nr62\" (UniqueName: \"kubernetes.io/projected/7f0d2a2d-ee8b-4b92-996b-7681ceb92064-kube-api-access-5nr62\") pod \"node-ca-8qvcj\" (UID: \"7f0d2a2d-ee8b-4b92-996b-7681ceb92064\") " pod="openshift-image-registry/node-ca-8qvcj" Sep 10 16:03:26.514311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513009 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-log-socket\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.514311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513032 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e259ee0-6025-45f0-8a9e-a777f702b9ae-ovn-node-metrics-cert\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.514311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513039 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fa87306a-d01f-4e6b-b860-65cd291d87c2-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.514311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513055 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-lib-modules\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:26.514311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513079 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8ccdc02-c0de-4b91-847e-ff741ec86efb-dbus\") pod \"global-pull-secret-syncer-7bc6j\" (UID: \"e8ccdc02-c0de-4b91-847e-ff741ec86efb\") " pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:26.514311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513095 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-system-cni-dir\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.514311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513138 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-host-var-lib-cni-multus\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.514311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513144 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fa87306a-d01f-4e6b-b860-65cd291d87c2-sys-fs\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.514311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/453a4988-a513-4136-b24a-27acca168047-multus-daemon-config\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.514311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-run-systemd\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.515086 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513203 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fa87306a-d01f-4e6b-b860-65cd291d87c2-sys-fs\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.515086 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513237 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kssp\" (UniqueName: \"kubernetes.io/projected/2e259ee0-6025-45f0-8a9e-a777f702b9ae-kube-api-access-4kssp\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.515086 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513350 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-tmp\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:26.515086 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513393 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dnhj\" (UniqueName: \"kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj\") pod \"network-check-target-ljtzt\" (UID: \"2e535dce-4a4c-4acc-84a3-edaba69c6a9e\") " pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:26.515086 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513449 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c3521be-b742-4374-b077-4ed94d0f8162-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:26.515086 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513473 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bcc8\" (UniqueName: \"kubernetes.io/projected/5c3521be-b742-4374-b077-4ed94d0f8162-kube-api-access-9bcc8\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:26.515086 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513506 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-hostroot\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.515086 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513546 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-multus-conf-dir\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.515086 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513590 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-multus-conf-dir\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.515086 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513597 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g946\" (UniqueName: \"kubernetes.io/projected/fa87306a-d01f-4e6b-b860-65cd291d87c2-kube-api-access-4g946\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.515086 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513635 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-hostroot\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.515086 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513654 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-multus-socket-dir-parent\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.515086 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513688 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-node-log\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.515086 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513720 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-cni-netd\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.515086 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513744 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3584bddc-510d-4e13-adc2-3a52c12df88b-iptables-alerter-script\") pod \"iptables-alerter-r8hld\" (UID: \"3584bddc-510d-4e13-adc2-3a52c12df88b\") " pod="openshift-network-operator/iptables-alerter-r8hld" Sep 10 16:03:26.515086 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513776 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c3521be-b742-4374-b077-4ed94d0f8162-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:26.515086 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513779 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-multus-socket-dir-parent\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.515805 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513804 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fa87306a-d01f-4e6b-b860-65cd291d87c2-device-dir\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.515805 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513828 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-host-var-lib-kubelet\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.515805 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513874 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eddbd0df-ed01-4c8e-97c2-4600b940a4f4-konnectivity-ca\") pod \"konnectivity-agent-6qtzm\" (UID: \"eddbd0df-ed01-4c8e-97c2-4600b940a4f4\") " pod="kube-system/konnectivity-agent-6qtzm" Sep 10 16:03:26.515805 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513897 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0b33001-5d69-4d19-8b5a-4eec74939854-tmp-dir\") pod \"node-resolver-jg5j2\" (UID: \"d0b33001-5d69-4d19-8b5a-4eec74939854\") " pod="openshift-dns/node-resolver-jg5j2" Sep 10 16:03:26.515805 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513920 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8ccdc02-c0de-4b91-847e-ff741ec86efb-kubelet-config\") pod \"global-pull-secret-syncer-7bc6j\" (UID: \"e8ccdc02-c0de-4b91-847e-ff741ec86efb\") " pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:26.515805 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c3521be-b742-4374-b077-4ed94d0f8162-cni-binary-copy\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:26.515805 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.513976 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs\") pod \"network-metrics-daemon-mdf7t\" (UID: \"226aa2a7-ea44-4496-ab2d-1dae7592f64f\") " pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:26.515805 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514029 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fa87306a-d01f-4e6b-b860-65cd291d87c2-device-dir\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.515805 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514052 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-systemd-units\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.515805 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:26.514065 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:26.515805 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514074 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-kubernetes\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:26.515805 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514097 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-sysctl-d\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:26.515805 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514122 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-host\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:26.515805 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:26.514180 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs podName:226aa2a7-ea44-4496-ab2d-1dae7592f64f nodeName:}" failed. No retries permitted until 2026-09-10 16:03:27.014121052 +0000 UTC m=+2.981120453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs") pod "network-metrics-daemon-mdf7t" (UID: "226aa2a7-ea44-4496-ab2d-1dae7592f64f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:26.515805 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fa87306a-d01f-4e6b-b860-65cd291d87c2-socket-dir\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.515805 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514245 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-multus-cni-dir\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.515805 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514289 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-kubelet\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.516469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514312 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-cni-bin\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.516469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514336 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.516469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrptv\" (UniqueName: \"kubernetes.io/projected/d0b33001-5d69-4d19-8b5a-4eec74939854-kube-api-access-zrptv\") pod \"node-resolver-jg5j2\" (UID: \"d0b33001-5d69-4d19-8b5a-4eec74939854\") " pod="openshift-dns/node-resolver-jg5j2" Sep 10 16:03:26.516469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret\") pod \"global-pull-secret-syncer-7bc6j\" (UID: \"e8ccdc02-c0de-4b91-847e-ff741ec86efb\") " pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:26.516469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514437 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-host-var-lib-kubelet\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.516469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514484 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c3521be-b742-4374-b077-4ed94d0f8162-cnibin\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:26.516469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514512 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-etc-openvswitch\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.516469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514540 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-run-ovn\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.516469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514566 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-run\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:26.516469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514596 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzlgr\" (UniqueName: \"kubernetes.io/projected/3584bddc-510d-4e13-adc2-3a52c12df88b-kube-api-access-nzlgr\") pod \"iptables-alerter-r8hld\" (UID: \"3584bddc-510d-4e13-adc2-3a52c12df88b\") " pod="openshift-network-operator/iptables-alerter-r8hld" Sep 10 16:03:26.516469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514610 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/453a4988-a513-4136-b24a-27acca168047-cni-binary-copy\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.516469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3584bddc-510d-4e13-adc2-3a52c12df88b-host-slash\") pod \"iptables-alerter-r8hld\" (UID: \"3584bddc-510d-4e13-adc2-3a52c12df88b\") " pod="openshift-network-operator/iptables-alerter-r8hld" Sep 10 16:03:26.516469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514632 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fa87306a-d01f-4e6b-b860-65cd291d87c2-socket-dir\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.516469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c3521be-b742-4374-b077-4ed94d0f8162-system-cni-dir\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:26.516469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514691 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eddbd0df-ed01-4c8e-97c2-4600b940a4f4-konnectivity-ca\") pod \"konnectivity-agent-6qtzm\" (UID: \"eddbd0df-ed01-4c8e-97c2-4600b940a4f4\") " pod="kube-system/konnectivity-agent-6qtzm" Sep 10 16:03:26.516469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514695 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eddbd0df-ed01-4c8e-97c2-4600b940a4f4-agent-certs\") pod \"konnectivity-agent-6qtzm\" (UID: \"eddbd0df-ed01-4c8e-97c2-4600b940a4f4\") " pod="kube-system/konnectivity-agent-6qtzm" Sep 10 16:03:26.516469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514754 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f0d2a2d-ee8b-4b92-996b-7681ceb92064-host\") pod \"node-ca-8qvcj\" (UID: \"7f0d2a2d-ee8b-4b92-996b-7681ceb92064\") " pod="openshift-image-registry/node-ca-8qvcj" Sep 10 16:03:26.517141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514789 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-multus-cni-dir\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.517141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514790 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-run-netns\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.517141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-modprobe-d\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:26.517141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514863 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f0d2a2d-ee8b-4b92-996b-7681ceb92064-host\") pod \"node-ca-8qvcj\" (UID: \"7f0d2a2d-ee8b-4b92-996b-7681ceb92064\") " pod="openshift-image-registry/node-ca-8qvcj" Sep 10 16:03:26.517141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514869 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-sys\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:26.517141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514905 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-tuned\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:26.517141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514942 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d0b33001-5d69-4d19-8b5a-4eec74939854-hosts-file\") pod \"node-resolver-jg5j2\" (UID: \"d0b33001-5d69-4d19-8b5a-4eec74939854\") " pod="openshift-dns/node-resolver-jg5j2" Sep 10 16:03:26.517141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514973 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fa87306a-d01f-4e6b-b860-65cd291d87c2-registration-dir\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.517141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.514999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-host-var-lib-cni-bin\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.517141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.515027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f0d2a2d-ee8b-4b92-996b-7681ceb92064-serviceca\") pod \"node-ca-8qvcj\" (UID: \"7f0d2a2d-ee8b-4b92-996b-7681ceb92064\") " pod="openshift-image-registry/node-ca-8qvcj" Sep 10 16:03:26.517141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.515046 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fa87306a-d01f-4e6b-b860-65cd291d87c2-registration-dir\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.517141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.515052 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e259ee0-6025-45f0-8a9e-a777f702b9ae-env-overrides\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.517141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.515075 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-sysctl-conf\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:26.517141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.515072 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 16:03:26.517141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.515104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fa87306a-d01f-4e6b-b860-65cd291d87c2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.517141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.515117 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/453a4988-a513-4136-b24a-27acca168047-multus-daemon-config\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.517141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.515161 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fa87306a-d01f-4e6b-b860-65cd291d87c2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.517947 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.515160 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e259ee0-6025-45f0-8a9e-a777f702b9ae-ovnkube-config\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:26.517947 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.515096 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/453a4988-a513-4136-b24a-27acca168047-host-var-lib-cni-bin\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.517947 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.515199 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-sysconfig\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:26.517947 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.515226 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqm4b\" (UniqueName: \"kubernetes.io/projected/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-kube-api-access-pqm4b\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:26.517947 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.515473 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f0d2a2d-ee8b-4b92-996b-7681ceb92064-serviceca\") pod \"node-ca-8qvcj\" (UID: \"7f0d2a2d-ee8b-4b92-996b-7681ceb92064\") " pod="openshift-image-registry/node-ca-8qvcj" Sep 10 16:03:26.521673 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.521617 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eddbd0df-ed01-4c8e-97c2-4600b940a4f4-agent-certs\") pod \"konnectivity-agent-6qtzm\" (UID: \"eddbd0df-ed01-4c8e-97c2-4600b940a4f4\") " pod="kube-system/konnectivity-agent-6qtzm" Sep 10 16:03:26.522217 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.522174 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rgjj\" (UniqueName: \"kubernetes.io/projected/453a4988-a513-4136-b24a-27acca168047-kube-api-access-2rgjj\") pod \"multus-9dwmj\" (UID: \"453a4988-a513-4136-b24a-27acca168047\") " pod="openshift-multus/multus-9dwmj" Sep 10 16:03:26.522217 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.522179 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nr62\" (UniqueName: \"kubernetes.io/projected/7f0d2a2d-ee8b-4b92-996b-7681ceb92064-kube-api-access-5nr62\") pod \"node-ca-8qvcj\" (UID: \"7f0d2a2d-ee8b-4b92-996b-7681ceb92064\") " pod="openshift-image-registry/node-ca-8qvcj" Sep 10 16:03:26.523873 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.523847 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g946\" (UniqueName: \"kubernetes.io/projected/fa87306a-d01f-4e6b-b860-65cd291d87c2-kube-api-access-4g946\") pod \"aws-ebs-csi-driver-node-gkhzg\" (UID: \"fa87306a-d01f-4e6b-b860-65cd291d87c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:26.524286 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.524266 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlb4t\" (UniqueName: \"kubernetes.io/projected/226aa2a7-ea44-4496-ab2d-1dae7592f64f-kube-api-access-xlb4t\") pod \"network-metrics-daemon-mdf7t\" (UID: \"226aa2a7-ea44-4496-ab2d-1dae7592f64f\") " pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:26.532089 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.532037 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal" event={"ID":"23084555b3dc75f8c230ccb6a14d1674","Type":"ContainerStarted","Data":"3454fbd3faae02ed75c724a110dfb4b0966cd57a4a468f6935c059f1ad0c8600"} Sep 10 16:03:26.534229 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.534198 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-144.ec2.internal" event={"ID":"2f6747baa96a83f589d64dbeaabcff6e","Type":"ContainerStarted","Data":"677b243a34fe52654c09bfa4fe11c0173a3f298faf25bef4d0bd54d5aa57da70"} Sep 10 16:03:26.563136 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:26.562967 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 16:03:27.869237 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e259ee0-6025-45f0-8a9e-a777f702b9ae-ovnkube-script-lib\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.869419 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869243 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-systemd\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.869419 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869273 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c3521be-b742-4374-b077-4ed94d0f8162-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:27.869419 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869302 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-log-socket\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.869419 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869326 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e259ee0-6025-45f0-8a9e-a777f702b9ae-ovn-node-metrics-cert\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.869419 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869349 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-lib-modules\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.869419 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869373 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8ccdc02-c0de-4b91-847e-ff741ec86efb-dbus\") pod \"global-pull-secret-syncer-7bc6j\" (UID: \"e8ccdc02-c0de-4b91-847e-ff741ec86efb\") " pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:27.869419 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-run-systemd\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.869419 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869421 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kssp\" (UniqueName: \"kubernetes.io/projected/2e259ee0-6025-45f0-8a9e-a777f702b9ae-kube-api-access-4kssp\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.869878 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869446 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-tmp\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.869878 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869470 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dnhj\" (UniqueName: \"kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj\") pod \"network-check-target-ljtzt\" (UID: \"2e535dce-4a4c-4acc-84a3-edaba69c6a9e\") " pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:27.869878 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869494 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c3521be-b742-4374-b077-4ed94d0f8162-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:27.869878 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869519 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bcc8\" (UniqueName: \"kubernetes.io/projected/5c3521be-b742-4374-b077-4ed94d0f8162-kube-api-access-9bcc8\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:27.869878 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869546 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-node-log\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.869878 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869569 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-cni-netd\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.869878 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869592 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3584bddc-510d-4e13-adc2-3a52c12df88b-iptables-alerter-script\") pod \"iptables-alerter-r8hld\" (UID: \"3584bddc-510d-4e13-adc2-3a52c12df88b\") " pod="openshift-network-operator/iptables-alerter-r8hld" Sep 10 16:03:27.869878 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869617 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c3521be-b742-4374-b077-4ed94d0f8162-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:27.869878 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869644 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0b33001-5d69-4d19-8b5a-4eec74939854-tmp-dir\") pod \"node-resolver-jg5j2\" (UID: \"d0b33001-5d69-4d19-8b5a-4eec74939854\") " pod="openshift-dns/node-resolver-jg5j2" Sep 10 16:03:27.869878 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869666 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8ccdc02-c0de-4b91-847e-ff741ec86efb-kubelet-config\") pod \"global-pull-secret-syncer-7bc6j\" (UID: \"e8ccdc02-c0de-4b91-847e-ff741ec86efb\") " pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:27.869878 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869689 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c3521be-b742-4374-b077-4ed94d0f8162-cni-binary-copy\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:27.869878 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869726 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-systemd-units\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.869878 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869749 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-kubernetes\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.869878 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-sysctl-d\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.869878 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-host\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.869878 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869819 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-kubelet\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.869878 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869841 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-cni-bin\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.870707 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869867 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.870707 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869892 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrptv\" (UniqueName: \"kubernetes.io/projected/d0b33001-5d69-4d19-8b5a-4eec74939854-kube-api-access-zrptv\") pod \"node-resolver-jg5j2\" (UID: \"d0b33001-5d69-4d19-8b5a-4eec74939854\") " pod="openshift-dns/node-resolver-jg5j2" Sep 10 16:03:27.870707 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869915 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret\") pod \"global-pull-secret-syncer-7bc6j\" (UID: \"e8ccdc02-c0de-4b91-847e-ff741ec86efb\") " pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:27.870707 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869940 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c3521be-b742-4374-b077-4ed94d0f8162-cnibin\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:27.870707 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.869963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-etc-openvswitch\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.870707 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870002 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-run-ovn\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.870707 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870034 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-run\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.870707 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870062 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzlgr\" (UniqueName: \"kubernetes.io/projected/3584bddc-510d-4e13-adc2-3a52c12df88b-kube-api-access-nzlgr\") pod \"iptables-alerter-r8hld\" (UID: \"3584bddc-510d-4e13-adc2-3a52c12df88b\") " pod="openshift-network-operator/iptables-alerter-r8hld" Sep 10 16:03:27.870707 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3584bddc-510d-4e13-adc2-3a52c12df88b-host-slash\") pod \"iptables-alerter-r8hld\" (UID: \"3584bddc-510d-4e13-adc2-3a52c12df88b\") " pod="openshift-network-operator/iptables-alerter-r8hld" Sep 10 16:03:27.870707 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870122 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c3521be-b742-4374-b077-4ed94d0f8162-system-cni-dir\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:27.870707 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-run-netns\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.870707 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870172 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-modprobe-d\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.870707 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-sys\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.870707 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870215 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-tuned\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.870707 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870241 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d0b33001-5d69-4d19-8b5a-4eec74939854-hosts-file\") pod \"node-resolver-jg5j2\" (UID: \"d0b33001-5d69-4d19-8b5a-4eec74939854\") " pod="openshift-dns/node-resolver-jg5j2" Sep 10 16:03:27.870707 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870270 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e259ee0-6025-45f0-8a9e-a777f702b9ae-env-overrides\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.870707 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870293 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-sysctl-conf\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.871587 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870321 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e259ee0-6025-45f0-8a9e-a777f702b9ae-ovnkube-config\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.871587 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870350 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-sysconfig\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.871587 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870373 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqm4b\" (UniqueName: \"kubernetes.io/projected/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-kube-api-access-pqm4b\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.871587 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870410 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-var-lib-openvswitch\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.871587 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870434 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-var-lib-kubelet\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.871587 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870462 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-slash\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.871587 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870486 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-run-openvswitch\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.871587 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870517 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.871587 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870612 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.871587 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.870954 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-cni-bin\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.871587 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.871048 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-node-log\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.871587 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.871049 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.871587 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.871072 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-sys\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.871587 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.871110 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-cni-netd\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.871587 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.871256 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-systemd\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.871587 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.871348 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-systemd-units\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.871587 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.871411 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c3521be-b742-4374-b077-4ed94d0f8162-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:27.871587 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:27.871442 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:27.872453 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.871466 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-log-socket\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.872453 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:27.871513 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret podName:e8ccdc02-c0de-4b91-847e-ff741ec86efb nodeName:}" failed. No retries permitted until 2026-09-10 16:03:28.371492112 +0000 UTC m=+3.085760085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret") pod "global-pull-secret-syncer-7bc6j" (UID: "e8ccdc02-c0de-4b91-847e-ff741ec86efb") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:27.872453 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.871625 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3584bddc-510d-4e13-adc2-3a52c12df88b-iptables-alerter-script\") pod \"iptables-alerter-r8hld\" (UID: \"3584bddc-510d-4e13-adc2-3a52c12df88b\") " pod="openshift-network-operator/iptables-alerter-r8hld" Sep 10 16:03:27.872453 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.871720 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c3521be-b742-4374-b077-4ed94d0f8162-cnibin\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:27.872453 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.871726 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-kubernetes\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.872453 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.871781 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-etc-openvswitch\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.872453 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.871825 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-run-ovn\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.872453 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.871853 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-sysctl-d\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.872453 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.871865 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c3521be-b742-4374-b077-4ed94d0f8162-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:27.872453 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.871881 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-run\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.872453 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.871907 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-host\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.872453 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.871930 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8ccdc02-c0de-4b91-847e-ff741ec86efb-kubelet-config\") pod \"global-pull-secret-syncer-7bc6j\" (UID: \"e8ccdc02-c0de-4b91-847e-ff741ec86efb\") " pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:27.872453 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.871955 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-kubelet\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.872453 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.872017 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-run-netns\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.872453 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.872057 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3584bddc-510d-4e13-adc2-3a52c12df88b-host-slash\") pod \"iptables-alerter-r8hld\" (UID: \"3584bddc-510d-4e13-adc2-3a52c12df88b\") " pod="openshift-network-operator/iptables-alerter-r8hld" Sep 10 16:03:27.872453 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.872124 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c3521be-b742-4374-b077-4ed94d0f8162-system-cni-dir\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:27.872453 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.872156 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-sysconfig\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.873261 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.872182 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0b33001-5d69-4d19-8b5a-4eec74939854-tmp-dir\") pod \"node-resolver-jg5j2\" (UID: \"d0b33001-5d69-4d19-8b5a-4eec74939854\") " pod="openshift-dns/node-resolver-jg5j2" Sep 10 16:03:27.873261 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.872212 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d0b33001-5d69-4d19-8b5a-4eec74939854-hosts-file\") pod \"node-resolver-jg5j2\" (UID: \"d0b33001-5d69-4d19-8b5a-4eec74939854\") " pod="openshift-dns/node-resolver-jg5j2" Sep 10 16:03:27.873261 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.872214 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-modprobe-d\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.873261 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.872328 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-sysctl-conf\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.873261 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.872629 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c3521be-b742-4374-b077-4ed94d0f8162-cni-binary-copy\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:27.873261 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.872711 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8ccdc02-c0de-4b91-847e-ff741ec86efb-dbus\") pod \"global-pull-secret-syncer-7bc6j\" (UID: \"e8ccdc02-c0de-4b91-847e-ff741ec86efb\") " pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:27.873261 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.872728 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-run-systemd\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.873261 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.872776 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-var-lib-openvswitch\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.873261 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.872797 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-var-lib-kubelet\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.873261 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.872829 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-run-openvswitch\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.873261 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.872846 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-lib-modules\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.873261 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.872887 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e259ee0-6025-45f0-8a9e-a777f702b9ae-host-slash\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.873820 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.873428 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e259ee0-6025-45f0-8a9e-a777f702b9ae-ovnkube-script-lib\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.873820 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.873511 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c3521be-b742-4374-b077-4ed94d0f8162-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:27.873820 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.873723 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e259ee0-6025-45f0-8a9e-a777f702b9ae-env-overrides\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.873820 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.873758 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e259ee0-6025-45f0-8a9e-a777f702b9ae-ovnkube-config\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.874823 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.874778 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e259ee0-6025-45f0-8a9e-a777f702b9ae-ovn-node-metrics-cert\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.875158 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.875139 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-etc-tuned\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.876193 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.876149 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-tmp\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.879750 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:27.879728 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:03:27.879850 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:27.879755 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:03:27.879850 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:27.879769 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5dnhj for pod openshift-network-diagnostics/network-check-target-ljtzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:27.879956 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:27.879860 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj podName:2e535dce-4a4c-4acc-84a3-edaba69c6a9e nodeName:}" failed. No retries permitted until 2026-09-10 16:03:28.379842687 +0000 UTC m=+3.094110683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5dnhj" (UniqueName: "kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj") pod "network-check-target-ljtzt" (UID: "2e535dce-4a4c-4acc-84a3-edaba69c6a9e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:27.882257 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.882209 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bcc8\" (UniqueName: \"kubernetes.io/projected/5c3521be-b742-4374-b077-4ed94d0f8162-kube-api-access-9bcc8\") pod \"multus-additional-cni-plugins-9mqzq\" (UID: \"5c3521be-b742-4374-b077-4ed94d0f8162\") " pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:27.882526 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.882469 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzlgr\" (UniqueName: \"kubernetes.io/projected/3584bddc-510d-4e13-adc2-3a52c12df88b-kube-api-access-nzlgr\") pod \"iptables-alerter-r8hld\" (UID: \"3584bddc-510d-4e13-adc2-3a52c12df88b\") " pod="openshift-network-operator/iptables-alerter-r8hld" Sep 10 16:03:27.883036 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.883017 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrptv\" (UniqueName: \"kubernetes.io/projected/d0b33001-5d69-4d19-8b5a-4eec74939854-kube-api-access-zrptv\") pod \"node-resolver-jg5j2\" (UID: \"d0b33001-5d69-4d19-8b5a-4eec74939854\") " pod="openshift-dns/node-resolver-jg5j2" Sep 10 16:03:27.883565 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.883540 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kssp\" (UniqueName: \"kubernetes.io/projected/2e259ee0-6025-45f0-8a9e-a777f702b9ae-kube-api-access-4kssp\") pod \"ovnkube-node-ktbmj\" (UID: \"2e259ee0-6025-45f0-8a9e-a777f702b9ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:27.883700 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.883675 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqm4b\" (UniqueName: \"kubernetes.io/projected/b1f7d8e6-a8fb-417d-992c-fbbdac868d30-kube-api-access-pqm4b\") pod \"tuned-62ksm\" (UID: \"b1f7d8e6-a8fb-417d-992c-fbbdac868d30\") " pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:27.962928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.962801 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" Sep 10 16:03:27.971226 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.971086 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9dwmj" Sep 10 16:03:27.982234 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.982207 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6qtzm" Sep 10 16:03:27.988466 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.988440 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8qvcj" Sep 10 16:03:27.997367 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:27.997343 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:28.006330 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:28.006299 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r8hld" Sep 10 16:03:28.013317 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:28.013293 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jg5j2" Sep 10 16:03:28.020122 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:28.020094 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-62ksm" Sep 10 16:03:28.026917 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:28.026896 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9mqzq" Sep 10 16:03:28.273549 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:28.273443 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs\") pod \"network-metrics-daemon-mdf7t\" (UID: \"226aa2a7-ea44-4496-ab2d-1dae7592f64f\") " pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:28.273721 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:28.273581 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:28.273721 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:28.273652 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs podName:226aa2a7-ea44-4496-ab2d-1dae7592f64f nodeName:}" failed. No retries permitted until 2026-09-10 16:03:29.27363338 +0000 UTC m=+3.987901376 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs") pod "network-metrics-daemon-mdf7t" (UID: "226aa2a7-ea44-4496-ab2d-1dae7592f64f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:28.374306 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:28.374269 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret\") pod \"global-pull-secret-syncer-7bc6j\" (UID: \"e8ccdc02-c0de-4b91-847e-ff741ec86efb\") " pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:28.374503 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:28.374405 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:28.374503 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:28.374477 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret podName:e8ccdc02-c0de-4b91-847e-ff741ec86efb nodeName:}" failed. No retries permitted until 2026-09-10 16:03:29.374457558 +0000 UTC m=+4.088725542 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret") pod "global-pull-secret-syncer-7bc6j" (UID: "e8ccdc02-c0de-4b91-847e-ff741ec86efb") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:28.474835 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:28.474796 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dnhj\" (UniqueName: \"kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj\") pod \"network-check-target-ljtzt\" (UID: \"2e535dce-4a4c-4acc-84a3-edaba69c6a9e\") " pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:28.475033 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:28.475004 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:03:28.475033 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:28.475032 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:03:28.475155 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:28.475047 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5dnhj for pod openshift-network-diagnostics/network-check-target-ljtzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:28.475155 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:28.475115 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj podName:2e535dce-4a4c-4acc-84a3-edaba69c6a9e nodeName:}" failed. No retries permitted until 2026-09-10 16:03:29.475096746 +0000 UTC m=+4.189364723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5dnhj" (UniqueName: "kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj") pod "network-check-target-ljtzt" (UID: "2e535dce-4a4c-4acc-84a3-edaba69c6a9e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:28.703958 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:28.703881 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 15:58:27 +0000 UTC" deadline="2028-02-07 16:56:11.266540662 +0000 UTC" Sep 10 16:03:28.703958 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:28.703916 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12360h52m42.562628604s" Sep 10 16:03:28.778801 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:28.778762 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:28.778965 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:28.778906 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:03:28.991559 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:28.991535 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod453a4988_a513_4136_b24a_27acca168047.slice/crio-c3c37734d89b3f8c64ca1d5f9182b5f61340124ce2b6ded0cffb7430a5cb0ebb WatchSource:0}: Error finding container c3c37734d89b3f8c64ca1d5f9182b5f61340124ce2b6ded0cffb7430a5cb0ebb: Status 404 returned error can't find the container with id c3c37734d89b3f8c64ca1d5f9182b5f61340124ce2b6ded0cffb7430a5cb0ebb Sep 10 16:03:28.993197 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:28.993158 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1f7d8e6_a8fb_417d_992c_fbbdac868d30.slice/crio-ea675f51a1367ceb1c1eec7990845b91a5381bda81b3bac5e2c90cbfc4d67e5c WatchSource:0}: Error finding container ea675f51a1367ceb1c1eec7990845b91a5381bda81b3bac5e2c90cbfc4d67e5c: Status 404 returned error can't find the container with id ea675f51a1367ceb1c1eec7990845b91a5381bda81b3bac5e2c90cbfc4d67e5c Sep 10 16:03:28.995429 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:28.995377 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c3521be_b742_4374_b077_4ed94d0f8162.slice/crio-7ec54d67a1f668c5aa3d10549022e35756a67ad6e037ced03b97da028a53f32b WatchSource:0}: Error finding container 7ec54d67a1f668c5aa3d10549022e35756a67ad6e037ced03b97da028a53f32b: Status 404 returned error can't find the container with id 7ec54d67a1f668c5aa3d10549022e35756a67ad6e037ced03b97da028a53f32b Sep 10 16:03:28.996521 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:28.996499 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3584bddc_510d_4e13_adc2_3a52c12df88b.slice/crio-7436cd12ffc91a0586ab4c6cdb86335fb3bbdbbbb7bcd43599b36e9bd4871927 WatchSource:0}: Error finding container 7436cd12ffc91a0586ab4c6cdb86335fb3bbdbbbb7bcd43599b36e9bd4871927: Status 404 returned error can't find the container with id 7436cd12ffc91a0586ab4c6cdb86335fb3bbdbbbb7bcd43599b36e9bd4871927 Sep 10 16:03:28.997710 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:28.997678 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa87306a_d01f_4e6b_b860_65cd291d87c2.slice/crio-f04bb1dcfbe7bd7b96fd29b12b1f093f696ace48227e18df33c092692047f1b4 WatchSource:0}: Error finding container f04bb1dcfbe7bd7b96fd29b12b1f093f696ace48227e18df33c092692047f1b4: Status 404 returned error can't find the container with id f04bb1dcfbe7bd7b96fd29b12b1f093f696ace48227e18df33c092692047f1b4 Sep 10 16:03:28.998731 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:03:28.998709 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f0d2a2d_ee8b_4b92_996b_7681ceb92064.slice/crio-d97dda1a58e076d2199f8c71fb9a3cf1bbe34cceaf8f470ca35f07d5eb835fab WatchSource:0}: Error finding container d97dda1a58e076d2199f8c71fb9a3cf1bbe34cceaf8f470ca35f07d5eb835fab: Status 404 returned error can't find the container with id d97dda1a58e076d2199f8c71fb9a3cf1bbe34cceaf8f470ca35f07d5eb835fab Sep 10 16:03:29.284218 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:29.282304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs\") pod \"network-metrics-daemon-mdf7t\" (UID: \"226aa2a7-ea44-4496-ab2d-1dae7592f64f\") " pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:29.284218 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:29.282531 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:29.284218 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:29.282674 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs podName:226aa2a7-ea44-4496-ab2d-1dae7592f64f nodeName:}" failed. No retries permitted until 2026-09-10 16:03:31.282645633 +0000 UTC m=+5.996913605 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs") pod "network-metrics-daemon-mdf7t" (UID: "226aa2a7-ea44-4496-ab2d-1dae7592f64f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:29.383538 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:29.383504 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret\") pod \"global-pull-secret-syncer-7bc6j\" (UID: \"e8ccdc02-c0de-4b91-847e-ff741ec86efb\") " pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:29.383704 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:29.383656 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:29.383776 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:29.383764 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret podName:e8ccdc02-c0de-4b91-847e-ff741ec86efb nodeName:}" failed. No retries permitted until 2026-09-10 16:03:31.383748998 +0000 UTC m=+6.098016976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret") pod "global-pull-secret-syncer-7bc6j" (UID: "e8ccdc02-c0de-4b91-847e-ff741ec86efb") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:29.484804 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:29.484714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dnhj\" (UniqueName: \"kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj\") pod \"network-check-target-ljtzt\" (UID: \"2e535dce-4a4c-4acc-84a3-edaba69c6a9e\") " pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:29.484962 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:29.484915 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:03:29.484962 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:29.484952 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:03:29.485084 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:29.484966 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5dnhj for pod openshift-network-diagnostics/network-check-target-ljtzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:29.485084 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:29.485055 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj podName:2e535dce-4a4c-4acc-84a3-edaba69c6a9e nodeName:}" failed. No retries permitted until 2026-09-10 16:03:31.485037309 +0000 UTC m=+6.199305300 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5dnhj" (UniqueName: "kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj") pod "network-check-target-ljtzt" (UID: "2e535dce-4a4c-4acc-84a3-edaba69c6a9e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:29.705183 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:29.705114 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 15:58:27 +0000 UTC" deadline="2028-03-23 07:23:23.779191407 +0000 UTC" Sep 10 16:03:29.705183 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:29.705179 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13431h19m54.074015703s" Sep 10 16:03:29.787512 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:29.787272 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:29.787655 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:29.787627 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:03:29.787731 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:29.787694 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:29.787851 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:29.787827 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:03:29.796801 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:29.796768 2578 generic.go:356] "Generic (PLEG): container finished" podID="23084555b3dc75f8c230ccb6a14d1674" containerID="383d8d25d026b0087239f1449430f27c35e80db041f9533d8a1d704a66c856e5" exitCode=0 Sep 10 16:03:29.796944 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:29.796851 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal" event={"ID":"23084555b3dc75f8c230ccb6a14d1674","Type":"ContainerDied","Data":"383d8d25d026b0087239f1449430f27c35e80db041f9533d8a1d704a66c856e5"} Sep 10 16:03:29.806134 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:29.805670 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-144.ec2.internal" event={"ID":"2f6747baa96a83f589d64dbeaabcff6e","Type":"ContainerStarted","Data":"aea30f6b2d823dc889588ad69e256acb2d6c365c44d97686dc71f4307a2ea199"} Sep 10 16:03:29.814244 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:29.814209 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" event={"ID":"2e259ee0-6025-45f0-8a9e-a777f702b9ae","Type":"ContainerStarted","Data":"ca66f4d24bdb2560ff7df96ad959f6bac39967234f598a7abe1af503087bf4d5"} Sep 10 16:03:29.821397 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:29.821336 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r8hld" event={"ID":"3584bddc-510d-4e13-adc2-3a52c12df88b","Type":"ContainerStarted","Data":"7436cd12ffc91a0586ab4c6cdb86335fb3bbdbbbb7bcd43599b36e9bd4871927"} Sep 10 16:03:29.824017 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:29.823969 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-62ksm" event={"ID":"b1f7d8e6-a8fb-417d-992c-fbbdac868d30","Type":"ContainerStarted","Data":"ea675f51a1367ceb1c1eec7990845b91a5381bda81b3bac5e2c90cbfc4d67e5c"} Sep 10 16:03:29.831386 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:29.831359 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9dwmj" event={"ID":"453a4988-a513-4136-b24a-27acca168047","Type":"ContainerStarted","Data":"c3c37734d89b3f8c64ca1d5f9182b5f61340124ce2b6ded0cffb7430a5cb0ebb"} Sep 10 16:03:29.843189 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:29.843109 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jg5j2" event={"ID":"d0b33001-5d69-4d19-8b5a-4eec74939854","Type":"ContainerStarted","Data":"7a464f411ae951ffbeccb8927595099beeef1f6505bbd918c82210959d80ac3a"} Sep 10 16:03:29.850680 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:29.850555 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6qtzm" event={"ID":"eddbd0df-ed01-4c8e-97c2-4600b940a4f4","Type":"ContainerStarted","Data":"b0a436dedfd0f95f90677743b3dbb259b3df5f76c67da361238881a2099a3eed"} Sep 10 16:03:29.852322 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:29.852209 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8qvcj" event={"ID":"7f0d2a2d-ee8b-4b92-996b-7681ceb92064","Type":"ContainerStarted","Data":"d97dda1a58e076d2199f8c71fb9a3cf1bbe34cceaf8f470ca35f07d5eb835fab"} Sep 10 16:03:29.854100 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:29.853971 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mqzq" event={"ID":"5c3521be-b742-4374-b077-4ed94d0f8162","Type":"ContainerStarted","Data":"7ec54d67a1f668c5aa3d10549022e35756a67ad6e037ced03b97da028a53f32b"} Sep 10 16:03:29.856275 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:29.856131 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" event={"ID":"fa87306a-d01f-4e6b-b860-65cd291d87c2","Type":"ContainerStarted","Data":"f04bb1dcfbe7bd7b96fd29b12b1f093f696ace48227e18df33c092692047f1b4"} Sep 10 16:03:30.779170 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:30.779087 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:30.779613 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:30.779232 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:03:30.885864 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:30.885827 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal" event={"ID":"23084555b3dc75f8c230ccb6a14d1674","Type":"ContainerStarted","Data":"67c45db1edfc16446b80c9b3e847c46d2b36f75ad5f43f68c9c250d6451e69a9"} Sep 10 16:03:30.903191 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:30.903131 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-144.ec2.internal" podStartSLOduration=4.903108044 podStartE2EDuration="4.903108044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:03:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:29.827420504 +0000 UTC m=+4.541688560" watchObservedRunningTime="2026-09-10 16:03:30.903108044 +0000 UTC m=+5.617376040" Sep 10 16:03:31.299151 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:31.299104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs\") pod \"network-metrics-daemon-mdf7t\" (UID: \"226aa2a7-ea44-4496-ab2d-1dae7592f64f\") " pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:31.299324 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:31.299310 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:31.299392 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:31.299374 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs podName:226aa2a7-ea44-4496-ab2d-1dae7592f64f nodeName:}" failed. No retries permitted until 2026-09-10 16:03:35.299356683 +0000 UTC m=+10.013624662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs") pod "network-metrics-daemon-mdf7t" (UID: "226aa2a7-ea44-4496-ab2d-1dae7592f64f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:31.400406 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:31.400369 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret\") pod \"global-pull-secret-syncer-7bc6j\" (UID: \"e8ccdc02-c0de-4b91-847e-ff741ec86efb\") " pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:31.400592 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:31.400528 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:31.400592 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:31.400592 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret podName:e8ccdc02-c0de-4b91-847e-ff741ec86efb nodeName:}" failed. No retries permitted until 2026-09-10 16:03:35.400574496 +0000 UTC m=+10.114842474 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret") pod "global-pull-secret-syncer-7bc6j" (UID: "e8ccdc02-c0de-4b91-847e-ff741ec86efb") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:31.501706 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:31.501653 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dnhj\" (UniqueName: \"kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj\") pod \"network-check-target-ljtzt\" (UID: \"2e535dce-4a4c-4acc-84a3-edaba69c6a9e\") " pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:31.501871 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:31.501811 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:03:31.501871 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:31.501834 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:03:31.501871 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:31.501847 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5dnhj for pod openshift-network-diagnostics/network-check-target-ljtzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:31.502063 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:31.501905 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj podName:2e535dce-4a4c-4acc-84a3-edaba69c6a9e nodeName:}" failed. No retries permitted until 2026-09-10 16:03:35.501887626 +0000 UTC m=+10.216155615 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5dnhj" (UniqueName: "kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj") pod "network-check-target-ljtzt" (UID: "2e535dce-4a4c-4acc-84a3-edaba69c6a9e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:31.780800 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:31.780248 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:31.780800 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:31.780394 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:03:31.781662 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:31.781461 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:31.781662 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:31.781573 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:03:32.778435 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:32.778401 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:32.778627 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:32.778558 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:03:33.778902 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:33.778865 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:33.779401 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:33.779035 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:03:33.779650 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:33.779515 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:33.779650 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:33.779610 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:03:34.779133 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:34.779098 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:34.779597 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:34.779240 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:03:35.334050 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:35.334010 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs\") pod \"network-metrics-daemon-mdf7t\" (UID: \"226aa2a7-ea44-4496-ab2d-1dae7592f64f\") " pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:35.334241 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:35.334182 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:35.334310 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:35.334244 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs podName:226aa2a7-ea44-4496-ab2d-1dae7592f64f nodeName:}" failed. No retries permitted until 2026-09-10 16:03:43.33422446 +0000 UTC m=+18.048492436 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs") pod "network-metrics-daemon-mdf7t" (UID: "226aa2a7-ea44-4496-ab2d-1dae7592f64f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:35.436137 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:35.435592 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret\") pod \"global-pull-secret-syncer-7bc6j\" (UID: \"e8ccdc02-c0de-4b91-847e-ff741ec86efb\") " pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:35.436137 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:35.435724 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:35.436137 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:35.435799 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret podName:e8ccdc02-c0de-4b91-847e-ff741ec86efb nodeName:}" failed. No retries permitted until 2026-09-10 16:03:43.435780125 +0000 UTC m=+18.150048112 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret") pod "global-pull-secret-syncer-7bc6j" (UID: "e8ccdc02-c0de-4b91-847e-ff741ec86efb") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:35.537012 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:35.536372 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dnhj\" (UniqueName: \"kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj\") pod \"network-check-target-ljtzt\" (UID: \"2e535dce-4a4c-4acc-84a3-edaba69c6a9e\") " pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:35.537012 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:35.536536 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:03:35.537012 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:35.536557 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:03:35.537012 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:35.536570 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5dnhj for pod openshift-network-diagnostics/network-check-target-ljtzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:35.537012 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:35.536636 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj podName:2e535dce-4a4c-4acc-84a3-edaba69c6a9e nodeName:}" failed. No retries permitted until 2026-09-10 16:03:43.536616648 +0000 UTC m=+18.250884636 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5dnhj" (UniqueName: "kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj") pod "network-check-target-ljtzt" (UID: "2e535dce-4a4c-4acc-84a3-edaba69c6a9e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:35.779287 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:35.779116 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:35.779287 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:35.779236 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:03:35.779805 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:35.779353 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:35.779805 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:35.779475 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:03:36.779140 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:36.779087 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:36.779316 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:36.779238 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:03:37.779023 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:37.778969 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:37.779023 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:37.779022 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:37.779270 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:37.779137 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:03:37.779345 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:37.779278 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:03:38.778926 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:38.778889 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:38.779101 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:38.779022 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:03:39.778800 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:39.778763 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:39.779263 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:39.778769 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:39.779263 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:39.778899 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:03:39.779263 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:39.779016 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:03:40.778218 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:40.778181 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:40.778392 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:40.778294 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:03:41.778412 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:41.778378 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:41.778870 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:41.778515 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:03:41.778870 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:41.778566 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:41.778870 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:41.778700 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:03:42.778538 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:42.778503 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:42.778927 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:42.778635 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:03:43.392048 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:43.392007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs\") pod \"network-metrics-daemon-mdf7t\" (UID: \"226aa2a7-ea44-4496-ab2d-1dae7592f64f\") " pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:43.392315 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:43.392148 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:43.392315 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:43.392217 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs podName:226aa2a7-ea44-4496-ab2d-1dae7592f64f nodeName:}" failed. No retries permitted until 2026-09-10 16:03:59.392197219 +0000 UTC m=+34.106465196 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs") pod "network-metrics-daemon-mdf7t" (UID: "226aa2a7-ea44-4496-ab2d-1dae7592f64f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:43.493036 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:43.492999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret\") pod \"global-pull-secret-syncer-7bc6j\" (UID: \"e8ccdc02-c0de-4b91-847e-ff741ec86efb\") " pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:43.493201 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:43.493120 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:43.493201 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:43.493174 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret podName:e8ccdc02-c0de-4b91-847e-ff741ec86efb nodeName:}" failed. No retries permitted until 2026-09-10 16:03:59.493158327 +0000 UTC m=+34.207426306 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret") pod "global-pull-secret-syncer-7bc6j" (UID: "e8ccdc02-c0de-4b91-847e-ff741ec86efb") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:43.594015 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:43.593966 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dnhj\" (UniqueName: \"kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj\") pod \"network-check-target-ljtzt\" (UID: \"2e535dce-4a4c-4acc-84a3-edaba69c6a9e\") " pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:43.594191 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:43.594160 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:03:43.594239 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:43.594197 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:03:43.594239 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:43.594214 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5dnhj for pod openshift-network-diagnostics/network-check-target-ljtzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:43.594318 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:43.594266 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj podName:2e535dce-4a4c-4acc-84a3-edaba69c6a9e nodeName:}" failed. No retries permitted until 2026-09-10 16:03:59.594253656 +0000 UTC m=+34.308521628 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5dnhj" (UniqueName: "kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj") pod "network-check-target-ljtzt" (UID: "2e535dce-4a4c-4acc-84a3-edaba69c6a9e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:43.778814 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:43.778780 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:43.779282 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:43.778780 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:43.779282 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:43.778928 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:03:43.779282 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:43.779015 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:03:44.779014 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:44.778961 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:44.779485 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:44.779100 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:03:45.779240 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:45.779203 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:45.779700 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:45.779344 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:03:45.779700 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:45.779679 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:45.779832 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:45.779792 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:03:46.778370 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:46.778298 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:46.778488 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:46.778441 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:03:46.936124 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:46.936063 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6qtzm" event={"ID":"eddbd0df-ed01-4c8e-97c2-4600b940a4f4","Type":"ContainerStarted","Data":"50ea211a2d9a530bbda91d8a1ad97d202a79d8c5930e1d0fb2705c8e055d5496"} Sep 10 16:03:46.942602 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:46.942539 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mqzq" event={"ID":"5c3521be-b742-4374-b077-4ed94d0f8162","Type":"ContainerStarted","Data":"3fa69cc02aac78528f232e25d809f646736c81f58b92bbc2ed4d1cfc522631b6"} Sep 10 16:03:46.954792 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:46.954748 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-144.ec2.internal" podStartSLOduration=20.954732356 podStartE2EDuration="20.954732356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:03:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:30.904263149 +0000 UTC m=+5.618531145" watchObservedRunningTime="2026-09-10 16:03:46.954732356 +0000 UTC m=+21.669000350" Sep 10 16:03:46.954914 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:46.954874 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6qtzm" podStartSLOduration=8.369181694 podStartE2EDuration="21.954869071s" totalImagesPullingTime="13.585687377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:46.954567549 +0000 UTC m=+21.668835544" watchObservedRunningTime="2026-09-10 16:03:46.954869071 +0000 UTC m=+21.669137066" Sep 10 16:03:47.779323 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:47.778879 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:47.779457 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:47.778942 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:47.779522 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:47.779454 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:03:47.779522 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:47.779500 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:03:47.946429 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:47.946383 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8qvcj" event={"ID":"7f0d2a2d-ee8b-4b92-996b-7681ceb92064","Type":"ContainerStarted","Data":"03fbe92f52f4558bf3aa2159018f3453c5dab1cb1b56470d7f1a5a53565d25d1"} Sep 10 16:03:47.947899 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:47.947877 2578 generic.go:356] "Generic (PLEG): container finished" podID="5c3521be-b742-4374-b077-4ed94d0f8162" containerID="3fa69cc02aac78528f232e25d809f646736c81f58b92bbc2ed4d1cfc522631b6" exitCode=0 Sep 10 16:03:47.947993 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:47.947944 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mqzq" event={"ID":"5c3521be-b742-4374-b077-4ed94d0f8162","Type":"ContainerDied","Data":"3fa69cc02aac78528f232e25d809f646736c81f58b92bbc2ed4d1cfc522631b6"} Sep 10 16:03:47.949479 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:47.949451 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" event={"ID":"fa87306a-d01f-4e6b-b860-65cd291d87c2","Type":"ContainerStarted","Data":"99f9368075c04d336c852eb827eaabac24807601a655140551cc7ebb02190f73"} Sep 10 16:03:47.952455 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:47.952433 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" event={"ID":"2e259ee0-6025-45f0-8a9e-a777f702b9ae","Type":"ContainerStarted","Data":"5ced58ddc6da06c561d61db9c1817538a5013dc8dd01ba30fd80c563150d3b40"} Sep 10 16:03:47.952549 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:47.952496 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" event={"ID":"2e259ee0-6025-45f0-8a9e-a777f702b9ae","Type":"ContainerStarted","Data":"892bd9bdafd0ed8773a9da9dab36019a996e02796f9a036721679a888b9037f5"} Sep 10 16:03:47.952549 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:47.952544 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" event={"ID":"2e259ee0-6025-45f0-8a9e-a777f702b9ae","Type":"ContainerStarted","Data":"16207b86fe0401bd9fdd2eb3088947e852e8e87dfcab25be34aef62f243c0dfc"} Sep 10 16:03:47.952662 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:47.952583 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" event={"ID":"2e259ee0-6025-45f0-8a9e-a777f702b9ae","Type":"ContainerStarted","Data":"8694244b17c2cac9a58f5cbc8a05aff621769d4a6cc196a971f968fa17830053"} Sep 10 16:03:47.952662 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:47.952611 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" event={"ID":"2e259ee0-6025-45f0-8a9e-a777f702b9ae","Type":"ContainerStarted","Data":"f83289395429edef8efd456cc94263923b8580584d5e2000c7cbb6425143cea1"} Sep 10 16:03:47.952662 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:47.952649 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" event={"ID":"2e259ee0-6025-45f0-8a9e-a777f702b9ae","Type":"ContainerStarted","Data":"6dc30e9658501c36ef12c7a4f01b5c1d954516b31421a5c5cf8e68ab7cb26f9c"} Sep 10 16:03:47.953861 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:47.953838 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-62ksm" event={"ID":"b1f7d8e6-a8fb-417d-992c-fbbdac868d30","Type":"ContainerStarted","Data":"b155e042b0b5a210ed14eab551e8c705d5698fa544d51238416e9b6f50f9b1cd"} Sep 10 16:03:47.955434 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:47.955416 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9dwmj" event={"ID":"453a4988-a513-4136-b24a-27acca168047","Type":"ContainerStarted","Data":"bd9ea8f01456ac6088eafdf3a3f29a99953d490ba3ae580bbd4f2d0eef4477b0"} Sep 10 16:03:47.956725 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:47.956705 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jg5j2" event={"ID":"d0b33001-5d69-4d19-8b5a-4eec74939854","Type":"ContainerStarted","Data":"6dd32140ddb4616ac8ca90e46def3bd85a91bcd617f30cded6baa725fbeb9094"} Sep 10 16:03:47.961150 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:47.961113 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8qvcj" podStartSLOduration=5.248616758 podStartE2EDuration="22.961102136s" totalImagesPullingTime="17.712485378s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:47.960689576 +0000 UTC m=+22.674957562" watchObservedRunningTime="2026-09-10 16:03:47.961102136 +0000 UTC m=+22.675370130" Sep 10 16:03:47.976947 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:47.976902 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-62ksm" podStartSLOduration=4.231761022 podStartE2EDuration="21.976889462s" totalImagesPullingTime="17.74512844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:47.97671477 +0000 UTC m=+22.690982758" watchObservedRunningTime="2026-09-10 16:03:47.976889462 +0000 UTC m=+22.691157454" Sep 10 16:03:47.995103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:47.995058 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9dwmj" podStartSLOduration=4.970169815 podStartE2EDuration="22.995043006s" totalImagesPullingTime="18.024873191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:47.994829807 +0000 UTC m=+22.709097803" watchObservedRunningTime="2026-09-10 16:03:47.995043006 +0000 UTC m=+22.709311001" Sep 10 16:03:48.010498 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:48.010455 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jg5j2" podStartSLOduration=4.26598443 podStartE2EDuration="22.010439706s" totalImagesPullingTime="17.744455276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:48.010018533 +0000 UTC m=+22.724286524" watchObservedRunningTime="2026-09-10 16:03:48.010439706 +0000 UTC m=+22.724707702" Sep 10 16:03:48.063968 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:48.063936 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:48.133940 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:48.133897 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:48.232729 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:48.232702 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:48.460500 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:48.460406 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:48.514966 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:48.514904 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:48.779188 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:48.779158 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:48.779443 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:48.779293 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:03:48.960330 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:48.960282 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r8hld" event={"ID":"3584bddc-510d-4e13-adc2-3a52c12df88b","Type":"ContainerStarted","Data":"f3493787225ff6bf69e708951bae3a98e9139c941494a4b3467c6b4b7c1c7e20"} Sep 10 16:03:48.976661 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:48.976610 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r8hld" podStartSLOduration=5.239360418 podStartE2EDuration="22.976595983s" totalImagesPullingTime="17.737235565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:48.976139717 +0000 UTC m=+23.690407713" watchObservedRunningTime="2026-09-10 16:03:48.976595983 +0000 UTC m=+23.690863978" Sep 10 16:03:49.096142 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:49.096108 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:49.195218 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:49.195192 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 16:03:49.196212 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:49.196185 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:49.296303 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:49.296273 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:49.767545 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:49.767363 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T16:03:49.195214042Z","UUID":"1fa31755-2fa7-407a-a444-d7776d9ab76f","Handler":null,"Name":"","Endpoint":""} Sep 10 16:03:49.769309 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:49.769281 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 16:03:49.769442 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:49.769323 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 16:03:49.778434 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:49.778407 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:49.778597 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:49.778563 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:03:49.778706 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:49.778685 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:49.778829 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:49.778798 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:03:49.966614 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:49.966576 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" event={"ID":"2e259ee0-6025-45f0-8a9e-a777f702b9ae","Type":"ContainerStarted","Data":"df850cdf3b82e7f3ca572c7766aabc1efb41b6df596928381fb325a009362c61"} Sep 10 16:03:49.968900 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:49.968870 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" event={"ID":"fa87306a-d01f-4e6b-b860-65cd291d87c2","Type":"ContainerStarted","Data":"58ca5e5ae9669db2695ad2987bd0d01ab9afec1940cec4f8432bca8f4dd99929"} Sep 10 16:03:50.274818 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:50.274780 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6qtzm" Sep 10 16:03:50.275420 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:50.275394 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6qtzm" Sep 10 16:03:50.403700 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:50.403658 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:50.502550 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:50.502517 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:50.713374 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:50.713339 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:50.778722 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:50.778643 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:50.778879 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:50.778772 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:03:50.784340 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:50.784307 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:50.973899 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:50.973858 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" event={"ID":"fa87306a-d01f-4e6b-b860-65cd291d87c2","Type":"ContainerStarted","Data":"0640a7ca2ea3a10180b5cc0e739a3f1658c287ddd0db8dc0c99194e3fd0ead0a"} Sep 10 16:03:50.974401 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:50.974386 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6qtzm" Sep 10 16:03:50.974938 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:50.974920 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6qtzm" Sep 10 16:03:51.003744 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:51.003670 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkhzg" podStartSLOduration=5.162856777 podStartE2EDuration="26.00364742s" totalImagesPullingTime="20.840790643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:03:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:50.994904145 +0000 UTC m=+25.709172140" watchObservedRunningTime="2026-09-10 16:03:51.00364742 +0000 UTC m=+25.717915415" Sep 10 16:03:51.109520 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:51.109439 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:51.214545 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:51.214515 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:51.306254 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:51.306224 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:51.466348 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:51.466250 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:51.778572 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:51.778348 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:51.778777 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:51.778375 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:51.778777 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:51.778683 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:03:51.778777 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:51.778715 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:03:51.984429 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:51.983262 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" event={"ID":"2e259ee0-6025-45f0-8a9e-a777f702b9ae","Type":"ContainerStarted","Data":"e35c10bfc5a5359abfc7fda6a377c5d4a9e0a0e9c8ce11af07b37005664efa08"} Sep 10 16:03:52.017005 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:52.016930 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" podStartSLOduration=8.272987356 podStartE2EDuration="26.016905844s" totalImagesPullingTime="17.743918488s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:52.014352194 +0000 UTC m=+26.728620217" watchObservedRunningTime="2026-09-10 16:03:52.016905844 +0000 UTC m=+26.731173840" Sep 10 16:03:52.778213 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:52.778180 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:52.778400 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:52.778293 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:03:52.806606 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:52.806549 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:52.908269 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:52.908234 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:52.987586 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:52.987552 2578 generic.go:356] "Generic (PLEG): container finished" podID="5c3521be-b742-4374-b077-4ed94d0f8162" containerID="7f74765908e6a8752e15a18c90d26da7f0a1dac88523216c8c5854b03545bfe5" exitCode=0 Sep 10 16:03:52.988264 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:52.987601 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mqzq" event={"ID":"5c3521be-b742-4374-b077-4ed94d0f8162","Type":"ContainerDied","Data":"7f74765908e6a8752e15a18c90d26da7f0a1dac88523216c8c5854b03545bfe5"} Sep 10 16:03:52.988387 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:52.988363 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:52.988525 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:52.988458 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:52.988525 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:52.988513 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:53.003593 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:53.003569 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:53.003726 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:53.003670 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:03:53.590842 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:53.590660 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jg5j2_d0b33001-5d69-4d19-8b5a-4eec74939854/dns-node-resolver/0.log" Sep 10 16:03:53.776841 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:53.776808 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:53.778877 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:53.778858 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:53.778971 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:53.778958 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:03:53.779044 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:53.779009 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:53.779120 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:53.779101 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:03:53.934577 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:53.934437 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mdf7t"] Sep 10 16:03:53.935028 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:53.934973 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ljtzt"] Sep 10 16:03:53.935509 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:53.935487 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7bc6j"] Sep 10 16:03:53.935594 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:53.935583 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:53.935708 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:53.935689 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:03:53.989771 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:53.989745 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:53.990138 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:53.989749 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:53.990138 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:53.989842 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:03:53.990138 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:53.989941 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:03:54.589761 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:54.589739 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8qvcj_7f0d2a2d-ee8b-4b92-996b-7681ceb92064/node-ca/0.log" Sep 10 16:03:54.993658 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:54.993624 2578 generic.go:356] "Generic (PLEG): container finished" podID="5c3521be-b742-4374-b077-4ed94d0f8162" containerID="ce45c4ab83edb91b84813c46308c9bc8edf6303c80c6479d2702f638ede2f02f" exitCode=0 Sep 10 16:03:54.994073 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:54.993702 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mqzq" event={"ID":"5c3521be-b742-4374-b077-4ed94d0f8162","Type":"ContainerDied","Data":"ce45c4ab83edb91b84813c46308c9bc8edf6303c80c6479d2702f638ede2f02f"} Sep 10 16:03:55.780125 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:55.780090 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:55.780305 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:55.780182 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:55.780305 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:55.780213 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:55.780305 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:55.780260 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:03:55.780305 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:55.780285 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:03:55.780478 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:55.780382 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:03:56.887492 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:56.887459 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:57.000570 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:57.000538 2578 generic.go:356] "Generic (PLEG): container finished" podID="5c3521be-b742-4374-b077-4ed94d0f8162" containerID="839f9a1178cd0abe974abfd20064f969d3bde5523115fcca7ed010efb35fdb8c" exitCode=0 Sep 10 16:03:57.000728 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:57.000584 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mqzq" event={"ID":"5c3521be-b742-4374-b077-4ed94d0f8162","Type":"ContainerDied","Data":"839f9a1178cd0abe974abfd20064f969d3bde5523115fcca7ed010efb35fdb8c"} Sep 10 16:03:57.016312 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:57.016283 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:57.113310 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:57.113278 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:57.390932 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:57.390893 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:57.499709 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:57.499672 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:57.629143 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:57.629042 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:57.778993 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:57.778961 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:57.779178 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:57.778961 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:57.779178 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:57.779089 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:03:57.779261 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:57.778961 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:57.779300 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:57.779194 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:03:57.779334 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:57.779300 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:03:57.968874 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:57.968791 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:58.313563 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:58.313518 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:58.954379 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:58.954338 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:59.116960 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:59.116913 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:59.305181 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:59.305145 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:59.412475 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:59.412436 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs\") pod \"network-metrics-daemon-mdf7t\" (UID: \"226aa2a7-ea44-4496-ab2d-1dae7592f64f\") " pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:59.412639 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:59.412589 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:59.412686 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:59.412652 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs podName:226aa2a7-ea44-4496-ab2d-1dae7592f64f nodeName:}" failed. No retries permitted until 2026-09-10 16:04:31.412635572 +0000 UTC m=+66.126903546 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs") pod "network-metrics-daemon-mdf7t" (UID: "226aa2a7-ea44-4496-ab2d-1dae7592f64f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:59.503366 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:59.503333 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:59.513389 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:59.513356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret\") pod \"global-pull-secret-syncer-7bc6j\" (UID: \"e8ccdc02-c0de-4b91-847e-ff741ec86efb\") " pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:59.513546 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:59.513484 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:59.513590 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:59.513559 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret podName:e8ccdc02-c0de-4b91-847e-ff741ec86efb nodeName:}" failed. No retries permitted until 2026-09-10 16:04:31.513541765 +0000 UTC m=+66.227809760 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret") pod "global-pull-secret-syncer-7bc6j" (UID: "e8ccdc02-c0de-4b91-847e-ff741ec86efb") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:59.604848 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:59.604743 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:59.613717 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:59.613681 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dnhj\" (UniqueName: \"kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj\") pod \"network-check-target-ljtzt\" (UID: \"2e535dce-4a4c-4acc-84a3-edaba69c6a9e\") " pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:59.613859 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:59.613843 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:03:59.613923 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:59.613874 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:03:59.613923 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:59.613888 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5dnhj for pod openshift-network-diagnostics/network-check-target-ljtzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:59.614037 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:59.613953 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj podName:2e535dce-4a4c-4acc-84a3-edaba69c6a9e nodeName:}" failed. No retries permitted until 2026-09-10 16:04:31.613934207 +0000 UTC m=+66.328202186 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5dnhj" (UniqueName: "kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj") pod "network-check-target-ljtzt" (UID: "2e535dce-4a4c-4acc-84a3-edaba69c6a9e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:59.778674 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:59.778587 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:03:59.778674 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:59.778587 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:03:59.778936 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:03:59.778732 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:03:59.778936 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:59.778722 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:03:59.778936 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:59.778879 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:03:59.779133 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:03:59.779037 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:04:00.891692 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:00.891640 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:00.976531 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:00.976488 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:01.119864 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:01.119833 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:01.194598 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:01.194481 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:01.364166 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:01.364122 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:01.521917 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:01.521880 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:01.577505 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:01.577476 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:01.778826 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:01.778749 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:04:01.778973 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:01.778750 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:04:01.778973 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:01.778847 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:04:01.778973 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:01.778754 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:04:01.779120 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:01.778915 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:04:01.779120 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:01.779041 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:04:02.015471 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:02.015425 2578 generic.go:356] "Generic (PLEG): container finished" podID="5c3521be-b742-4374-b077-4ed94d0f8162" containerID="f14691cfc826b9fe6c3af7e15cca0adf754c626de77ec62b1cfcdc42980a098f" exitCode=0 Sep 10 16:04:02.015932 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:02.015482 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mqzq" event={"ID":"5c3521be-b742-4374-b077-4ed94d0f8162","Type":"ContainerDied","Data":"f14691cfc826b9fe6c3af7e15cca0adf754c626de77ec62b1cfcdc42980a098f"} Sep 10 16:04:02.710807 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:02.710768 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:02.910814 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:02.910776 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:03.021662 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:03.021621 2578 generic.go:356] "Generic (PLEG): container finished" podID="5c3521be-b742-4374-b077-4ed94d0f8162" containerID="d173b5ee16c229ad4ec72222a4726623c75b1836bf864c9b12f58836350aa539" exitCode=0 Sep 10 16:04:03.022147 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:03.021668 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mqzq" event={"ID":"5c3521be-b742-4374-b077-4ed94d0f8162","Type":"ContainerDied","Data":"d173b5ee16c229ad4ec72222a4726623c75b1836bf864c9b12f58836350aa539"} Sep 10 16:04:03.108557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:03.108520 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:03.301372 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:03.301282 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:03.540232 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:03.540196 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:03.781632 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:03.781605 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:04:03.781825 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:03.781702 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:04:03.781825 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:03.781711 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:04:03.781825 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:03.781736 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:04:03.782013 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:03.781886 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:04:03.782013 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:03.781977 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:04:03.801791 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:03.801742 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:04.030456 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:04.030423 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mqzq" event={"ID":"5c3521be-b742-4374-b077-4ed94d0f8162","Type":"ContainerStarted","Data":"c1f728a4e255c36ec58384910aa72ef2f44e744e7a2a9c253d3ab7381087ef7d"} Sep 10 16:04:04.054400 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:04.054347 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9mqzq" podStartSLOduration=9.408284759 podStartE2EDuration="38.05433152s" totalImagesPullingTime="28.646046761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:03:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:04.054091889 +0000 UTC m=+38.768359885" watchObservedRunningTime="2026-09-10 16:04:04.05433152 +0000 UTC m=+38.768599515" Sep 10 16:04:04.104001 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:04.103955 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:04.504420 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:04.504392 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:04.903349 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:04.903272 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:05.106268 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:05.106237 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:05.203962 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:05.203885 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:05.304177 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:05.304140 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:05.405416 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:05.405387 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:05.511105 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:05.511071 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:05.779574 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:05.779496 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:04:05.779718 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:05.779603 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:04:05.779718 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:05.779670 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:04:05.779792 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:05.779753 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:04:05.779830 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:05.779780 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:04:05.779830 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:05.779809 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:04:06.531829 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:06.531791 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:06.911497 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:06.911419 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:07.109108 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:07.109076 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:07.315382 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:07.315330 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:07.501332 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:07.501298 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:07.640514 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:07.640431 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:07.740756 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:07.740723 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:07.779087 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:07.779059 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:04:07.779087 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:07.779072 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:04:07.779273 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:07.779096 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:04:07.779273 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:07.779167 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:04:07.779333 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:07.779276 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:04:07.779375 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:07.779339 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:04:09.518741 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:09.518701 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:09.616220 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:09.616186 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:09.715021 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:09.714974 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:09.778292 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:09.778211 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:04:09.778292 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:09.778237 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:04:09.778471 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:09.778211 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:04:09.778471 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:09.778326 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:04:09.778471 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:09.778388 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:04:09.778579 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:09.778471 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:04:09.816046 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:09.816016 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:10.173295 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:10.173208 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:10.274105 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:10.274072 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:10.582522 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:10.582489 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:10.775071 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:10.775039 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:11.013222 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:11.013176 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:11.182847 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:11.182816 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:11.247690 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:11.247656 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:11.399777 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:11.399689 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:11.551591 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:11.551558 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:11.779107 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:11.779063 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:04:11.779469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:11.779069 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:04:11.779469 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:11.779205 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:04:11.779469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:11.779069 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:04:11.779469 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:11.779267 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:04:11.779469 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:11.779329 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:04:13.005964 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:13.005933 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:13.592259 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:13.592218 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:13.694801 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:13.694768 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:13.779111 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:13.779030 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:04:13.779111 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:13.779050 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:04:13.779279 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:13.779030 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:04:13.779279 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:13.779155 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bc6j" podUID="e8ccdc02-c0de-4b91-847e-ff741ec86efb" Sep 10 16:04:13.779279 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:13.779198 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljtzt" podUID="2e535dce-4a4c-4acc-84a3-edaba69c6a9e" Sep 10 16:04:13.779384 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:13.779288 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdf7t" podUID="226aa2a7-ea44-4496-ab2d-1dae7592f64f" Sep 10 16:04:13.797115 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:13.797083 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:13.895568 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:13.895536 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:14.075606 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.075531 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-144.ec2.internal" event="NodeReady" Sep 10 16:04:14.075962 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.075673 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 16:04:14.135648 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.135614 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:14.158778 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.158743 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xs9vx"] Sep 10 16:04:14.179032 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.179000 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mp96x"] Sep 10 16:04:14.179194 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.179092 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xs9vx" Sep 10 16:04:14.184830 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.184797 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 16:04:14.185005 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.184844 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 16:04:14.185005 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.184963 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-snhng\"" Sep 10 16:04:14.201937 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.201906 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xs9vx"] Sep 10 16:04:14.201937 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.201948 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mp96x"] Sep 10 16:04:14.202168 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.202066 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mp96x" Sep 10 16:04:14.205710 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.205689 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 16:04:14.205834 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.205767 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 16:04:14.205834 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.205801 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tj7w7\"" Sep 10 16:04:14.206125 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.206110 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 16:04:14.210401 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.210380 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jrvcd"] Sep 10 16:04:14.228977 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.228947 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jrvcd"] Sep 10 16:04:14.229128 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.229069 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jrvcd" Sep 10 16:04:14.232000 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.231962 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 16:04:14.232147 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.232073 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 16:04:14.232147 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.232075 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ng9sv\"" Sep 10 16:04:14.232804 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.232790 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 16:04:14.232865 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.232824 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 16:04:14.322201 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.322155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6322c63-61ef-4316-ac08-c022eb2a2c7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrvcd\" (UID: \"b6322c63-61ef-4316-ac08-c022eb2a2c7c\") " pod="openshift-insights/insights-runtime-extractor-jrvcd" Sep 10 16:04:14.322376 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.322235 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjprv\" (UniqueName: \"kubernetes.io/projected/a30ad0cc-9cc3-4e18-88c4-3ca6490808a3-kube-api-access-xjprv\") pod \"ingress-canary-mp96x\" (UID: \"a30ad0cc-9cc3-4e18-88c4-3ca6490808a3\") " pod="openshift-ingress-canary/ingress-canary-mp96x" Sep 10 16:04:14.322376 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.322254 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlftx\" (UniqueName: \"kubernetes.io/projected/8dcc1664-6944-4ce1-9416-1f5d08420c82-kube-api-access-zlftx\") pod \"dns-default-xs9vx\" (UID: \"8dcc1664-6944-4ce1-9416-1f5d08420c82\") " pod="openshift-dns/dns-default-xs9vx" Sep 10 16:04:14.322376 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.322271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b6322c63-61ef-4316-ac08-c022eb2a2c7c-crio-socket\") pod \"insights-runtime-extractor-jrvcd\" (UID: \"b6322c63-61ef-4316-ac08-c022eb2a2c7c\") " pod="openshift-insights/insights-runtime-extractor-jrvcd" Sep 10 16:04:14.322376 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.322290 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6322c63-61ef-4316-ac08-c022eb2a2c7c-data-volume\") pod \"insights-runtime-extractor-jrvcd\" (UID: \"b6322c63-61ef-4316-ac08-c022eb2a2c7c\") " pod="openshift-insights/insights-runtime-extractor-jrvcd" Sep 10 16:04:14.322376 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.322334 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8dcc1664-6944-4ce1-9416-1f5d08420c82-config-volume\") pod \"dns-default-xs9vx\" (UID: \"8dcc1664-6944-4ce1-9416-1f5d08420c82\") " pod="openshift-dns/dns-default-xs9vx" Sep 10 16:04:14.322376 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.322367 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8tpj\" (UniqueName: \"kubernetes.io/projected/b6322c63-61ef-4316-ac08-c022eb2a2c7c-kube-api-access-b8tpj\") pod \"insights-runtime-extractor-jrvcd\" (UID: \"b6322c63-61ef-4316-ac08-c022eb2a2c7c\") " pod="openshift-insights/insights-runtime-extractor-jrvcd" Sep 10 16:04:14.322670 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.322404 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6322c63-61ef-4316-ac08-c022eb2a2c7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrvcd\" (UID: \"b6322c63-61ef-4316-ac08-c022eb2a2c7c\") " pod="openshift-insights/insights-runtime-extractor-jrvcd" Sep 10 16:04:14.322670 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.322440 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dcc1664-6944-4ce1-9416-1f5d08420c82-tmp-dir\") pod \"dns-default-xs9vx\" (UID: \"8dcc1664-6944-4ce1-9416-1f5d08420c82\") " pod="openshift-dns/dns-default-xs9vx" Sep 10 16:04:14.322670 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.322515 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a30ad0cc-9cc3-4e18-88c4-3ca6490808a3-cert\") pod \"ingress-canary-mp96x\" (UID: \"a30ad0cc-9cc3-4e18-88c4-3ca6490808a3\") " pod="openshift-ingress-canary/ingress-canary-mp96x" Sep 10 16:04:14.322670 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.322543 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dcc1664-6944-4ce1-9416-1f5d08420c82-metrics-tls\") pod \"dns-default-xs9vx\" (UID: \"8dcc1664-6944-4ce1-9416-1f5d08420c82\") " pod="openshift-dns/dns-default-xs9vx" Sep 10 16:04:14.338756 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.338680 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:14.423874 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.423838 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8dcc1664-6944-4ce1-9416-1f5d08420c82-config-volume\") pod \"dns-default-xs9vx\" (UID: \"8dcc1664-6944-4ce1-9416-1f5d08420c82\") " pod="openshift-dns/dns-default-xs9vx" Sep 10 16:04:14.424038 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.423880 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8tpj\" (UniqueName: \"kubernetes.io/projected/b6322c63-61ef-4316-ac08-c022eb2a2c7c-kube-api-access-b8tpj\") pod \"insights-runtime-extractor-jrvcd\" (UID: \"b6322c63-61ef-4316-ac08-c022eb2a2c7c\") " pod="openshift-insights/insights-runtime-extractor-jrvcd" Sep 10 16:04:14.424113 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.424037 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6322c63-61ef-4316-ac08-c022eb2a2c7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrvcd\" (UID: \"b6322c63-61ef-4316-ac08-c022eb2a2c7c\") " pod="openshift-insights/insights-runtime-extractor-jrvcd" Sep 10 16:04:14.424113 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.424063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dcc1664-6944-4ce1-9416-1f5d08420c82-tmp-dir\") pod \"dns-default-xs9vx\" (UID: \"8dcc1664-6944-4ce1-9416-1f5d08420c82\") " pod="openshift-dns/dns-default-xs9vx" Sep 10 16:04:14.424113 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.424096 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a30ad0cc-9cc3-4e18-88c4-3ca6490808a3-cert\") pod \"ingress-canary-mp96x\" (UID: \"a30ad0cc-9cc3-4e18-88c4-3ca6490808a3\") " pod="openshift-ingress-canary/ingress-canary-mp96x" Sep 10 16:04:14.424255 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.424212 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dcc1664-6944-4ce1-9416-1f5d08420c82-metrics-tls\") pod \"dns-default-xs9vx\" (UID: \"8dcc1664-6944-4ce1-9416-1f5d08420c82\") " pod="openshift-dns/dns-default-xs9vx" Sep 10 16:04:14.424303 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.424259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6322c63-61ef-4316-ac08-c022eb2a2c7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrvcd\" (UID: \"b6322c63-61ef-4316-ac08-c022eb2a2c7c\") " pod="openshift-insights/insights-runtime-extractor-jrvcd" Sep 10 16:04:14.424350 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.424337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjprv\" (UniqueName: \"kubernetes.io/projected/a30ad0cc-9cc3-4e18-88c4-3ca6490808a3-kube-api-access-xjprv\") pod \"ingress-canary-mp96x\" (UID: \"a30ad0cc-9cc3-4e18-88c4-3ca6490808a3\") " pod="openshift-ingress-canary/ingress-canary-mp96x" Sep 10 16:04:14.424400 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.424360 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dcc1664-6944-4ce1-9416-1f5d08420c82-tmp-dir\") pod \"dns-default-xs9vx\" (UID: \"8dcc1664-6944-4ce1-9416-1f5d08420c82\") " pod="openshift-dns/dns-default-xs9vx" Sep 10 16:04:14.424400 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.424363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlftx\" (UniqueName: \"kubernetes.io/projected/8dcc1664-6944-4ce1-9416-1f5d08420c82-kube-api-access-zlftx\") pod \"dns-default-xs9vx\" (UID: \"8dcc1664-6944-4ce1-9416-1f5d08420c82\") " pod="openshift-dns/dns-default-xs9vx" Sep 10 16:04:14.424529 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.424504 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8dcc1664-6944-4ce1-9416-1f5d08420c82-config-volume\") pod \"dns-default-xs9vx\" (UID: \"8dcc1664-6944-4ce1-9416-1f5d08420c82\") " pod="openshift-dns/dns-default-xs9vx" Sep 10 16:04:14.424682 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.424657 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6322c63-61ef-4316-ac08-c022eb2a2c7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrvcd\" (UID: \"b6322c63-61ef-4316-ac08-c022eb2a2c7c\") " pod="openshift-insights/insights-runtime-extractor-jrvcd" Sep 10 16:04:14.424682 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.424561 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b6322c63-61ef-4316-ac08-c022eb2a2c7c-crio-socket\") pod \"insights-runtime-extractor-jrvcd\" (UID: \"b6322c63-61ef-4316-ac08-c022eb2a2c7c\") " pod="openshift-insights/insights-runtime-extractor-jrvcd" Sep 10 16:04:14.424835 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.424704 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6322c63-61ef-4316-ac08-c022eb2a2c7c-data-volume\") pod \"insights-runtime-extractor-jrvcd\" (UID: \"b6322c63-61ef-4316-ac08-c022eb2a2c7c\") " pod="openshift-insights/insights-runtime-extractor-jrvcd" Sep 10 16:04:14.424835 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.424729 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b6322c63-61ef-4316-ac08-c022eb2a2c7c-crio-socket\") pod \"insights-runtime-extractor-jrvcd\" (UID: \"b6322c63-61ef-4316-ac08-c022eb2a2c7c\") " pod="openshift-insights/insights-runtime-extractor-jrvcd" Sep 10 16:04:14.424946 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.424915 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6322c63-61ef-4316-ac08-c022eb2a2c7c-data-volume\") pod \"insights-runtime-extractor-jrvcd\" (UID: \"b6322c63-61ef-4316-ac08-c022eb2a2c7c\") " pod="openshift-insights/insights-runtime-extractor-jrvcd" Sep 10 16:04:14.428095 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.428075 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dcc1664-6944-4ce1-9416-1f5d08420c82-metrics-tls\") pod \"dns-default-xs9vx\" (UID: \"8dcc1664-6944-4ce1-9416-1f5d08420c82\") " pod="openshift-dns/dns-default-xs9vx" Sep 10 16:04:14.428177 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.428100 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6322c63-61ef-4316-ac08-c022eb2a2c7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrvcd\" (UID: \"b6322c63-61ef-4316-ac08-c022eb2a2c7c\") " pod="openshift-insights/insights-runtime-extractor-jrvcd" Sep 10 16:04:14.428177 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.428173 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a30ad0cc-9cc3-4e18-88c4-3ca6490808a3-cert\") pod \"ingress-canary-mp96x\" (UID: \"a30ad0cc-9cc3-4e18-88c4-3ca6490808a3\") " pod="openshift-ingress-canary/ingress-canary-mp96x" Sep 10 16:04:14.435059 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.435018 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlftx\" (UniqueName: \"kubernetes.io/projected/8dcc1664-6944-4ce1-9416-1f5d08420c82-kube-api-access-zlftx\") pod \"dns-default-xs9vx\" (UID: \"8dcc1664-6944-4ce1-9416-1f5d08420c82\") " pod="openshift-dns/dns-default-xs9vx" Sep 10 16:04:14.435324 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.435304 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:14.436109 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.436089 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8tpj\" (UniqueName: \"kubernetes.io/projected/b6322c63-61ef-4316-ac08-c022eb2a2c7c-kube-api-access-b8tpj\") pod \"insights-runtime-extractor-jrvcd\" (UID: \"b6322c63-61ef-4316-ac08-c022eb2a2c7c\") " pod="openshift-insights/insights-runtime-extractor-jrvcd" Sep 10 16:04:14.436109 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.436099 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjprv\" (UniqueName: \"kubernetes.io/projected/a30ad0cc-9cc3-4e18-88c4-3ca6490808a3-kube-api-access-xjprv\") pod \"ingress-canary-mp96x\" (UID: \"a30ad0cc-9cc3-4e18-88c4-3ca6490808a3\") " pod="openshift-ingress-canary/ingress-canary-mp96x" Sep 10 16:04:14.488777 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.488735 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xs9vx" Sep 10 16:04:14.510515 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.510485 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mp96x" Sep 10 16:04:14.537786 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.537751 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jrvcd" Sep 10 16:04:14.803497 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.803459 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mp96x"] Sep 10 16:04:14.808157 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.808126 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xs9vx"] Sep 10 16:04:14.808604 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:04:14.808571 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda30ad0cc_9cc3_4e18_88c4_3ca6490808a3.slice/crio-9275e90a719ccf724aea11222383ece72137c73d362aa67dc61e87d9fd28717a WatchSource:0}: Error finding container 9275e90a719ccf724aea11222383ece72137c73d362aa67dc61e87d9fd28717a: Status 404 returned error can't find the container with id 9275e90a719ccf724aea11222383ece72137c73d362aa67dc61e87d9fd28717a Sep 10 16:04:14.811330 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:04:14.811310 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dcc1664_6944_4ce1_9416_1f5d08420c82.slice/crio-a0f3403db7bc221a5f0b45de6561943f68e000f34c0e3fe4a65c661f235b136b WatchSource:0}: Error finding container a0f3403db7bc221a5f0b45de6561943f68e000f34c0e3fe4a65c661f235b136b: Status 404 returned error can't find the container with id a0f3403db7bc221a5f0b45de6561943f68e000f34c0e3fe4a65c661f235b136b Sep 10 16:04:14.837577 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:14.837546 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jrvcd"] Sep 10 16:04:14.840685 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:04:14.840659 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6322c63_61ef_4316_ac08_c022eb2a2c7c.slice/crio-d94bcd512ff22a1202fb8fa06e1186e972ac38da4f379b47aba38bd77367e4a3 WatchSource:0}: Error finding container d94bcd512ff22a1202fb8fa06e1186e972ac38da4f379b47aba38bd77367e4a3: Status 404 returned error can't find the container with id d94bcd512ff22a1202fb8fa06e1186e972ac38da4f379b47aba38bd77367e4a3 Sep 10 16:04:15.058085 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:15.058039 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mp96x" event={"ID":"a30ad0cc-9cc3-4e18-88c4-3ca6490808a3","Type":"ContainerStarted","Data":"9275e90a719ccf724aea11222383ece72137c73d362aa67dc61e87d9fd28717a"} Sep 10 16:04:15.059490 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:15.059458 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jrvcd" event={"ID":"b6322c63-61ef-4316-ac08-c022eb2a2c7c","Type":"ContainerStarted","Data":"142d79f9b72be37560d4d58e76580d813a658f3b6dd5c2efba19b7263e2686dc"} Sep 10 16:04:15.059648 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:15.059517 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jrvcd" event={"ID":"b6322c63-61ef-4316-ac08-c022eb2a2c7c","Type":"ContainerStarted","Data":"d94bcd512ff22a1202fb8fa06e1186e972ac38da4f379b47aba38bd77367e4a3"} Sep 10 16:04:15.060503 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:15.060480 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xs9vx" event={"ID":"8dcc1664-6944-4ce1-9416-1f5d08420c82","Type":"ContainerStarted","Data":"a0f3403db7bc221a5f0b45de6561943f68e000f34c0e3fe4a65c661f235b136b"} Sep 10 16:04:15.568812 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:15.568769 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:15.667514 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:15.667475 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:15.779550 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:15.779515 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:04:15.779729 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:15.779594 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:04:15.779729 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:15.779633 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:04:15.782420 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:15.782393 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 16:04:15.783633 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:15.783607 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x4mwj\"" Sep 10 16:04:15.786015 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:15.785756 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 16:04:15.786015 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:15.785915 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 16:04:15.786430 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:15.785765 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 16:04:15.786508 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:15.786410 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wstvg\"" Sep 10 16:04:16.299390 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:16.299354 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:18.069803 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:18.069762 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mp96x" event={"ID":"a30ad0cc-9cc3-4e18-88c4-3ca6490808a3","Type":"ContainerStarted","Data":"c269509e1f2d01e0faa4d53c1832529e3c266e44cb8e37bde233a90a3e459fe8"} Sep 10 16:04:18.071717 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:18.071689 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jrvcd" event={"ID":"b6322c63-61ef-4316-ac08-c022eb2a2c7c","Type":"ContainerStarted","Data":"0b407cb5d957a430fbfbc8705b27f56bd7d39f419e513f8e3ba7f04dddda7f78"} Sep 10 16:04:18.073507 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:18.073484 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xs9vx" event={"ID":"8dcc1664-6944-4ce1-9416-1f5d08420c82","Type":"ContainerStarted","Data":"2cbfdccf1f4449f4853c40049202850e87b9e7ab2128b9501fcffb5a3a7e600a"} Sep 10 16:04:18.073636 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:18.073531 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xs9vx" event={"ID":"8dcc1664-6944-4ce1-9416-1f5d08420c82","Type":"ContainerStarted","Data":"6222c2fbc016b1cf6f2f1e86021881a748082c8d4442850338a7c1b6d221bc60"} Sep 10 16:04:18.073686 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:18.073632 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xs9vx" Sep 10 16:04:18.087029 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:18.086899 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mp96x" podStartSLOduration=1.055748882 podStartE2EDuration="4.086882366s" totalImagesPullingTime="3.031133484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:18.085624529 +0000 UTC m=+52.799892524" watchObservedRunningTime="2026-09-10 16:04:18.086882366 +0000 UTC m=+52.801150360" Sep 10 16:04:18.106805 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:18.106745 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xs9vx" podStartSLOduration=1.088823048 podStartE2EDuration="4.106728162s" totalImagesPullingTime="3.017905114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:18.106147231 +0000 UTC m=+52.820415220" watchObservedRunningTime="2026-09-10 16:04:18.106728162 +0000 UTC m=+52.820996156" Sep 10 16:04:19.612924 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:19.612867 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:20.082800 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.082759 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jrvcd" event={"ID":"b6322c63-61ef-4316-ac08-c022eb2a2c7c","Type":"ContainerStarted","Data":"4872c14e2545495defbc7f068a9adb70b080f7ca81ae24887840fe18e353eb30"} Sep 10 16:04:20.104967 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.104909 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jrvcd" podStartSLOduration=1.3244413 podStartE2EDuration="6.104890494s" totalImagesPullingTime="4.780449194s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:04:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:20.104078732 +0000 UTC m=+54.818346727" watchObservedRunningTime="2026-09-10 16:04:20.104890494 +0000 UTC m=+54.819158483" Sep 10 16:04:20.114221 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.114191 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-655d6db7df-8pm9q"] Sep 10 16:04:20.116051 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.116008 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:20.118882 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.118863 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 10 16:04:20.119172 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.119157 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 10 16:04:20.119451 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.119426 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 10 16:04:20.119549 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.119460 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 10 16:04:20.119549 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.119479 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-p5dm5\"" Sep 10 16:04:20.120209 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.120191 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 10 16:04:20.120307 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.120284 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 16:04:20.120360 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.120284 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 16:04:20.129341 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.129316 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-655d6db7df-8pm9q"] Sep 10 16:04:20.274264 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.274220 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91d5f630-cd46-4a46-b320-923fa4aa5b71-console-serving-cert\") pod \"console-655d6db7df-8pm9q\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:20.274264 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.274260 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91d5f630-cd46-4a46-b320-923fa4aa5b71-console-config\") pod \"console-655d6db7df-8pm9q\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:20.274471 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.274284 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91d5f630-cd46-4a46-b320-923fa4aa5b71-service-ca\") pod \"console-655d6db7df-8pm9q\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:20.274471 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.274360 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvtcj\" (UniqueName: \"kubernetes.io/projected/91d5f630-cd46-4a46-b320-923fa4aa5b71-kube-api-access-jvtcj\") pod \"console-655d6db7df-8pm9q\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:20.274471 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.274416 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91d5f630-cd46-4a46-b320-923fa4aa5b71-console-oauth-config\") pod \"console-655d6db7df-8pm9q\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:20.274471 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.274432 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91d5f630-cd46-4a46-b320-923fa4aa5b71-oauth-serving-cert\") pod \"console-655d6db7df-8pm9q\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:20.375783 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.375686 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91d5f630-cd46-4a46-b320-923fa4aa5b71-service-ca\") pod \"console-655d6db7df-8pm9q\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:20.375783 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.375737 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvtcj\" (UniqueName: \"kubernetes.io/projected/91d5f630-cd46-4a46-b320-923fa4aa5b71-kube-api-access-jvtcj\") pod \"console-655d6db7df-8pm9q\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:20.375783 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.375764 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91d5f630-cd46-4a46-b320-923fa4aa5b71-console-oauth-config\") pod \"console-655d6db7df-8pm9q\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:20.375783 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.375782 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91d5f630-cd46-4a46-b320-923fa4aa5b71-oauth-serving-cert\") pod \"console-655d6db7df-8pm9q\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:20.376189 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.375827 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91d5f630-cd46-4a46-b320-923fa4aa5b71-console-serving-cert\") pod \"console-655d6db7df-8pm9q\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:20.376189 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.375841 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91d5f630-cd46-4a46-b320-923fa4aa5b71-console-config\") pod \"console-655d6db7df-8pm9q\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:20.376519 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.376491 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91d5f630-cd46-4a46-b320-923fa4aa5b71-console-config\") pod \"console-655d6db7df-8pm9q\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:20.376519 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.376508 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91d5f630-cd46-4a46-b320-923fa4aa5b71-service-ca\") pod \"console-655d6db7df-8pm9q\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:20.376647 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.376547 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91d5f630-cd46-4a46-b320-923fa4aa5b71-oauth-serving-cert\") pod \"console-655d6db7df-8pm9q\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:20.378249 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.378229 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91d5f630-cd46-4a46-b320-923fa4aa5b71-console-oauth-config\") pod \"console-655d6db7df-8pm9q\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:20.378249 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.378241 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91d5f630-cd46-4a46-b320-923fa4aa5b71-console-serving-cert\") pod \"console-655d6db7df-8pm9q\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:20.387536 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.387513 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvtcj\" (UniqueName: \"kubernetes.io/projected/91d5f630-cd46-4a46-b320-923fa4aa5b71-kube-api-access-jvtcj\") pod \"console-655d6db7df-8pm9q\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:20.424371 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.424326 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:20.611237 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.611199 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:20.693926 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.693847 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-655d6db7df-8pm9q"] Sep 10 16:04:20.696554 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:04:20.696511 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91d5f630_cd46_4a46_b320_923fa4aa5b71.slice/crio-bc6f4e6cc0841d40e4969bb9112f348a7c187095f25d8f9fd8e722205e451a09 WatchSource:0}: Error finding container bc6f4e6cc0841d40e4969bb9112f348a7c187095f25d8f9fd8e722205e451a09: Status 404 returned error can't find the container with id bc6f4e6cc0841d40e4969bb9112f348a7c187095f25d8f9fd8e722205e451a09 Sep 10 16:04:20.775965 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.775923 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-529nm"] Sep 10 16:04:20.778812 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.778787 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-529nm" Sep 10 16:04:20.781326 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.781299 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 10 16:04:20.781426 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.781407 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-m75wp\"" Sep 10 16:04:20.787459 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.787431 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-529nm"] Sep 10 16:04:20.879305 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.879258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0a8aaef3-02e6-4805-9cb6-aefeab913059-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-529nm\" (UID: \"0a8aaef3-02e6-4805-9cb6-aefeab913059\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-529nm" Sep 10 16:04:20.979889 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:20.979864 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0a8aaef3-02e6-4805-9cb6-aefeab913059-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-529nm\" (UID: \"0a8aaef3-02e6-4805-9cb6-aefeab913059\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-529nm" Sep 10 16:04:20.980071 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:20.980005 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 10 16:04:20.980071 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:20.980070 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8aaef3-02e6-4805-9cb6-aefeab913059-tls-certificates podName:0a8aaef3-02e6-4805-9cb6-aefeab913059 nodeName:}" failed. No retries permitted until 2026-09-10 16:04:21.480054083 +0000 UTC m=+56.194322056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/0a8aaef3-02e6-4805-9cb6-aefeab913059-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-529nm" (UID: "0a8aaef3-02e6-4805-9cb6-aefeab913059") : secret "prometheus-operator-admission-webhook-tls" not found Sep 10 16:04:21.086962 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:21.086923 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-655d6db7df-8pm9q" event={"ID":"91d5f630-cd46-4a46-b320-923fa4aa5b71","Type":"ContainerStarted","Data":"bc6f4e6cc0841d40e4969bb9112f348a7c187095f25d8f9fd8e722205e451a09"} Sep 10 16:04:21.275910 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:21.275834 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:21.327411 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:21.327367 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:21.483763 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:21.483725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0a8aaef3-02e6-4805-9cb6-aefeab913059-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-529nm\" (UID: \"0a8aaef3-02e6-4805-9cb6-aefeab913059\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-529nm" Sep 10 16:04:21.486409 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:21.486374 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0a8aaef3-02e6-4805-9cb6-aefeab913059-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-529nm\" (UID: \"0a8aaef3-02e6-4805-9cb6-aefeab913059\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-529nm" Sep 10 16:04:21.688478 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:21.688390 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-529nm" Sep 10 16:04:21.975494 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:21.975415 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-529nm"] Sep 10 16:04:21.979050 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:04:21.979012 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a8aaef3_02e6_4805_9cb6_aefeab913059.slice/crio-5e60c73018edcc5e01cdbc979479f190cd1673b50b445433785a6451b90f7cb5 WatchSource:0}: Error finding container 5e60c73018edcc5e01cdbc979479f190cd1673b50b445433785a6451b90f7cb5: Status 404 returned error can't find the container with id 5e60c73018edcc5e01cdbc979479f190cd1673b50b445433785a6451b90f7cb5 Sep 10 16:04:22.092923 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:22.092877 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-529nm" event={"ID":"0a8aaef3-02e6-4805-9cb6-aefeab913059","Type":"ContainerStarted","Data":"5e60c73018edcc5e01cdbc979479f190cd1673b50b445433785a6451b90f7cb5"} Sep 10 16:04:22.468368 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:22.468330 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:22.679134 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:22.679099 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:24.100582 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:24.100546 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-655d6db7df-8pm9q" event={"ID":"91d5f630-cd46-4a46-b320-923fa4aa5b71","Type":"ContainerStarted","Data":"960da0e7413dad6073bed2b3a85665e15ad158c9535d2ce5751acee40596ee24"} Sep 10 16:04:24.122569 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:24.122210 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-655d6db7df-8pm9q" podStartSLOduration=0.937194003 podStartE2EDuration="4.122187222s" totalImagesPullingTime="3.184993219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:24.121181981 +0000 UTC m=+58.835449976" watchObservedRunningTime="2026-09-10 16:04:24.122187222 +0000 UTC m=+58.836455217" Sep 10 16:04:25.004603 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:25.004573 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktbmj" Sep 10 16:04:25.105430 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:25.105380 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-529nm" event={"ID":"0a8aaef3-02e6-4805-9cb6-aefeab913059","Type":"ContainerStarted","Data":"3854bae1671dc1354abc119ab91cfba04e0b18c1db6d8ad3efdca59333eeb85a"} Sep 10 16:04:25.126070 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:25.126041 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:25.189707 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:25.189679 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:25.298954 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:25.298862 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:26.109017 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:26.108966 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-529nm" Sep 10 16:04:26.113805 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:26.113782 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-529nm" Sep 10 16:04:26.131122 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:26.131061 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-529nm" podStartSLOduration=3.425704872 podStartE2EDuration="6.131040897s" totalImagesPullingTime="2.705336025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:25.121783424 +0000 UTC m=+59.836051420" watchObservedRunningTime="2026-09-10 16:04:26.131040897 +0000 UTC m=+60.845308893" Sep 10 16:04:26.800737 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:26.800704 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:26.851518 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:26.851483 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-tsvz5"] Sep 10 16:04:26.854138 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:26.854118 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-tsvz5" Sep 10 16:04:26.858098 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:26.858074 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 10 16:04:26.858240 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:26.858151 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 16:04:26.858299 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:26.858169 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-drlkq\"" Sep 10 16:04:26.858595 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:26.858579 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 16:04:26.859322 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:26.859302 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 10 16:04:26.859438 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:26.859311 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 16:04:26.865262 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:26.865240 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-tsvz5"] Sep 10 16:04:26.880391 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:26.880360 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:27.014338 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:27.014300 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:27.028108 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:27.028081 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/877096ff-d2bd-4a6c-bce4-5704248b2f2b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-tsvz5\" (UID: \"877096ff-d2bd-4a6c-bce4-5704248b2f2b\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tsvz5" Sep 10 16:04:27.028197 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:27.028156 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/877096ff-d2bd-4a6c-bce4-5704248b2f2b-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-tsvz5\" (UID: \"877096ff-d2bd-4a6c-bce4-5704248b2f2b\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tsvz5" Sep 10 16:04:27.028431 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:27.028214 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t97cx\" (UniqueName: \"kubernetes.io/projected/877096ff-d2bd-4a6c-bce4-5704248b2f2b-kube-api-access-t97cx\") pod \"prometheus-operator-6f4946db56-tsvz5\" (UID: \"877096ff-d2bd-4a6c-bce4-5704248b2f2b\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tsvz5" Sep 10 16:04:27.028431 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:27.028258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/877096ff-d2bd-4a6c-bce4-5704248b2f2b-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-tsvz5\" (UID: \"877096ff-d2bd-4a6c-bce4-5704248b2f2b\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tsvz5" Sep 10 16:04:27.084188 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:27.084100 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:27.128930 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:27.128887 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/877096ff-d2bd-4a6c-bce4-5704248b2f2b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-tsvz5\" (UID: \"877096ff-d2bd-4a6c-bce4-5704248b2f2b\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tsvz5" Sep 10 16:04:27.129428 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:27.128961 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/877096ff-d2bd-4a6c-bce4-5704248b2f2b-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-tsvz5\" (UID: \"877096ff-d2bd-4a6c-bce4-5704248b2f2b\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tsvz5" Sep 10 16:04:27.129428 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:27.129008 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t97cx\" (UniqueName: \"kubernetes.io/projected/877096ff-d2bd-4a6c-bce4-5704248b2f2b-kube-api-access-t97cx\") pod \"prometheus-operator-6f4946db56-tsvz5\" (UID: \"877096ff-d2bd-4a6c-bce4-5704248b2f2b\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tsvz5" Sep 10 16:04:27.129428 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:27.129035 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/877096ff-d2bd-4a6c-bce4-5704248b2f2b-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-tsvz5\" (UID: \"877096ff-d2bd-4a6c-bce4-5704248b2f2b\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tsvz5" Sep 10 16:04:27.129794 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:27.129770 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/877096ff-d2bd-4a6c-bce4-5704248b2f2b-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-tsvz5\" (UID: \"877096ff-d2bd-4a6c-bce4-5704248b2f2b\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tsvz5" Sep 10 16:04:27.131349 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:27.131329 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/877096ff-d2bd-4a6c-bce4-5704248b2f2b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-tsvz5\" (UID: \"877096ff-d2bd-4a6c-bce4-5704248b2f2b\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tsvz5" Sep 10 16:04:27.131423 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:27.131349 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/877096ff-d2bd-4a6c-bce4-5704248b2f2b-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-tsvz5\" (UID: \"877096ff-d2bd-4a6c-bce4-5704248b2f2b\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tsvz5" Sep 10 16:04:27.137997 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:27.137966 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t97cx\" (UniqueName: \"kubernetes.io/projected/877096ff-d2bd-4a6c-bce4-5704248b2f2b-kube-api-access-t97cx\") pod \"prometheus-operator-6f4946db56-tsvz5\" (UID: \"877096ff-d2bd-4a6c-bce4-5704248b2f2b\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tsvz5" Sep 10 16:04:27.162878 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:27.162842 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-tsvz5" Sep 10 16:04:27.435937 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:27.435848 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-tsvz5"] Sep 10 16:04:27.438545 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:04:27.438516 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod877096ff_d2bd_4a6c_bce4_5704248b2f2b.slice/crio-1a15beeffef674a1319c04dcdba88f753b70cba3c77c7e29d6c35c4d1313ec4d WatchSource:0}: Error finding container 1a15beeffef674a1319c04dcdba88f753b70cba3c77c7e29d6c35c4d1313ec4d: Status 404 returned error can't find the container with id 1a15beeffef674a1319c04dcdba88f753b70cba3c77c7e29d6c35c4d1313ec4d Sep 10 16:04:27.568332 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:27.568300 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:27.651253 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:27.651223 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:28.078773 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:28.078741 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xs9vx" Sep 10 16:04:28.118451 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:28.118411 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-tsvz5" event={"ID":"877096ff-d2bd-4a6c-bce4-5704248b2f2b","Type":"ContainerStarted","Data":"1a15beeffef674a1319c04dcdba88f753b70cba3c77c7e29d6c35c4d1313ec4d"} Sep 10 16:04:29.123578 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:29.123552 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-tsvz5" event={"ID":"877096ff-d2bd-4a6c-bce4-5704248b2f2b","Type":"ContainerStarted","Data":"20b7d6a71f4773ff35730e2a4313778eae2958ac8b3c06d6b2b917df7072ca70"} Sep 10 16:04:29.272408 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:29.272326 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:30.128473 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.128435 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-tsvz5" event={"ID":"877096ff-d2bd-4a6c-bce4-5704248b2f2b","Type":"ContainerStarted","Data":"65a58e32a6d94d36116b52eb55d32659edcc0d2252745e392a29dc6ff0599b3d"} Sep 10 16:04:30.157043 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.156955 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-tsvz5" podStartSLOduration=2.587261816 podStartE2EDuration="4.156935822s" totalImagesPullingTime="1.569674006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:30.156008862 +0000 UTC m=+64.870276858" watchObservedRunningTime="2026-09-10 16:04:30.156935822 +0000 UTC m=+64.871203817" Sep 10 16:04:30.424916 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.424820 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:30.424916 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.424895 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:30.429615 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.429590 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:30.833275 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.831622 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-864755d77-4d468"] Sep 10 16:04:30.839132 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.839097 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:30.852327 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.852294 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-864755d77-4d468"] Sep 10 16:04:30.852474 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.852417 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.854823 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.854798 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39d7944e-f156-4664-ab8b-37506c5537e4-console-oauth-config\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.854919 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.854832 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4grvp\" (UniqueName: \"kubernetes.io/projected/39d7944e-f156-4664-ab8b-37506c5537e4-kube-api-access-4grvp\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.854966 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.854935 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-oauth-serving-cert\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.855075 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.855058 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-trusted-ca-bundle\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.855126 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.855107 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39d7944e-f156-4664-ab8b-37506c5537e4-console-serving-cert\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.855162 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.855129 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-console-config\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.855162 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.855146 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-service-ca\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.861485 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.861462 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 10 16:04:30.947956 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.947919 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:30.956223 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.956181 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39d7944e-f156-4664-ab8b-37506c5537e4-console-serving-cert\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.956223 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.956221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-console-config\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.956448 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.956244 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-service-ca\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.956448 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.956280 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39d7944e-f156-4664-ab8b-37506c5537e4-console-oauth-config\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.956448 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.956305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4grvp\" (UniqueName: \"kubernetes.io/projected/39d7944e-f156-4664-ab8b-37506c5537e4-kube-api-access-4grvp\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.956589 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.956548 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-oauth-serving-cert\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.956642 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.956627 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-trusted-ca-bundle\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.957009 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.956964 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-console-config\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.957129 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.956969 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-service-ca\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.957129 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.957122 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-oauth-serving-cert\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.957516 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.957492 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-trusted-ca-bundle\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.958803 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.958774 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39d7944e-f156-4664-ab8b-37506c5537e4-console-serving-cert\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.959177 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.959098 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39d7944e-f156-4664-ab8b-37506c5537e4-console-oauth-config\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:30.966974 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:30.966944 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4grvp\" (UniqueName: \"kubernetes.io/projected/39d7944e-f156-4664-ab8b-37506c5537e4-kube-api-access-4grvp\") pod \"console-864755d77-4d468\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:31.135470 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:31.135381 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:04:31.161969 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:31.161932 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:31.459787 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:31.459702 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs\") pod \"network-metrics-daemon-mdf7t\" (UID: \"226aa2a7-ea44-4496-ab2d-1dae7592f64f\") " pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:04:31.462730 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:31.462707 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 16:04:31.472788 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:31.472740 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/226aa2a7-ea44-4496-ab2d-1dae7592f64f-metrics-certs\") pod \"network-metrics-daemon-mdf7t\" (UID: \"226aa2a7-ea44-4496-ab2d-1dae7592f64f\") " pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:04:31.473457 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:31.473431 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-864755d77-4d468"] Sep 10 16:04:31.483867 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:04:31.483836 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d7944e_f156_4664_ab8b_37506c5537e4.slice/crio-f943a246a145c4c2a1a02556d0d8fbdab33969fa8dd019e6590697bce7d13040 WatchSource:0}: Error finding container f943a246a145c4c2a1a02556d0d8fbdab33969fa8dd019e6590697bce7d13040: Status 404 returned error can't find the container with id f943a246a145c4c2a1a02556d0d8fbdab33969fa8dd019e6590697bce7d13040 Sep 10 16:04:31.560979 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:31.560951 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret\") pod \"global-pull-secret-syncer-7bc6j\" (UID: \"e8ccdc02-c0de-4b91-847e-ff741ec86efb\") " pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:04:31.563954 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:31.563933 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 16:04:31.573878 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:31.573854 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8ccdc02-c0de-4b91-847e-ff741ec86efb-original-pull-secret\") pod \"global-pull-secret-syncer-7bc6j\" (UID: \"e8ccdc02-c0de-4b91-847e-ff741ec86efb\") " pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:04:31.662380 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:31.662342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dnhj\" (UniqueName: \"kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj\") pod \"network-check-target-ljtzt\" (UID: \"2e535dce-4a4c-4acc-84a3-edaba69c6a9e\") " pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:04:31.665338 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:31.665311 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 16:04:31.676578 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:31.676552 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 16:04:31.686210 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:31.686188 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dnhj\" (UniqueName: \"kubernetes.io/projected/2e535dce-4a4c-4acc-84a3-edaba69c6a9e-kube-api-access-5dnhj\") pod \"network-check-target-ljtzt\" (UID: \"2e535dce-4a4c-4acc-84a3-edaba69c6a9e\") " pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:04:31.694672 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:31.694648 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x4mwj\"" Sep 10 16:04:31.699827 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:31.699813 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bc6j" Sep 10 16:04:31.702935 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:31.702916 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:04:31.708424 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:31.708404 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wstvg\"" Sep 10 16:04:31.716722 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:31.716665 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdf7t" Sep 10 16:04:32.028018 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.027960 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7bc6j"] Sep 10 16:04:32.028947 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.028923 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:32.032090 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:04:32.032060 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ccdc02_c0de_4b91_847e_ff741ec86efb.slice/crio-7ba1f788ee2281da11df343dc82e5f04bc4df6f70a838ce09ae416a7dd54ac90 WatchSource:0}: Error finding container 7ba1f788ee2281da11df343dc82e5f04bc4df6f70a838ce09ae416a7dd54ac90: Status 404 returned error can't find the container with id 7ba1f788ee2281da11df343dc82e5f04bc4df6f70a838ce09ae416a7dd54ac90 Sep 10 16:04:32.044069 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.044047 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ljtzt"] Sep 10 16:04:32.047188 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:04:32.047165 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e535dce_4a4c_4acc_84a3_edaba69c6a9e.slice/crio-04a07a0f0afc888385ec463a6ed50700d17e7da24ae0abb14b54ab1fd409011c WatchSource:0}: Error finding container 04a07a0f0afc888385ec463a6ed50700d17e7da24ae0abb14b54ab1fd409011c: Status 404 returned error can't find the container with id 04a07a0f0afc888385ec463a6ed50700d17e7da24ae0abb14b54ab1fd409011c Sep 10 16:04:32.078110 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.077950 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mdf7t"] Sep 10 16:04:32.080630 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:04:32.080596 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226aa2a7_ea44_4496_ab2d_1dae7592f64f.slice/crio-6f7507463d38ba00d84efc71328091328ae2a4aa059fba8409186815645fbe6d WatchSource:0}: Error finding container 6f7507463d38ba00d84efc71328091328ae2a4aa059fba8409186815645fbe6d: Status 404 returned error can't find the container with id 6f7507463d38ba00d84efc71328091328ae2a4aa059fba8409186815645fbe6d Sep 10 16:04:32.125955 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.125921 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:32.135857 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.135814 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mdf7t" event={"ID":"226aa2a7-ea44-4496-ab2d-1dae7592f64f","Type":"ContainerStarted","Data":"6f7507463d38ba00d84efc71328091328ae2a4aa059fba8409186815645fbe6d"} Sep 10 16:04:32.136930 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.136897 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7bc6j" event={"ID":"e8ccdc02-c0de-4b91-847e-ff741ec86efb","Type":"ContainerStarted","Data":"7ba1f788ee2281da11df343dc82e5f04bc4df6f70a838ce09ae416a7dd54ac90"} Sep 10 16:04:32.138538 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.138517 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-864755d77-4d468" event={"ID":"39d7944e-f156-4664-ab8b-37506c5537e4","Type":"ContainerStarted","Data":"481cad342143ac53d814a063cbec6bc2eade2b1eb95318bd14be4add46c18e12"} Sep 10 16:04:32.138627 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.138556 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-864755d77-4d468" event={"ID":"39d7944e-f156-4664-ab8b-37506c5537e4","Type":"ContainerStarted","Data":"f943a246a145c4c2a1a02556d0d8fbdab33969fa8dd019e6590697bce7d13040"} Sep 10 16:04:32.139686 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.139664 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ljtzt" event={"ID":"2e535dce-4a4c-4acc-84a3-edaba69c6a9e","Type":"ContainerStarted","Data":"04a07a0f0afc888385ec463a6ed50700d17e7da24ae0abb14b54ab1fd409011c"} Sep 10 16:04:32.290004 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.289907 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:32.357742 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.357686 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-864755d77-4d468" podStartSLOduration=2.357667633 podStartE2EDuration="2.357667633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:32.164017049 +0000 UTC m=+66.878285046" watchObservedRunningTime="2026-09-10 16:04:32.357667633 +0000 UTC m=+67.071935628" Sep 10 16:04:32.358240 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.358222 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv"] Sep 10 16:04:32.361386 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.361366 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv" Sep 10 16:04:32.365843 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.365824 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 10 16:04:32.366119 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.366099 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dlcll\"" Sep 10 16:04:32.366227 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.366212 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 10 16:04:32.368232 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.368198 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79c50c85-10c1-4f22-a8df-053ace504e0d-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-qnkmv\" (UID: \"79c50c85-10c1-4f22-a8df-053ace504e0d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv" Sep 10 16:04:32.368304 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.368261 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk4cl\" (UniqueName: \"kubernetes.io/projected/79c50c85-10c1-4f22-a8df-053ace504e0d-kube-api-access-lk4cl\") pod \"openshift-state-metrics-657fd6c54-qnkmv\" (UID: \"79c50c85-10c1-4f22-a8df-053ace504e0d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv" Sep 10 16:04:32.368349 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.368299 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79c50c85-10c1-4f22-a8df-053ace504e0d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-qnkmv\" (UID: \"79c50c85-10c1-4f22-a8df-053ace504e0d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv" Sep 10 16:04:32.368349 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.368331 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/79c50c85-10c1-4f22-a8df-053ace504e0d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-qnkmv\" (UID: \"79c50c85-10c1-4f22-a8df-053ace504e0d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv" Sep 10 16:04:32.375880 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.375855 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-c5clp"] Sep 10 16:04:32.378839 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.378816 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:32.380447 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.380425 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv"] Sep 10 16:04:32.382769 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.382632 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 10 16:04:32.382769 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.382642 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 10 16:04:32.382769 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.382669 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 10 16:04:32.382769 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.382740 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9vkbj\"" Sep 10 16:04:32.398407 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.398381 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s7jg6"] Sep 10 16:04:32.400593 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.400563 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.403398 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.403373 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 16:04:32.403398 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.403382 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h8l7j\"" Sep 10 16:04:32.403641 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.403626 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 16:04:32.403692 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.403638 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 16:04:32.403692 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.403673 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-c5clp"] Sep 10 16:04:32.427220 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.427194 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:32.469574 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.469532 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79c50c85-10c1-4f22-a8df-053ace504e0d-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-qnkmv\" (UID: \"79c50c85-10c1-4f22-a8df-053ace504e0d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv" Sep 10 16:04:32.469744 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.469586 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-node-exporter-textfile\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.469744 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.469619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-node-exporter-accelerators-collector-config\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.469744 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.469645 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbdwk\" (UniqueName: \"kubernetes.io/projected/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-kube-api-access-hbdwk\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.469744 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.469673 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc478c19-a9a2-497b-899c-22af4307f668-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-c5clp\" (UID: \"fc478c19-a9a2-497b-899c-22af4307f668\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:32.469744 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.469697 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-root\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.469744 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.469726 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk4cl\" (UniqueName: \"kubernetes.io/projected/79c50c85-10c1-4f22-a8df-053ace504e0d-kube-api-access-lk4cl\") pod \"openshift-state-metrics-657fd6c54-qnkmv\" (UID: \"79c50c85-10c1-4f22-a8df-053ace504e0d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv" Sep 10 16:04:32.469964 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.469751 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-metrics-client-ca\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.469964 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.469785 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79c50c85-10c1-4f22-a8df-053ace504e0d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-qnkmv\" (UID: \"79c50c85-10c1-4f22-a8df-053ace504e0d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv" Sep 10 16:04:32.469964 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.469817 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/79c50c85-10c1-4f22-a8df-053ace504e0d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-qnkmv\" (UID: \"79c50c85-10c1-4f22-a8df-053ace504e0d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv" Sep 10 16:04:32.469964 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.469852 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-node-exporter-wtmp\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.469964 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.469876 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfn8g\" (UniqueName: \"kubernetes.io/projected/fc478c19-a9a2-497b-899c-22af4307f668-kube-api-access-cfn8g\") pod \"kube-state-metrics-74cb57df7-c5clp\" (UID: \"fc478c19-a9a2-497b-899c-22af4307f668\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:32.469964 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.469926 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc478c19-a9a2-497b-899c-22af4307f668-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-c5clp\" (UID: \"fc478c19-a9a2-497b-899c-22af4307f668\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:32.470262 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.469977 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-sys\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.470262 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.470028 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fc478c19-a9a2-497b-899c-22af4307f668-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-c5clp\" (UID: \"fc478c19-a9a2-497b-899c-22af4307f668\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:32.470262 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.470056 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc478c19-a9a2-497b-899c-22af4307f668-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-c5clp\" (UID: \"fc478c19-a9a2-497b-899c-22af4307f668\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:32.470262 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.470098 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-node-exporter-tls\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.470262 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.470128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.470262 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.470167 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fc478c19-a9a2-497b-899c-22af4307f668-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-c5clp\" (UID: \"fc478c19-a9a2-497b-899c-22af4307f668\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:32.470552 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.470509 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79c50c85-10c1-4f22-a8df-053ace504e0d-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-qnkmv\" (UID: \"79c50c85-10c1-4f22-a8df-053ace504e0d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv" Sep 10 16:04:32.474155 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.474099 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79c50c85-10c1-4f22-a8df-053ace504e0d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-qnkmv\" (UID: \"79c50c85-10c1-4f22-a8df-053ace504e0d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv" Sep 10 16:04:32.474463 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.474441 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/79c50c85-10c1-4f22-a8df-053ace504e0d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-qnkmv\" (UID: \"79c50c85-10c1-4f22-a8df-053ace504e0d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv" Sep 10 16:04:32.484360 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.484304 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk4cl\" (UniqueName: \"kubernetes.io/projected/79c50c85-10c1-4f22-a8df-053ace504e0d-kube-api-access-lk4cl\") pod \"openshift-state-metrics-657fd6c54-qnkmv\" (UID: \"79c50c85-10c1-4f22-a8df-053ace504e0d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv" Sep 10 16:04:32.563633 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.563524 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:32.570911 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.570865 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fc478c19-a9a2-497b-899c-22af4307f668-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-c5clp\" (UID: \"fc478c19-a9a2-497b-899c-22af4307f668\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:32.571099 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.570917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc478c19-a9a2-497b-899c-22af4307f668-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-c5clp\" (UID: \"fc478c19-a9a2-497b-899c-22af4307f668\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:32.571099 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.570958 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-node-exporter-tls\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.571099 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.571005 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.571099 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.571037 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fc478c19-a9a2-497b-899c-22af4307f668-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-c5clp\" (UID: \"fc478c19-a9a2-497b-899c-22af4307f668\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:32.571099 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.571082 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-node-exporter-textfile\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.571354 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.571109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-node-exporter-accelerators-collector-config\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.571354 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.571134 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbdwk\" (UniqueName: \"kubernetes.io/projected/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-kube-api-access-hbdwk\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.571354 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:32.571197 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 10 16:04:32.571354 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:32.571279 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-node-exporter-tls podName:77adaf4d-0b09-4ebc-983a-f53dea1c1cef nodeName:}" failed. No retries permitted until 2026-09-10 16:04:33.071256759 +0000 UTC m=+67.785524752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-node-exporter-tls") pod "node-exporter-s7jg6" (UID: "77adaf4d-0b09-4ebc-983a-f53dea1c1cef") : secret "node-exporter-tls" not found Sep 10 16:04:32.571610 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.571353 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fc478c19-a9a2-497b-899c-22af4307f668-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-c5clp\" (UID: \"fc478c19-a9a2-497b-899c-22af4307f668\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:32.571610 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.571386 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc478c19-a9a2-497b-899c-22af4307f668-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-c5clp\" (UID: \"fc478c19-a9a2-497b-899c-22af4307f668\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:32.571610 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.571430 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-root\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.571610 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.571463 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-metrics-client-ca\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.571610 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.571515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-node-exporter-wtmp\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.571610 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.571541 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfn8g\" (UniqueName: \"kubernetes.io/projected/fc478c19-a9a2-497b-899c-22af4307f668-kube-api-access-cfn8g\") pod \"kube-state-metrics-74cb57df7-c5clp\" (UID: \"fc478c19-a9a2-497b-899c-22af4307f668\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:32.571610 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.571573 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc478c19-a9a2-497b-899c-22af4307f668-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-c5clp\" (UID: \"fc478c19-a9a2-497b-899c-22af4307f668\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:32.571610 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.571601 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-sys\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.571998 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.571663 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-node-exporter-textfile\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.571998 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.571686 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-sys\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.571998 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.571794 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-node-exporter-wtmp\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.571998 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:32.571819 2578 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 10 16:04:32.571998 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.571838 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-root\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.571998 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:04:32.571869 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc478c19-a9a2-497b-899c-22af4307f668-kube-state-metrics-tls podName:fc478c19-a9a2-497b-899c-22af4307f668 nodeName:}" failed. No retries permitted until 2026-09-10 16:04:33.071854022 +0000 UTC m=+67.786122033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fc478c19-a9a2-497b-899c-22af4307f668-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-c5clp" (UID: "fc478c19-a9a2-497b-899c-22af4307f668") : secret "kube-state-metrics-tls" not found Sep 10 16:04:32.572315 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.572013 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-node-exporter-accelerators-collector-config\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.572315 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.572083 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc478c19-a9a2-497b-899c-22af4307f668-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-c5clp\" (UID: \"fc478c19-a9a2-497b-899c-22af4307f668\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:32.572315 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.572120 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fc478c19-a9a2-497b-899c-22af4307f668-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-c5clp\" (UID: \"fc478c19-a9a2-497b-899c-22af4307f668\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:32.572466 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.572331 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-metrics-client-ca\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.574153 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.574100 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.574533 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.574509 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc478c19-a9a2-497b-899c-22af4307f668-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-c5clp\" (UID: \"fc478c19-a9a2-497b-899c-22af4307f668\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:32.581432 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.581408 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbdwk\" (UniqueName: \"kubernetes.io/projected/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-kube-api-access-hbdwk\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:32.581865 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.581847 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfn8g\" (UniqueName: \"kubernetes.io/projected/fc478c19-a9a2-497b-899c-22af4307f668-kube-api-access-cfn8g\") pod \"kube-state-metrics-74cb57df7-c5clp\" (UID: \"fc478c19-a9a2-497b-899c-22af4307f668\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:32.670525 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.670481 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv" Sep 10 16:04:32.674490 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.674454 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:32.967739 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:32.967650 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv"] Sep 10 16:04:32.987965 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:04:32.987855 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c50c85_10c1_4f22_a8df_053ace504e0d.slice/crio-157dfeae0dbccb5d4dd9ca63725390da8646f0a80b5650e3db796c7d5543d09b WatchSource:0}: Error finding container 157dfeae0dbccb5d4dd9ca63725390da8646f0a80b5650e3db796c7d5543d09b: Status 404 returned error can't find the container with id 157dfeae0dbccb5d4dd9ca63725390da8646f0a80b5650e3db796c7d5543d09b Sep 10 16:04:33.036430 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.036400 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:33.075568 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.075391 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc478c19-a9a2-497b-899c-22af4307f668-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-c5clp\" (UID: \"fc478c19-a9a2-497b-899c-22af4307f668\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:33.075568 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.075462 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-node-exporter-tls\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:33.079211 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.079185 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77adaf4d-0b09-4ebc-983a-f53dea1c1cef-node-exporter-tls\") pod \"node-exporter-s7jg6\" (UID: \"77adaf4d-0b09-4ebc-983a-f53dea1c1cef\") " pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:33.082122 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.082100 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc478c19-a9a2-497b-899c-22af4307f668-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-c5clp\" (UID: \"fc478c19-a9a2-497b-899c-22af4307f668\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:33.133226 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.133182 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:33.147824 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.147678 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv" event={"ID":"79c50c85-10c1-4f22-a8df-053ace504e0d","Type":"ContainerStarted","Data":"c490b411f8d5f2b1d8d8178270b6538e0c29cfe6a9ffb949ca8ef753c6dff644"} Sep 10 16:04:33.147824 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.147762 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv" event={"ID":"79c50c85-10c1-4f22-a8df-053ace504e0d","Type":"ContainerStarted","Data":"ddcd4e0baf443527c3542d6fe7546a29617cb859bc083a28bc53eff66ab6c628"} Sep 10 16:04:33.147824 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.147792 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv" event={"ID":"79c50c85-10c1-4f22-a8df-053ace504e0d","Type":"ContainerStarted","Data":"157dfeae0dbccb5d4dd9ca63725390da8646f0a80b5650e3db796c7d5543d09b"} Sep 10 16:04:33.153092 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.151249 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mdf7t" event={"ID":"226aa2a7-ea44-4496-ab2d-1dae7592f64f","Type":"ContainerStarted","Data":"1027794d34ebc20673ff02472593d4d920bb74488784d05f0a1ea374af3a7c5e"} Sep 10 16:04:33.240521 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.240475 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:33.288331 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.288295 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" Sep 10 16:04:33.310703 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.310667 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s7jg6" Sep 10 16:04:33.325342 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:04:33.325302 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77adaf4d_0b09_4ebc_983a_f53dea1c1cef.slice/crio-6ab3323680df1111a4df3cfeaa644907841e381f28bd86194c560e94eafb26d8 WatchSource:0}: Error finding container 6ab3323680df1111a4df3cfeaa644907841e381f28bd86194c560e94eafb26d8: Status 404 returned error can't find the container with id 6ab3323680df1111a4df3cfeaa644907841e381f28bd86194c560e94eafb26d8 Sep 10 16:04:33.340567 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.340492 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:33.419224 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.419146 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 16:04:33.421794 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.421757 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:33.422975 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.422949 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.427250 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.426810 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 16:04:33.427250 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.426902 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 16:04:33.427250 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.426919 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 16:04:33.427250 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.426390 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pmq9q\"" Sep 10 16:04:33.427250 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.427146 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 16:04:33.429024 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.427698 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 16:04:33.429024 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.428261 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 16:04:33.429024 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.428293 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 16:04:33.429024 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.428669 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 16:04:33.429024 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.428727 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 16:04:33.439138 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.439114 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 16:04:33.479371 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.479276 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.479371 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.479321 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4njvk\" (UniqueName: \"kubernetes.io/projected/ea906d87-83fb-4631-a103-160a65b68956-kube-api-access-4njvk\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.479371 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.479349 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea906d87-83fb-4631-a103-160a65b68956-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.479627 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.479426 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea906d87-83fb-4631-a103-160a65b68956-config-out\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.479627 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.479464 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.479627 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.479491 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-config-volume\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.479627 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.479518 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.479627 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.479539 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea906d87-83fb-4631-a103-160a65b68956-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.479627 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.479565 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-web-config\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.479627 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.479598 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ea906d87-83fb-4631-a103-160a65b68956-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.479627 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.479622 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea906d87-83fb-4631-a103-160a65b68956-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.479921 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.479646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.479921 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.479691 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.580116 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.580084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.580247 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.580144 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.580247 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.580178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4njvk\" (UniqueName: \"kubernetes.io/projected/ea906d87-83fb-4631-a103-160a65b68956-kube-api-access-4njvk\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.580247 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.580215 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea906d87-83fb-4631-a103-160a65b68956-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.580247 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.580241 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea906d87-83fb-4631-a103-160a65b68956-config-out\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.580567 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.580265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.580567 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.580295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-config-volume\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.580567 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.580319 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.580567 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.580342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea906d87-83fb-4631-a103-160a65b68956-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.580567 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.580368 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-web-config\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.580567 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.580389 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ea906d87-83fb-4631-a103-160a65b68956-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.580567 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.580413 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea906d87-83fb-4631-a103-160a65b68956-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.580567 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.580432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.581098 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.580698 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-c5clp"] Sep 10 16:04:33.583773 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.582845 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ea906d87-83fb-4631-a103-160a65b68956-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.583773 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.583294 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.583773 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.583699 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.584330 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.583770 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea906d87-83fb-4631-a103-160a65b68956-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.584330 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.584061 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea906d87-83fb-4631-a103-160a65b68956-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.584687 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.584665 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea906d87-83fb-4631-a103-160a65b68956-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.584914 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.584834 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-config-volume\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.585578 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.585546 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea906d87-83fb-4631-a103-160a65b68956-config-out\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.585671 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.585606 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.585671 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.585641 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.586239 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.586216 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-web-config\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.587079 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.587061 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ea906d87-83fb-4631-a103-160a65b68956-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.590293 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.590269 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4njvk\" (UniqueName: \"kubernetes.io/projected/ea906d87-83fb-4631-a103-160a65b68956-kube-api-access-4njvk\") pod \"alertmanager-main-0\" (UID: \"ea906d87-83fb-4631-a103-160a65b68956\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:33.737852 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:33.737807 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 16:04:34.039219 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:04:34.039177 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea906d87_83fb_4631_a103_160a65b68956.slice/crio-ee95e431193bc9d19761af3dd46a7508b6b4181da5ac0d48a31e9e50112b21a3 WatchSource:0}: Error finding container ee95e431193bc9d19761af3dd46a7508b6b4181da5ac0d48a31e9e50112b21a3: Status 404 returned error can't find the container with id ee95e431193bc9d19761af3dd46a7508b6b4181da5ac0d48a31e9e50112b21a3 Sep 10 16:04:34.040115 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:34.040019 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 16:04:34.157632 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:34.157551 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mdf7t" event={"ID":"226aa2a7-ea44-4496-ab2d-1dae7592f64f","Type":"ContainerStarted","Data":"8c65cb12ce42064348a70c441f434714c378934cee7aeaa2ee9ee4d2620bb9e2"} Sep 10 16:04:34.159522 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:34.159490 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s7jg6" event={"ID":"77adaf4d-0b09-4ebc-983a-f53dea1c1cef","Type":"ContainerStarted","Data":"6ab3323680df1111a4df3cfeaa644907841e381f28bd86194c560e94eafb26d8"} Sep 10 16:04:34.161187 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:34.161095 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ea906d87-83fb-4631-a103-160a65b68956","Type":"ContainerStarted","Data":"ee95e431193bc9d19761af3dd46a7508b6b4181da5ac0d48a31e9e50112b21a3"} Sep 10 16:04:34.162750 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:34.162726 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" event={"ID":"fc478c19-a9a2-497b-899c-22af4307f668","Type":"ContainerStarted","Data":"5a018ed9b747cd289336033180a826b3caae8775576c24300cbf7ae009cf65ff"} Sep 10 16:04:34.186730 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:34.186532 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mdf7t" podStartSLOduration=67.248561767 podStartE2EDuration="1m8.186514052s" totalImagesPullingTime="937.952285ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:34.184427134 +0000 UTC m=+68.898695130" watchObservedRunningTime="2026-09-10 16:04:34.186514052 +0000 UTC m=+68.900782048" Sep 10 16:04:34.318876 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:34.318719 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:35.784860 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:35.784822 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:36.175818 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.175775 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s7jg6" event={"ID":"77adaf4d-0b09-4ebc-983a-f53dea1c1cef","Type":"ContainerStarted","Data":"346c833146e29cce1d967f68f025e18302cdc0b27f299d20a88a9bc10e08bfd7"} Sep 10 16:04:36.182388 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.182304 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:36.182705 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.182640 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7bc6j" event={"ID":"e8ccdc02-c0de-4b91-847e-ff741ec86efb","Type":"ContainerStarted","Data":"d575960683d19d7a33691df5e39026b9d7544b50701e10f59fde64b88914368d"} Sep 10 16:04:36.187797 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.187718 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv" event={"ID":"79c50c85-10c1-4f22-a8df-053ace504e0d","Type":"ContainerStarted","Data":"883115f07f9a211a5462074288b3f5d3a198f65d529c78e331357eb03abbf8dc"} Sep 10 16:04:36.223012 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.221083 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qnkmv" podStartSLOduration=1.362914475 podStartE2EDuration="4.221060996s" totalImagesPullingTime="2.858146521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:36.220246308 +0000 UTC m=+70.934514302" watchObservedRunningTime="2026-09-10 16:04:36.221060996 +0000 UTC m=+70.935328993" Sep 10 16:04:36.244403 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.244333 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7bc6j" podStartSLOduration=66.263991104 podStartE2EDuration="1m10.244307198s" totalImagesPullingTime="3.980316094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:36.242973938 +0000 UTC m=+70.957241960" watchObservedRunningTime="2026-09-10 16:04:36.244307198 +0000 UTC m=+70.958575195" Sep 10 16:04:36.362359 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.362272 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-8685b56967-j5p6l"] Sep 10 16:04:36.367362 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.366394 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.372106 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.371638 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2sp2d\"" Sep 10 16:04:36.372268 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.372198 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5c0m4745993bj\"" Sep 10 16:04:36.372334 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.372299 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 10 16:04:36.373589 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.372492 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 10 16:04:36.373589 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.372559 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 10 16:04:36.373589 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.372753 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 10 16:04:36.373589 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.372865 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 10 16:04:36.382027 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.381976 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8685b56967-j5p6l"] Sep 10 16:04:36.386721 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.386608 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:36.404115 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.403935 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beb584ec-bebe-4c2c-89e3-0975be9d07ad-metrics-client-ca\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.404115 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.404019 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/beb584ec-bebe-4c2c-89e3-0975be9d07ad-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.404115 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.404068 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/beb584ec-bebe-4c2c-89e3-0975be9d07ad-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.404401 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.404145 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/beb584ec-bebe-4c2c-89e3-0975be9d07ad-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.404401 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.404183 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6tq2\" (UniqueName: \"kubernetes.io/projected/beb584ec-bebe-4c2c-89e3-0975be9d07ad-kube-api-access-w6tq2\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.404401 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.404213 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/beb584ec-bebe-4c2c-89e3-0975be9d07ad-secret-thanos-querier-tls\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.404401 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.404246 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/beb584ec-bebe-4c2c-89e3-0975be9d07ad-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.404401 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.404286 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/beb584ec-bebe-4c2c-89e3-0975be9d07ad-secret-grpc-tls\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.483432 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.483350 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:36.505330 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.505291 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beb584ec-bebe-4c2c-89e3-0975be9d07ad-metrics-client-ca\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.505509 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.505346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/beb584ec-bebe-4c2c-89e3-0975be9d07ad-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.505509 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.505385 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/beb584ec-bebe-4c2c-89e3-0975be9d07ad-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.505509 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.505411 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/beb584ec-bebe-4c2c-89e3-0975be9d07ad-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.505509 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.505434 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6tq2\" (UniqueName: \"kubernetes.io/projected/beb584ec-bebe-4c2c-89e3-0975be9d07ad-kube-api-access-w6tq2\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.505509 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.505451 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/beb584ec-bebe-4c2c-89e3-0975be9d07ad-secret-thanos-querier-tls\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.505509 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.505471 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/beb584ec-bebe-4c2c-89e3-0975be9d07ad-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.505509 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.505497 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/beb584ec-bebe-4c2c-89e3-0975be9d07ad-secret-grpc-tls\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.506276 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.506210 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beb584ec-bebe-4c2c-89e3-0975be9d07ad-metrics-client-ca\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.509425 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.509394 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/beb584ec-bebe-4c2c-89e3-0975be9d07ad-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.510150 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.510117 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/beb584ec-bebe-4c2c-89e3-0975be9d07ad-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.510591 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.510565 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/beb584ec-bebe-4c2c-89e3-0975be9d07ad-secret-thanos-querier-tls\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.510870 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.510846 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/beb584ec-bebe-4c2c-89e3-0975be9d07ad-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.510961 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.510937 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/beb584ec-bebe-4c2c-89e3-0975be9d07ad-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.513673 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.513649 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/beb584ec-bebe-4c2c-89e3-0975be9d07ad-secret-grpc-tls\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.515169 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.515126 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6tq2\" (UniqueName: \"kubernetes.io/projected/beb584ec-bebe-4c2c-89e3-0975be9d07ad-kube-api-access-w6tq2\") pod \"thanos-querier-8685b56967-j5p6l\" (UID: \"beb584ec-bebe-4c2c-89e3-0975be9d07ad\") " pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.681455 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.681365 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:36.795263 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.795221 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-55d9744ccf-pvmwm"] Sep 10 16:04:36.798547 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.798515 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:36.801663 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.801597 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 16:04:36.803067 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.802915 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 10 16:04:36.803067 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.802958 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-blqm8\"" Sep 10 16:04:36.803067 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.802972 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 10 16:04:36.803421 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.803086 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 10 16:04:36.803421 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.803101 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-13c85b7ia8ald\"" Sep 10 16:04:36.813715 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.813682 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55d9744ccf-pvmwm"] Sep 10 16:04:36.909766 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.909717 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5e8bf19-3de3-4e44-8737-ee89b8218706-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:36.909942 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.909843 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f5e8bf19-3de3-4e44-8737-ee89b8218706-secret-metrics-server-tls\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:36.910031 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.909949 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8652h\" (UniqueName: \"kubernetes.io/projected/f5e8bf19-3de3-4e44-8737-ee89b8218706-kube-api-access-8652h\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:36.910031 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.910000 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f5e8bf19-3de3-4e44-8737-ee89b8218706-secret-metrics-server-client-certs\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:36.910158 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.910047 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f5e8bf19-3de3-4e44-8737-ee89b8218706-metrics-server-audit-profiles\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:36.910158 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.910066 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5e8bf19-3de3-4e44-8737-ee89b8218706-client-ca-bundle\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:36.910158 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:36.910118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f5e8bf19-3de3-4e44-8737-ee89b8218706-audit-log\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:37.013977 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.011543 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f5e8bf19-3de3-4e44-8737-ee89b8218706-metrics-server-audit-profiles\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:37.013977 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.011596 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5e8bf19-3de3-4e44-8737-ee89b8218706-client-ca-bundle\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:37.013977 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.011632 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f5e8bf19-3de3-4e44-8737-ee89b8218706-audit-log\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:37.013977 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.011665 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5e8bf19-3de3-4e44-8737-ee89b8218706-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:37.013977 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.011727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f5e8bf19-3de3-4e44-8737-ee89b8218706-secret-metrics-server-tls\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:37.013977 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.011767 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8652h\" (UniqueName: \"kubernetes.io/projected/f5e8bf19-3de3-4e44-8737-ee89b8218706-kube-api-access-8652h\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:37.013977 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.011794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f5e8bf19-3de3-4e44-8737-ee89b8218706-secret-metrics-server-client-certs\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:37.013977 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.012706 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f5e8bf19-3de3-4e44-8737-ee89b8218706-audit-log\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:37.013977 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.013203 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5e8bf19-3de3-4e44-8737-ee89b8218706-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:37.013977 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.013651 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f5e8bf19-3de3-4e44-8737-ee89b8218706-metrics-server-audit-profiles\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:37.014726 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.014663 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f5e8bf19-3de3-4e44-8737-ee89b8218706-secret-metrics-server-client-certs\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:37.015820 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.015798 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f5e8bf19-3de3-4e44-8737-ee89b8218706-secret-metrics-server-tls\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:37.017188 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.017145 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5e8bf19-3de3-4e44-8737-ee89b8218706-client-ca-bundle\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:37.025962 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.025894 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8652h\" (UniqueName: \"kubernetes.io/projected/f5e8bf19-3de3-4e44-8737-ee89b8218706-kube-api-access-8652h\") pod \"metrics-server-55d9744ccf-pvmwm\" (UID: \"f5e8bf19-3de3-4e44-8737-ee89b8218706\") " pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:37.052041 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.051970 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:37.065568 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.065533 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-kxhln"] Sep 10 16:04:37.070414 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.070388 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kxhln" Sep 10 16:04:37.075786 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.075758 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 10 16:04:37.075926 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.075805 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tlv82\"" Sep 10 16:04:37.080487 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.080454 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-kxhln"] Sep 10 16:04:37.112128 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.112085 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:37.112554 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.112499 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00eca29a-1f31-4247-b5ee-da7fca959e68-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-kxhln\" (UID: \"00eca29a-1f31-4247-b5ee-da7fca959e68\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kxhln" Sep 10 16:04:37.112908 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.112882 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9c8x\" (UniqueName: \"kubernetes.io/projected/00eca29a-1f31-4247-b5ee-da7fca959e68-kube-api-access-x9c8x\") pod \"monitoring-plugin-85bbbbbf4-kxhln\" (UID: \"00eca29a-1f31-4247-b5ee-da7fca959e68\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kxhln" Sep 10 16:04:37.143506 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.143463 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:37.194218 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.194179 2578 generic.go:356] "Generic (PLEG): container finished" podID="77adaf4d-0b09-4ebc-983a-f53dea1c1cef" containerID="346c833146e29cce1d967f68f025e18302cdc0b27f299d20a88a9bc10e08bfd7" exitCode=0 Sep 10 16:04:37.194377 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.194329 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s7jg6" event={"ID":"77adaf4d-0b09-4ebc-983a-f53dea1c1cef","Type":"ContainerDied","Data":"346c833146e29cce1d967f68f025e18302cdc0b27f299d20a88a9bc10e08bfd7"} Sep 10 16:04:37.213905 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.213876 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9c8x\" (UniqueName: \"kubernetes.io/projected/00eca29a-1f31-4247-b5ee-da7fca959e68-kube-api-access-x9c8x\") pod \"monitoring-plugin-85bbbbbf4-kxhln\" (UID: \"00eca29a-1f31-4247-b5ee-da7fca959e68\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kxhln" Sep 10 16:04:37.214053 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.214034 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00eca29a-1f31-4247-b5ee-da7fca959e68-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-kxhln\" (UID: \"00eca29a-1f31-4247-b5ee-da7fca959e68\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kxhln" Sep 10 16:04:37.217941 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.217869 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:37.218260 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.218235 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00eca29a-1f31-4247-b5ee-da7fca959e68-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-kxhln\" (UID: \"00eca29a-1f31-4247-b5ee-da7fca959e68\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kxhln" Sep 10 16:04:37.226321 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.226290 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9c8x\" (UniqueName: \"kubernetes.io/projected/00eca29a-1f31-4247-b5ee-da7fca959e68-kube-api-access-x9c8x\") pod \"monitoring-plugin-85bbbbbf4-kxhln\" (UID: \"00eca29a-1f31-4247-b5ee-da7fca959e68\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kxhln" Sep 10 16:04:37.384536 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.384501 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kxhln" Sep 10 16:04:37.500698 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.499999 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55d9744ccf-pvmwm"] Sep 10 16:04:37.511469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.511338 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8685b56967-j5p6l"] Sep 10 16:04:37.514336 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:04:37.511898 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5e8bf19_3de3_4e44_8737_ee89b8218706.slice/crio-e63aea46ddf627473ac8e80025476c529ff1b46c18b851368c5f60e435fb4d80 WatchSource:0}: Error finding container e63aea46ddf627473ac8e80025476c529ff1b46c18b851368c5f60e435fb4d80: Status 404 returned error can't find the container with id e63aea46ddf627473ac8e80025476c529ff1b46c18b851368c5f60e435fb4d80 Sep 10 16:04:37.518550 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:04:37.518503 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb584ec_bebe_4c2c_89e3_0975be9d07ad.slice/crio-700398c21b9c3f115767245b202b480976e8725bd530cee86603525020a16fda WatchSource:0}: Error finding container 700398c21b9c3f115767245b202b480976e8725bd530cee86603525020a16fda: Status 404 returned error can't find the container with id 700398c21b9c3f115767245b202b480976e8725bd530cee86603525020a16fda Sep 10 16:04:37.681160 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:37.681049 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-kxhln"] Sep 10 16:04:37.684110 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:04:37.684078 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00eca29a_1f31_4247_b5ee_da7fca959e68.slice/crio-0dac9e8e40f11bff209e8692f79ad526c4d8c2443b5709074571a77c21f78768 WatchSource:0}: Error finding container 0dac9e8e40f11bff209e8692f79ad526c4d8c2443b5709074571a77c21f78768: Status 404 returned error can't find the container with id 0dac9e8e40f11bff209e8692f79ad526c4d8c2443b5709074571a77c21f78768 Sep 10 16:04:38.022713 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.022668 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:38.125141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.125070 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:38.201352 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.201251 2578 generic.go:356] "Generic (PLEG): container finished" podID="ea906d87-83fb-4631-a103-160a65b68956" containerID="84c66eeb007a18226977c737fe1d45ce14c701dee2f85d66c7d4e721a81e5ca7" exitCode=0 Sep 10 16:04:38.201352 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.201334 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ea906d87-83fb-4631-a103-160a65b68956","Type":"ContainerDied","Data":"84c66eeb007a18226977c737fe1d45ce14c701dee2f85d66c7d4e721a81e5ca7"} Sep 10 16:04:38.204766 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.204614 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" event={"ID":"fc478c19-a9a2-497b-899c-22af4307f668","Type":"ContainerStarted","Data":"003d3bb2b6ee61b1992512ac8f88f5f011dd9e605d3897ca8fae0479f606ce8f"} Sep 10 16:04:38.204766 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.204683 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" event={"ID":"fc478c19-a9a2-497b-899c-22af4307f668","Type":"ContainerStarted","Data":"0278f4aee9679cd8ed9dba39a34b3d0b512854936d5a99fe70ef5af6aa437225"} Sep 10 16:04:38.204766 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.204717 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" event={"ID":"fc478c19-a9a2-497b-899c-22af4307f668","Type":"ContainerStarted","Data":"5c781ad4d4ffd7f4a7d02c2ebc975ede2a617e7437f1fb7816bb2558c7c9f98a"} Sep 10 16:04:38.206324 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.206291 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" event={"ID":"beb584ec-bebe-4c2c-89e3-0975be9d07ad","Type":"ContainerStarted","Data":"700398c21b9c3f115767245b202b480976e8725bd530cee86603525020a16fda"} Sep 10 16:04:38.207894 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.207843 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kxhln" event={"ID":"00eca29a-1f31-4247-b5ee-da7fca959e68","Type":"ContainerStarted","Data":"0dac9e8e40f11bff209e8692f79ad526c4d8c2443b5709074571a77c21f78768"} Sep 10 16:04:38.211334 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.211288 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s7jg6" event={"ID":"77adaf4d-0b09-4ebc-983a-f53dea1c1cef","Type":"ContainerStarted","Data":"6072253203e63303d9039c5ca7da640d5dbec077b4b2489bf23f8cf685d714cf"} Sep 10 16:04:38.211439 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.211338 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s7jg6" event={"ID":"77adaf4d-0b09-4ebc-983a-f53dea1c1cef","Type":"ContainerStarted","Data":"88e4a370f31f187dcbb1467b410d3dd79923305c24530db92247b8083acd3bd1"} Sep 10 16:04:38.213038 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.212927 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" event={"ID":"f5e8bf19-3de3-4e44-8737-ee89b8218706","Type":"ContainerStarted","Data":"e63aea46ddf627473ac8e80025476c529ff1b46c18b851368c5f60e435fb4d80"} Sep 10 16:04:38.273824 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.273684 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-c5clp" podStartSLOduration=2.642004795 podStartE2EDuration="6.273643698s" totalImagesPullingTime="3.631638903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:38.273481777 +0000 UTC m=+72.987749772" watchObservedRunningTime="2026-09-10 16:04:38.273643698 +0000 UTC m=+72.987911694" Sep 10 16:04:38.275049 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.274997 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s7jg6" podStartSLOduration=3.498421326 podStartE2EDuration="6.274966913s" totalImagesPullingTime="2.675765308s" totalInitContainerRuntime="100.780279ms" isStatefulPod=true podCreationTimestamp="2026-09-10 16:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:38.25307314 +0000 UTC m=+72.967341137" watchObservedRunningTime="2026-09-10 16:04:38.274966913 +0000 UTC m=+72.989234920" Sep 10 16:04:38.574508 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.574371 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:38.585535 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.583210 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 16:04:38.592524 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.592491 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.596837 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.596799 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 10 16:04:38.599797 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.597107 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 10 16:04:38.599797 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.597364 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 10 16:04:38.599797 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.597560 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 10 16:04:38.599797 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.597779 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 10 16:04:38.599797 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.597953 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 10 16:04:38.599797 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.598222 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 10 16:04:38.599797 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.598454 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 10 16:04:38.599797 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.598678 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 10 16:04:38.599797 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.598806 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1puql2e4a84tv\"" Sep 10 16:04:38.599797 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.598912 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 10 16:04:38.599797 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.599116 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 10 16:04:38.599797 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.599135 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 10 16:04:38.599797 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.599323 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7jf5k\"" Sep 10 16:04:38.602037 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.602012 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 10 16:04:38.611817 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.611003 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 16:04:38.612454 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.612425 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 10 16:04:38.629557 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.629514 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.630052 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.629571 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55rlw\" (UniqueName: \"kubernetes.io/projected/73d81deb-5b52-4748-9aac-ec44cb99f3b8-kube-api-access-55rlw\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.630052 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.629613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73d81deb-5b52-4748-9aac-ec44cb99f3b8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.630052 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.629653 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-config\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.630052 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.629683 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73d81deb-5b52-4748-9aac-ec44cb99f3b8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.630052 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.629734 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73d81deb-5b52-4748-9aac-ec44cb99f3b8-config-out\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.630052 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.629761 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.630052 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.629823 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.630052 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.629864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.630052 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.629891 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.630052 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.629925 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.630052 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.629956 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.630779 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.630692 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.630779 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.630755 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.630912 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.630797 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.630912 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.630830 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-web-config\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.630912 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.630860 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.630912 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.630884 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.630912 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.630899 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.631180 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.630954 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.731976 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.731931 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.732177 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.732059 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.732177 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.732101 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.732177 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.732147 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.732322 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.732208 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55rlw\" (UniqueName: \"kubernetes.io/projected/73d81deb-5b52-4748-9aac-ec44cb99f3b8-kube-api-access-55rlw\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.732322 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.732258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73d81deb-5b52-4748-9aac-ec44cb99f3b8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.732322 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.732284 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-config\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.732322 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.732314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73d81deb-5b52-4748-9aac-ec44cb99f3b8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.732507 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.732398 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73d81deb-5b52-4748-9aac-ec44cb99f3b8-config-out\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.732507 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.732435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.732507 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.732461 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.732636 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.732485 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.732636 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.732542 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.732636 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.732572 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.732636 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.732608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.732808 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.732647 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.732808 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.732708 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.732808 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.732759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.732808 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.732791 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-web-config\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.733009 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.732820 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.733009 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.732965 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.734783 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.733454 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.734783 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.734052 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.735455 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.735425 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73d81deb-5b52-4748-9aac-ec44cb99f3b8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.738730 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.737689 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.738730 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.738198 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.738730 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.738290 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.739021 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.738751 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.739709 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.739514 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.739709 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.739615 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73d81deb-5b52-4748-9aac-ec44cb99f3b8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.740696 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.740651 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73d81deb-5b52-4748-9aac-ec44cb99f3b8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.741240 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.741214 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73d81deb-5b52-4748-9aac-ec44cb99f3b8-config-out\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.742725 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.742698 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-web-config\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.742836 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.742726 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.742836 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.742764 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.743405 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.743259 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.743836 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.743777 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.744413 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.744363 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.746673 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.746620 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/73d81deb-5b52-4748-9aac-ec44cb99f3b8-config\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.746847 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.746824 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55rlw\" (UniqueName: \"kubernetes.io/projected/73d81deb-5b52-4748-9aac-ec44cb99f3b8-kube-api-access-55rlw\") pod \"prometheus-k8s-0\" (UID: \"73d81deb-5b52-4748-9aac-ec44cb99f3b8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:38.912274 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:38.912181 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:39.427561 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.426940 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-864755d77-4d468"] Sep 10 16:04:39.458130 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.458096 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cf55fc6fd-74626"] Sep 10 16:04:39.462667 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.462100 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.471630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.470998 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cf55fc6fd-74626"] Sep 10 16:04:39.541523 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.541482 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-trusted-ca-bundle\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.541708 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.541545 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-oauth-serving-cert\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.541708 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.541588 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-console-config\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.541708 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.541628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-service-ca\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.541708 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.541699 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9531e6c-4198-4e61-a702-614a4c6a05de-console-oauth-config\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.541919 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.541728 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9531e6c-4198-4e61-a702-614a4c6a05de-console-serving-cert\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.541919 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.541760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d46pp\" (UniqueName: \"kubernetes.io/projected/a9531e6c-4198-4e61-a702-614a4c6a05de-kube-api-access-d46pp\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.642258 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.642217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d46pp\" (UniqueName: \"kubernetes.io/projected/a9531e6c-4198-4e61-a702-614a4c6a05de-kube-api-access-d46pp\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.642445 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.642290 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-trusted-ca-bundle\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.642445 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.642312 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-oauth-serving-cert\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.642445 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.642340 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-console-config\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.642445 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.642371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-service-ca\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.642445 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.642416 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9531e6c-4198-4e61-a702-614a4c6a05de-console-oauth-config\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.642445 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.642432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9531e6c-4198-4e61-a702-614a4c6a05de-console-serving-cert\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.643833 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.643799 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-oauth-serving-cert\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.643833 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.643819 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-trusted-ca-bundle\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.644634 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.644607 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-service-ca\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.644729 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.644695 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-console-config\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.648195 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.648150 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9531e6c-4198-4e61-a702-614a4c6a05de-console-serving-cert\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.649683 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.649639 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9531e6c-4198-4e61-a702-614a4c6a05de-console-oauth-config\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.654365 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.654321 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d46pp\" (UniqueName: \"kubernetes.io/projected/a9531e6c-4198-4e61-a702-614a4c6a05de-kube-api-access-d46pp\") pod \"console-5cf55fc6fd-74626\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:39.782091 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:39.781830 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:41.162551 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:41.162302 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-864755d77-4d468" Sep 10 16:04:41.255132 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:41.255015 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kxhln" Sep 10 16:04:41.257037 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:41.255533 2578 patch_prober.go:28] interesting pod/monitoring-plugin-85bbbbbf4-kxhln container/monitoring-plugin namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.134.0.18:9443/health\": dial tcp 10.134.0.18:9443: connect: connection refused" start-of-body= Sep 10 16:04:41.257037 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:41.255640 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kxhln" podUID="00eca29a-1f31-4247-b5ee-da7fca959e68" containerName="monitoring-plugin" probeResult="failure" output="Get \"https://10.134.0.18:9443/health\": dial tcp 10.134.0.18:9443: connect: connection refused" Sep 10 16:04:41.264554 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:41.264517 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" event={"ID":"beb584ec-bebe-4c2c-89e3-0975be9d07ad","Type":"ContainerStarted","Data":"45dd7ca65cb584ece86e0c73fd4ebdce2fd716d4bd3fade493208698d025b178"} Sep 10 16:04:41.267540 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:41.267509 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ljtzt" event={"ID":"2e535dce-4a4c-4acc-84a3-edaba69c6a9e","Type":"ContainerStarted","Data":"1aa0c9a05ab3932117d8f33499bb1732c3e0f69cb9b10b60c0202e5e0c1c98f9"} Sep 10 16:04:41.267849 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:41.267802 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:04:41.271511 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:41.271459 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kxhln" podStartSLOduration=0.843150084 podStartE2EDuration="4.271440107s" totalImagesPullingTime="3.428290023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:41.270590275 +0000 UTC m=+75.984858269" watchObservedRunningTime="2026-09-10 16:04:41.271440107 +0000 UTC m=+75.985708102" Sep 10 16:04:41.287914 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:41.287672 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ljtzt" podStartSLOduration=66.28097874 podStartE2EDuration="1m15.287654602s" totalImagesPullingTime="9.006675862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:41.287417618 +0000 UTC m=+76.001685614" watchObservedRunningTime="2026-09-10 16:04:41.287654602 +0000 UTC m=+76.001922593" Sep 10 16:04:41.402007 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:41.400814 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cf55fc6fd-74626"] Sep 10 16:04:41.404196 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:04:41.404138 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9531e6c_4198_4e61_a702_614a4c6a05de.slice/crio-4dd73c7f839dae98258467e0951684a1e9818c11d20f8dc44bbbc03f685b9b12 WatchSource:0}: Error finding container 4dd73c7f839dae98258467e0951684a1e9818c11d20f8dc44bbbc03f685b9b12: Status 404 returned error can't find the container with id 4dd73c7f839dae98258467e0951684a1e9818c11d20f8dc44bbbc03f685b9b12 Sep 10 16:04:41.418871 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:41.418623 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 16:04:41.433178 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:04:41.433155 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d81deb_5b52_4748_9aac_ec44cb99f3b8.slice/crio-79d445f185eb3c0ff2dab4ada210e1621ff731ede68a4c179ed823bb5f57065a WatchSource:0}: Error finding container 79d445f185eb3c0ff2dab4ada210e1621ff731ede68a4c179ed823bb5f57065a: Status 404 returned error can't find the container with id 79d445f185eb3c0ff2dab4ada210e1621ff731ede68a4c179ed823bb5f57065a Sep 10 16:04:42.275057 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:42.275021 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ea906d87-83fb-4631-a103-160a65b68956","Type":"ContainerStarted","Data":"f16592e616aa42024c4139050a899417cf6777d66da838c7b938d3556a66b7ad"} Sep 10 16:04:42.275427 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:42.275098 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ea906d87-83fb-4631-a103-160a65b68956","Type":"ContainerStarted","Data":"5231a068b6be82aa96ced5f08f521e24a717c2888c2314c06694741adc9d94a4"} Sep 10 16:04:42.275427 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:42.275138 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ea906d87-83fb-4631-a103-160a65b68956","Type":"ContainerStarted","Data":"d5676ada58f267cf81f0a73b3e15c947b2f701c8669ce2f8d5205aad3895c2bb"} Sep 10 16:04:42.275427 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:42.275162 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ea906d87-83fb-4631-a103-160a65b68956","Type":"ContainerStarted","Data":"6ede766623296e14693dc8d3beb6a5f00af0fafc5a59b3fbbe21c86905a881c0"} Sep 10 16:04:42.275427 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:42.275185 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ea906d87-83fb-4631-a103-160a65b68956","Type":"ContainerStarted","Data":"70c1d7d7c3ab92942065fb16b6d4dc3801449cff9264b36761b1936ff3c13dc9"} Sep 10 16:04:42.276936 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:42.276908 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cf55fc6fd-74626" event={"ID":"a9531e6c-4198-4e61-a702-614a4c6a05de","Type":"ContainerStarted","Data":"e5c54fae7d651596fc62456662540d6e680fccde2e2d2f5c86fedf2ad6b36a07"} Sep 10 16:04:42.277066 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:42.276959 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cf55fc6fd-74626" event={"ID":"a9531e6c-4198-4e61-a702-614a4c6a05de","Type":"ContainerStarted","Data":"4dd73c7f839dae98258467e0951684a1e9818c11d20f8dc44bbbc03f685b9b12"} Sep 10 16:04:42.280131 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:42.280105 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" event={"ID":"beb584ec-bebe-4c2c-89e3-0975be9d07ad","Type":"ContainerStarted","Data":"aca53c4ffa2cd9cc4c2567e336b7afef406e9f01486d6e23549494b7dad18fa7"} Sep 10 16:04:42.280228 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:42.280181 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" event={"ID":"beb584ec-bebe-4c2c-89e3-0975be9d07ad","Type":"ContainerStarted","Data":"7fd2acadeb24fa986ef36ceb60c96dceafec0f2e031cd808fe574e0a6ee4237c"} Sep 10 16:04:42.280283 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:42.280273 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" event={"ID":"beb584ec-bebe-4c2c-89e3-0975be9d07ad","Type":"ContainerStarted","Data":"b60ebcf847d2feeef9f0e73424bb59d16a16523b887164dfaeb89bcd15a920ba"} Sep 10 16:04:42.280338 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:42.280311 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" event={"ID":"beb584ec-bebe-4c2c-89e3-0975be9d07ad","Type":"ContainerStarted","Data":"75898296e5be4c2431f85007193db3cda250d70c73aa391c6620c3a6734fd32a"} Sep 10 16:04:42.281870 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:42.281847 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kxhln" event={"ID":"00eca29a-1f31-4247-b5ee-da7fca959e68","Type":"ContainerStarted","Data":"1882a645a5d57245b7ea2aa32f94dbcf7e50f85b4d43f8405e59825367671f60"} Sep 10 16:04:42.283748 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:42.283712 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" event={"ID":"f5e8bf19-3de3-4e44-8737-ee89b8218706","Type":"ContainerStarted","Data":"f554ba2a54dc222b11e614351a02be9ce7ea92bd961b170a627d158d753354ac"} Sep 10 16:04:42.286768 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:42.286299 2578 generic.go:356] "Generic (PLEG): container finished" podID="73d81deb-5b52-4748-9aac-ec44cb99f3b8" containerID="872c74a0d24d13200d788711277b5c44ab1fbc4c6152faed4dac218394610cc1" exitCode=0 Sep 10 16:04:42.286768 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:42.286653 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73d81deb-5b52-4748-9aac-ec44cb99f3b8","Type":"ContainerDied","Data":"872c74a0d24d13200d788711277b5c44ab1fbc4c6152faed4dac218394610cc1"} Sep 10 16:04:42.286768 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:42.286723 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73d81deb-5b52-4748-9aac-ec44cb99f3b8","Type":"ContainerStarted","Data":"79d445f185eb3c0ff2dab4ada210e1621ff731ede68a4c179ed823bb5f57065a"} Sep 10 16:04:42.287872 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:42.287759 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kxhln" Sep 10 16:04:42.297740 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:42.297686 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cf55fc6fd-74626" podStartSLOduration=3.29766733 podStartE2EDuration="3.29766733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:42.296707987 +0000 UTC m=+77.010975983" watchObservedRunningTime="2026-09-10 16:04:42.29766733 +0000 UTC m=+77.011935326" Sep 10 16:04:42.314602 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:42.314517 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" podStartSLOduration=2.713160963 podStartE2EDuration="6.31449353s" totalImagesPullingTime="3.601332567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:42.31349097 +0000 UTC m=+77.027758966" watchObservedRunningTime="2026-09-10 16:04:42.31449353 +0000 UTC m=+77.028761526" Sep 10 16:04:43.043841 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:43.043806 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:43.294250 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:43.294136 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ea906d87-83fb-4631-a103-160a65b68956","Type":"ContainerStarted","Data":"977bff79e48d9c41e534b9a896775da48e5f0ed6d179e57176afb81a15f4e46a"} Sep 10 16:04:43.297273 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:43.297242 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" event={"ID":"beb584ec-bebe-4c2c-89e3-0975be9d07ad","Type":"ContainerStarted","Data":"826fe6b6c561c602c54057e140455c08581c8654aa1473c8c112b32e1b60dff5"} Sep 10 16:04:43.323431 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:43.323378 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.171178356 podStartE2EDuration="10.323361056s" totalImagesPullingTime="7.125069394s" totalInitContainerRuntime="27.113306ms" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:43.321874595 +0000 UTC m=+78.036142628" watchObservedRunningTime="2026-09-10 16:04:43.323361056 +0000 UTC m=+78.037629093" Sep 10 16:04:43.345953 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:43.345894 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" podStartSLOduration=2.9949218440000003 podStartE2EDuration="7.345874733s" totalImagesPullingTime="4.350952889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:43.344378154 +0000 UTC m=+78.058646162" watchObservedRunningTime="2026-09-10 16:04:43.345874733 +0000 UTC m=+78.060142728" Sep 10 16:04:44.304275 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:44.304234 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:44.681215 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:44.681108 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:44.780967 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:44.780932 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:44.882193 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:44.882152 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:44.942123 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:44.942037 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:46.208421 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:46.208374 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:47.322096 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:47.321889 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73d81deb-5b52-4748-9aac-ec44cb99f3b8","Type":"ContainerStarted","Data":"01162bf08d7ca19e8fc28a8ece6203a427809da0b23b1f01a22058d07ecc89da"} Sep 10 16:04:47.322096 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:47.321952 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73d81deb-5b52-4748-9aac-ec44cb99f3b8","Type":"ContainerStarted","Data":"8155dec163d72ff26b4fa3d196db5b154b1b51e14499c1c1dee1881c17a702db"} Sep 10 16:04:47.322096 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:47.321979 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73d81deb-5b52-4748-9aac-ec44cb99f3b8","Type":"ContainerStarted","Data":"9c84c16f2c8d71e990128ddc9b5a3f2c0b9b5652dd5e6b43ae1bb1fb7231151b"} Sep 10 16:04:47.322096 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:47.322018 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73d81deb-5b52-4748-9aac-ec44cb99f3b8","Type":"ContainerStarted","Data":"9846f70c2e5b692f305146d8c2e90921f91cc3fb2933fb844b6071804e245506"} Sep 10 16:04:47.322096 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:47.322040 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73d81deb-5b52-4748-9aac-ec44cb99f3b8","Type":"ContainerStarted","Data":"14f58599402a4de7f88db22e050e1b557fed10cc1f0d17cffa8cac5cd4ea4ba9"} Sep 10 16:04:47.322096 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:47.322068 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73d81deb-5b52-4748-9aac-ec44cb99f3b8","Type":"ContainerStarted","Data":"da82edf2884178d705255f05e989e8ea564d997efa1952b653b8e161862533f5"} Sep 10 16:04:47.353163 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:47.353097 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.860403357 podStartE2EDuration="9.35307556s" totalImagesPullingTime="4.467460141s" totalInitContainerRuntime="25.212062ms" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:47.350554738 +0000 UTC m=+82.064822733" watchObservedRunningTime="2026-09-10 16:04:47.35307556 +0000 UTC m=+82.067343555" Sep 10 16:04:48.912669 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:48.912624 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:04:48.974524 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:48.974489 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:49.037695 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:49.037659 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:49.784929 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:49.784893 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:49.785141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:49.784945 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:49.788024 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:49.788003 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:50.137407 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:50.137332 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:50.314036 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:50.314005 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:50.316035 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:50.316012 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-8685b56967-j5p6l" Sep 10 16:04:50.342859 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:50.342821 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:04:50.399188 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:50.399103 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-655d6db7df-8pm9q"] Sep 10 16:04:50.514534 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:50.514486 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:50.617402 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:50.617374 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:51.502430 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:51.502393 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:51.602425 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:51.602394 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:52.630729 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:52.630696 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:52.723108 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:52.723068 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:56.419382 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:56.419343 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:56.496912 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:56.496875 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:04:57.113009 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:57.112946 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:04:57.113218 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:04:57.113036 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:05:04.464083 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.464018 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-864755d77-4d468" podUID="39d7944e-f156-4664-ab8b-37506c5537e4" containerName="console" containerID="cri-o://481cad342143ac53d814a063cbec6bc2eade2b1eb95318bd14be4add46c18e12" gracePeriod=15 Sep 10 16:05:04.708674 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.708648 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-864755d77-4d468" Sep 10 16:05:04.788662 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.788628 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39d7944e-f156-4664-ab8b-37506c5537e4-console-oauth-config\") pod \"39d7944e-f156-4664-ab8b-37506c5537e4\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " Sep 10 16:05:04.788662 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.788668 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39d7944e-f156-4664-ab8b-37506c5537e4-console-serving-cert\") pod \"39d7944e-f156-4664-ab8b-37506c5537e4\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " Sep 10 16:05:04.788868 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.788688 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-console-config\") pod \"39d7944e-f156-4664-ab8b-37506c5537e4\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " Sep 10 16:05:04.788868 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.788735 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4grvp\" (UniqueName: \"kubernetes.io/projected/39d7944e-f156-4664-ab8b-37506c5537e4-kube-api-access-4grvp\") pod \"39d7944e-f156-4664-ab8b-37506c5537e4\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " Sep 10 16:05:04.788868 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.788814 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-service-ca\") pod \"39d7944e-f156-4664-ab8b-37506c5537e4\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " Sep 10 16:05:04.788868 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.788849 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-trusted-ca-bundle\") pod \"39d7944e-f156-4664-ab8b-37506c5537e4\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " Sep 10 16:05:04.789096 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.788906 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-oauth-serving-cert\") pod \"39d7944e-f156-4664-ab8b-37506c5537e4\" (UID: \"39d7944e-f156-4664-ab8b-37506c5537e4\") " Sep 10 16:05:04.789241 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.789203 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-console-config" (OuterVolumeSpecName: "console-config") pod "39d7944e-f156-4664-ab8b-37506c5537e4" (UID: "39d7944e-f156-4664-ab8b-37506c5537e4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:05:04.789376 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.789321 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "39d7944e-f156-4664-ab8b-37506c5537e4" (UID: "39d7944e-f156-4664-ab8b-37506c5537e4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:05:04.789376 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.789337 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-service-ca" (OuterVolumeSpecName: "service-ca") pod "39d7944e-f156-4664-ab8b-37506c5537e4" (UID: "39d7944e-f156-4664-ab8b-37506c5537e4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:05:04.789376 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.789342 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "39d7944e-f156-4664-ab8b-37506c5537e4" (UID: "39d7944e-f156-4664-ab8b-37506c5537e4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:05:04.791165 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.791139 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39d7944e-f156-4664-ab8b-37506c5537e4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "39d7944e-f156-4664-ab8b-37506c5537e4" (UID: "39d7944e-f156-4664-ab8b-37506c5537e4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:05:04.791289 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.791177 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39d7944e-f156-4664-ab8b-37506c5537e4-kube-api-access-4grvp" (OuterVolumeSpecName: "kube-api-access-4grvp") pod "39d7944e-f156-4664-ab8b-37506c5537e4" (UID: "39d7944e-f156-4664-ab8b-37506c5537e4"). InnerVolumeSpecName "kube-api-access-4grvp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:05:04.791289 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.791228 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39d7944e-f156-4664-ab8b-37506c5537e4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "39d7944e-f156-4664-ab8b-37506c5537e4" (UID: "39d7944e-f156-4664-ab8b-37506c5537e4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:05:04.890400 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.890360 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-service-ca\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:05:04.890400 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.890396 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-trusted-ca-bundle\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:05:04.890400 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.890406 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-oauth-serving-cert\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:05:04.890629 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.890415 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39d7944e-f156-4664-ab8b-37506c5537e4-console-oauth-config\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:05:04.890629 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.890424 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39d7944e-f156-4664-ab8b-37506c5537e4-console-serving-cert\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:05:04.890629 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.890432 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39d7944e-f156-4664-ab8b-37506c5537e4-console-config\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:05:04.890629 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:04.890440 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4grvp\" (UniqueName: \"kubernetes.io/projected/39d7944e-f156-4664-ab8b-37506c5537e4-kube-api-access-4grvp\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:05:05.402243 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:05.402200 2578 generic.go:356] "Generic (PLEG): container finished" podID="39d7944e-f156-4664-ab8b-37506c5537e4" containerID="481cad342143ac53d814a063cbec6bc2eade2b1eb95318bd14be4add46c18e12" exitCode=0 Sep 10 16:05:05.402414 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:05.402260 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-864755d77-4d468" Sep 10 16:05:05.402414 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:05.402288 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-864755d77-4d468" event={"ID":"39d7944e-f156-4664-ab8b-37506c5537e4","Type":"ContainerDied","Data":"481cad342143ac53d814a063cbec6bc2eade2b1eb95318bd14be4add46c18e12"} Sep 10 16:05:05.402414 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:05.402342 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-864755d77-4d468" event={"ID":"39d7944e-f156-4664-ab8b-37506c5537e4","Type":"ContainerDied","Data":"f943a246a145c4c2a1a02556d0d8fbdab33969fa8dd019e6590697bce7d13040"} Sep 10 16:05:05.402414 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:05.402363 2578 scope.go:117] "RemoveContainer" containerID="481cad342143ac53d814a063cbec6bc2eade2b1eb95318bd14be4add46c18e12" Sep 10 16:05:05.412011 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:05.411973 2578 scope.go:117] "RemoveContainer" containerID="481cad342143ac53d814a063cbec6bc2eade2b1eb95318bd14be4add46c18e12" Sep 10 16:05:05.412342 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:05:05.412314 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"481cad342143ac53d814a063cbec6bc2eade2b1eb95318bd14be4add46c18e12\": container with ID starting with 481cad342143ac53d814a063cbec6bc2eade2b1eb95318bd14be4add46c18e12 not found: ID does not exist" containerID="481cad342143ac53d814a063cbec6bc2eade2b1eb95318bd14be4add46c18e12" Sep 10 16:05:05.412391 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:05.412351 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"481cad342143ac53d814a063cbec6bc2eade2b1eb95318bd14be4add46c18e12"} err="failed to get container status \"481cad342143ac53d814a063cbec6bc2eade2b1eb95318bd14be4add46c18e12\": rpc error: code = NotFound desc = could not find container \"481cad342143ac53d814a063cbec6bc2eade2b1eb95318bd14be4add46c18e12\": container with ID starting with 481cad342143ac53d814a063cbec6bc2eade2b1eb95318bd14be4add46c18e12 not found: ID does not exist" Sep 10 16:05:05.439520 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:05.439480 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-864755d77-4d468"] Sep 10 16:05:05.444488 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:05.444455 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-864755d77-4d468"] Sep 10 16:05:05.784833 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:05.784798 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39d7944e-f156-4664-ab8b-37506c5537e4" path="/var/lib/kubelet/pods/39d7944e-f156-4664-ab8b-37506c5537e4/volumes" Sep 10 16:05:08.755388 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:08.755353 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:05:08.856756 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:08.856720 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:05:08.939592 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:08.939563 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:05:12.289571 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:12.289539 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ljtzt" Sep 10 16:05:15.419474 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:15.419430 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-655d6db7df-8pm9q" podUID="91d5f630-cd46-4a46-b320-923fa4aa5b71" containerName="console" containerID="cri-o://960da0e7413dad6073bed2b3a85665e15ad158c9535d2ce5751acee40596ee24" gracePeriod=15 Sep 10 16:05:15.659234 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:15.659209 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:05:15.685648 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:15.685573 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91d5f630-cd46-4a46-b320-923fa4aa5b71-console-config\") pod \"91d5f630-cd46-4a46-b320-923fa4aa5b71\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " Sep 10 16:05:15.685648 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:15.685612 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91d5f630-cd46-4a46-b320-923fa4aa5b71-service-ca\") pod \"91d5f630-cd46-4a46-b320-923fa4aa5b71\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " Sep 10 16:05:15.685648 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:15.685639 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvtcj\" (UniqueName: \"kubernetes.io/projected/91d5f630-cd46-4a46-b320-923fa4aa5b71-kube-api-access-jvtcj\") pod \"91d5f630-cd46-4a46-b320-923fa4aa5b71\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " Sep 10 16:05:15.685908 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:15.685664 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91d5f630-cd46-4a46-b320-923fa4aa5b71-oauth-serving-cert\") pod \"91d5f630-cd46-4a46-b320-923fa4aa5b71\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " Sep 10 16:05:15.686083 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:15.686058 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91d5f630-cd46-4a46-b320-923fa4aa5b71-console-config" (OuterVolumeSpecName: "console-config") pod "91d5f630-cd46-4a46-b320-923fa4aa5b71" (UID: "91d5f630-cd46-4a46-b320-923fa4aa5b71"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:05:15.686184 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:15.686158 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91d5f630-cd46-4a46-b320-923fa4aa5b71-service-ca" (OuterVolumeSpecName: "service-ca") pod "91d5f630-cd46-4a46-b320-923fa4aa5b71" (UID: "91d5f630-cd46-4a46-b320-923fa4aa5b71"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:05:15.686232 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:15.686163 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91d5f630-cd46-4a46-b320-923fa4aa5b71-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "91d5f630-cd46-4a46-b320-923fa4aa5b71" (UID: "91d5f630-cd46-4a46-b320-923fa4aa5b71"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:05:15.687940 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:15.687913 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91d5f630-cd46-4a46-b320-923fa4aa5b71-kube-api-access-jvtcj" (OuterVolumeSpecName: "kube-api-access-jvtcj") pod "91d5f630-cd46-4a46-b320-923fa4aa5b71" (UID: "91d5f630-cd46-4a46-b320-923fa4aa5b71"). InnerVolumeSpecName "kube-api-access-jvtcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:05:15.786172 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:15.786143 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91d5f630-cd46-4a46-b320-923fa4aa5b71-console-oauth-config\") pod \"91d5f630-cd46-4a46-b320-923fa4aa5b71\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " Sep 10 16:05:15.786359 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:15.786186 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91d5f630-cd46-4a46-b320-923fa4aa5b71-console-serving-cert\") pod \"91d5f630-cd46-4a46-b320-923fa4aa5b71\" (UID: \"91d5f630-cd46-4a46-b320-923fa4aa5b71\") " Sep 10 16:05:15.786466 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:15.786442 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91d5f630-cd46-4a46-b320-923fa4aa5b71-console-config\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:05:15.786466 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:15.786470 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91d5f630-cd46-4a46-b320-923fa4aa5b71-service-ca\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:05:15.786650 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:15.786481 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvtcj\" (UniqueName: \"kubernetes.io/projected/91d5f630-cd46-4a46-b320-923fa4aa5b71-kube-api-access-jvtcj\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:05:15.786650 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:15.786494 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91d5f630-cd46-4a46-b320-923fa4aa5b71-oauth-serving-cert\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:05:15.788644 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:15.788611 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91d5f630-cd46-4a46-b320-923fa4aa5b71-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "91d5f630-cd46-4a46-b320-923fa4aa5b71" (UID: "91d5f630-cd46-4a46-b320-923fa4aa5b71"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:05:15.788751 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:15.788695 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91d5f630-cd46-4a46-b320-923fa4aa5b71-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "91d5f630-cd46-4a46-b320-923fa4aa5b71" (UID: "91d5f630-cd46-4a46-b320-923fa4aa5b71"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:05:15.887426 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:15.887362 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91d5f630-cd46-4a46-b320-923fa4aa5b71-console-oauth-config\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:05:15.887426 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:15.887420 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91d5f630-cd46-4a46-b320-923fa4aa5b71-console-serving-cert\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:05:16.448732 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:16.448691 2578 generic.go:356] "Generic (PLEG): container finished" podID="91d5f630-cd46-4a46-b320-923fa4aa5b71" containerID="960da0e7413dad6073bed2b3a85665e15ad158c9535d2ce5751acee40596ee24" exitCode=0 Sep 10 16:05:16.449132 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:16.448749 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-655d6db7df-8pm9q" Sep 10 16:05:16.449132 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:16.448765 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-655d6db7df-8pm9q" event={"ID":"91d5f630-cd46-4a46-b320-923fa4aa5b71","Type":"ContainerDied","Data":"960da0e7413dad6073bed2b3a85665e15ad158c9535d2ce5751acee40596ee24"} Sep 10 16:05:16.449132 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:16.448843 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-655d6db7df-8pm9q" event={"ID":"91d5f630-cd46-4a46-b320-923fa4aa5b71","Type":"ContainerDied","Data":"bc6f4e6cc0841d40e4969bb9112f348a7c187095f25d8f9fd8e722205e451a09"} Sep 10 16:05:16.449132 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:16.448863 2578 scope.go:117] "RemoveContainer" containerID="960da0e7413dad6073bed2b3a85665e15ad158c9535d2ce5751acee40596ee24" Sep 10 16:05:16.457608 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:16.457589 2578 scope.go:117] "RemoveContainer" containerID="960da0e7413dad6073bed2b3a85665e15ad158c9535d2ce5751acee40596ee24" Sep 10 16:05:16.457890 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:05:16.457869 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"960da0e7413dad6073bed2b3a85665e15ad158c9535d2ce5751acee40596ee24\": container with ID starting with 960da0e7413dad6073bed2b3a85665e15ad158c9535d2ce5751acee40596ee24 not found: ID does not exist" containerID="960da0e7413dad6073bed2b3a85665e15ad158c9535d2ce5751acee40596ee24" Sep 10 16:05:16.457970 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:16.457899 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"960da0e7413dad6073bed2b3a85665e15ad158c9535d2ce5751acee40596ee24"} err="failed to get container status \"960da0e7413dad6073bed2b3a85665e15ad158c9535d2ce5751acee40596ee24\": rpc error: code = NotFound desc = could not find container \"960da0e7413dad6073bed2b3a85665e15ad158c9535d2ce5751acee40596ee24\": container with ID starting with 960da0e7413dad6073bed2b3a85665e15ad158c9535d2ce5751acee40596ee24 not found: ID does not exist" Sep 10 16:05:16.471977 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:16.471948 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-655d6db7df-8pm9q"] Sep 10 16:05:16.474892 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:16.474869 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-655d6db7df-8pm9q"] Sep 10 16:05:16.839373 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:16.839339 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:05:16.914596 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:16.914564 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:05:17.118333 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:17.118258 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:05:17.122143 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:17.122125 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-55d9744ccf-pvmwm" Sep 10 16:05:17.784288 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:17.784253 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91d5f630-cd46-4a46-b320-923fa4aa5b71" path="/var/lib/kubelet/pods/91d5f630-cd46-4a46-b320-923fa4aa5b71/volumes" Sep 10 16:05:34.259372 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:34.259330 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:05:38.912676 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:38.912633 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:05:38.932413 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:38.932378 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:05:39.566528 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:39.566502 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 16:05:51.587262 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:51.587225 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:05:51.992134 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:51.992096 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:05:56.686245 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.686207 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-78b69f799c-7xdb2"] Sep 10 16:05:56.686762 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.686741 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91d5f630-cd46-4a46-b320-923fa4aa5b71" containerName="console" Sep 10 16:05:56.686762 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.686763 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="91d5f630-cd46-4a46-b320-923fa4aa5b71" containerName="console" Sep 10 16:05:56.686889 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.686796 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39d7944e-f156-4664-ab8b-37506c5537e4" containerName="console" Sep 10 16:05:56.686889 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.686805 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="39d7944e-f156-4664-ab8b-37506c5537e4" containerName="console" Sep 10 16:05:56.687004 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.686901 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="91d5f630-cd46-4a46-b320-923fa4aa5b71" containerName="console" Sep 10 16:05:56.687004 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.686913 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="39d7944e-f156-4664-ab8b-37506c5537e4" containerName="console" Sep 10 16:05:56.689900 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.689875 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.693571 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.693549 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 10 16:05:56.693571 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.693563 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 10 16:05:56.693765 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.693660 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qjbhm\"" Sep 10 16:05:56.693765 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.693676 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 10 16:05:56.694285 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.694263 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 10 16:05:56.694403 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.694303 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 10 16:05:56.704742 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.704703 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 10 16:05:56.709196 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.709168 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78b69f799c-7xdb2"] Sep 10 16:05:56.841732 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.841689 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdqcp\" (UniqueName: \"kubernetes.io/projected/b36ed941-1e15-46a8-b5a5-06727e8e27ea-kube-api-access-rdqcp\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.841732 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.841738 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b36ed941-1e15-46a8-b5a5-06727e8e27ea-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.842053 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.841808 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b36ed941-1e15-46a8-b5a5-06727e8e27ea-metrics-client-ca\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.842053 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.841864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b36ed941-1e15-46a8-b5a5-06727e8e27ea-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.842053 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.841895 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b36ed941-1e15-46a8-b5a5-06727e8e27ea-federate-client-tls\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.842053 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.842002 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b36ed941-1e15-46a8-b5a5-06727e8e27ea-telemeter-client-tls\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.842053 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.842036 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b36ed941-1e15-46a8-b5a5-06727e8e27ea-serving-certs-ca-bundle\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.842053 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.842053 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b36ed941-1e15-46a8-b5a5-06727e8e27ea-secret-telemeter-client\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.942699 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.942592 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b36ed941-1e15-46a8-b5a5-06727e8e27ea-telemeter-client-tls\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.942699 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.942645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b36ed941-1e15-46a8-b5a5-06727e8e27ea-serving-certs-ca-bundle\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.942699 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.942670 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b36ed941-1e15-46a8-b5a5-06727e8e27ea-secret-telemeter-client\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.943011 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.942721 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdqcp\" (UniqueName: \"kubernetes.io/projected/b36ed941-1e15-46a8-b5a5-06727e8e27ea-kube-api-access-rdqcp\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.943011 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.942763 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b36ed941-1e15-46a8-b5a5-06727e8e27ea-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.943134 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.943114 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b36ed941-1e15-46a8-b5a5-06727e8e27ea-metrics-client-ca\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.943240 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.943209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b36ed941-1e15-46a8-b5a5-06727e8e27ea-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.943377 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.943260 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b36ed941-1e15-46a8-b5a5-06727e8e27ea-federate-client-tls\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.943526 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.943501 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b36ed941-1e15-46a8-b5a5-06727e8e27ea-serving-certs-ca-bundle\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.943795 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.943766 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b36ed941-1e15-46a8-b5a5-06727e8e27ea-metrics-client-ca\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.944040 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.944020 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b36ed941-1e15-46a8-b5a5-06727e8e27ea-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.945313 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.945283 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b36ed941-1e15-46a8-b5a5-06727e8e27ea-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.945671 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.945649 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b36ed941-1e15-46a8-b5a5-06727e8e27ea-telemeter-client-tls\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.945759 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.945709 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b36ed941-1e15-46a8-b5a5-06727e8e27ea-secret-telemeter-client\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.945926 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.945906 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b36ed941-1e15-46a8-b5a5-06727e8e27ea-federate-client-tls\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:56.955862 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:56.955837 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdqcp\" (UniqueName: \"kubernetes.io/projected/b36ed941-1e15-46a8-b5a5-06727e8e27ea-kube-api-access-rdqcp\") pod \"telemeter-client-78b69f799c-7xdb2\" (UID: \"b36ed941-1e15-46a8-b5a5-06727e8e27ea\") " pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:57.011449 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:57.011408 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" Sep 10 16:05:57.292950 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:57.292911 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78b69f799c-7xdb2"] Sep 10 16:05:57.293673 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:05:57.293650 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb36ed941_1e15_46a8_b5a5_06727e8e27ea.slice/crio-5eb327b5692cb6ac607e90d7afdffac86fc9a6b0f1b009bd516ebf1e9431cb4b WatchSource:0}: Error finding container 5eb327b5692cb6ac607e90d7afdffac86fc9a6b0f1b009bd516ebf1e9431cb4b: Status 404 returned error can't find the container with id 5eb327b5692cb6ac607e90d7afdffac86fc9a6b0f1b009bd516ebf1e9431cb4b Sep 10 16:05:57.627874 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:57.627785 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" event={"ID":"b36ed941-1e15-46a8-b5a5-06727e8e27ea","Type":"ContainerStarted","Data":"5eb327b5692cb6ac607e90d7afdffac86fc9a6b0f1b009bd516ebf1e9431cb4b"} Sep 10 16:05:59.638150 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.638110 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" event={"ID":"b36ed941-1e15-46a8-b5a5-06727e8e27ea","Type":"ContainerStarted","Data":"43a0dce4c3324ff5c8d757fe359c58adcfed19fc9ff02b8b90934db18f0b095b"} Sep 10 16:05:59.638568 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.638178 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" event={"ID":"b36ed941-1e15-46a8-b5a5-06727e8e27ea","Type":"ContainerStarted","Data":"04bde70d57204e649de253b46ece3d5630e36fdbf2e306612a441c34bc00e391"} Sep 10 16:05:59.638568 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.638214 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" event={"ID":"b36ed941-1e15-46a8-b5a5-06727e8e27ea","Type":"ContainerStarted","Data":"7b97415372ee05bb2df89df1025e4e7d04393ccca51bf3226cbd415db2f87827"} Sep 10 16:05:59.662855 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.662794 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-78b69f799c-7xdb2" podStartSLOduration=2.115124229 podStartE2EDuration="3.662774676s" totalImagesPullingTime="1.547650447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:05:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:05:59.659929892 +0000 UTC m=+154.374197887" watchObservedRunningTime="2026-09-10 16:05:59.662774676 +0000 UTC m=+154.377042671" Sep 10 16:05:59.754166 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.752189 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cf49f95ff-5r6ds"] Sep 10 16:05:59.755802 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.755775 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.805827 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.805787 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cf49f95ff-5r6ds"] Sep 10 16:05:59.807475 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.807447 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:05:59.869764 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.869721 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-oauth-serving-cert\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.869947 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.869786 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae91dc7b-8db9-4348-8e31-4b31caa71775-console-oauth-config\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.869947 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.869861 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae91dc7b-8db9-4348-8e31-4b31caa71775-console-serving-cert\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.869947 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.869904 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-console-config\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.869947 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.869921 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxg2j\" (UniqueName: \"kubernetes.io/projected/ae91dc7b-8db9-4348-8e31-4b31caa71775-kube-api-access-xxg2j\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.870129 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.869965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-service-ca\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.870129 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.870020 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-trusted-ca-bundle\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.909583 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.909497 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:05:59.970932 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.970899 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae91dc7b-8db9-4348-8e31-4b31caa71775-console-oauth-config\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.971109 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.970945 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae91dc7b-8db9-4348-8e31-4b31caa71775-console-serving-cert\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.971109 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.970973 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-console-config\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.971109 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.971021 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxg2j\" (UniqueName: \"kubernetes.io/projected/ae91dc7b-8db9-4348-8e31-4b31caa71775-kube-api-access-xxg2j\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.971109 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.971054 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-service-ca\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.971109 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.971087 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-trusted-ca-bundle\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.971372 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.971144 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-oauth-serving-cert\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.972033 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.972007 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-console-config\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.972157 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.972072 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-oauth-serving-cert\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.972157 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.972104 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-trusted-ca-bundle\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.972269 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.972190 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-service-ca\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.973669 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.973648 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae91dc7b-8db9-4348-8e31-4b31caa71775-console-oauth-config\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.973759 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.973742 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae91dc7b-8db9-4348-8e31-4b31caa71775-console-serving-cert\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:05:59.979109 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:05:59.979086 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxg2j\" (UniqueName: \"kubernetes.io/projected/ae91dc7b-8db9-4348-8e31-4b31caa71775-kube-api-access-xxg2j\") pod \"console-cf49f95ff-5r6ds\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:06:00.069186 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:00.069129 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:06:00.180654 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:00.180568 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:06:00.345158 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:00.345131 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cf49f95ff-5r6ds"] Sep 10 16:06:00.347377 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:06:00.347351 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae91dc7b_8db9_4348_8e31_4b31caa71775.slice/crio-a98fc6840787d29f1cd09fa15b404a0cee43232b7eda1e24385b686ef4e19bc9 WatchSource:0}: Error finding container a98fc6840787d29f1cd09fa15b404a0cee43232b7eda1e24385b686ef4e19bc9: Status 404 returned error can't find the container with id a98fc6840787d29f1cd09fa15b404a0cee43232b7eda1e24385b686ef4e19bc9 Sep 10 16:06:00.552129 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:00.552073 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:06:00.644335 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:00.644292 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf49f95ff-5r6ds" event={"ID":"ae91dc7b-8db9-4348-8e31-4b31caa71775","Type":"ContainerStarted","Data":"cf41890c74d414484d6c730caa01aad8d352db910f5ef21bbae273a39f6e2a0e"} Sep 10 16:06:00.644813 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:00.644391 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf49f95ff-5r6ds" event={"ID":"ae91dc7b-8db9-4348-8e31-4b31caa71775","Type":"ContainerStarted","Data":"a98fc6840787d29f1cd09fa15b404a0cee43232b7eda1e24385b686ef4e19bc9"} Sep 10 16:06:00.651367 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:00.651345 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:06:00.663079 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:00.663026 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cf49f95ff-5r6ds" podStartSLOduration=1.663012044 podStartE2EDuration="1.663012044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:05:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:06:00.661744689 +0000 UTC m=+155.376012684" watchObservedRunningTime="2026-09-10 16:06:00.663012044 +0000 UTC m=+155.377280036" Sep 10 16:06:06.837899 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:06.837859 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:06:07.859313 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:07.859276 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:06:09.516841 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.516807 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cf49f95ff-5r6ds"] Sep 10 16:06:09.547442 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.547408 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55f8bd5bd8-kc2pv"] Sep 10 16:06:09.553198 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.553171 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.562159 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.562129 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f8bd5bd8-kc2pv"] Sep 10 16:06:09.664143 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.664096 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-console-config\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.664143 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.664144 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-trusted-ca-bundle\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.664354 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.664238 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d049b3e4-88a8-4b15-a06e-acd171635c9f-console-oauth-config\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.664354 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.664304 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d049b3e4-88a8-4b15-a06e-acd171635c9f-console-serving-cert\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.664354 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.664324 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-oauth-serving-cert\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.664354 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.664346 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-service-ca\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.664503 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.664431 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br9fx\" (UniqueName: \"kubernetes.io/projected/d049b3e4-88a8-4b15-a06e-acd171635c9f-kube-api-access-br9fx\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.765783 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.765740 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br9fx\" (UniqueName: \"kubernetes.io/projected/d049b3e4-88a8-4b15-a06e-acd171635c9f-kube-api-access-br9fx\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.765783 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.765784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-console-config\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.766158 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.765800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-trusted-ca-bundle\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.766158 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.765838 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d049b3e4-88a8-4b15-a06e-acd171635c9f-console-oauth-config\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.766158 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.765897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d049b3e4-88a8-4b15-a06e-acd171635c9f-console-serving-cert\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.766158 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.765933 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-oauth-serving-cert\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.766158 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.765969 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-service-ca\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.766606 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.766581 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-console-config\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.766708 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.766684 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-service-ca\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.766759 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.766736 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-oauth-serving-cert\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.766814 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.766742 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-trusted-ca-bundle\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.768588 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.768530 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d049b3e4-88a8-4b15-a06e-acd171635c9f-console-serving-cert\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.768588 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.768572 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d049b3e4-88a8-4b15-a06e-acd171635c9f-console-oauth-config\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.775964 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.775940 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br9fx\" (UniqueName: \"kubernetes.io/projected/d049b3e4-88a8-4b15-a06e-acd171635c9f-kube-api-access-br9fx\") pod \"console-55f8bd5bd8-kc2pv\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:09.863515 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:09.863473 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:10.069714 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:10.069618 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:06:10.141130 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:10.141105 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f8bd5bd8-kc2pv"] Sep 10 16:06:10.143573 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:06:10.143545 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd049b3e4_88a8_4b15_a06e_acd171635c9f.slice/crio-8633ac39f7c50038f498c711be78e975d1bb6564c83a2dca3d52cb0e061be7e9 WatchSource:0}: Error finding container 8633ac39f7c50038f498c711be78e975d1bb6564c83a2dca3d52cb0e061be7e9: Status 404 returned error can't find the container with id 8633ac39f7c50038f498c711be78e975d1bb6564c83a2dca3d52cb0e061be7e9 Sep 10 16:06:10.689012 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:10.688948 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f8bd5bd8-kc2pv" event={"ID":"d049b3e4-88a8-4b15-a06e-acd171635c9f","Type":"ContainerStarted","Data":"7dacd61ea35114f164128f3425eca946fcce1a0473d7ff801d9678c215521e6e"} Sep 10 16:06:10.689012 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:10.689011 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f8bd5bd8-kc2pv" event={"ID":"d049b3e4-88a8-4b15-a06e-acd171635c9f","Type":"ContainerStarted","Data":"8633ac39f7c50038f498c711be78e975d1bb6564c83a2dca3d52cb0e061be7e9"} Sep 10 16:06:10.706468 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:10.706412 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55f8bd5bd8-kc2pv" podStartSLOduration=1.706394552 podStartE2EDuration="1.706394552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:06:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:06:10.705356835 +0000 UTC m=+165.419624832" watchObservedRunningTime="2026-09-10 16:06:10.706394552 +0000 UTC m=+165.420662547" Sep 10 16:06:18.882591 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:18.882494 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:06:19.766833 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:19.766800 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:06:19.864005 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:19.863936 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:19.864179 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:19.864038 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:19.868807 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:19.868782 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:20.741703 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:20.741669 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:06:20.779864 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:20.779826 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cf55fc6fd-74626"] Sep 10 16:06:20.883843 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:20.883800 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:06:20.947265 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:20.947228 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:06:21.258237 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:21.258201 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:06:22.636410 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:22.636379 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:06:22.736378 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:22.736348 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:06:34.536834 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.536785 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cf49f95ff-5r6ds" podUID="ae91dc7b-8db9-4348-8e31-4b31caa71775" containerName="console" containerID="cri-o://cf41890c74d414484d6c730caa01aad8d352db910f5ef21bbae273a39f6e2a0e" gracePeriod=15 Sep 10 16:06:34.781630 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.781600 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:06:34.795047 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.794948 2578 generic.go:356] "Generic (PLEG): container finished" podID="ae91dc7b-8db9-4348-8e31-4b31caa71775" containerID="cf41890c74d414484d6c730caa01aad8d352db910f5ef21bbae273a39f6e2a0e" exitCode=0 Sep 10 16:06:34.795047 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.795010 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf49f95ff-5r6ds" Sep 10 16:06:34.795047 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.795022 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf49f95ff-5r6ds" event={"ID":"ae91dc7b-8db9-4348-8e31-4b31caa71775","Type":"ContainerDied","Data":"cf41890c74d414484d6c730caa01aad8d352db910f5ef21bbae273a39f6e2a0e"} Sep 10 16:06:34.795256 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.795076 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf49f95ff-5r6ds" event={"ID":"ae91dc7b-8db9-4348-8e31-4b31caa71775","Type":"ContainerDied","Data":"a98fc6840787d29f1cd09fa15b404a0cee43232b7eda1e24385b686ef4e19bc9"} Sep 10 16:06:34.795256 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.795099 2578 scope.go:117] "RemoveContainer" containerID="cf41890c74d414484d6c730caa01aad8d352db910f5ef21bbae273a39f6e2a0e" Sep 10 16:06:34.804388 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.804359 2578 scope.go:117] "RemoveContainer" containerID="cf41890c74d414484d6c730caa01aad8d352db910f5ef21bbae273a39f6e2a0e" Sep 10 16:06:34.804737 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:06:34.804706 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf41890c74d414484d6c730caa01aad8d352db910f5ef21bbae273a39f6e2a0e\": container with ID starting with cf41890c74d414484d6c730caa01aad8d352db910f5ef21bbae273a39f6e2a0e not found: ID does not exist" containerID="cf41890c74d414484d6c730caa01aad8d352db910f5ef21bbae273a39f6e2a0e" Sep 10 16:06:34.804817 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.804746 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf41890c74d414484d6c730caa01aad8d352db910f5ef21bbae273a39f6e2a0e"} err="failed to get container status \"cf41890c74d414484d6c730caa01aad8d352db910f5ef21bbae273a39f6e2a0e\": rpc error: code = NotFound desc = could not find container \"cf41890c74d414484d6c730caa01aad8d352db910f5ef21bbae273a39f6e2a0e\": container with ID starting with cf41890c74d414484d6c730caa01aad8d352db910f5ef21bbae273a39f6e2a0e not found: ID does not exist" Sep 10 16:06:34.896880 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.896842 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxg2j\" (UniqueName: \"kubernetes.io/projected/ae91dc7b-8db9-4348-8e31-4b31caa71775-kube-api-access-xxg2j\") pod \"ae91dc7b-8db9-4348-8e31-4b31caa71775\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " Sep 10 16:06:34.897085 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.896918 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae91dc7b-8db9-4348-8e31-4b31caa71775-console-serving-cert\") pod \"ae91dc7b-8db9-4348-8e31-4b31caa71775\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " Sep 10 16:06:34.897085 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.896937 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-service-ca\") pod \"ae91dc7b-8db9-4348-8e31-4b31caa71775\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " Sep 10 16:06:34.897085 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.897002 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae91dc7b-8db9-4348-8e31-4b31caa71775-console-oauth-config\") pod \"ae91dc7b-8db9-4348-8e31-4b31caa71775\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " Sep 10 16:06:34.897085 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.897032 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-console-config\") pod \"ae91dc7b-8db9-4348-8e31-4b31caa71775\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " Sep 10 16:06:34.897309 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.897095 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-oauth-serving-cert\") pod \"ae91dc7b-8db9-4348-8e31-4b31caa71775\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " Sep 10 16:06:34.897309 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.897110 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-trusted-ca-bundle\") pod \"ae91dc7b-8db9-4348-8e31-4b31caa71775\" (UID: \"ae91dc7b-8db9-4348-8e31-4b31caa71775\") " Sep 10 16:06:34.897450 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.897422 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-service-ca" (OuterVolumeSpecName: "service-ca") pod "ae91dc7b-8db9-4348-8e31-4b31caa71775" (UID: "ae91dc7b-8db9-4348-8e31-4b31caa71775"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:06:34.897507 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.897451 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-console-config" (OuterVolumeSpecName: "console-config") pod "ae91dc7b-8db9-4348-8e31-4b31caa71775" (UID: "ae91dc7b-8db9-4348-8e31-4b31caa71775"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:06:34.897651 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.897620 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ae91dc7b-8db9-4348-8e31-4b31caa71775" (UID: "ae91dc7b-8db9-4348-8e31-4b31caa71775"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:06:34.897766 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.897670 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ae91dc7b-8db9-4348-8e31-4b31caa71775" (UID: "ae91dc7b-8db9-4348-8e31-4b31caa71775"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:06:34.899186 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.899164 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae91dc7b-8db9-4348-8e31-4b31caa71775-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ae91dc7b-8db9-4348-8e31-4b31caa71775" (UID: "ae91dc7b-8db9-4348-8e31-4b31caa71775"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:06:34.899186 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.899180 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae91dc7b-8db9-4348-8e31-4b31caa71775-kube-api-access-xxg2j" (OuterVolumeSpecName: "kube-api-access-xxg2j") pod "ae91dc7b-8db9-4348-8e31-4b31caa71775" (UID: "ae91dc7b-8db9-4348-8e31-4b31caa71775"). InnerVolumeSpecName "kube-api-access-xxg2j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:06:34.899336 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.899229 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae91dc7b-8db9-4348-8e31-4b31caa71775-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ae91dc7b-8db9-4348-8e31-4b31caa71775" (UID: "ae91dc7b-8db9-4348-8e31-4b31caa71775"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:06:34.998588 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.998531 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-oauth-serving-cert\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:06:34.998588 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.998581 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-trusted-ca-bundle\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:06:34.998588 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.998592 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxg2j\" (UniqueName: \"kubernetes.io/projected/ae91dc7b-8db9-4348-8e31-4b31caa71775-kube-api-access-xxg2j\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:06:34.998588 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.998600 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae91dc7b-8db9-4348-8e31-4b31caa71775-console-serving-cert\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:06:34.998588 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.998610 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-service-ca\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:06:34.998905 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.998618 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae91dc7b-8db9-4348-8e31-4b31caa71775-console-oauth-config\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:06:34.998905 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:34.998626 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae91dc7b-8db9-4348-8e31-4b31caa71775-console-config\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:06:35.117496 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:35.117461 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cf49f95ff-5r6ds"] Sep 10 16:06:35.121587 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:35.121556 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cf49f95ff-5r6ds"] Sep 10 16:06:35.784361 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:35.784328 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae91dc7b-8db9-4348-8e31-4b31caa71775" path="/var/lib/kubelet/pods/ae91dc7b-8db9-4348-8e31-4b31caa71775/volumes" Sep 10 16:06:45.800753 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:45.800709 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cf55fc6fd-74626" podUID="a9531e6c-4198-4e61-a702-614a4c6a05de" containerName="console" containerID="cri-o://e5c54fae7d651596fc62456662540d6e680fccde2e2d2f5c86fedf2ad6b36a07" gracePeriod=15 Sep 10 16:06:46.048399 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.048357 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:06:46.198215 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.198102 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9531e6c-4198-4e61-a702-614a4c6a05de-console-serving-cert\") pod \"a9531e6c-4198-4e61-a702-614a4c6a05de\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " Sep 10 16:06:46.198215 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.198192 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-console-config\") pod \"a9531e6c-4198-4e61-a702-614a4c6a05de\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " Sep 10 16:06:46.198460 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.198227 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-trusted-ca-bundle\") pod \"a9531e6c-4198-4e61-a702-614a4c6a05de\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " Sep 10 16:06:46.198460 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.198277 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d46pp\" (UniqueName: \"kubernetes.io/projected/a9531e6c-4198-4e61-a702-614a4c6a05de-kube-api-access-d46pp\") pod \"a9531e6c-4198-4e61-a702-614a4c6a05de\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " Sep 10 16:06:46.198460 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.198339 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-service-ca\") pod \"a9531e6c-4198-4e61-a702-614a4c6a05de\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " Sep 10 16:06:46.198460 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.198375 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-oauth-serving-cert\") pod \"a9531e6c-4198-4e61-a702-614a4c6a05de\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " Sep 10 16:06:46.198460 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.198430 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9531e6c-4198-4e61-a702-614a4c6a05de-console-oauth-config\") pod \"a9531e6c-4198-4e61-a702-614a4c6a05de\" (UID: \"a9531e6c-4198-4e61-a702-614a4c6a05de\") " Sep 10 16:06:46.198757 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.198713 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-console-config" (OuterVolumeSpecName: "console-config") pod "a9531e6c-4198-4e61-a702-614a4c6a05de" (UID: "a9531e6c-4198-4e61-a702-614a4c6a05de"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:06:46.198943 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.198844 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-service-ca" (OuterVolumeSpecName: "service-ca") pod "a9531e6c-4198-4e61-a702-614a4c6a05de" (UID: "a9531e6c-4198-4e61-a702-614a4c6a05de"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:06:46.199141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.199072 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a9531e6c-4198-4e61-a702-614a4c6a05de" (UID: "a9531e6c-4198-4e61-a702-614a4c6a05de"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:06:46.199141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.199087 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a9531e6c-4198-4e61-a702-614a4c6a05de" (UID: "a9531e6c-4198-4e61-a702-614a4c6a05de"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:06:46.200519 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.200494 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9531e6c-4198-4e61-a702-614a4c6a05de-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a9531e6c-4198-4e61-a702-614a4c6a05de" (UID: "a9531e6c-4198-4e61-a702-614a4c6a05de"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:06:46.201151 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.201123 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9531e6c-4198-4e61-a702-614a4c6a05de-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a9531e6c-4198-4e61-a702-614a4c6a05de" (UID: "a9531e6c-4198-4e61-a702-614a4c6a05de"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:06:46.201151 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.201127 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9531e6c-4198-4e61-a702-614a4c6a05de-kube-api-access-d46pp" (OuterVolumeSpecName: "kube-api-access-d46pp") pod "a9531e6c-4198-4e61-a702-614a4c6a05de" (UID: "a9531e6c-4198-4e61-a702-614a4c6a05de"). InnerVolumeSpecName "kube-api-access-d46pp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:06:46.299382 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.299332 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-oauth-serving-cert\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:06:46.299382 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.299377 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9531e6c-4198-4e61-a702-614a4c6a05de-console-oauth-config\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:06:46.299382 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.299393 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9531e6c-4198-4e61-a702-614a4c6a05de-console-serving-cert\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:06:46.299629 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.299407 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-console-config\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:06:46.299629 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.299422 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-trusted-ca-bundle\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:06:46.299629 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.299436 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d46pp\" (UniqueName: \"kubernetes.io/projected/a9531e6c-4198-4e61-a702-614a4c6a05de-kube-api-access-d46pp\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:06:46.299629 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.299450 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9531e6c-4198-4e61-a702-614a4c6a05de-service-ca\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:06:46.846490 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.846454 2578 generic.go:356] "Generic (PLEG): container finished" podID="a9531e6c-4198-4e61-a702-614a4c6a05de" containerID="e5c54fae7d651596fc62456662540d6e680fccde2e2d2f5c86fedf2ad6b36a07" exitCode=0 Sep 10 16:06:46.846909 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.846504 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cf55fc6fd-74626" event={"ID":"a9531e6c-4198-4e61-a702-614a4c6a05de","Type":"ContainerDied","Data":"e5c54fae7d651596fc62456662540d6e680fccde2e2d2f5c86fedf2ad6b36a07"} Sep 10 16:06:46.846909 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.846523 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cf55fc6fd-74626" Sep 10 16:06:46.846909 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.846544 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cf55fc6fd-74626" event={"ID":"a9531e6c-4198-4e61-a702-614a4c6a05de","Type":"ContainerDied","Data":"4dd73c7f839dae98258467e0951684a1e9818c11d20f8dc44bbbc03f685b9b12"} Sep 10 16:06:46.846909 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.846564 2578 scope.go:117] "RemoveContainer" containerID="e5c54fae7d651596fc62456662540d6e680fccde2e2d2f5c86fedf2ad6b36a07" Sep 10 16:06:46.855314 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.855295 2578 scope.go:117] "RemoveContainer" containerID="e5c54fae7d651596fc62456662540d6e680fccde2e2d2f5c86fedf2ad6b36a07" Sep 10 16:06:46.855615 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:06:46.855591 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5c54fae7d651596fc62456662540d6e680fccde2e2d2f5c86fedf2ad6b36a07\": container with ID starting with e5c54fae7d651596fc62456662540d6e680fccde2e2d2f5c86fedf2ad6b36a07 not found: ID does not exist" containerID="e5c54fae7d651596fc62456662540d6e680fccde2e2d2f5c86fedf2ad6b36a07" Sep 10 16:06:46.855665 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.855625 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5c54fae7d651596fc62456662540d6e680fccde2e2d2f5c86fedf2ad6b36a07"} err="failed to get container status \"e5c54fae7d651596fc62456662540d6e680fccde2e2d2f5c86fedf2ad6b36a07\": rpc error: code = NotFound desc = could not find container \"e5c54fae7d651596fc62456662540d6e680fccde2e2d2f5c86fedf2ad6b36a07\": container with ID starting with e5c54fae7d651596fc62456662540d6e680fccde2e2d2f5c86fedf2ad6b36a07 not found: ID does not exist" Sep 10 16:06:46.868253 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.868221 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cf55fc6fd-74626"] Sep 10 16:06:46.872048 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:46.872020 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cf55fc6fd-74626"] Sep 10 16:06:47.625161 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:47.625126 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:06:47.708531 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:47.708501 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:06:47.784461 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:06:47.784427 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9531e6c-4198-4e61-a702-614a4c6a05de" path="/var/lib/kubelet/pods/a9531e6c-4198-4e61-a702-614a4c6a05de/volumes" Sep 10 16:07:12.051368 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:12.051334 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:12.144673 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:12.144634 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:20.650914 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:20.650882 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:20.701532 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:20.701497 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:33.842551 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:33.842513 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:34.446510 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:34.446473 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:34.544019 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:34.543975 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:34.672243 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:34.672208 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:37.638086 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:37.638047 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:37.737823 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:37.737784 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:38.723595 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:38.723561 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:38.851166 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:38.851134 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:39.741355 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:39.741323 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:39.840656 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:39.840622 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:40.695650 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:40.695616 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gzlj4"] Sep 10 16:07:40.695974 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:40.695962 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae91dc7b-8db9-4348-8e31-4b31caa71775" containerName="console" Sep 10 16:07:40.695974 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:40.695975 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae91dc7b-8db9-4348-8e31-4b31caa71775" containerName="console" Sep 10 16:07:40.695974 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:40.695997 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9531e6c-4198-4e61-a702-614a4c6a05de" containerName="console" Sep 10 16:07:40.695974 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:40.696003 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9531e6c-4198-4e61-a702-614a4c6a05de" containerName="console" Sep 10 16:07:40.696160 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:40.696050 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9531e6c-4198-4e61-a702-614a4c6a05de" containerName="console" Sep 10 16:07:40.696160 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:40.696062 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae91dc7b-8db9-4348-8e31-4b31caa71775" containerName="console" Sep 10 16:07:40.700469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:40.700444 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gzlj4" Sep 10 16:07:40.703235 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:40.703210 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 10 16:07:40.704389 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:40.704367 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 10 16:07:40.704491 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:40.704423 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-r2p79\"" Sep 10 16:07:40.708585 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:40.708528 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gzlj4"] Sep 10 16:07:40.875001 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:40.874941 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1da8d2c0-8df3-4493-9dfd-b851338ac9fc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gzlj4\" (UID: \"1da8d2c0-8df3-4493-9dfd-b851338ac9fc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gzlj4" Sep 10 16:07:40.875401 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:40.875026 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cckg5\" (UniqueName: \"kubernetes.io/projected/1da8d2c0-8df3-4493-9dfd-b851338ac9fc-kube-api-access-cckg5\") pod \"cert-manager-webhook-6486ffd997-gzlj4\" (UID: \"1da8d2c0-8df3-4493-9dfd-b851338ac9fc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gzlj4" Sep 10 16:07:40.976490 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:40.976396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cckg5\" (UniqueName: \"kubernetes.io/projected/1da8d2c0-8df3-4493-9dfd-b851338ac9fc-kube-api-access-cckg5\") pod \"cert-manager-webhook-6486ffd997-gzlj4\" (UID: \"1da8d2c0-8df3-4493-9dfd-b851338ac9fc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gzlj4" Sep 10 16:07:40.976490 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:40.976487 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1da8d2c0-8df3-4493-9dfd-b851338ac9fc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gzlj4\" (UID: \"1da8d2c0-8df3-4493-9dfd-b851338ac9fc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gzlj4" Sep 10 16:07:40.988544 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:40.988511 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1da8d2c0-8df3-4493-9dfd-b851338ac9fc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gzlj4\" (UID: \"1da8d2c0-8df3-4493-9dfd-b851338ac9fc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gzlj4" Sep 10 16:07:40.988683 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:40.988665 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cckg5\" (UniqueName: \"kubernetes.io/projected/1da8d2c0-8df3-4493-9dfd-b851338ac9fc-kube-api-access-cckg5\") pod \"cert-manager-webhook-6486ffd997-gzlj4\" (UID: \"1da8d2c0-8df3-4493-9dfd-b851338ac9fc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gzlj4" Sep 10 16:07:41.025021 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:41.024962 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gzlj4" Sep 10 16:07:41.295120 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:41.295093 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gzlj4"] Sep 10 16:07:41.297160 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:07:41.297128 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1da8d2c0_8df3_4493_9dfd_b851338ac9fc.slice/crio-070bc218ae206eb93257e6559e39fc7819a3ed570fc15d4fd7f7b9c65e4531c1 WatchSource:0}: Error finding container 070bc218ae206eb93257e6559e39fc7819a3ed570fc15d4fd7f7b9c65e4531c1: Status 404 returned error can't find the container with id 070bc218ae206eb93257e6559e39fc7819a3ed570fc15d4fd7f7b9c65e4531c1 Sep 10 16:07:41.957231 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:41.957193 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:42.084381 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:42.084347 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gzlj4" event={"ID":"1da8d2c0-8df3-4493-9dfd-b851338ac9fc","Type":"ContainerStarted","Data":"070bc218ae206eb93257e6559e39fc7819a3ed570fc15d4fd7f7b9c65e4531c1"} Sep 10 16:07:42.154739 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:42.154706 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:44.490871 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:44.490822 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:44.557153 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:44.557098 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:45.100547 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:45.100503 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gzlj4" event={"ID":"1da8d2c0-8df3-4493-9dfd-b851338ac9fc","Type":"ContainerStarted","Data":"b16cec3d20845bfaf7b6c81c24519ba0baa05edd4604ea83dab75cfd718ff020"} Sep 10 16:07:45.100733 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:45.100645 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gzlj4" Sep 10 16:07:45.121432 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:45.121374 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-gzlj4" podStartSLOduration=1.74217055 podStartE2EDuration="5.121357387s" totalImagesPullingTime="3.379186837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:07:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:07:45.120793065 +0000 UTC m=+259.835061061" watchObservedRunningTime="2026-09-10 16:07:45.121357387 +0000 UTC m=+259.835625383" Sep 10 16:07:45.648160 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:45.648125 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tbtt5"] Sep 10 16:07:45.651771 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:45.651753 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbtt5" Sep 10 16:07:45.654532 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:45.654514 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-q8n22\"" Sep 10 16:07:45.659965 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:45.659943 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tbtt5"] Sep 10 16:07:45.820182 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:45.820145 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d372a46a-f703-44fd-8cf7-7826f7d6ec14-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tbtt5\" (UID: \"d372a46a-f703-44fd-8cf7-7826f7d6ec14\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbtt5" Sep 10 16:07:45.820371 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:45.820207 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsfw6\" (UniqueName: \"kubernetes.io/projected/d372a46a-f703-44fd-8cf7-7826f7d6ec14-kube-api-access-hsfw6\") pod \"cert-manager-cainjector-559cdd8c87-tbtt5\" (UID: \"d372a46a-f703-44fd-8cf7-7826f7d6ec14\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbtt5" Sep 10 16:07:45.921348 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:45.921257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d372a46a-f703-44fd-8cf7-7826f7d6ec14-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tbtt5\" (UID: \"d372a46a-f703-44fd-8cf7-7826f7d6ec14\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbtt5" Sep 10 16:07:45.921348 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:45.921312 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsfw6\" (UniqueName: \"kubernetes.io/projected/d372a46a-f703-44fd-8cf7-7826f7d6ec14-kube-api-access-hsfw6\") pod \"cert-manager-cainjector-559cdd8c87-tbtt5\" (UID: \"d372a46a-f703-44fd-8cf7-7826f7d6ec14\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbtt5" Sep 10 16:07:45.932519 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:45.932487 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsfw6\" (UniqueName: \"kubernetes.io/projected/d372a46a-f703-44fd-8cf7-7826f7d6ec14-kube-api-access-hsfw6\") pod \"cert-manager-cainjector-559cdd8c87-tbtt5\" (UID: \"d372a46a-f703-44fd-8cf7-7826f7d6ec14\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbtt5" Sep 10 16:07:45.932519 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:45.932507 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d372a46a-f703-44fd-8cf7-7826f7d6ec14-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tbtt5\" (UID: \"d372a46a-f703-44fd-8cf7-7826f7d6ec14\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbtt5" Sep 10 16:07:45.961253 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:45.961220 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbtt5" Sep 10 16:07:46.232366 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:46.232338 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tbtt5"] Sep 10 16:07:46.234867 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:07:46.234839 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd372a46a_f703_44fd_8cf7_7826f7d6ec14.slice/crio-ba13b9ad73318ae5faab86acfa333ea9d5b34e416c6f2a0a66922c16fddeb406 WatchSource:0}: Error finding container ba13b9ad73318ae5faab86acfa333ea9d5b34e416c6f2a0a66922c16fddeb406: Status 404 returned error can't find the container with id ba13b9ad73318ae5faab86acfa333ea9d5b34e416c6f2a0a66922c16fddeb406 Sep 10 16:07:47.037959 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:47.037926 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:47.109870 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:47.109834 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbtt5" event={"ID":"d372a46a-f703-44fd-8cf7-7826f7d6ec14","Type":"ContainerStarted","Data":"02537c7235be2c3cc3437003e32fda7c67d7c5813f4e124d82d3855646032cf5"} Sep 10 16:07:47.109870 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:47.109879 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbtt5" event={"ID":"d372a46a-f703-44fd-8cf7-7826f7d6ec14","Type":"ContainerStarted","Data":"ba13b9ad73318ae5faab86acfa333ea9d5b34e416c6f2a0a66922c16fddeb406"} Sep 10 16:07:47.140220 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:47.140154 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbtt5" podStartSLOduration=2.140130478 podStartE2EDuration="2.140130478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:07:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:07:47.139659474 +0000 UTC m=+261.853927469" watchObservedRunningTime="2026-09-10 16:07:47.140130478 +0000 UTC m=+261.854398473" Sep 10 16:07:47.206603 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:47.206568 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:47.854253 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:47.854219 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:47.957205 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:47.957171 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:50.153899 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:50.153860 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:51.106229 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:51.106193 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gzlj4" Sep 10 16:07:55.519648 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:55.519609 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:55.622107 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:55.622074 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:07:56.965861 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:07:56.965823 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:10.331335 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:10.331298 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:11.206958 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.206914 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429"] Sep 10 16:08:11.212544 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.212507 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" Sep 10 16:08:11.227766 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.227722 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 16:08:11.227934 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.227847 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-784hl\"" Sep 10 16:08:11.228312 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.228289 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 16:08:11.228699 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.228679 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 16:08:11.229123 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.229108 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 16:08:11.244601 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.244563 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429"] Sep 10 16:08:11.333591 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.333554 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3f4345c-04be-4505-92b0-1f0e2872ddb4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-g9429\" (UID: \"e3f4345c-04be-4505-92b0-1f0e2872ddb4\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" Sep 10 16:08:11.333591 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.333592 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3f4345c-04be-4505-92b0-1f0e2872ddb4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-g9429\" (UID: \"e3f4345c-04be-4505-92b0-1f0e2872ddb4\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" Sep 10 16:08:11.334055 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.333619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3f4345c-04be-4505-92b0-1f0e2872ddb4-tmp\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-g9429\" (UID: \"e3f4345c-04be-4505-92b0-1f0e2872ddb4\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" Sep 10 16:08:11.334055 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.333721 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pfh5\" (UniqueName: \"kubernetes.io/projected/e3f4345c-04be-4505-92b0-1f0e2872ddb4-kube-api-access-7pfh5\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-g9429\" (UID: \"e3f4345c-04be-4505-92b0-1f0e2872ddb4\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" Sep 10 16:08:11.334055 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.333792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e3f4345c-04be-4505-92b0-1f0e2872ddb4-manifests\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-g9429\" (UID: \"e3f4345c-04be-4505-92b0-1f0e2872ddb4\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" Sep 10 16:08:11.434669 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.434631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3f4345c-04be-4505-92b0-1f0e2872ddb4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-g9429\" (UID: \"e3f4345c-04be-4505-92b0-1f0e2872ddb4\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" Sep 10 16:08:11.434669 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.434670 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3f4345c-04be-4505-92b0-1f0e2872ddb4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-g9429\" (UID: \"e3f4345c-04be-4505-92b0-1f0e2872ddb4\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" Sep 10 16:08:11.434876 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.434692 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3f4345c-04be-4505-92b0-1f0e2872ddb4-tmp\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-g9429\" (UID: \"e3f4345c-04be-4505-92b0-1f0e2872ddb4\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" Sep 10 16:08:11.434876 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.434752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pfh5\" (UniqueName: \"kubernetes.io/projected/e3f4345c-04be-4505-92b0-1f0e2872ddb4-kube-api-access-7pfh5\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-g9429\" (UID: \"e3f4345c-04be-4505-92b0-1f0e2872ddb4\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" Sep 10 16:08:11.434876 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.434817 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e3f4345c-04be-4505-92b0-1f0e2872ddb4-manifests\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-g9429\" (UID: \"e3f4345c-04be-4505-92b0-1f0e2872ddb4\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" Sep 10 16:08:11.435256 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.435232 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e3f4345c-04be-4505-92b0-1f0e2872ddb4-manifests\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-g9429\" (UID: \"e3f4345c-04be-4505-92b0-1f0e2872ddb4\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" Sep 10 16:08:11.436953 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.436919 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3f4345c-04be-4505-92b0-1f0e2872ddb4-tmp\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-g9429\" (UID: \"e3f4345c-04be-4505-92b0-1f0e2872ddb4\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" Sep 10 16:08:11.437282 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.437263 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3f4345c-04be-4505-92b0-1f0e2872ddb4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-g9429\" (UID: \"e3f4345c-04be-4505-92b0-1f0e2872ddb4\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" Sep 10 16:08:11.437368 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.437298 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3f4345c-04be-4505-92b0-1f0e2872ddb4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-g9429\" (UID: \"e3f4345c-04be-4505-92b0-1f0e2872ddb4\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" Sep 10 16:08:11.446260 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.446236 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pfh5\" (UniqueName: \"kubernetes.io/projected/e3f4345c-04be-4505-92b0-1f0e2872ddb4-kube-api-access-7pfh5\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-g9429\" (UID: \"e3f4345c-04be-4505-92b0-1f0e2872ddb4\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" Sep 10 16:08:11.523040 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.523002 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" Sep 10 16:08:11.803897 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:11.803867 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429"] Sep 10 16:08:11.805510 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:08:11.805486 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f4345c_04be_4505_92b0_1f0e2872ddb4.slice/crio-f7050975a96b6896bfbc835a0f29460b6841d15d2e1297b3c8bfd23a85527abe WatchSource:0}: Error finding container f7050975a96b6896bfbc835a0f29460b6841d15d2e1297b3c8bfd23a85527abe: Status 404 returned error can't find the container with id f7050975a96b6896bfbc835a0f29460b6841d15d2e1297b3c8bfd23a85527abe Sep 10 16:08:12.012925 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:12.012889 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:12.226349 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:12.226250 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" event={"ID":"e3f4345c-04be-4505-92b0-1f0e2872ddb4","Type":"ContainerStarted","Data":"f7050975a96b6896bfbc835a0f29460b6841d15d2e1297b3c8bfd23a85527abe"} Sep 10 16:08:15.242671 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:15.242635 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" event={"ID":"e3f4345c-04be-4505-92b0-1f0e2872ddb4","Type":"ContainerStarted","Data":"27b27f980786f684f04c04cc72591b0006ba4715be8230c9a1f42f3af209c49e"} Sep 10 16:08:16.249289 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:16.249256 2578 generic.go:356] "Generic (PLEG): container finished" podID="e3f4345c-04be-4505-92b0-1f0e2872ddb4" containerID="27b27f980786f684f04c04cc72591b0006ba4715be8230c9a1f42f3af209c49e" exitCode=0 Sep 10 16:08:16.249717 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:16.249345 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" event={"ID":"e3f4345c-04be-4505-92b0-1f0e2872ddb4","Type":"ContainerDied","Data":"27b27f980786f684f04c04cc72591b0006ba4715be8230c9a1f42f3af209c49e"} Sep 10 16:08:16.277061 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:16.277020 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:16.387228 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:16.387140 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:17.256045 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:17.256005 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" event={"ID":"e3f4345c-04be-4505-92b0-1f0e2872ddb4","Type":"ContainerStarted","Data":"d9cb395b3e5abc16bd8a54e400678ff0cb01168f145b509953d0ffa8c10f3807"} Sep 10 16:08:17.256451 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:17.256150 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" Sep 10 16:08:17.282250 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:17.282177 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" podStartSLOduration=1.7774738110000001 podStartE2EDuration="6.282152814s" totalImagesPullingTime="3.440467229s" totalInitContainerRuntime="1.064211774s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:08:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:08:17.279583677 +0000 UTC m=+291.993851674" watchObservedRunningTime="2026-09-10 16:08:17.282152814 +0000 UTC m=+291.996420799" Sep 10 16:08:25.688623 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:25.688598 2578 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 16:08:28.263183 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:28.263149 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-g9429" Sep 10 16:08:31.625638 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:31.625604 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:31.754379 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:31.754349 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:31.898223 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:31.898114 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:32.050092 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:32.050057 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:33.744489 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:33.744456 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:33.836411 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:33.836362 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:34.847436 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:34.847386 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:38.819097 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:38.819058 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:38.935582 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:38.935537 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:39.499769 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:39.499739 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:39.659490 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:39.659456 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:39.765605 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:39.765511 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:42.659210 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:42.659173 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:42.778756 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:42.778716 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:42.863374 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:42.863338 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:43.218858 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:43.218827 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:43.453114 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:43.453076 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:43.586604 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:43.586571 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:51.137179 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.137142 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v"] Sep 10 16:08:51.144154 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.144128 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v" Sep 10 16:08:51.148188 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.148145 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 16:08:51.148188 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.148175 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 16:08:51.148394 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.148182 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 16:08:51.148394 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.148192 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 16:08:51.148394 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.148242 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 16:08:51.148560 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.148425 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-kmkp8\"" Sep 10 16:08:51.157251 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.157226 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v"] Sep 10 16:08:51.203102 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.203064 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/47ebb480-aecc-4ab6-8eae-a262abb2e0a3-manager-config\") pod \"lws-controller-manager-5745f97d58-wcs9v\" (UID: \"47ebb480-aecc-4ab6-8eae-a262abb2e0a3\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v" Sep 10 16:08:51.203102 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.203114 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47ebb480-aecc-4ab6-8eae-a262abb2e0a3-cert\") pod \"lws-controller-manager-5745f97d58-wcs9v\" (UID: \"47ebb480-aecc-4ab6-8eae-a262abb2e0a3\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v" Sep 10 16:08:51.203359 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.203176 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rkxh\" (UniqueName: \"kubernetes.io/projected/47ebb480-aecc-4ab6-8eae-a262abb2e0a3-kube-api-access-4rkxh\") pod \"lws-controller-manager-5745f97d58-wcs9v\" (UID: \"47ebb480-aecc-4ab6-8eae-a262abb2e0a3\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v" Sep 10 16:08:51.203359 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.203245 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/47ebb480-aecc-4ab6-8eae-a262abb2e0a3-metrics-cert\") pod \"lws-controller-manager-5745f97d58-wcs9v\" (UID: \"47ebb480-aecc-4ab6-8eae-a262abb2e0a3\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v" Sep 10 16:08:51.303813 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.303774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47ebb480-aecc-4ab6-8eae-a262abb2e0a3-cert\") pod \"lws-controller-manager-5745f97d58-wcs9v\" (UID: \"47ebb480-aecc-4ab6-8eae-a262abb2e0a3\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v" Sep 10 16:08:51.304011 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.303864 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rkxh\" (UniqueName: \"kubernetes.io/projected/47ebb480-aecc-4ab6-8eae-a262abb2e0a3-kube-api-access-4rkxh\") pod \"lws-controller-manager-5745f97d58-wcs9v\" (UID: \"47ebb480-aecc-4ab6-8eae-a262abb2e0a3\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v" Sep 10 16:08:51.304011 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.303904 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/47ebb480-aecc-4ab6-8eae-a262abb2e0a3-metrics-cert\") pod \"lws-controller-manager-5745f97d58-wcs9v\" (UID: \"47ebb480-aecc-4ab6-8eae-a262abb2e0a3\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v" Sep 10 16:08:51.304122 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.304103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/47ebb480-aecc-4ab6-8eae-a262abb2e0a3-manager-config\") pod \"lws-controller-manager-5745f97d58-wcs9v\" (UID: \"47ebb480-aecc-4ab6-8eae-a262abb2e0a3\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v" Sep 10 16:08:51.304698 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.304672 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/47ebb480-aecc-4ab6-8eae-a262abb2e0a3-manager-config\") pod \"lws-controller-manager-5745f97d58-wcs9v\" (UID: \"47ebb480-aecc-4ab6-8eae-a262abb2e0a3\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v" Sep 10 16:08:51.306316 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.306297 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/47ebb480-aecc-4ab6-8eae-a262abb2e0a3-metrics-cert\") pod \"lws-controller-manager-5745f97d58-wcs9v\" (UID: \"47ebb480-aecc-4ab6-8eae-a262abb2e0a3\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v" Sep 10 16:08:51.306381 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.306352 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47ebb480-aecc-4ab6-8eae-a262abb2e0a3-cert\") pod \"lws-controller-manager-5745f97d58-wcs9v\" (UID: \"47ebb480-aecc-4ab6-8eae-a262abb2e0a3\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v" Sep 10 16:08:51.312678 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.312652 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rkxh\" (UniqueName: \"kubernetes.io/projected/47ebb480-aecc-4ab6-8eae-a262abb2e0a3-kube-api-access-4rkxh\") pod \"lws-controller-manager-5745f97d58-wcs9v\" (UID: \"47ebb480-aecc-4ab6-8eae-a262abb2e0a3\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v" Sep 10 16:08:51.454355 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.454245 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v" Sep 10 16:08:51.731097 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.731042 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v"] Sep 10 16:08:51.734686 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:08:51.734640 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47ebb480_aecc_4ab6_8eae_a262abb2e0a3.slice/crio-7096941170dc396865a843e3e00fe2ba40dc6d90ebd5a21a93320609262c39c4 WatchSource:0}: Error finding container 7096941170dc396865a843e3e00fe2ba40dc6d90ebd5a21a93320609262c39c4: Status 404 returned error can't find the container with id 7096941170dc396865a843e3e00fe2ba40dc6d90ebd5a21a93320609262c39c4 Sep 10 16:08:51.737233 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:51.737212 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 16:08:52.440272 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.440229 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v" event={"ID":"47ebb480-aecc-4ab6-8eae-a262abb2e0a3","Type":"ContainerStarted","Data":"7096941170dc396865a843e3e00fe2ba40dc6d90ebd5a21a93320609262c39c4"} Sep 10 16:08:52.494072 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.494023 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9vjkc"] Sep 10 16:08:52.497535 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.497514 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9vjkc" Sep 10 16:08:52.501184 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.501159 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 10 16:08:52.501330 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.501209 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-9kpkn\"" Sep 10 16:08:52.502232 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.502206 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:52.515861 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.515830 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9vjkc"] Sep 10 16:08:52.517471 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.517446 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fnfmh"] Sep 10 16:08:52.519996 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.519961 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnfmh" Sep 10 16:08:52.523587 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.523565 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 10 16:08:52.524690 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.523804 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-ssfdk\"" Sep 10 16:08:52.537416 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.537388 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fnfmh"] Sep 10 16:08:52.601780 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.601743 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:52.619714 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.619679 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76a98092-efff-46ba-97bf-dad4a1010a31-cert\") pod \"kserve-controller-manager-d6f4b65b8-9vjkc\" (UID: \"76a98092-efff-46ba-97bf-dad4a1010a31\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9vjkc" Sep 10 16:08:52.619714 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.619723 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhvnc\" (UniqueName: \"kubernetes.io/projected/8fbddd6b-f387-4c4a-9b00-39f96f04fd5c-kube-api-access-vhvnc\") pod \"llmisvc-controller-manager-777c6bd7d5-fnfmh\" (UID: \"8fbddd6b-f387-4c4a-9b00-39f96f04fd5c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnfmh" Sep 10 16:08:52.619961 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.619768 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8fbddd6b-f387-4c4a-9b00-39f96f04fd5c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fnfmh\" (UID: \"8fbddd6b-f387-4c4a-9b00-39f96f04fd5c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnfmh" Sep 10 16:08:52.619961 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.619817 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkk82\" (UniqueName: \"kubernetes.io/projected/76a98092-efff-46ba-97bf-dad4a1010a31-kube-api-access-mkk82\") pod \"kserve-controller-manager-d6f4b65b8-9vjkc\" (UID: \"76a98092-efff-46ba-97bf-dad4a1010a31\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9vjkc" Sep 10 16:08:52.715149 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.715063 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:52.721203 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.721178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkk82\" (UniqueName: \"kubernetes.io/projected/76a98092-efff-46ba-97bf-dad4a1010a31-kube-api-access-mkk82\") pod \"kserve-controller-manager-d6f4b65b8-9vjkc\" (UID: \"76a98092-efff-46ba-97bf-dad4a1010a31\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9vjkc" Sep 10 16:08:52.721282 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.721232 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76a98092-efff-46ba-97bf-dad4a1010a31-cert\") pod \"kserve-controller-manager-d6f4b65b8-9vjkc\" (UID: \"76a98092-efff-46ba-97bf-dad4a1010a31\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9vjkc" Sep 10 16:08:52.721282 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.721259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhvnc\" (UniqueName: \"kubernetes.io/projected/8fbddd6b-f387-4c4a-9b00-39f96f04fd5c-kube-api-access-vhvnc\") pod \"llmisvc-controller-manager-777c6bd7d5-fnfmh\" (UID: \"8fbddd6b-f387-4c4a-9b00-39f96f04fd5c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnfmh" Sep 10 16:08:52.721386 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.721305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8fbddd6b-f387-4c4a-9b00-39f96f04fd5c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fnfmh\" (UID: \"8fbddd6b-f387-4c4a-9b00-39f96f04fd5c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnfmh" Sep 10 16:08:52.721386 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:08:52.721347 2578 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Sep 10 16:08:52.721480 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:08:52.721419 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76a98092-efff-46ba-97bf-dad4a1010a31-cert podName:76a98092-efff-46ba-97bf-dad4a1010a31 nodeName:}" failed. No retries permitted until 2026-09-10 16:08:53.221399651 +0000 UTC m=+327.935667627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/76a98092-efff-46ba-97bf-dad4a1010a31-cert") pod "kserve-controller-manager-d6f4b65b8-9vjkc" (UID: "76a98092-efff-46ba-97bf-dad4a1010a31") : secret "kserve-webhook-server-cert" not found Sep 10 16:08:52.723876 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.723851 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8fbddd6b-f387-4c4a-9b00-39f96f04fd5c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fnfmh\" (UID: \"8fbddd6b-f387-4c4a-9b00-39f96f04fd5c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnfmh" Sep 10 16:08:52.732751 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.732721 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkk82\" (UniqueName: \"kubernetes.io/projected/76a98092-efff-46ba-97bf-dad4a1010a31-kube-api-access-mkk82\") pod \"kserve-controller-manager-d6f4b65b8-9vjkc\" (UID: \"76a98092-efff-46ba-97bf-dad4a1010a31\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9vjkc" Sep 10 16:08:52.736974 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.736948 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhvnc\" (UniqueName: \"kubernetes.io/projected/8fbddd6b-f387-4c4a-9b00-39f96f04fd5c-kube-api-access-vhvnc\") pod \"llmisvc-controller-manager-777c6bd7d5-fnfmh\" (UID: \"8fbddd6b-f387-4c4a-9b00-39f96f04fd5c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnfmh" Sep 10 16:08:52.848161 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.848125 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnfmh" Sep 10 16:08:52.893009 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:52.892938 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:53.122459 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:53.122421 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fnfmh"] Sep 10 16:08:53.126435 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:08:53.126391 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8fbddd6b_f387_4c4a_9b00_39f96f04fd5c.slice/crio-0c5480eefa549a635fdfa20f13272bccc729a786d1939e849c785757f7611a09 WatchSource:0}: Error finding container 0c5480eefa549a635fdfa20f13272bccc729a786d1939e849c785757f7611a09: Status 404 returned error can't find the container with id 0c5480eefa549a635fdfa20f13272bccc729a786d1939e849c785757f7611a09 Sep 10 16:08:53.227500 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:53.227454 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76a98092-efff-46ba-97bf-dad4a1010a31-cert\") pod \"kserve-controller-manager-d6f4b65b8-9vjkc\" (UID: \"76a98092-efff-46ba-97bf-dad4a1010a31\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9vjkc" Sep 10 16:08:53.230769 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:53.230730 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76a98092-efff-46ba-97bf-dad4a1010a31-cert\") pod \"kserve-controller-manager-d6f4b65b8-9vjkc\" (UID: \"76a98092-efff-46ba-97bf-dad4a1010a31\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9vjkc" Sep 10 16:08:53.410367 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:53.410137 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9vjkc" Sep 10 16:08:53.449103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:53.449022 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnfmh" event={"ID":"8fbddd6b-f387-4c4a-9b00-39f96f04fd5c","Type":"ContainerStarted","Data":"0c5480eefa549a635fdfa20f13272bccc729a786d1939e849c785757f7611a09"} Sep 10 16:08:53.720622 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:53.720596 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9vjkc"] Sep 10 16:08:53.758024 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:53.757968 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:53.893157 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:53.893115 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:08:54.589851 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:08:54.589816 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a98092_efff_46ba_97bf_dad4a1010a31.slice/crio-23bb51eabc36e820a7f1e0b8e6870bd17d13a6e3c54cb0b99a11441560f5312d WatchSource:0}: Error finding container 23bb51eabc36e820a7f1e0b8e6870bd17d13a6e3c54cb0b99a11441560f5312d: Status 404 returned error can't find the container with id 23bb51eabc36e820a7f1e0b8e6870bd17d13a6e3c54cb0b99a11441560f5312d Sep 10 16:08:55.463245 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:55.463207 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9vjkc" event={"ID":"76a98092-efff-46ba-97bf-dad4a1010a31","Type":"ContainerStarted","Data":"23bb51eabc36e820a7f1e0b8e6870bd17d13a6e3c54cb0b99a11441560f5312d"} Sep 10 16:08:55.465124 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:55.465084 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v" event={"ID":"47ebb480-aecc-4ab6-8eae-a262abb2e0a3","Type":"ContainerStarted","Data":"02bbe21f77465d481ac7b894c479bc0ee2663c0272b2048643197c3a6d5662cf"} Sep 10 16:08:55.465305 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:55.465282 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v" Sep 10 16:08:55.484096 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:55.484038 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v" podStartSLOduration=1.58282209 podStartE2EDuration="4.484015593s" totalImagesPullingTime="2.901193503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:08:55.483384263 +0000 UTC m=+330.197652258" watchObservedRunningTime="2026-09-10 16:08:55.484015593 +0000 UTC m=+330.198283585" Sep 10 16:08:58.481816 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:58.481775 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnfmh" event={"ID":"8fbddd6b-f387-4c4a-9b00-39f96f04fd5c","Type":"ContainerStarted","Data":"d126bfd10365f5fcd47813e45b3f5485f4abc229fe743e1c1f50e42034ccb4c3"} Sep 10 16:08:58.482325 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:58.481969 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnfmh" Sep 10 16:08:58.483575 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:58.483550 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9vjkc" event={"ID":"76a98092-efff-46ba-97bf-dad4a1010a31","Type":"ContainerStarted","Data":"c30544af6f80bb9756aa8a50475d2f97f3d272f12291eb80988da820e811993a"} Sep 10 16:08:58.483679 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:58.483664 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9vjkc" Sep 10 16:08:58.499356 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:58.499308 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnfmh" podStartSLOduration=1.545621745 podStartE2EDuration="6.499293806s" totalImagesPullingTime="4.953672061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:08:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:08:58.49849549 +0000 UTC m=+333.212763503" watchObservedRunningTime="2026-09-10 16:08:58.499293806 +0000 UTC m=+333.213561802" Sep 10 16:08:58.519046 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:08:58.518998 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9vjkc" podStartSLOduration=3.029244751 podStartE2EDuration="6.518968636s" totalImagesPullingTime="3.489723885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:08:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:08:58.517493372 +0000 UTC m=+333.231761368" watchObservedRunningTime="2026-09-10 16:08:58.518968636 +0000 UTC m=+333.233236632" Sep 10 16:09:06.473412 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:06.473379 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5745f97d58-wcs9v" Sep 10 16:09:08.072106 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:08.072072 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:09:22.930935 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:22.929785 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dcf4fddbf-cxq9h"] Sep 10 16:09:22.938775 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:22.938750 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:22.942713 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:22.942685 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dcf4fddbf-cxq9h"] Sep 10 16:09:22.980133 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:22.980101 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:09:22.992797 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:22.992768 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f22547ed-acb5-4040-b3ea-1d05c0776b1c-trusted-ca-bundle\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:22.992949 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:22.992832 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f22547ed-acb5-4040-b3ea-1d05c0776b1c-console-config\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:22.992949 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:22.992870 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f22547ed-acb5-4040-b3ea-1d05c0776b1c-console-serving-cert\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:22.992949 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:22.992902 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74vf6\" (UniqueName: \"kubernetes.io/projected/f22547ed-acb5-4040-b3ea-1d05c0776b1c-kube-api-access-74vf6\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:22.993089 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:22.992958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f22547ed-acb5-4040-b3ea-1d05c0776b1c-oauth-serving-cert\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:22.993089 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:22.993013 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f22547ed-acb5-4040-b3ea-1d05c0776b1c-console-oauth-config\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:22.993089 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:22.993066 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f22547ed-acb5-4040-b3ea-1d05c0776b1c-service-ca\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:23.033941 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:23.033909 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:09:23.094362 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:23.094329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74vf6\" (UniqueName: \"kubernetes.io/projected/f22547ed-acb5-4040-b3ea-1d05c0776b1c-kube-api-access-74vf6\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:23.094525 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:23.094375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f22547ed-acb5-4040-b3ea-1d05c0776b1c-oauth-serving-cert\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:23.094525 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:23.094396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f22547ed-acb5-4040-b3ea-1d05c0776b1c-console-oauth-config\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:23.094525 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:23.094439 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f22547ed-acb5-4040-b3ea-1d05c0776b1c-service-ca\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:23.094525 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:23.094480 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f22547ed-acb5-4040-b3ea-1d05c0776b1c-trusted-ca-bundle\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:23.094525 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:23.094527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f22547ed-acb5-4040-b3ea-1d05c0776b1c-console-config\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:23.094781 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:23.094549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f22547ed-acb5-4040-b3ea-1d05c0776b1c-console-serving-cert\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:23.095237 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:23.095211 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f22547ed-acb5-4040-b3ea-1d05c0776b1c-oauth-serving-cert\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:23.095334 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:23.095257 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f22547ed-acb5-4040-b3ea-1d05c0776b1c-service-ca\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:23.095389 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:23.095363 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f22547ed-acb5-4040-b3ea-1d05c0776b1c-console-config\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:23.095458 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:23.095440 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f22547ed-acb5-4040-b3ea-1d05c0776b1c-trusted-ca-bundle\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:23.097042 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:23.097021 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f22547ed-acb5-4040-b3ea-1d05c0776b1c-console-serving-cert\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:23.097182 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:23.097162 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f22547ed-acb5-4040-b3ea-1d05c0776b1c-console-oauth-config\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:23.103155 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:23.103132 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74vf6\" (UniqueName: \"kubernetes.io/projected/f22547ed-acb5-4040-b3ea-1d05c0776b1c-kube-api-access-74vf6\") pod \"console-5dcf4fddbf-cxq9h\" (UID: \"f22547ed-acb5-4040-b3ea-1d05c0776b1c\") " pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:23.248945 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:23.248906 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:23.522467 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:23.522439 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dcf4fddbf-cxq9h"] Sep 10 16:09:23.524721 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:09:23.524691 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf22547ed_acb5_4040_b3ea_1d05c0776b1c.slice/crio-ae73a6e150270f8cde97aecafc4ddc57a9e8eabc66d861b2b7da8d51b94125bf WatchSource:0}: Error finding container ae73a6e150270f8cde97aecafc4ddc57a9e8eabc66d861b2b7da8d51b94125bf: Status 404 returned error can't find the container with id ae73a6e150270f8cde97aecafc4ddc57a9e8eabc66d861b2b7da8d51b94125bf Sep 10 16:09:23.608960 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:23.608926 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dcf4fddbf-cxq9h" event={"ID":"f22547ed-acb5-4040-b3ea-1d05c0776b1c","Type":"ContainerStarted","Data":"15a0a9d5f4be33756fdae5dd90e428afaecb44ad491fd2477603902edc50659e"} Sep 10 16:09:23.609164 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:23.608974 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dcf4fddbf-cxq9h" event={"ID":"f22547ed-acb5-4040-b3ea-1d05c0776b1c","Type":"ContainerStarted","Data":"ae73a6e150270f8cde97aecafc4ddc57a9e8eabc66d861b2b7da8d51b94125bf"} Sep 10 16:09:23.632889 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:23.632822 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dcf4fddbf-cxq9h" podStartSLOduration=1.632800482 podStartE2EDuration="1.632800482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:09:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:09:23.631200934 +0000 UTC m=+358.345468930" watchObservedRunningTime="2026-09-10 16:09:23.632800482 +0000 UTC m=+358.347068478" Sep 10 16:09:29.490786 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:29.490750 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnfmh" Sep 10 16:09:29.493738 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:29.493718 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9vjkc" Sep 10 16:09:33.249715 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:33.249674 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:33.250159 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:33.249740 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:33.254322 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:33.254296 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:33.659214 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:33.659133 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dcf4fddbf-cxq9h" Sep 10 16:09:33.708099 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:33.708055 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55f8bd5bd8-kc2pv"] Sep 10 16:09:33.818920 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:33.818888 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:09:33.873753 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:33.873724 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:09:38.002868 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:38.002831 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:09:38.060534 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:38.060503 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:09:43.713487 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:43.713453 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:09:43.812327 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:43.812293 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:09:46.994340 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:46.994304 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:09:58.733841 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:58.733788 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-55f8bd5bd8-kc2pv" podUID="d049b3e4-88a8-4b15-a06e-acd171635c9f" containerName="console" containerID="cri-o://7dacd61ea35114f164128f3425eca946fcce1a0473d7ff801d9678c215521e6e" gracePeriod=15 Sep 10 16:09:58.972322 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:58.972299 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:09:59.126345 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.126247 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-service-ca\") pod \"d049b3e4-88a8-4b15-a06e-acd171635c9f\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " Sep 10 16:09:59.126345 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.126307 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-console-config\") pod \"d049b3e4-88a8-4b15-a06e-acd171635c9f\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " Sep 10 16:09:59.126575 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.126360 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-trusted-ca-bundle\") pod \"d049b3e4-88a8-4b15-a06e-acd171635c9f\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " Sep 10 16:09:59.126575 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.126399 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-oauth-serving-cert\") pod \"d049b3e4-88a8-4b15-a06e-acd171635c9f\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " Sep 10 16:09:59.126575 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.126422 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-br9fx\" (UniqueName: \"kubernetes.io/projected/d049b3e4-88a8-4b15-a06e-acd171635c9f-kube-api-access-br9fx\") pod \"d049b3e4-88a8-4b15-a06e-acd171635c9f\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " Sep 10 16:09:59.126575 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.126461 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d049b3e4-88a8-4b15-a06e-acd171635c9f-console-serving-cert\") pod \"d049b3e4-88a8-4b15-a06e-acd171635c9f\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " Sep 10 16:09:59.126575 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.126489 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d049b3e4-88a8-4b15-a06e-acd171635c9f-console-oauth-config\") pod \"d049b3e4-88a8-4b15-a06e-acd171635c9f\" (UID: \"d049b3e4-88a8-4b15-a06e-acd171635c9f\") " Sep 10 16:09:59.126816 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.126743 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-service-ca" (OuterVolumeSpecName: "service-ca") pod "d049b3e4-88a8-4b15-a06e-acd171635c9f" (UID: "d049b3e4-88a8-4b15-a06e-acd171635c9f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:09:59.126854 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.126804 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-console-config" (OuterVolumeSpecName: "console-config") pod "d049b3e4-88a8-4b15-a06e-acd171635c9f" (UID: "d049b3e4-88a8-4b15-a06e-acd171635c9f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:09:59.126854 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.126812 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d049b3e4-88a8-4b15-a06e-acd171635c9f" (UID: "d049b3e4-88a8-4b15-a06e-acd171635c9f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:09:59.126917 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.126849 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d049b3e4-88a8-4b15-a06e-acd171635c9f" (UID: "d049b3e4-88a8-4b15-a06e-acd171635c9f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:09:59.128738 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.128704 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d049b3e4-88a8-4b15-a06e-acd171635c9f-kube-api-access-br9fx" (OuterVolumeSpecName: "kube-api-access-br9fx") pod "d049b3e4-88a8-4b15-a06e-acd171635c9f" (UID: "d049b3e4-88a8-4b15-a06e-acd171635c9f"). InnerVolumeSpecName "kube-api-access-br9fx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:09:59.128840 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.128733 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d049b3e4-88a8-4b15-a06e-acd171635c9f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d049b3e4-88a8-4b15-a06e-acd171635c9f" (UID: "d049b3e4-88a8-4b15-a06e-acd171635c9f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:09:59.128840 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.128814 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d049b3e4-88a8-4b15-a06e-acd171635c9f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d049b3e4-88a8-4b15-a06e-acd171635c9f" (UID: "d049b3e4-88a8-4b15-a06e-acd171635c9f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:09:59.227915 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.227880 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-service-ca\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:09:59.227915 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.227906 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-console-config\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:09:59.227915 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.227916 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-trusted-ca-bundle\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:09:59.228138 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.227925 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d049b3e4-88a8-4b15-a06e-acd171635c9f-oauth-serving-cert\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:09:59.228138 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.227934 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-br9fx\" (UniqueName: \"kubernetes.io/projected/d049b3e4-88a8-4b15-a06e-acd171635c9f-kube-api-access-br9fx\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:09:59.228138 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.227944 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d049b3e4-88a8-4b15-a06e-acd171635c9f-console-serving-cert\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:09:59.228138 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.227952 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d049b3e4-88a8-4b15-a06e-acd171635c9f-console-oauth-config\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:09:59.270117 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.270072 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:09:59.773235 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.773202 2578 generic.go:356] "Generic (PLEG): container finished" podID="d049b3e4-88a8-4b15-a06e-acd171635c9f" containerID="7dacd61ea35114f164128f3425eca946fcce1a0473d7ff801d9678c215521e6e" exitCode=0 Sep 10 16:09:59.773642 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.773246 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f8bd5bd8-kc2pv" Sep 10 16:09:59.773642 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.773284 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f8bd5bd8-kc2pv" event={"ID":"d049b3e4-88a8-4b15-a06e-acd171635c9f","Type":"ContainerDied","Data":"7dacd61ea35114f164128f3425eca946fcce1a0473d7ff801d9678c215521e6e"} Sep 10 16:09:59.773642 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.773336 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f8bd5bd8-kc2pv" event={"ID":"d049b3e4-88a8-4b15-a06e-acd171635c9f","Type":"ContainerDied","Data":"8633ac39f7c50038f498c711be78e975d1bb6564c83a2dca3d52cb0e061be7e9"} Sep 10 16:09:59.773642 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.773356 2578 scope.go:117] "RemoveContainer" containerID="7dacd61ea35114f164128f3425eca946fcce1a0473d7ff801d9678c215521e6e" Sep 10 16:09:59.784623 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.784593 2578 scope.go:117] "RemoveContainer" containerID="7dacd61ea35114f164128f3425eca946fcce1a0473d7ff801d9678c215521e6e" Sep 10 16:09:59.785000 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:09:59.784961 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dacd61ea35114f164128f3425eca946fcce1a0473d7ff801d9678c215521e6e\": container with ID starting with 7dacd61ea35114f164128f3425eca946fcce1a0473d7ff801d9678c215521e6e not found: ID does not exist" containerID="7dacd61ea35114f164128f3425eca946fcce1a0473d7ff801d9678c215521e6e" Sep 10 16:09:59.785097 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.785007 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dacd61ea35114f164128f3425eca946fcce1a0473d7ff801d9678c215521e6e"} err="failed to get container status \"7dacd61ea35114f164128f3425eca946fcce1a0473d7ff801d9678c215521e6e\": rpc error: code = NotFound desc = could not find container \"7dacd61ea35114f164128f3425eca946fcce1a0473d7ff801d9678c215521e6e\": container with ID starting with 7dacd61ea35114f164128f3425eca946fcce1a0473d7ff801d9678c215521e6e not found: ID does not exist" Sep 10 16:09:59.803747 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.803714 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55f8bd5bd8-kc2pv"] Sep 10 16:09:59.810444 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:09:59.810422 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55f8bd5bd8-kc2pv"] Sep 10 16:10:01.264589 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:01.264552 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9f4sk"] Sep 10 16:10:01.264978 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:01.264928 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d049b3e4-88a8-4b15-a06e-acd171635c9f" containerName="console" Sep 10 16:10:01.264978 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:01.264939 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d049b3e4-88a8-4b15-a06e-acd171635c9f" containerName="console" Sep 10 16:10:01.265089 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:01.265041 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d049b3e4-88a8-4b15-a06e-acd171635c9f" containerName="console" Sep 10 16:10:01.267901 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:01.267881 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9f4sk" Sep 10 16:10:01.270889 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:01.270853 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 10 16:10:01.270889 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:01.270862 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-4tpkz\"" Sep 10 16:10:01.271089 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:01.270958 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 10 16:10:01.271922 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:01.271904 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 10 16:10:01.282018 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:01.281976 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9f4sk"] Sep 10 16:10:01.449786 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:01.449745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xr5r\" (UniqueName: \"kubernetes.io/projected/ea8e0430-221b-4459-b2ce-990754af52c0-kube-api-access-4xr5r\") pod \"dns-operator-controller-manager-7b84cd7c9c-9f4sk\" (UID: \"ea8e0430-221b-4459-b2ce-990754af52c0\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9f4sk" Sep 10 16:10:01.551297 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:01.551188 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xr5r\" (UniqueName: \"kubernetes.io/projected/ea8e0430-221b-4459-b2ce-990754af52c0-kube-api-access-4xr5r\") pod \"dns-operator-controller-manager-7b84cd7c9c-9f4sk\" (UID: \"ea8e0430-221b-4459-b2ce-990754af52c0\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9f4sk" Sep 10 16:10:01.567126 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:01.567086 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xr5r\" (UniqueName: \"kubernetes.io/projected/ea8e0430-221b-4459-b2ce-990754af52c0-kube-api-access-4xr5r\") pod \"dns-operator-controller-manager-7b84cd7c9c-9f4sk\" (UID: \"ea8e0430-221b-4459-b2ce-990754af52c0\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9f4sk" Sep 10 16:10:01.578646 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:01.578618 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9f4sk" Sep 10 16:10:01.784897 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:01.784853 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d049b3e4-88a8-4b15-a06e-acd171635c9f" path="/var/lib/kubelet/pods/d049b3e4-88a8-4b15-a06e-acd171635c9f/volumes" Sep 10 16:10:01.868253 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:01.868228 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9f4sk"] Sep 10 16:10:01.870759 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:10:01.870730 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea8e0430_221b_4459_b2ce_990754af52c0.slice/crio-3b3d98a0038555ba90c72a2f96efc5f6e3e00a8d65f59e7b702b8365ae0c8d0c WatchSource:0}: Error finding container 3b3d98a0038555ba90c72a2f96efc5f6e3e00a8d65f59e7b702b8365ae0c8d0c: Status 404 returned error can't find the container with id 3b3d98a0038555ba90c72a2f96efc5f6e3e00a8d65f59e7b702b8365ae0c8d0c Sep 10 16:10:02.077853 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:02.077823 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:02.790211 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:02.790179 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9f4sk" event={"ID":"ea8e0430-221b-4459-b2ce-990754af52c0","Type":"ContainerStarted","Data":"3b3d98a0038555ba90c72a2f96efc5f6e3e00a8d65f59e7b702b8365ae0c8d0c"} Sep 10 16:10:03.401648 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:03.401611 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4"] Sep 10 16:10:03.405034 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:03.405009 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4" Sep 10 16:10:03.408620 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:03.408598 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pc28t\"" Sep 10 16:10:03.421164 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:03.421140 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4"] Sep 10 16:10:03.568576 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:03.568537 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92xch\" (UniqueName: \"kubernetes.io/projected/bf302565-3feb-4f26-90e9-18b2fc6925ea-kube-api-access-92xch\") pod \"limitador-operator-controller-manager-74495c69f8-kfsb4\" (UID: \"bf302565-3feb-4f26-90e9-18b2fc6925ea\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4" Sep 10 16:10:03.669884 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:03.669790 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92xch\" (UniqueName: \"kubernetes.io/projected/bf302565-3feb-4f26-90e9-18b2fc6925ea-kube-api-access-92xch\") pod \"limitador-operator-controller-manager-74495c69f8-kfsb4\" (UID: \"bf302565-3feb-4f26-90e9-18b2fc6925ea\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4" Sep 10 16:10:03.684511 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:03.684481 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92xch\" (UniqueName: \"kubernetes.io/projected/bf302565-3feb-4f26-90e9-18b2fc6925ea-kube-api-access-92xch\") pod \"limitador-operator-controller-manager-74495c69f8-kfsb4\" (UID: \"bf302565-3feb-4f26-90e9-18b2fc6925ea\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4" Sep 10 16:10:03.717375 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:03.717328 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4" Sep 10 16:10:03.864336 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:03.864297 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:03.972783 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:03.972704 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:03.993522 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:03.993499 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4"] Sep 10 16:10:03.995892 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:10:03.995866 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf302565_3feb_4f26_90e9_18b2fc6925ea.slice/crio-4107bec3c98c2a316adff9ba8d89707179f4ed5e8bbf4e44a69310d8fd5b988a WatchSource:0}: Error finding container 4107bec3c98c2a316adff9ba8d89707179f4ed5e8bbf4e44a69310d8fd5b988a: Status 404 returned error can't find the container with id 4107bec3c98c2a316adff9ba8d89707179f4ed5e8bbf4e44a69310d8fd5b988a Sep 10 16:10:04.455294 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:04.455256 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:04.805862 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:04.805823 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4" event={"ID":"bf302565-3feb-4f26-90e9-18b2fc6925ea","Type":"ContainerStarted","Data":"4107bec3c98c2a316adff9ba8d89707179f4ed5e8bbf4e44a69310d8fd5b988a"} Sep 10 16:10:04.840040 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:04.839952 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:05.121291 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:05.121191 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:05.903868 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:05.903833 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:06.816867 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:06.816825 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9f4sk" event={"ID":"ea8e0430-221b-4459-b2ce-990754af52c0","Type":"ContainerStarted","Data":"9d550ab774d9b338199b9ef679e9617a502bdfd17fad06801dd570bb0f6e5286"} Sep 10 16:10:06.817280 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:06.816971 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9f4sk" Sep 10 16:10:06.838488 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:06.838437 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9f4sk" podStartSLOduration=1.6939825160000002 podStartE2EDuration="5.838419162s" totalImagesPullingTime="4.144436646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:10:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:10:06.836752539 +0000 UTC m=+401.551020533" watchObservedRunningTime="2026-09-10 16:10:06.838419162 +0000 UTC m=+401.552687157" Sep 10 16:10:07.823366 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:07.823327 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4" event={"ID":"bf302565-3feb-4f26-90e9-18b2fc6925ea","Type":"ContainerStarted","Data":"2176cdcfe7389f00f2cf83aa58edb25819cac39ab5fe518f7e99af60bb5eadf8"} Sep 10 16:10:07.823829 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:07.823691 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4" Sep 10 16:10:07.845833 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:07.845772 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4" podStartSLOduration=1.9922618760000002 podStartE2EDuration="4.845754564s" totalImagesPullingTime="2.853492688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:10:07.843645305 +0000 UTC m=+402.557913301" watchObservedRunningTime="2026-09-10 16:10:07.845754564 +0000 UTC m=+402.560022559" Sep 10 16:10:08.032610 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:08.032570 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:08.420695 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:08.420640 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:09.892703 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:09.892667 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:10.345746 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:10.345707 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-x9sck"] Sep 10 16:10:10.348561 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:10.348538 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-x9sck" Sep 10 16:10:10.351664 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:10.351647 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-vfhgj\"" Sep 10 16:10:10.370374 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:10.370338 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-x9sck"] Sep 10 16:10:10.434507 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:10.434471 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcnhc\" (UniqueName: \"kubernetes.io/projected/08297e00-4b09-4512-85ab-cd457cb7a924-kube-api-access-jcnhc\") pod \"authorino-operator-76b478bd78-x9sck\" (UID: \"08297e00-4b09-4512-85ab-cd457cb7a924\") " pod="kuadrant-system/authorino-operator-76b478bd78-x9sck" Sep 10 16:10:10.535602 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:10.535564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcnhc\" (UniqueName: \"kubernetes.io/projected/08297e00-4b09-4512-85ab-cd457cb7a924-kube-api-access-jcnhc\") pod \"authorino-operator-76b478bd78-x9sck\" (UID: \"08297e00-4b09-4512-85ab-cd457cb7a924\") " pod="kuadrant-system/authorino-operator-76b478bd78-x9sck" Sep 10 16:10:10.546837 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:10.546807 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcnhc\" (UniqueName: \"kubernetes.io/projected/08297e00-4b09-4512-85ab-cd457cb7a924-kube-api-access-jcnhc\") pod \"authorino-operator-76b478bd78-x9sck\" (UID: \"08297e00-4b09-4512-85ab-cd457cb7a924\") " pod="kuadrant-system/authorino-operator-76b478bd78-x9sck" Sep 10 16:10:10.658514 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:10.658426 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-x9sck" Sep 10 16:10:10.940965 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:10:10.940935 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08297e00_4b09_4512_85ab_cd457cb7a924.slice/crio-d9de8c46792447a4088eff4cfb70738ab534409bd35de244e3ac854ca0a0e858 WatchSource:0}: Error finding container d9de8c46792447a4088eff4cfb70738ab534409bd35de244e3ac854ca0a0e858: Status 404 returned error can't find the container with id d9de8c46792447a4088eff4cfb70738ab534409bd35de244e3ac854ca0a0e858 Sep 10 16:10:10.949172 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:10.949144 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-x9sck"] Sep 10 16:10:11.844370 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:11.844324 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-x9sck" event={"ID":"08297e00-4b09-4512-85ab-cd457cb7a924","Type":"ContainerStarted","Data":"d9de8c46792447a4088eff4cfb70738ab534409bd35de244e3ac854ca0a0e858"} Sep 10 16:10:11.852055 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:11.852021 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:11.957343 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:11.957301 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:12.600123 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:12.600090 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:12.699191 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:12.699113 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:12.850607 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:12.850572 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-x9sck" event={"ID":"08297e00-4b09-4512-85ab-cd457cb7a924","Type":"ContainerStarted","Data":"dbf8cc0730388f943c21b70e920195cbe7da08db6b1dfc6f92010b5c17550ada"} Sep 10 16:10:12.850779 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:12.850767 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-x9sck" Sep 10 16:10:12.867860 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:12.867807 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-x9sck" podStartSLOduration=1.403366636 podStartE2EDuration="2.867787556s" totalImagesPullingTime="1.46442092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:10:12.86654412 +0000 UTC m=+407.580812115" watchObservedRunningTime="2026-09-10 16:10:12.867787556 +0000 UTC m=+407.582055551" Sep 10 16:10:15.304857 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:15.304820 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:15.418043 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:15.418010 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:15.520383 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:15.520349 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:15.935772 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:15.935731 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:17.826224 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:17.826195 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9f4sk" Sep 10 16:10:18.830773 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:18.830738 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4" Sep 10 16:10:19.473930 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:19.473897 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:19.586609 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:19.586579 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:19.707887 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:19.707853 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:23.858107 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:23.858073 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-x9sck" Sep 10 16:10:26.744113 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:26.744078 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4"] Sep 10 16:10:26.744534 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:26.744354 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4" podUID="bf302565-3feb-4f26-90e9-18b2fc6925ea" containerName="manager" containerID="cri-o://2176cdcfe7389f00f2cf83aa58edb25819cac39ab5fe518f7e99af60bb5eadf8" gracePeriod=2 Sep 10 16:10:26.757558 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:26.757525 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4"] Sep 10 16:10:26.758830 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:10:26.758792 2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"bf302565-3feb-4f26-90e9-18b2fc6925ea\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-kfsb4\": pods \"limitador-operator-controller-manager-74495c69f8-kfsb4\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4" Sep 10 16:10:26.770103 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:26.770077 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rlqfp"] Sep 10 16:10:26.770480 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:26.770468 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf302565-3feb-4f26-90e9-18b2fc6925ea" containerName="manager" Sep 10 16:10:26.770529 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:26.770483 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf302565-3feb-4f26-90e9-18b2fc6925ea" containerName="manager" Sep 10 16:10:26.770582 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:26.770571 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf302565-3feb-4f26-90e9-18b2fc6925ea" containerName="manager" Sep 10 16:10:26.772882 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:26.772864 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rlqfp" Sep 10 16:10:26.776009 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:10:26.775968 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-kfsb4\" is forbidden: User \"system:node:ip-10-0-135-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-144.ec2.internal' and this object" podUID="bf302565-3feb-4f26-90e9-18b2fc6925ea" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4" Sep 10 16:10:26.788555 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:26.788527 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rlqfp"] Sep 10 16:10:26.887360 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:26.887319 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4ddl\" (UniqueName: \"kubernetes.io/projected/bacea6b7-efa1-4f65-b607-001feb3e8a6f-kube-api-access-c4ddl\") pod \"limitador-operator-controller-manager-74495c69f8-rlqfp\" (UID: \"bacea6b7-efa1-4f65-b607-001feb3e8a6f\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rlqfp" Sep 10 16:10:26.921154 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:26.921120 2578 generic.go:356] "Generic (PLEG): container finished" podID="bf302565-3feb-4f26-90e9-18b2fc6925ea" containerID="2176cdcfe7389f00f2cf83aa58edb25819cac39ab5fe518f7e99af60bb5eadf8" exitCode=0 Sep 10 16:10:26.979164 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:26.979137 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4" Sep 10 16:10:26.983752 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:10:26.983723 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-kfsb4\" is forbidden: User \"system:node:ip-10-0-135-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-144.ec2.internal' and this object" podUID="bf302565-3feb-4f26-90e9-18b2fc6925ea" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4" Sep 10 16:10:26.988298 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:26.988275 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ddl\" (UniqueName: \"kubernetes.io/projected/bacea6b7-efa1-4f65-b607-001feb3e8a6f-kube-api-access-c4ddl\") pod \"limitador-operator-controller-manager-74495c69f8-rlqfp\" (UID: \"bacea6b7-efa1-4f65-b607-001feb3e8a6f\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rlqfp" Sep 10 16:10:27.007236 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:27.007169 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4ddl\" (UniqueName: \"kubernetes.io/projected/bacea6b7-efa1-4f65-b607-001feb3e8a6f-kube-api-access-c4ddl\") pod \"limitador-operator-controller-manager-74495c69f8-rlqfp\" (UID: \"bacea6b7-efa1-4f65-b607-001feb3e8a6f\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rlqfp" Sep 10 16:10:27.088958 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:27.088924 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92xch\" (UniqueName: \"kubernetes.io/projected/bf302565-3feb-4f26-90e9-18b2fc6925ea-kube-api-access-92xch\") pod \"bf302565-3feb-4f26-90e9-18b2fc6925ea\" (UID: \"bf302565-3feb-4f26-90e9-18b2fc6925ea\") " Sep 10 16:10:27.091029 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:27.091005 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf302565-3feb-4f26-90e9-18b2fc6925ea-kube-api-access-92xch" (OuterVolumeSpecName: "kube-api-access-92xch") pod "bf302565-3feb-4f26-90e9-18b2fc6925ea" (UID: "bf302565-3feb-4f26-90e9-18b2fc6925ea"). InnerVolumeSpecName "kube-api-access-92xch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:10:27.131117 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:27.131077 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rlqfp" Sep 10 16:10:27.189921 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:27.189883 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92xch\" (UniqueName: \"kubernetes.io/projected/bf302565-3feb-4f26-90e9-18b2fc6925ea-kube-api-access-92xch\") on node \"ip-10-0-135-144.ec2.internal\" DevicePath \"\"" Sep 10 16:10:27.408703 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:27.408581 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rlqfp"] Sep 10 16:10:27.410904 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:10:27.410875 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbacea6b7_efa1_4f65_b607_001feb3e8a6f.slice/crio-6d7f1cbac943a010f8c7ad4d73bf3f878c4fffc7ff08702fa6a61d88571682d9 WatchSource:0}: Error finding container 6d7f1cbac943a010f8c7ad4d73bf3f878c4fffc7ff08702fa6a61d88571682d9: Status 404 returned error can't find the container with id 6d7f1cbac943a010f8c7ad4d73bf3f878c4fffc7ff08702fa6a61d88571682d9 Sep 10 16:10:27.784941 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:27.784909 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf302565-3feb-4f26-90e9-18b2fc6925ea" path="/var/lib/kubelet/pods/bf302565-3feb-4f26-90e9-18b2fc6925ea/volumes" Sep 10 16:10:27.926947 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:27.926913 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kfsb4" Sep 10 16:10:27.927132 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:27.926952 2578 scope.go:117] "RemoveContainer" containerID="2176cdcfe7389f00f2cf83aa58edb25819cac39ab5fe518f7e99af60bb5eadf8" Sep 10 16:10:27.928737 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:27.928707 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rlqfp" event={"ID":"bacea6b7-efa1-4f65-b607-001feb3e8a6f","Type":"ContainerStarted","Data":"af7f7ee38d5a35648025f96dc495f4aa821a9e2698d419496b68adb4f8363a22"} Sep 10 16:10:27.928906 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:27.928779 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rlqfp" event={"ID":"bacea6b7-efa1-4f65-b607-001feb3e8a6f","Type":"ContainerStarted","Data":"6d7f1cbac943a010f8c7ad4d73bf3f878c4fffc7ff08702fa6a61d88571682d9"} Sep 10 16:10:27.928906 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:27.928813 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rlqfp" Sep 10 16:10:27.977361 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:27.977307 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rlqfp" podStartSLOduration=1.97729257 podStartE2EDuration="1.97729257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:10:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:10:27.976785127 +0000 UTC m=+422.691053123" watchObservedRunningTime="2026-09-10 16:10:27.97729257 +0000 UTC m=+422.691560565" Sep 10 16:10:28.298461 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:28.298429 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:28.396909 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:28.396877 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:28.496131 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:28.496096 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:30.894754 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:30.894714 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:30.996820 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:30.996781 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:34.100559 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:34.100524 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:34.205161 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:34.205127 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:38.540649 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:38.540615 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:38.661753 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:38.661710 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:38.777385 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:38.777350 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:38.880653 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:38.880565 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:38.937761 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:38.937725 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rlqfp" Sep 10 16:10:38.994588 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:38.994559 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:42.745530 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:42.745491 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:42.853090 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:42.853045 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:47.397830 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:47.397738 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:47.497462 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:47.497429 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:55.309245 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:55.309211 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:10:55.557138 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:10:55.557100 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:11:09.512840 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:09.512801 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:11:09.612545 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:09.612503 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:11:10.576361 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:10.576326 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:11:10.653709 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:10.653680 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:11:10.754032 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:10.753975 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:11:11.022220 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:11.022180 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f2nxw"] Sep 10 16:11:11.025108 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:11.025083 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-f2nxw" Sep 10 16:11:11.032033 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:11.032006 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j5jtb\"" Sep 10 16:11:11.032302 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:11.032285 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 10 16:11:11.041172 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:11.041144 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f2nxw"] Sep 10 16:11:11.074193 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:11.074147 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f2nxw"] Sep 10 16:11:11.090599 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:11.090557 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2f9eca43-364a-4560-b75c-85a4fd11c490-config-file\") pod \"limitador-limitador-84994f7ffc-f2nxw\" (UID: \"2f9eca43-364a-4560-b75c-85a4fd11c490\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-f2nxw" Sep 10 16:11:11.090763 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:11.090605 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffb7s\" (UniqueName: \"kubernetes.io/projected/2f9eca43-364a-4560-b75c-85a4fd11c490-kube-api-access-ffb7s\") pod \"limitador-limitador-84994f7ffc-f2nxw\" (UID: \"2f9eca43-364a-4560-b75c-85a4fd11c490\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-f2nxw" Sep 10 16:11:11.191386 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:11.191343 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffb7s\" (UniqueName: \"kubernetes.io/projected/2f9eca43-364a-4560-b75c-85a4fd11c490-kube-api-access-ffb7s\") pod \"limitador-limitador-84994f7ffc-f2nxw\" (UID: \"2f9eca43-364a-4560-b75c-85a4fd11c490\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-f2nxw" Sep 10 16:11:11.191581 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:11.191449 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2f9eca43-364a-4560-b75c-85a4fd11c490-config-file\") pod \"limitador-limitador-84994f7ffc-f2nxw\" (UID: \"2f9eca43-364a-4560-b75c-85a4fd11c490\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-f2nxw" Sep 10 16:11:11.192043 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:11.192024 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2f9eca43-364a-4560-b75c-85a4fd11c490-config-file\") pod \"limitador-limitador-84994f7ffc-f2nxw\" (UID: \"2f9eca43-364a-4560-b75c-85a4fd11c490\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-f2nxw" Sep 10 16:11:11.200469 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:11.200446 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffb7s\" (UniqueName: \"kubernetes.io/projected/2f9eca43-364a-4560-b75c-85a4fd11c490-kube-api-access-ffb7s\") pod \"limitador-limitador-84994f7ffc-f2nxw\" (UID: \"2f9eca43-364a-4560-b75c-85a4fd11c490\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-f2nxw" Sep 10 16:11:11.335665 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:11.335563 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-f2nxw" Sep 10 16:11:11.422257 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:11.422217 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:11:11.520155 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:11.520120 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:11:11.612409 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:11.612325 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f2nxw"] Sep 10 16:11:11.615342 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:11:11.615311 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f9eca43_364a_4560_b75c_85a4fd11c490.slice/crio-3c350eb69801bb15cf7049bdc69a7a854de465e1ea19cbdef63b4d0ee17e91ab WatchSource:0}: Error finding container 3c350eb69801bb15cf7049bdc69a7a854de465e1ea19cbdef63b4d0ee17e91ab: Status 404 returned error can't find the container with id 3c350eb69801bb15cf7049bdc69a7a854de465e1ea19cbdef63b4d0ee17e91ab Sep 10 16:11:12.147933 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:12.147897 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-f2nxw" event={"ID":"2f9eca43-364a-4560-b75c-85a4fd11c490","Type":"ContainerStarted","Data":"3c350eb69801bb15cf7049bdc69a7a854de465e1ea19cbdef63b4d0ee17e91ab"} Sep 10 16:11:15.164015 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:15.163962 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-f2nxw" event={"ID":"2f9eca43-364a-4560-b75c-85a4fd11c490","Type":"ContainerStarted","Data":"d10aeae6e517159701c12da27ba98622241d648dec7a8e76aa1494138bcadc2f"} Sep 10 16:11:15.164430 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:15.164043 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-f2nxw" Sep 10 16:11:15.183515 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:15.183459 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-f2nxw" podStartSLOduration=2.539472181 podStartE2EDuration="5.183444504s" totalImagesPullingTime="2.643972323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:11:15.181666694 +0000 UTC m=+469.895934688" watchObservedRunningTime="2026-09-10 16:11:15.183444504 +0000 UTC m=+469.897712498" Sep 10 16:11:26.170531 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:26.170496 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-f2nxw" Sep 10 16:11:29.344865 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:29.344830 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:11:29.438426 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:29.438389 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:11:29.843883 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:29.843852 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:11:42.215573 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:42.215536 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:11:42.796563 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:42.796531 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:11:49.643743 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:49.643706 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:11:49.750554 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:49.750512 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:11:49.849756 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:49.849722 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:11:50.426453 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:50.426415 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:11:54.042511 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:54.042467 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:11:54.160883 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:11:54.160843 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:12:27.353316 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:12:27.353235 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:12:27.458554 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:12:27.458525 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:12:28.975206 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:12:28.975170 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:12:29.083248 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:12:29.083212 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:12:29.178885 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:12:29.178853 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:12:29.521871 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:12:29.521840 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:12:29.727087 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:12:29.727048 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f2nxw"] Sep 10 16:12:29.785325 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:12:29.785229 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:12:39.147518 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:12:39.147472 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:12:39.308669 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:12:39.308636 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:12:44.657203 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:12:44.657170 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:12:45.302893 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:12:45.302853 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f2nxw"] Sep 10 16:13:15.623693 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.623654 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-49x74"] Sep 10 16:13:15.627406 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.627389 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:15.631440 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.631412 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kf6s8\"" Sep 10 16:13:15.631592 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.631412 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 16:13:15.631592 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.631416 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 16:13:15.631592 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.631419 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 10 16:13:15.636079 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.636050 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-49x74"] Sep 10 16:13:15.712546 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.712513 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eec69198-d44d-4d28-ae1d-7b9e8f62aac8-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-49x74\" (UID: \"eec69198-d44d-4d28-ae1d-7b9e8f62aac8\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:15.712708 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.712668 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eec69198-d44d-4d28-ae1d-7b9e8f62aac8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-49x74\" (UID: \"eec69198-d44d-4d28-ae1d-7b9e8f62aac8\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:15.712770 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.712706 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eec69198-d44d-4d28-ae1d-7b9e8f62aac8-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-49x74\" (UID: \"eec69198-d44d-4d28-ae1d-7b9e8f62aac8\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:15.712810 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.712785 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kst6h\" (UniqueName: \"kubernetes.io/projected/eec69198-d44d-4d28-ae1d-7b9e8f62aac8-kube-api-access-kst6h\") pod \"e2e-distinct-simulated-kserve-6685d86975-49x74\" (UID: \"eec69198-d44d-4d28-ae1d-7b9e8f62aac8\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:15.712844 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.712828 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eec69198-d44d-4d28-ae1d-7b9e8f62aac8-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-49x74\" (UID: \"eec69198-d44d-4d28-ae1d-7b9e8f62aac8\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:15.712877 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.712853 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eec69198-d44d-4d28-ae1d-7b9e8f62aac8-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-49x74\" (UID: \"eec69198-d44d-4d28-ae1d-7b9e8f62aac8\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:15.726598 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.726569 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:13:15.814088 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.814044 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kst6h\" (UniqueName: \"kubernetes.io/projected/eec69198-d44d-4d28-ae1d-7b9e8f62aac8-kube-api-access-kst6h\") pod \"e2e-distinct-simulated-kserve-6685d86975-49x74\" (UID: \"eec69198-d44d-4d28-ae1d-7b9e8f62aac8\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:15.814088 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.814096 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eec69198-d44d-4d28-ae1d-7b9e8f62aac8-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-49x74\" (UID: \"eec69198-d44d-4d28-ae1d-7b9e8f62aac8\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:15.814338 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.814114 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eec69198-d44d-4d28-ae1d-7b9e8f62aac8-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-49x74\" (UID: \"eec69198-d44d-4d28-ae1d-7b9e8f62aac8\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:15.814338 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.814134 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eec69198-d44d-4d28-ae1d-7b9e8f62aac8-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-49x74\" (UID: \"eec69198-d44d-4d28-ae1d-7b9e8f62aac8\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:15.814828 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.814535 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eec69198-d44d-4d28-ae1d-7b9e8f62aac8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-49x74\" (UID: \"eec69198-d44d-4d28-ae1d-7b9e8f62aac8\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:15.814828 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.814597 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eec69198-d44d-4d28-ae1d-7b9e8f62aac8-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-49x74\" (UID: \"eec69198-d44d-4d28-ae1d-7b9e8f62aac8\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:15.815053 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.814864 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eec69198-d44d-4d28-ae1d-7b9e8f62aac8-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-49x74\" (UID: \"eec69198-d44d-4d28-ae1d-7b9e8f62aac8\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:15.815053 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.814867 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eec69198-d44d-4d28-ae1d-7b9e8f62aac8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-49x74\" (UID: \"eec69198-d44d-4d28-ae1d-7b9e8f62aac8\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:15.815186 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.815164 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eec69198-d44d-4d28-ae1d-7b9e8f62aac8-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-49x74\" (UID: \"eec69198-d44d-4d28-ae1d-7b9e8f62aac8\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:15.816457 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.816436 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eec69198-d44d-4d28-ae1d-7b9e8f62aac8-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-49x74\" (UID: \"eec69198-d44d-4d28-ae1d-7b9e8f62aac8\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:15.816716 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.816699 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eec69198-d44d-4d28-ae1d-7b9e8f62aac8-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-49x74\" (UID: \"eec69198-d44d-4d28-ae1d-7b9e8f62aac8\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:15.822160 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.822138 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kst6h\" (UniqueName: \"kubernetes.io/projected/eec69198-d44d-4d28-ae1d-7b9e8f62aac8-kube-api-access-kst6h\") pod \"e2e-distinct-simulated-kserve-6685d86975-49x74\" (UID: \"eec69198-d44d-4d28-ae1d-7b9e8f62aac8\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:15.937858 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:15.937773 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:16.210921 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:16.210894 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-49x74"] Sep 10 16:13:16.213416 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:13:16.213377 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec69198_d44d_4d28_ae1d_7b9e8f62aac8.slice/crio-92e61c6c59c2a53f5f242d624547fb8c90c8dffa802f1c669c21194dfe88d7fd WatchSource:0}: Error finding container 92e61c6c59c2a53f5f242d624547fb8c90c8dffa802f1c669c21194dfe88d7fd: Status 404 returned error can't find the container with id 92e61c6c59c2a53f5f242d624547fb8c90c8dffa802f1c669c21194dfe88d7fd Sep 10 16:13:16.399258 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:16.399218 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f2nxw"] Sep 10 16:13:16.780567 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:16.780523 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" event={"ID":"eec69198-d44d-4d28-ae1d-7b9e8f62aac8","Type":"ContainerStarted","Data":"92e61c6c59c2a53f5f242d624547fb8c90c8dffa802f1c669c21194dfe88d7fd"} Sep 10 16:13:17.381660 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:13:17.381631 2578 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec69198_d44d_4d28_ae1d_7b9e8f62aac8.slice/crio-66b7d572eb90519cd43165ca590e33a4d51429f5bd21a51d205890d11ebf0ec9.scope\": RecentStats: unable to find data in memory cache]" Sep 10 16:13:17.787937 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:17.787906 2578 generic.go:356] "Generic (PLEG): container finished" podID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" containerID="66b7d572eb90519cd43165ca590e33a4d51429f5bd21a51d205890d11ebf0ec9" exitCode=0 Sep 10 16:13:17.788342 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:17.788013 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" event={"ID":"eec69198-d44d-4d28-ae1d-7b9e8f62aac8","Type":"ContainerDied","Data":"66b7d572eb90519cd43165ca590e33a4d51429f5bd21a51d205890d11ebf0ec9"} Sep 10 16:13:17.788342 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:17.788211 2578 scope.go:117] "RemoveContainer" containerID="66b7d572eb90519cd43165ca590e33a4d51429f5bd21a51d205890d11ebf0ec9" Sep 10 16:13:18.795181 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:18.795146 2578 generic.go:356] "Generic (PLEG): container finished" podID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" containerID="85593ff2909d0523606111ca3d8197cf61a142bad6ce40697dbf0293b3f5f4ef" exitCode=0 Sep 10 16:13:18.795568 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:18.795202 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" event={"ID":"eec69198-d44d-4d28-ae1d-7b9e8f62aac8","Type":"ContainerDied","Data":"85593ff2909d0523606111ca3d8197cf61a142bad6ce40697dbf0293b3f5f4ef"} Sep 10 16:13:18.795568 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:18.795272 2578 scope.go:117] "RemoveContainer" containerID="66b7d572eb90519cd43165ca590e33a4d51429f5bd21a51d205890d11ebf0ec9" Sep 10 16:13:18.795568 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:18.795555 2578 scope.go:117] "RemoveContainer" containerID="85593ff2909d0523606111ca3d8197cf61a142bad6ce40697dbf0293b3f5f4ef" Sep 10 16:13:18.795773 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:13:18.795753 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:13:19.801898 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:19.801869 2578 scope.go:117] "RemoveContainer" containerID="85593ff2909d0523606111ca3d8197cf61a142bad6ce40697dbf0293b3f5f4ef" Sep 10 16:13:19.802312 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:13:19.802057 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:13:22.419314 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:22.419280 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:13:23.398896 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:23.398852 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f2nxw"] Sep 10 16:13:25.938615 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:25.938588 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:25.939015 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:25.938633 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:25.939015 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:25.938649 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:25.939015 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:25.938662 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:25.939015 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:25.939009 2578 scope.go:117] "RemoveContainer" containerID="85593ff2909d0523606111ca3d8197cf61a142bad6ce40697dbf0293b3f5f4ef" Sep 10 16:13:25.939182 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:13:25.939164 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:13:37.779275 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:37.779244 2578 scope.go:117] "RemoveContainer" containerID="85593ff2909d0523606111ca3d8197cf61a142bad6ce40697dbf0293b3f5f4ef" Sep 10 16:13:38.445068 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:38.444946 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:13:38.896398 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:38.896364 2578 generic.go:356] "Generic (PLEG): container finished" podID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" containerID="5259dcd0e5ca19de05f900e3eec2ff5c5a5ed2a637535d7c1f5a616ba44bb309" exitCode=0 Sep 10 16:13:38.896783 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:38.896412 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" event={"ID":"eec69198-d44d-4d28-ae1d-7b9e8f62aac8","Type":"ContainerDied","Data":"5259dcd0e5ca19de05f900e3eec2ff5c5a5ed2a637535d7c1f5a616ba44bb309"} Sep 10 16:13:38.896783 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:38.896459 2578 scope.go:117] "RemoveContainer" containerID="85593ff2909d0523606111ca3d8197cf61a142bad6ce40697dbf0293b3f5f4ef" Sep 10 16:13:38.896861 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:38.896802 2578 scope.go:117] "RemoveContainer" containerID="5259dcd0e5ca19de05f900e3eec2ff5c5a5ed2a637535d7c1f5a616ba44bb309" Sep 10 16:13:38.897055 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:13:38.897035 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:13:45.938142 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:45.938109 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:45.938672 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:45.938164 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:45.938672 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:45.938182 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:45.938672 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:45.938205 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:13:45.938672 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:45.938540 2578 scope.go:117] "RemoveContainer" containerID="5259dcd0e5ca19de05f900e3eec2ff5c5a5ed2a637535d7c1f5a616ba44bb309" Sep 10 16:13:45.938841 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:13:45.938714 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:13:47.565713 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:47.565616 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:13:48.797523 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:48.797484 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f2nxw"] Sep 10 16:13:52.205307 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.205269 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2"] Sep 10 16:13:52.207911 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.207890 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:13:52.211758 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.211733 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 10 16:13:52.228458 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.228429 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2"] Sep 10 16:13:52.248604 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.248579 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:13:52.251864 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.251840 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60ba3f2b-3026-42eb-9c4b-75911ab57261-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2\" (UID: \"60ba3f2b-3026-42eb-9c4b-75911ab57261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:13:52.252026 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.251893 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7m5z\" (UniqueName: \"kubernetes.io/projected/60ba3f2b-3026-42eb-9c4b-75911ab57261-kube-api-access-q7m5z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2\" (UID: \"60ba3f2b-3026-42eb-9c4b-75911ab57261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:13:52.252026 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.251963 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60ba3f2b-3026-42eb-9c4b-75911ab57261-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2\" (UID: \"60ba3f2b-3026-42eb-9c4b-75911ab57261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:13:52.252130 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.252058 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60ba3f2b-3026-42eb-9c4b-75911ab57261-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2\" (UID: \"60ba3f2b-3026-42eb-9c4b-75911ab57261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:13:52.252130 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.252090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60ba3f2b-3026-42eb-9c4b-75911ab57261-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2\" (UID: \"60ba3f2b-3026-42eb-9c4b-75911ab57261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:13:52.252130 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.252116 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60ba3f2b-3026-42eb-9c4b-75911ab57261-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2\" (UID: \"60ba3f2b-3026-42eb-9c4b-75911ab57261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:13:52.352734 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.352695 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7m5z\" (UniqueName: \"kubernetes.io/projected/60ba3f2b-3026-42eb-9c4b-75911ab57261-kube-api-access-q7m5z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2\" (UID: \"60ba3f2b-3026-42eb-9c4b-75911ab57261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:13:52.352919 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.352748 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60ba3f2b-3026-42eb-9c4b-75911ab57261-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2\" (UID: \"60ba3f2b-3026-42eb-9c4b-75911ab57261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:13:52.352919 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.352772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60ba3f2b-3026-42eb-9c4b-75911ab57261-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2\" (UID: \"60ba3f2b-3026-42eb-9c4b-75911ab57261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:13:52.352919 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.352794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60ba3f2b-3026-42eb-9c4b-75911ab57261-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2\" (UID: \"60ba3f2b-3026-42eb-9c4b-75911ab57261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:13:52.352919 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.352817 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60ba3f2b-3026-42eb-9c4b-75911ab57261-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2\" (UID: \"60ba3f2b-3026-42eb-9c4b-75911ab57261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:13:52.353132 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.352918 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60ba3f2b-3026-42eb-9c4b-75911ab57261-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2\" (UID: \"60ba3f2b-3026-42eb-9c4b-75911ab57261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:13:52.353322 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.353292 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60ba3f2b-3026-42eb-9c4b-75911ab57261-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2\" (UID: \"60ba3f2b-3026-42eb-9c4b-75911ab57261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:13:52.353438 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.353295 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60ba3f2b-3026-42eb-9c4b-75911ab57261-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2\" (UID: \"60ba3f2b-3026-42eb-9c4b-75911ab57261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:13:52.353438 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.353344 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60ba3f2b-3026-42eb-9c4b-75911ab57261-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2\" (UID: \"60ba3f2b-3026-42eb-9c4b-75911ab57261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:13:52.355162 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.355140 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60ba3f2b-3026-42eb-9c4b-75911ab57261-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2\" (UID: \"60ba3f2b-3026-42eb-9c4b-75911ab57261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:13:52.355343 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.355325 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60ba3f2b-3026-42eb-9c4b-75911ab57261-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2\" (UID: \"60ba3f2b-3026-42eb-9c4b-75911ab57261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:13:52.368570 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.368542 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7m5z\" (UniqueName: \"kubernetes.io/projected/60ba3f2b-3026-42eb-9c4b-75911ab57261-kube-api-access-q7m5z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2\" (UID: \"60ba3f2b-3026-42eb-9c4b-75911ab57261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:13:52.518119 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.518073 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:13:52.791197 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.791166 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2"] Sep 10 16:13:52.792715 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:13:52.792689 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60ba3f2b_3026_42eb_9c4b_75911ab57261.slice/crio-90bdd086d204940610ac0c3cb39c4f00f609f67934eb7c4a3e0220023b2f03e9 WatchSource:0}: Error finding container 90bdd086d204940610ac0c3cb39c4f00f609f67934eb7c4a3e0220023b2f03e9: Status 404 returned error can't find the container with id 90bdd086d204940610ac0c3cb39c4f00f609f67934eb7c4a3e0220023b2f03e9 Sep 10 16:13:52.794108 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.794092 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 16:13:52.969049 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:52.969013 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" event={"ID":"60ba3f2b-3026-42eb-9c4b-75911ab57261","Type":"ContainerStarted","Data":"90bdd086d204940610ac0c3cb39c4f00f609f67934eb7c4a3e0220023b2f03e9"} Sep 10 16:13:53.799060 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:53.799025 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f2nxw"] Sep 10 16:13:53.975462 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:53.975422 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" event={"ID":"60ba3f2b-3026-42eb-9c4b-75911ab57261","Type":"ContainerStarted","Data":"5c225e23941d6d009559d44b9a5b118090e40396a11dcb54a7024daa104387d4"} Sep 10 16:13:53.995608 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:53.995560 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" podStartSLOduration=1.8141879159999998 podStartE2EDuration="1.995544995s" totalImagesPullingTime="181.357079ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:13:53.994147863 +0000 UTC m=+628.708415860" watchObservedRunningTime="2026-09-10 16:13:53.995544995 +0000 UTC m=+628.709812981" Sep 10 16:13:59.779178 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:13:59.779131 2578 scope.go:117] "RemoveContainer" containerID="5259dcd0e5ca19de05f900e3eec2ff5c5a5ed2a637535d7c1f5a616ba44bb309" Sep 10 16:14:01.012297 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:01.012264 2578 generic.go:356] "Generic (PLEG): container finished" podID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" containerID="8141d48a5a6548ee889acec97499d68aeeac273f7232e11bfc83d97c2b911691" exitCode=0 Sep 10 16:14:01.012787 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:01.012318 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" event={"ID":"eec69198-d44d-4d28-ae1d-7b9e8f62aac8","Type":"ContainerDied","Data":"8141d48a5a6548ee889acec97499d68aeeac273f7232e11bfc83d97c2b911691"} Sep 10 16:14:01.012787 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:01.012365 2578 scope.go:117] "RemoveContainer" containerID="5259dcd0e5ca19de05f900e3eec2ff5c5a5ed2a637535d7c1f5a616ba44bb309" Sep 10 16:14:01.012907 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:01.012790 2578 scope.go:117] "RemoveContainer" containerID="8141d48a5a6548ee889acec97499d68aeeac273f7232e11bfc83d97c2b911691" Sep 10 16:14:01.013054 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:14:01.013030 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:14:02.518303 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:02.518256 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:14:02.518738 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:02.518326 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:14:02.531099 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:02.531069 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:14:03.035270 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:03.035236 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2" Sep 10 16:14:05.937927 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:05.937896 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:14:05.938406 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:05.937955 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:14:05.938406 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:05.937974 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:14:05.938406 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:05.938009 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:14:05.938564 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:05.938423 2578 scope.go:117] "RemoveContainer" containerID="8141d48a5a6548ee889acec97499d68aeeac273f7232e11bfc83d97c2b911691" Sep 10 16:14:05.938642 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:14:05.938622 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:14:16.763166 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:16.763123 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:14:18.601436 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:18.601402 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f2nxw"] Sep 10 16:14:20.507192 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:20.507161 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:14:20.779597 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:20.779517 2578 scope.go:117] "RemoveContainer" containerID="8141d48a5a6548ee889acec97499d68aeeac273f7232e11bfc83d97c2b911691" Sep 10 16:14:20.779747 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:14:20.779692 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:14:34.779045 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:34.779010 2578 scope.go:117] "RemoveContainer" containerID="8141d48a5a6548ee889acec97499d68aeeac273f7232e11bfc83d97c2b911691" Sep 10 16:14:34.779504 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:14:34.779168 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:14:35.152242 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:35.152164 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:14:37.298546 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:37.298503 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f2nxw"] Sep 10 16:14:48.779236 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:48.779201 2578 scope.go:117] "RemoveContainer" containerID="8141d48a5a6548ee889acec97499d68aeeac273f7232e11bfc83d97c2b911691" Sep 10 16:14:49.257923 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:49.257890 2578 generic.go:356] "Generic (PLEG): container finished" podID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" containerID="f287817197575e5d3993784ba336d2e5d8932f1c3b5360203e0b813fa74f36b5" exitCode=0 Sep 10 16:14:49.258093 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:49.257964 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" event={"ID":"eec69198-d44d-4d28-ae1d-7b9e8f62aac8","Type":"ContainerDied","Data":"f287817197575e5d3993784ba336d2e5d8932f1c3b5360203e0b813fa74f36b5"} Sep 10 16:14:49.258093 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:49.258033 2578 scope.go:117] "RemoveContainer" containerID="8141d48a5a6548ee889acec97499d68aeeac273f7232e11bfc83d97c2b911691" Sep 10 16:14:49.258407 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:49.258380 2578 scope.go:117] "RemoveContainer" containerID="f287817197575e5d3993784ba336d2e5d8932f1c3b5360203e0b813fa74f36b5" Sep 10 16:14:49.258623 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:14:49.258600 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:14:55.937884 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:55.937851 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:14:55.938376 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:55.937924 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:14:55.938376 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:55.937949 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:14:55.938376 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:55.937965 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:14:55.938376 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:55.938363 2578 scope.go:117] "RemoveContainer" containerID="f287817197575e5d3993784ba336d2e5d8932f1c3b5360203e0b813fa74f36b5" Sep 10 16:14:55.938598 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:14:55.938572 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:14:56.301170 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:14:56.301140 2578 scope.go:117] "RemoveContainer" containerID="f287817197575e5d3993784ba336d2e5d8932f1c3b5360203e0b813fa74f36b5" Sep 10 16:14:56.301339 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:14:56.301315 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:15:00.150691 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:15:00.150655 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817615-g4n5f"] Sep 10 16:15:00.154253 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:15:00.154229 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817615-g4n5f" Sep 10 16:15:00.158038 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:15:00.158007 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-g542f\"" Sep 10 16:15:00.163928 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:15:00.163902 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817615-g4n5f" Sep 10 16:15:00.168561 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:15:00.168538 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817615-g4n5f"] Sep 10 16:15:00.438842 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:15:00.438817 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817615-g4n5f"] Sep 10 16:15:00.441055 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:15:00.441025 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a5bcea6_4a59_4410_8472_1741833138a9.slice/crio-43290dd7dfed17d029d89a2c45e3e99731a8eb12023d59612073624fcbc6e3d8 WatchSource:0}: Error finding container 43290dd7dfed17d029d89a2c45e3e99731a8eb12023d59612073624fcbc6e3d8: Status 404 returned error can't find the container with id 43290dd7dfed17d029d89a2c45e3e99731a8eb12023d59612073624fcbc6e3d8 Sep 10 16:15:01.325656 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:15:01.325620 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817615-g4n5f" event={"ID":"7a5bcea6-4a59-4410-8472-1741833138a9","Type":"ContainerStarted","Data":"43290dd7dfed17d029d89a2c45e3e99731a8eb12023d59612073624fcbc6e3d8"} Sep 10 16:15:03.340081 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:15:03.340039 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817615-g4n5f" event={"ID":"7a5bcea6-4a59-4410-8472-1741833138a9","Type":"ContainerStarted","Data":"be746e4b990cf8a35323c96146fc1ae00d9806b7512990400a553355ac99f67b"} Sep 10 16:15:03.358060 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:15:03.358001 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817615-g4n5f" podStartSLOduration=0.848338581 podStartE2EDuration="3.357971768s" totalImagesPullingTime="2.509633187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:15:03.356273135 +0000 UTC m=+698.070541130" watchObservedRunningTime="2026-09-10 16:15:03.357971768 +0000 UTC m=+698.072239763" Sep 10 16:15:04.346745 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:15:04.346702 2578 generic.go:356] "Generic (PLEG): container finished" podID="7a5bcea6-4a59-4410-8472-1741833138a9" containerID="be746e4b990cf8a35323c96146fc1ae00d9806b7512990400a553355ac99f67b" exitCode=0 Sep 10 16:15:04.347197 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:15:04.346791 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817615-g4n5f" event={"ID":"7a5bcea6-4a59-4410-8472-1741833138a9","Type":"ContainerDied","Data":"be746e4b990cf8a35323c96146fc1ae00d9806b7512990400a553355ac99f67b"} Sep 10 16:15:05.487771 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:15:05.487743 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817615-g4n5f" Sep 10 16:15:06.362092 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:15:06.362048 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817615-g4n5f" event={"ID":"7a5bcea6-4a59-4410-8472-1741833138a9","Type":"ContainerDied","Data":"43290dd7dfed17d029d89a2c45e3e99731a8eb12023d59612073624fcbc6e3d8"} Sep 10 16:15:06.362592 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:15:06.362560 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817615-g4n5f" Sep 10 16:15:06.362705 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:15:06.362638 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43290dd7dfed17d029d89a2c45e3e99731a8eb12023d59612073624fcbc6e3d8" Sep 10 16:15:09.778587 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:15:09.778550 2578 scope.go:117] "RemoveContainer" containerID="f287817197575e5d3993784ba336d2e5d8932f1c3b5360203e0b813fa74f36b5" Sep 10 16:15:09.779085 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:15:09.778785 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:15:13.523089 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:15:13.523050 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:15:20.779068 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:15:20.778952 2578 scope.go:117] "RemoveContainer" containerID="f287817197575e5d3993784ba336d2e5d8932f1c3b5360203e0b813fa74f36b5" Sep 10 16:15:20.779463 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:15:20.779152 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:15:32.779314 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:15:32.779280 2578 scope.go:117] "RemoveContainer" containerID="f287817197575e5d3993784ba336d2e5d8932f1c3b5360203e0b813fa74f36b5" Sep 10 16:15:32.779789 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:15:32.779502 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:15:46.779057 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:15:46.779025 2578 scope.go:117] "RemoveContainer" containerID="f287817197575e5d3993784ba336d2e5d8932f1c3b5360203e0b813fa74f36b5" Sep 10 16:15:46.779645 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:15:46.779212 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:16:01.779607 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:16:01.779572 2578 scope.go:117] "RemoveContainer" containerID="f287817197575e5d3993784ba336d2e5d8932f1c3b5360203e0b813fa74f36b5" Sep 10 16:16:01.780165 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:16:01.779830 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:16:12.779250 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:16:12.779212 2578 scope.go:117] "RemoveContainer" containerID="f287817197575e5d3993784ba336d2e5d8932f1c3b5360203e0b813fa74f36b5" Sep 10 16:16:13.701856 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:16:13.701823 2578 generic.go:356] "Generic (PLEG): container finished" podID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" containerID="226313ae063c2b0cede2c63d6e8a98db2ea0582c85d1ee8fae9fb3391f1ea8fa" exitCode=0 Sep 10 16:16:13.702049 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:16:13.701904 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" event={"ID":"eec69198-d44d-4d28-ae1d-7b9e8f62aac8","Type":"ContainerDied","Data":"226313ae063c2b0cede2c63d6e8a98db2ea0582c85d1ee8fae9fb3391f1ea8fa"} Sep 10 16:16:13.702049 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:16:13.702026 2578 scope.go:117] "RemoveContainer" containerID="f287817197575e5d3993784ba336d2e5d8932f1c3b5360203e0b813fa74f36b5" Sep 10 16:16:13.702425 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:16:13.702409 2578 scope.go:117] "RemoveContainer" containerID="226313ae063c2b0cede2c63d6e8a98db2ea0582c85d1ee8fae9fb3391f1ea8fa" Sep 10 16:16:13.702619 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:16:13.702602 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:16:15.938522 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:16:15.938481 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:16:15.938959 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:16:15.938547 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:16:15.938959 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:16:15.938684 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:16:15.938959 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:16:15.938735 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" Sep 10 16:16:15.938959 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:16:15.938896 2578 scope.go:117] "RemoveContainer" containerID="226313ae063c2b0cede2c63d6e8a98db2ea0582c85d1ee8fae9fb3391f1ea8fa" Sep 10 16:16:15.939146 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:16:15.939094 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:16:16.718794 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:16:16.718765 2578 scope.go:117] "RemoveContainer" containerID="226313ae063c2b0cede2c63d6e8a98db2ea0582c85d1ee8fae9fb3391f1ea8fa" Sep 10 16:16:16.718973 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:16:16.718940 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:16:29.779071 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:16:29.779032 2578 scope.go:117] "RemoveContainer" containerID="226313ae063c2b0cede2c63d6e8a98db2ea0582c85d1ee8fae9fb3391f1ea8fa" Sep 10 16:16:29.779543 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:16:29.779255 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:16:30.540641 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:16:30.540607 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:16:44.778832 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:16:44.778794 2578 scope.go:117] "RemoveContainer" containerID="226313ae063c2b0cede2c63d6e8a98db2ea0582c85d1ee8fae9fb3391f1ea8fa" Sep 10 16:16:44.779346 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:16:44.779047 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:16:55.781578 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:16:55.781488 2578 scope.go:117] "RemoveContainer" containerID="226313ae063c2b0cede2c63d6e8a98db2ea0582c85d1ee8fae9fb3391f1ea8fa" Sep 10 16:16:55.782042 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:16:55.781714 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:17:10.779224 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:17:10.779193 2578 scope.go:117] "RemoveContainer" containerID="226313ae063c2b0cede2c63d6e8a98db2ea0582c85d1ee8fae9fb3391f1ea8fa" Sep 10 16:17:10.779713 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:17:10.779384 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:17:16.491570 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:17:16.491536 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:17:16.553256 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:17:16.553221 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:17:24.779377 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:17:24.779343 2578 scope.go:117] "RemoveContainer" containerID="226313ae063c2b0cede2c63d6e8a98db2ea0582c85d1ee8fae9fb3391f1ea8fa" Sep 10 16:17:24.779778 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:17:24.779538 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:17:38.778808 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:17:38.778779 2578 scope.go:117] "RemoveContainer" containerID="226313ae063c2b0cede2c63d6e8a98db2ea0582c85d1ee8fae9fb3391f1ea8fa" Sep 10 16:17:38.779217 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:17:38.779013 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:17:49.161971 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:17:49.161940 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9vjkc_76a98092-efff-46ba-97bf-dad4a1010a31/manager/0.log" Sep 10 16:17:49.288375 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:17:49.288344 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fnfmh_8fbddd6b-f387-4c4a-9b00-39f96f04fd5c/manager/0.log" Sep 10 16:17:49.771548 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:17:49.771522 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ff9c7664b-g9429_e3f4345c-04be-4505-92b0-1f0e2872ddb4/copy-manifests/0.log" Sep 10 16:17:49.785351 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:17:49.785320 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ff9c7664b-g9429_e3f4345c-04be-4505-92b0-1f0e2872ddb4/manager/0.log" Sep 10 16:17:50.506129 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:17:50.506093 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29817615-g4n5f_7a5bcea6-4a59-4410-8472-1741833138a9/cleanup/0.log" Sep 10 16:17:50.779489 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:17:50.779411 2578 scope.go:117] "RemoveContainer" containerID="226313ae063c2b0cede2c63d6e8a98db2ea0582c85d1ee8fae9fb3391f1ea8fa" Sep 10 16:17:50.779679 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:17:50.779657 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:17:51.520817 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:17:51.520781 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-x9sck_08297e00-4b09-4512-85ab-cd457cb7a924/manager/0.log" Sep 10 16:17:51.637262 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:17:51.637210 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-9f4sk_ea8e0430-221b-4459-b2ce-990754af52c0/manager/0.log" Sep 10 16:17:52.007022 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:17:52.006991 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-f2nxw_2f9eca43-364a-4560-b75c-85a4fd11c490/limitador/0.log" Sep 10 16:17:52.129692 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:17:52.129662 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-rlqfp_bacea6b7-efa1-4f65-b607-001feb3e8a6f/manager/0.log" Sep 10 16:17:53.795799 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:17:53.795769 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-6685d86975-49x74_eec69198-d44d-4d28-ae1d-7b9e8f62aac8/main/5.log" Sep 10 16:17:54.156089 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:17:54.156005 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkwnf2_60ba3f2b-3026-42eb-9c4b-75911ab57261/main/0.log" Sep 10 16:18:00.117294 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:00.117252 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lfcr8/must-gather-rxxhc"] Sep 10 16:18:00.117903 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:00.117881 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a5bcea6-4a59-4410-8472-1741833138a9" containerName="cleanup" Sep 10 16:18:00.118023 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:00.117907 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a5bcea6-4a59-4410-8472-1741833138a9" containerName="cleanup" Sep 10 16:18:00.118092 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:00.118069 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a5bcea6-4a59-4410-8472-1741833138a9" containerName="cleanup" Sep 10 16:18:00.121325 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:00.121301 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lfcr8/must-gather-rxxhc" Sep 10 16:18:00.124111 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:00.124084 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lfcr8\"/\"openshift-service-ca.crt\"" Sep 10 16:18:00.125343 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:00.125324 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lfcr8\"/\"kube-root-ca.crt\"" Sep 10 16:18:00.125452 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:00.125391 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lfcr8\"/\"default-dockercfg-c9bm4\"" Sep 10 16:18:00.133674 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:00.133629 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:18:00.139691 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:00.139660 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lfcr8/must-gather-rxxhc"] Sep 10 16:18:00.170393 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:00.170351 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1e599416-47c9-40d5-a473-1fd224a5062e-must-gather-output\") pod \"must-gather-rxxhc\" (UID: \"1e599416-47c9-40d5-a473-1fd224a5062e\") " pod="openshift-must-gather-lfcr8/must-gather-rxxhc" Sep 10 16:18:00.170393 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:00.170393 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjm7m\" (UniqueName: \"kubernetes.io/projected/1e599416-47c9-40d5-a473-1fd224a5062e-kube-api-access-bjm7m\") pod \"must-gather-rxxhc\" (UID: \"1e599416-47c9-40d5-a473-1fd224a5062e\") " pod="openshift-must-gather-lfcr8/must-gather-rxxhc" Sep 10 16:18:00.229001 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:00.228954 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" limit=1024 Sep 10 16:18:00.271678 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:00.271642 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1e599416-47c9-40d5-a473-1fd224a5062e-must-gather-output\") pod \"must-gather-rxxhc\" (UID: \"1e599416-47c9-40d5-a473-1fd224a5062e\") " pod="openshift-must-gather-lfcr8/must-gather-rxxhc" Sep 10 16:18:00.271678 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:00.271682 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjm7m\" (UniqueName: \"kubernetes.io/projected/1e599416-47c9-40d5-a473-1fd224a5062e-kube-api-access-bjm7m\") pod \"must-gather-rxxhc\" (UID: \"1e599416-47c9-40d5-a473-1fd224a5062e\") " pod="openshift-must-gather-lfcr8/must-gather-rxxhc" Sep 10 16:18:00.272013 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:00.271966 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1e599416-47c9-40d5-a473-1fd224a5062e-must-gather-output\") pod \"must-gather-rxxhc\" (UID: \"1e599416-47c9-40d5-a473-1fd224a5062e\") " pod="openshift-must-gather-lfcr8/must-gather-rxxhc" Sep 10 16:18:00.281078 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:00.281046 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjm7m\" (UniqueName: \"kubernetes.io/projected/1e599416-47c9-40d5-a473-1fd224a5062e-kube-api-access-bjm7m\") pod \"must-gather-rxxhc\" (UID: \"1e599416-47c9-40d5-a473-1fd224a5062e\") " pod="openshift-must-gather-lfcr8/must-gather-rxxhc" Sep 10 16:18:00.431106 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:00.430978 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lfcr8/must-gather-rxxhc" Sep 10 16:18:00.724875 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:00.724846 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lfcr8/must-gather-rxxhc"] Sep 10 16:18:00.726333 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:18:00.726303 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e599416_47c9_40d5_a473_1fd224a5062e.slice/crio-569fbebff5e2f6f5c909e318d1fe66c0f0b9b7164a313780722f612d14ace8ee WatchSource:0}: Error finding container 569fbebff5e2f6f5c909e318d1fe66c0f0b9b7164a313780722f612d14ace8ee: Status 404 returned error can't find the container with id 569fbebff5e2f6f5c909e318d1fe66c0f0b9b7164a313780722f612d14ace8ee Sep 10 16:18:01.257695 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:01.257656 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lfcr8/must-gather-rxxhc" event={"ID":"1e599416-47c9-40d5-a473-1fd224a5062e","Type":"ContainerStarted","Data":"569fbebff5e2f6f5c909e318d1fe66c0f0b9b7164a313780722f612d14ace8ee"} Sep 10 16:18:02.268223 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:02.268187 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lfcr8/must-gather-rxxhc" event={"ID":"1e599416-47c9-40d5-a473-1fd224a5062e","Type":"ContainerStarted","Data":"05ea5d6dda0329e9e47136969bfa91c22e584b9a75cfb725fef03d3346d3303c"} Sep 10 16:18:02.268975 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:02.268238 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lfcr8/must-gather-rxxhc" event={"ID":"1e599416-47c9-40d5-a473-1fd224a5062e","Type":"ContainerStarted","Data":"38cbbc0850010335cf74cdf8b97ee8bc78c3cb5def0ef197b4fed8c1683abddd"} Sep 10 16:18:02.287093 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:02.287025 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lfcr8/must-gather-rxxhc" podStartSLOduration=1.669285601 podStartE2EDuration="2.287003093s" totalImagesPullingTime="617.717492ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:18:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:18:02.285386621 +0000 UTC m=+876.999654617" watchObservedRunningTime="2026-09-10 16:18:02.287003093 +0000 UTC m=+877.001271086" Sep 10 16:18:02.779605 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:02.779573 2578 scope.go:117] "RemoveContainer" containerID="226313ae063c2b0cede2c63d6e8a98db2ea0582c85d1ee8fae9fb3391f1ea8fa" Sep 10 16:18:02.779789 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:18:02.779721 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:18:02.907959 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:02.907927 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7bc6j_e8ccdc02-c0de-4b91-847e-ff741ec86efb/global-pull-secret-syncer/0.log" Sep 10 16:18:03.058786 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:03.058677 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6qtzm_eddbd0df-ed01-4c8e-97c2-4600b940a4f4/konnectivity-agent/0.log" Sep 10 16:18:03.181972 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:03.181938 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-144.ec2.internal_2f6747baa96a83f589d64dbeaabcff6e/haproxy/0.log" Sep 10 16:18:07.672917 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:07.672884 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-x9sck_08297e00-4b09-4512-85ab-cd457cb7a924/manager/0.log" Sep 10 16:18:07.708054 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:07.708024 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-9f4sk_ea8e0430-221b-4459-b2ce-990754af52c0/manager/0.log" Sep 10 16:18:07.818045 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:07.818019 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-f2nxw_2f9eca43-364a-4560-b75c-85a4fd11c490/limitador/0.log" Sep 10 16:18:07.848403 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:07.848372 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-rlqfp_bacea6b7-efa1-4f65-b607-001feb3e8a6f/manager/0.log" Sep 10 16:18:09.320755 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:09.320720 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ea906d87-83fb-4631-a103-160a65b68956/alertmanager/0.log" Sep 10 16:18:09.357456 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:09.357339 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ea906d87-83fb-4631-a103-160a65b68956/config-reloader/0.log" Sep 10 16:18:09.377688 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:09.377601 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ea906d87-83fb-4631-a103-160a65b68956/kube-rbac-proxy-web/0.log" Sep 10 16:18:09.398363 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:09.398337 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ea906d87-83fb-4631-a103-160a65b68956/kube-rbac-proxy/0.log" Sep 10 16:18:09.418452 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:09.418424 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ea906d87-83fb-4631-a103-160a65b68956/kube-rbac-proxy-metric/0.log" Sep 10 16:18:09.438687 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:09.438637 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ea906d87-83fb-4631-a103-160a65b68956/prom-label-proxy/0.log" Sep 10 16:18:09.459759 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:09.459730 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ea906d87-83fb-4631-a103-160a65b68956/init-config-reloader/0.log" Sep 10 16:18:09.524604 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:09.524568 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-c5clp_fc478c19-a9a2-497b-899c-22af4307f668/kube-state-metrics/0.log" Sep 10 16:18:09.549243 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:09.549209 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-c5clp_fc478c19-a9a2-497b-899c-22af4307f668/kube-rbac-proxy-main/0.log" Sep 10 16:18:09.574019 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:09.573973 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-c5clp_fc478c19-a9a2-497b-899c-22af4307f668/kube-rbac-proxy-self/0.log" Sep 10 16:18:09.602202 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:09.602166 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-55d9744ccf-pvmwm_f5e8bf19-3de3-4e44-8737-ee89b8218706/metrics-server/0.log" Sep 10 16:18:09.624204 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:09.624172 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-kxhln_00eca29a-1f31-4247-b5ee-da7fca959e68/monitoring-plugin/0.log" Sep 10 16:18:09.737311 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:09.737267 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s7jg6_77adaf4d-0b09-4ebc-983a-f53dea1c1cef/node-exporter/0.log" Sep 10 16:18:09.761586 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:09.761554 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s7jg6_77adaf4d-0b09-4ebc-983a-f53dea1c1cef/kube-rbac-proxy/0.log" Sep 10 16:18:09.781631 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:09.781590 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s7jg6_77adaf4d-0b09-4ebc-983a-f53dea1c1cef/init-textfile/0.log" Sep 10 16:18:09.886636 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:09.886599 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-qnkmv_79c50c85-10c1-4f22-a8df-053ace504e0d/kube-rbac-proxy-main/0.log" Sep 10 16:18:09.930001 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:09.929944 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-qnkmv_79c50c85-10c1-4f22-a8df-053ace504e0d/kube-rbac-proxy-self/0.log" Sep 10 16:18:09.977583 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:09.977483 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-qnkmv_79c50c85-10c1-4f22-a8df-053ace504e0d/openshift-state-metrics/0.log" Sep 10 16:18:10.024684 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:10.024641 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73d81deb-5b52-4748-9aac-ec44cb99f3b8/prometheus/0.log" Sep 10 16:18:10.052678 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:10.052639 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73d81deb-5b52-4748-9aac-ec44cb99f3b8/config-reloader/0.log" Sep 10 16:18:10.081248 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:10.081206 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73d81deb-5b52-4748-9aac-ec44cb99f3b8/thanos-sidecar/0.log" Sep 10 16:18:10.112965 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:10.112931 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73d81deb-5b52-4748-9aac-ec44cb99f3b8/kube-rbac-proxy-web/0.log" Sep 10 16:18:10.134155 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:10.134124 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73d81deb-5b52-4748-9aac-ec44cb99f3b8/kube-rbac-proxy/0.log" Sep 10 16:18:10.171043 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:10.170213 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73d81deb-5b52-4748-9aac-ec44cb99f3b8/kube-rbac-proxy-thanos/0.log" Sep 10 16:18:10.211626 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:10.211589 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73d81deb-5b52-4748-9aac-ec44cb99f3b8/init-config-reloader/0.log" Sep 10 16:18:10.249686 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:10.247899 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-tsvz5_877096ff-d2bd-4a6c-bce4-5704248b2f2b/prometheus-operator/0.log" Sep 10 16:18:10.277889 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:10.275884 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-tsvz5_877096ff-d2bd-4a6c-bce4-5704248b2f2b/kube-rbac-proxy/0.log" Sep 10 16:18:10.333005 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:10.332407 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-529nm_0a8aaef3-02e6-4805-9cb6-aefeab913059/prometheus-operator-admission-webhook/0.log" Sep 10 16:18:10.359618 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:10.359580 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78b69f799c-7xdb2_b36ed941-1e15-46a8-b5a5-06727e8e27ea/telemeter-client/0.log" Sep 10 16:18:10.397036 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:10.397002 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78b69f799c-7xdb2_b36ed941-1e15-46a8-b5a5-06727e8e27ea/reload/0.log" Sep 10 16:18:10.416262 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:10.416231 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78b69f799c-7xdb2_b36ed941-1e15-46a8-b5a5-06727e8e27ea/kube-rbac-proxy/0.log" Sep 10 16:18:10.445647 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:10.445612 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8685b56967-j5p6l_beb584ec-bebe-4c2c-89e3-0975be9d07ad/thanos-query/0.log" Sep 10 16:18:10.466796 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:10.466762 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8685b56967-j5p6l_beb584ec-bebe-4c2c-89e3-0975be9d07ad/kube-rbac-proxy-web/0.log" Sep 10 16:18:10.496262 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:10.496232 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8685b56967-j5p6l_beb584ec-bebe-4c2c-89e3-0975be9d07ad/kube-rbac-proxy/0.log" Sep 10 16:18:10.515205 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:10.515124 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8685b56967-j5p6l_beb584ec-bebe-4c2c-89e3-0975be9d07ad/prom-label-proxy/0.log" Sep 10 16:18:10.543003 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:10.542641 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8685b56967-j5p6l_beb584ec-bebe-4c2c-89e3-0975be9d07ad/kube-rbac-proxy-rules/0.log" Sep 10 16:18:10.559968 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:10.559937 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8685b56967-j5p6l_beb584ec-bebe-4c2c-89e3-0975be9d07ad/kube-rbac-proxy-metrics/0.log" Sep 10 16:18:13.210244 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.210208 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c"] Sep 10 16:18:13.216495 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.216462 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" Sep 10 16:18:13.225301 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.225268 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c"] Sep 10 16:18:13.226483 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.226452 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5dcf4fddbf-cxq9h_f22547ed-acb5-4040-b3ea-1d05c0776b1c/console/0.log" Sep 10 16:18:13.327213 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.323661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e32f6330-d94d-4e91-99f6-aeaa75ecba09-lib-modules\") pod \"perf-node-gather-daemonset-xsx9c\" (UID: \"e32f6330-d94d-4e91-99f6-aeaa75ecba09\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" Sep 10 16:18:13.327213 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.323718 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e32f6330-d94d-4e91-99f6-aeaa75ecba09-sys\") pod \"perf-node-gather-daemonset-xsx9c\" (UID: \"e32f6330-d94d-4e91-99f6-aeaa75ecba09\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" Sep 10 16:18:13.327213 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.323836 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrbwg\" (UniqueName: \"kubernetes.io/projected/e32f6330-d94d-4e91-99f6-aeaa75ecba09-kube-api-access-xrbwg\") pod \"perf-node-gather-daemonset-xsx9c\" (UID: \"e32f6330-d94d-4e91-99f6-aeaa75ecba09\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" Sep 10 16:18:13.327213 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.323872 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e32f6330-d94d-4e91-99f6-aeaa75ecba09-podres\") pod \"perf-node-gather-daemonset-xsx9c\" (UID: \"e32f6330-d94d-4e91-99f6-aeaa75ecba09\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" Sep 10 16:18:13.327213 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.323916 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e32f6330-d94d-4e91-99f6-aeaa75ecba09-proc\") pod \"perf-node-gather-daemonset-xsx9c\" (UID: \"e32f6330-d94d-4e91-99f6-aeaa75ecba09\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" Sep 10 16:18:13.425764 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.424755 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrbwg\" (UniqueName: \"kubernetes.io/projected/e32f6330-d94d-4e91-99f6-aeaa75ecba09-kube-api-access-xrbwg\") pod \"perf-node-gather-daemonset-xsx9c\" (UID: \"e32f6330-d94d-4e91-99f6-aeaa75ecba09\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" Sep 10 16:18:13.425764 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.424816 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e32f6330-d94d-4e91-99f6-aeaa75ecba09-podres\") pod \"perf-node-gather-daemonset-xsx9c\" (UID: \"e32f6330-d94d-4e91-99f6-aeaa75ecba09\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" Sep 10 16:18:13.425764 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.424859 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e32f6330-d94d-4e91-99f6-aeaa75ecba09-proc\") pod \"perf-node-gather-daemonset-xsx9c\" (UID: \"e32f6330-d94d-4e91-99f6-aeaa75ecba09\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" Sep 10 16:18:13.425764 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.424894 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e32f6330-d94d-4e91-99f6-aeaa75ecba09-lib-modules\") pod \"perf-node-gather-daemonset-xsx9c\" (UID: \"e32f6330-d94d-4e91-99f6-aeaa75ecba09\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" Sep 10 16:18:13.425764 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.424938 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e32f6330-d94d-4e91-99f6-aeaa75ecba09-sys\") pod \"perf-node-gather-daemonset-xsx9c\" (UID: \"e32f6330-d94d-4e91-99f6-aeaa75ecba09\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" Sep 10 16:18:13.425764 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.425162 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e32f6330-d94d-4e91-99f6-aeaa75ecba09-sys\") pod \"perf-node-gather-daemonset-xsx9c\" (UID: \"e32f6330-d94d-4e91-99f6-aeaa75ecba09\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" Sep 10 16:18:13.425764 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.425592 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e32f6330-d94d-4e91-99f6-aeaa75ecba09-podres\") pod \"perf-node-gather-daemonset-xsx9c\" (UID: \"e32f6330-d94d-4e91-99f6-aeaa75ecba09\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" Sep 10 16:18:13.425764 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.425650 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e32f6330-d94d-4e91-99f6-aeaa75ecba09-proc\") pod \"perf-node-gather-daemonset-xsx9c\" (UID: \"e32f6330-d94d-4e91-99f6-aeaa75ecba09\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" Sep 10 16:18:13.425764 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.425735 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e32f6330-d94d-4e91-99f6-aeaa75ecba09-lib-modules\") pod \"perf-node-gather-daemonset-xsx9c\" (UID: \"e32f6330-d94d-4e91-99f6-aeaa75ecba09\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" Sep 10 16:18:13.435362 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.435325 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrbwg\" (UniqueName: \"kubernetes.io/projected/e32f6330-d94d-4e91-99f6-aeaa75ecba09-kube-api-access-xrbwg\") pod \"perf-node-gather-daemonset-xsx9c\" (UID: \"e32f6330-d94d-4e91-99f6-aeaa75ecba09\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" Sep 10 16:18:13.557801 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.557752 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" Sep 10 16:18:13.860700 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:13.860530 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c"] Sep 10 16:18:13.864796 ip-10-0-135-144 kubenswrapper[2578]: W0910 16:18:13.864760 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode32f6330_d94d_4e91_99f6_aeaa75ecba09.slice/crio-7bf73633a97321560aec2b6e84f7387f5a646d2c23f9ffbb8fe65569e91d38c8 WatchSource:0}: Error finding container 7bf73633a97321560aec2b6e84f7387f5a646d2c23f9ffbb8fe65569e91d38c8: Status 404 returned error can't find the container with id 7bf73633a97321560aec2b6e84f7387f5a646d2c23f9ffbb8fe65569e91d38c8 Sep 10 16:18:14.389915 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:14.389868 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" event={"ID":"e32f6330-d94d-4e91-99f6-aeaa75ecba09","Type":"ContainerStarted","Data":"98fd84cca22c89484a148e20e7b80644287ec71dfa575c9c8d4b5793021b37fa"} Sep 10 16:18:14.390607 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:14.390578 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" event={"ID":"e32f6330-d94d-4e91-99f6-aeaa75ecba09","Type":"ContainerStarted","Data":"7bf73633a97321560aec2b6e84f7387f5a646d2c23f9ffbb8fe65569e91d38c8"} Sep 10 16:18:14.390921 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:14.390893 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" Sep 10 16:18:15.060576 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:15.060544 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xs9vx_8dcc1664-6944-4ce1-9416-1f5d08420c82/dns/0.log" Sep 10 16:18:15.077589 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:15.077559 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xs9vx_8dcc1664-6944-4ce1-9416-1f5d08420c82/kube-rbac-proxy/0.log" Sep 10 16:18:15.097123 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:15.097093 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jg5j2_d0b33001-5d69-4d19-8b5a-4eec74939854/dns-node-resolver/0.log" Sep 10 16:18:15.656527 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:15.656496 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8qvcj_7f0d2a2d-ee8b-4b92-996b-7681ceb92064/node-ca/0.log" Sep 10 16:18:15.789067 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:15.789033 2578 scope.go:117] "RemoveContainer" containerID="226313ae063c2b0cede2c63d6e8a98db2ea0582c85d1ee8fae9fb3391f1ea8fa" Sep 10 16:18:15.789328 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:18:15.789301 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:18:17.494516 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:17.494393 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mp96x_a30ad0cc-9cc3-4e18-88c4-3ca6490808a3/serve-healthcheck-canary/0.log" Sep 10 16:18:18.015528 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:18.015489 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jrvcd_b6322c63-61ef-4316-ac08-c022eb2a2c7c/kube-rbac-proxy/0.log" Sep 10 16:18:18.041038 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:18.041004 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jrvcd_b6322c63-61ef-4316-ac08-c022eb2a2c7c/exporter/0.log" Sep 10 16:18:18.075637 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:18.075588 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jrvcd_b6322c63-61ef-4316-ac08-c022eb2a2c7c/extractor/0.log" Sep 10 16:18:20.408675 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:20.408647 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" Sep 10 16:18:20.428009 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:20.427935 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-xsx9c" podStartSLOduration=7.427906553 podStartE2EDuration="7.427906553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:18:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:18:14.410575193 +0000 UTC m=+889.124843189" watchObservedRunningTime="2026-09-10 16:18:20.427906553 +0000 UTC m=+895.142174548" Sep 10 16:18:20.535252 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:20.535219 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9vjkc_76a98092-efff-46ba-97bf-dad4a1010a31/manager/0.log" Sep 10 16:18:20.571297 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:20.571261 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fnfmh_8fbddd6b-f387-4c4a-9b00-39f96f04fd5c/manager/0.log" Sep 10 16:18:20.750927 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:20.750893 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ff9c7664b-g9429_e3f4345c-04be-4505-92b0-1f0e2872ddb4/manager/0.log" Sep 10 16:18:20.765423 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:20.765387 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ff9c7664b-g9429_e3f4345c-04be-4505-92b0-1f0e2872ddb4/copy-manifests/0.log" Sep 10 16:18:22.167710 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:22.167678 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5745f97d58-wcs9v_47ebb480-aecc-4ab6-8eae-a262abb2e0a3/manager/0.log" Sep 10 16:18:26.778690 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:26.778661 2578 scope.go:117] "RemoveContainer" containerID="226313ae063c2b0cede2c63d6e8a98db2ea0582c85d1ee8fae9fb3391f1ea8fa" Sep 10 16:18:26.779081 ip-10-0-135-144 kubenswrapper[2578]: E0910 16:18:26.778833 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-49x74_llm(eec69198-d44d-4d28-ae1d-7b9e8f62aac8)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-49x74" podUID="eec69198-d44d-4d28-ae1d-7b9e8f62aac8" Sep 10 16:18:28.619163 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:28.619127 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9dwmj_453a4988-a513-4136-b24a-27acca168047/kube-multus/0.log" Sep 10 16:18:28.639458 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:28.639430 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9mqzq_5c3521be-b742-4374-b077-4ed94d0f8162/kube-multus-additional-cni-plugins/0.log" Sep 10 16:18:28.657910 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:28.657882 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9mqzq_5c3521be-b742-4374-b077-4ed94d0f8162/egress-router-binary-copy/0.log" Sep 10 16:18:28.676873 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:28.676840 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9mqzq_5c3521be-b742-4374-b077-4ed94d0f8162/cni-plugins/0.log" Sep 10 16:18:28.694899 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:28.694870 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9mqzq_5c3521be-b742-4374-b077-4ed94d0f8162/bond-cni-plugin/0.log" Sep 10 16:18:28.717766 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:28.717741 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9mqzq_5c3521be-b742-4374-b077-4ed94d0f8162/routeoverride-cni/0.log" Sep 10 16:18:28.742783 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:28.742757 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9mqzq_5c3521be-b742-4374-b077-4ed94d0f8162/whereabouts-cni-bincopy/0.log" Sep 10 16:18:28.759110 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:28.759080 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9mqzq_5c3521be-b742-4374-b077-4ed94d0f8162/whereabouts-cni/0.log" Sep 10 16:18:29.259891 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:29.259855 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mdf7t_226aa2a7-ea44-4496-ab2d-1dae7592f64f/network-metrics-daemon/0.log" Sep 10 16:18:29.280672 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:29.280628 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mdf7t_226aa2a7-ea44-4496-ab2d-1dae7592f64f/kube-rbac-proxy/0.log" Sep 10 16:18:30.081676 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:30.081645 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktbmj_2e259ee0-6025-45f0-8a9e-a777f702b9ae/ovn-controller/0.log" Sep 10 16:18:30.101141 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:30.101105 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktbmj_2e259ee0-6025-45f0-8a9e-a777f702b9ae/ovn-acl-logging/0.log" Sep 10 16:18:30.127843 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:30.127816 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktbmj_2e259ee0-6025-45f0-8a9e-a777f702b9ae/kube-rbac-proxy-node/0.log" Sep 10 16:18:30.154562 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:30.154529 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktbmj_2e259ee0-6025-45f0-8a9e-a777f702b9ae/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 16:18:30.176180 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:30.176152 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktbmj_2e259ee0-6025-45f0-8a9e-a777f702b9ae/northd/0.log" Sep 10 16:18:30.196640 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:30.196613 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktbmj_2e259ee0-6025-45f0-8a9e-a777f702b9ae/nbdb/0.log" Sep 10 16:18:30.216284 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:30.216259 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktbmj_2e259ee0-6025-45f0-8a9e-a777f702b9ae/sbdb/0.log" Sep 10 16:18:30.261597 ip-10-0-135-144 kubenswrapper[2578]: I0910 16:18:30.261561 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktbmj_2e259ee0-6025-45f0-8a9e-a777f702b9ae/ovnkube-controller/0.log"