Oct 31 00:26:58.628458 ip-10-0-131-90 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Oct 31 00:26:58.628472 ip-10-0-131-90 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Oct 31 00:26:58.628482 ip-10-0-131-90 systemd[1]: kubelet.service: Failed with result 'resources'. Oct 31 00:26:58.628810 ip-10-0-131-90 systemd[1]: Failed to start Kubernetes Kubelet. Oct 31 00:27:08.705325 ip-10-0-131-90 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Oct 31 00:27:08.705344 ip-10-0-131-90 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9a3bc226f53e4400bda6e916605031c0 -- Oct 31 00:29:04.612726 ip-10-0-131-90 systemd[1]: Starting Kubernetes Kubelet... Oct 31 00:29:05.052393 ip-10-0-131-90 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 00:29:05.052393 ip-10-0-131-90 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 31 00:29:05.052393 ip-10-0-131-90 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 00:29:05.052393 ip-10-0-131-90 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 00:29:05.057913 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057838 2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:29:05.057913 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057913 2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:29:05.057981 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057917 2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:29:05.057981 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057920 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:29:05.057981 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057923 2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:29:05.057981 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057927 2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:29:05.057981 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057932 2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:29:05.057981 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057935 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:29:05.057981 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057939 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:29:05.057981 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057942 2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:29:05.057981 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057944 2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:29:05.057981 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057947 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:29:05.057981 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057950 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:29:05.057981 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057952 2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:29:05.057981 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057955 2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:29:05.057981 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057958 2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:29:05.057981 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057960 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:29:05.057981 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057963 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:29:05.057981 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057965 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:29:05.057981 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057969 2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:29:05.057981 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057971 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:29:05.058440 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057974 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:29:05.058440 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057976 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:29:05.058440 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057979 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:29:05.058440 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057982 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:29:05.058440 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057985 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:29:05.058440 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057988 2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:29:05.058440 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057991 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:29:05.058440 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057993 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:29:05.058440 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057996 2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:29:05.058440 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.057999 2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:29:05.058440 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058001 2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:29:05.058440 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058004 2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:29:05.058440 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058006 2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:29:05.058440 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058009 2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:29:05.058440 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058012 2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:29:05.058440 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058014 2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:29:05.058440 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058017 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:29:05.058440 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058019 2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:29:05.058440 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058022 2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:29:05.058884 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058024 2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:29:05.058884 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058027 2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:29:05.058884 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058030 2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:29:05.058884 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058033 2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:29:05.058884 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058035 2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:29:05.058884 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058037 2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:29:05.058884 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058040 2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:29:05.058884 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058042 2579 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:29:05.058884 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058045 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:29:05.058884 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058054 2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:29:05.058884 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058057 2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:29:05.058884 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058060 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:29:05.058884 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058062 2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:29:05.058884 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058065 2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:29:05.058884 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058068 2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:29:05.058884 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058071 2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:29:05.058884 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058074 2579 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:29:05.058884 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058077 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:29:05.058884 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058080 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:29:05.058884 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058082 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:29:05.059341 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058085 2579 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:29:05.059341 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058087 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:29:05.059341 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058090 2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:29:05.059341 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058093 2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:29:05.059341 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058095 2579 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:29:05.059341 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058098 2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:29:05.059341 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058100 2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:29:05.059341 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058103 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:29:05.059341 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058105 2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:29:05.059341 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058108 2579 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:29:05.059341 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058110 2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:29:05.059341 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058113 2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:29:05.059341 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058115 2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:29:05.059341 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058118 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:29:05.059341 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058121 2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:29:05.059341 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058123 2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:29:05.059341 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058125 2579 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:29:05.059341 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058128 2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:29:05.059341 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058130 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:29:05.059341 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058133 2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:29:05.059851 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058135 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:29:05.059851 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058138 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:29:05.059851 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058140 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:29:05.059851 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058143 2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:29:05.059851 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058146 2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:29:05.059851 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058149 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:29:05.059851 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058152 2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:29:05.059851 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058155 2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:29:05.059851 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058158 2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:29:05.059851 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058160 2579 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:29:05.059851 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058163 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:29:05.059851 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058165 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:29:05.059851 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058169 2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:29:05.059851 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058173 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:29:05.059851 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058176 2579 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:29:05.059851 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058180 2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:29:05.059851 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058183 2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:29:05.059851 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058185 2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:29:05.059851 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058189 2579 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:29:05.060299 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058192 2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:29:05.060299 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058197 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:29:05.060299 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058199 2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:29:05.060299 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058202 2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:29:05.060299 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058205 2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:29:05.060299 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058207 2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:29:05.060299 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.058210 2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:29:05.061599 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061586 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:29:05.061599 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061598 2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:29:05.061655 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061603 2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:29:05.061655 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061606 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:29:05.061655 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061609 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:29:05.061655 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061612 2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:29:05.061655 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061615 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:29:05.061655 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061617 2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:29:05.061655 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061620 2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:29:05.061655 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061623 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:29:05.061655 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061626 2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:29:05.061655 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061629 2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:29:05.061655 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061632 2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:29:05.061655 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061634 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:29:05.061655 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061637 2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:29:05.061655 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061639 2579 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:29:05.061655 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061642 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:29:05.061655 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061644 2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:29:05.061655 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061647 2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:29:05.061655 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061649 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:29:05.061655 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061652 2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:29:05.061655 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061654 2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:29:05.062130 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061657 2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:29:05.062130 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061660 2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:29:05.062130 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061663 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:29:05.062130 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061666 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:29:05.062130 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061668 2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:29:05.062130 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061671 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:29:05.062130 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061674 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:29:05.062130 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061676 2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:29:05.062130 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061678 2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:29:05.062130 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061681 2579 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:29:05.062130 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061683 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:29:05.062130 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061686 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:29:05.062130 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061688 2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:29:05.062130 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061691 2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:29:05.062130 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061693 2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:29:05.062130 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061696 2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:29:05.062130 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061698 2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:29:05.062130 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061701 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:29:05.062130 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061703 2579 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:29:05.062130 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061706 2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:29:05.062616 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061708 2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:29:05.062616 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061711 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:29:05.062616 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061714 2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:29:05.062616 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061716 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:29:05.062616 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061718 2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:29:05.062616 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061721 2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:29:05.062616 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061723 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:29:05.062616 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061726 2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:29:05.062616 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061728 2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:29:05.062616 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061730 2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:29:05.062616 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061733 2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:29:05.062616 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061735 2579 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:29:05.062616 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061738 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:29:05.062616 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061742 2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:29:05.062616 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061745 2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:29:05.062616 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061747 2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:29:05.062616 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061750 2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:29:05.062616 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061753 2579 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:29:05.062616 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061755 2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:29:05.063070 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061758 2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:29:05.063070 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061760 2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:29:05.063070 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061763 2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:29:05.063070 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061766 2579 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:29:05.063070 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061768 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:29:05.063070 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061771 2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:29:05.063070 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061773 2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:29:05.063070 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061777 2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:29:05.063070 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061781 2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:29:05.063070 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061784 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:29:05.063070 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061787 2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:29:05.063070 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061789 2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:29:05.063070 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061792 2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:29:05.063070 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061794 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:29:05.063070 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061797 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:29:05.063070 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061801 2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:29:05.063070 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061803 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:29:05.063070 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061806 2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:29:05.063070 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061810 2579 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:29:05.063070 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061812 2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:29:05.063583 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061815 2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:29:05.063583 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061817 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:29:05.063583 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061820 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:29:05.063583 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061822 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:29:05.063583 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061825 2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:29:05.063583 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061829 2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:29:05.063583 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061832 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:29:05.063583 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061834 2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:29:05.063583 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061837 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:29:05.063583 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061840 2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:29:05.063583 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061842 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:29:05.063583 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061847 2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:29:05.063583 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061851 2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:29:05.063583 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061854 2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:29:05.063583 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061857 2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:29:05.063583 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061860 2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:29:05.063583 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061863 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:29:05.063583 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061865 2579 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:29:05.063583 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061868 2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:29:05.063583 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061870 2579 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:29:05.064127 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061873 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:29:05.064127 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061875 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:29:05.064127 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061878 2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:29:05.064127 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061880 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:29:05.064127 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.061883 2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:29:05.064127 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062331 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:29:05.064127 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062336 2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:29:05.064127 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062340 2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:29:05.064127 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062342 2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:29:05.064127 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062345 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:29:05.064127 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062348 2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:29:05.064127 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062351 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:29:05.064127 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062353 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:29:05.064127 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062356 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:29:05.064127 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062359 2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:29:05.064127 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062362 2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:29:05.064127 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062365 2579 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:29:05.064127 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062367 2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:29:05.064127 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062370 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:29:05.064127 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062373 2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:29:05.064614 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062376 2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:29:05.064614 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062378 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:29:05.064614 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062381 2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:29:05.064614 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062384 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:29:05.064614 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062386 2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:29:05.064614 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062390 2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:29:05.064614 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062392 2579 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:29:05.064614 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062395 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:29:05.064614 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062397 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:29:05.064614 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062413 2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:29:05.064614 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062416 2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:29:05.064614 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062419 2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:29:05.064614 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062421 2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:29:05.064614 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062424 2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:29:05.064614 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062427 2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:29:05.064614 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062430 2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:29:05.064614 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062434 2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:29:05.064614 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062437 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:29:05.064614 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062440 2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:29:05.065062 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062443 2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:29:05.065062 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062446 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:29:05.065062 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062449 2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:29:05.065062 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062452 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:29:05.065062 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062454 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:29:05.065062 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062456 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:29:05.065062 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062459 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:29:05.065062 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062462 2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:29:05.065062 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062465 2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:29:05.065062 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062467 2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:29:05.065062 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062470 2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:29:05.065062 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062472 2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:29:05.065062 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062475 2579 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:29:05.065062 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062478 2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:29:05.065062 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062481 2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:29:05.065062 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062483 2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:29:05.065062 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062486 2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:29:05.065062 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062488 2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:29:05.065062 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062491 2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:29:05.065530 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062494 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:29:05.065530 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062496 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:29:05.065530 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062498 2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:29:05.065530 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062501 2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:29:05.065530 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062504 2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:29:05.065530 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062506 2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:29:05.065530 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062509 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:29:05.065530 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062511 2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:29:05.065530 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062514 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:29:05.065530 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062517 2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:29:05.065530 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062519 2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:29:05.065530 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062524 2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:29:05.065530 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062527 2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:29:05.065530 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062529 2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:29:05.065530 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062532 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:29:05.065530 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062535 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:29:05.065530 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062538 2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:29:05.065530 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062541 2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:29:05.065530 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062545 2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:29:05.065971 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062548 2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:29:05.065971 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062552 2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:29:05.065971 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062555 2579 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:29:05.065971 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062558 2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:29:05.065971 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062561 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:29:05.065971 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062564 2579 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:29:05.065971 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062567 2579 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:29:05.065971 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062569 2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:29:05.065971 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062572 2579 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:29:05.065971 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062574 2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:29:05.065971 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062576 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:29:05.065971 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062579 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:29:05.065971 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062581 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:29:05.065971 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062583 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:29:05.065971 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062586 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:29:05.065971 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062588 2579 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:29:05.065971 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062591 2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:29:05.065971 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062593 2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:29:05.065971 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062596 2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:29:05.065971 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062598 2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062601 2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062603 2579 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062605 2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062608 2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062612 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062614 2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062617 2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062620 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062623 2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062626 2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062629 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062632 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062634 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.062637 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062730 2579 flags.go:64] FLAG: --address="0.0.0.0" Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062737 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062744 2579 flags.go:64] FLAG: --anonymous-auth="true" Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062748 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062753 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062756 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 31 00:29:05.066872 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062760 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062764 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062767 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062770 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062774 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062777 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062780 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062783 2579 flags.go:64] FLAG: --cgroup-root="" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062786 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062790 2579 flags.go:64] FLAG: --client-ca-file="" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062793 2579 flags.go:64] FLAG: --cloud-provider="external" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062797 2579 flags.go:64] FLAG: --cluster-dns="[]" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062800 2579 flags.go:64] FLAG: --cluster-domain="" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062803 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062806 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062809 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062813 2579 flags.go:64] FLAG: --container-log-max-files="5" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062817 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062820 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062823 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062827 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062830 2579 flags.go:64] FLAG: --contention-profiling="false" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062833 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062836 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 31 00:29:05.067363 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062839 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062842 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062846 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062849 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062852 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062855 2579 flags.go:64] FLAG: --enable-load-reader="false" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062857 2579 flags.go:64] FLAG: --enable-server="true" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062860 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062865 2579 flags.go:64] FLAG: --event-burst="100" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062868 2579 flags.go:64] FLAG: --event-qps="50" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062871 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062874 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062877 2579 flags.go:64] FLAG: --eviction-hard="" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062881 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062884 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062887 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062890 2579 flags.go:64] FLAG: --eviction-soft="" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062893 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062896 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062898 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062901 2579 flags.go:64] FLAG: --experimental-mounter-path="" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062904 2579 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062907 2579 flags.go:64] FLAG: --fail-swap-on="true" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062910 2579 flags.go:64] FLAG: --feature-gates="" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062914 2579 flags.go:64] FLAG: --file-check-frequency="20s" Oct 31 00:29:05.067978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062917 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062920 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062924 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062927 2579 flags.go:64] FLAG: --healthz-port="10248" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062930 2579 flags.go:64] FLAG: --help="false" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062933 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-131-90.ec2.internal" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062936 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062939 2579 flags.go:64] FLAG: --http-check-frequency="20s" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062942 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062946 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062949 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062952 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062955 2579 flags.go:64] FLAG: --image-service-endpoint="" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062957 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062960 2579 flags.go:64] FLAG: --kube-api-burst="100" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062963 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062966 2579 flags.go:64] FLAG: --kube-api-qps="50" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062969 2579 flags.go:64] FLAG: --kube-reserved="" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062972 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062975 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062978 2579 flags.go:64] FLAG: --kubelet-cgroups="" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062980 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062983 2579 flags.go:64] FLAG: --lock-file="" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062986 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 31 00:29:05.068620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062989 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062992 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.062997 2579 flags.go:64] FLAG: --log-json-split-stream="false" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063000 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063003 2579 flags.go:64] FLAG: --log-text-split-stream="false" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063006 2579 flags.go:64] FLAG: --logging-format="text" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063009 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063012 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063015 2579 flags.go:64] FLAG: --manifest-url="" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063018 2579 flags.go:64] FLAG: --manifest-url-header="" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063023 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063026 2579 flags.go:64] FLAG: --max-open-files="1000000" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063030 2579 flags.go:64] FLAG: --max-pods="110" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063033 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063036 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063039 2579 flags.go:64] FLAG: --memory-manager-policy="None" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063043 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063046 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063049 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063051 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063059 2579 flags.go:64] FLAG: --node-status-max-images="50" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063062 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063065 2579 flags.go:64] FLAG: --oom-score-adj="-999" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063068 2579 flags.go:64] FLAG: --pod-cidr="" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063071 2579 flags.go:64] FLAG: --pod-manifest-path="" Oct 31 00:29:05.069169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063074 2579 flags.go:64] FLAG: --pod-max-pids="-1" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063078 2579 flags.go:64] FLAG: --pods-per-core="0" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063081 2579 flags.go:64] FLAG: --port="10250" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063084 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063087 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-069c2cd15c7a758dd" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063090 2579 flags.go:64] FLAG: --qos-reserved="" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063093 2579 flags.go:64] FLAG: --read-only-port="10255" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063096 2579 flags.go:64] FLAG: --register-node="true" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063099 2579 flags.go:64] FLAG: --register-with-taints="" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063106 2579 flags.go:64] FLAG: --registry-burst="10" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063109 2579 flags.go:64] FLAG: --registry-qps="5" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063111 2579 flags.go:64] FLAG: --reserved-cpus="" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063114 2579 flags.go:64] FLAG: --reserved-memory="" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063118 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063121 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063124 2579 flags.go:64] FLAG: --rotate-certificates="false" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063127 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063130 2579 flags.go:64] FLAG: --runonce="false" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063135 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063138 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063141 2579 flags.go:64] FLAG: --seccomp-default="false" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063144 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063146 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063150 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063153 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063156 2579 flags.go:64] FLAG: --storage-driver-password="root" Oct 31 00:29:05.069766 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063159 2579 flags.go:64] FLAG: --storage-driver-secure="false" Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063162 2579 flags.go:64] FLAG: --storage-driver-table="stats" Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063165 2579 flags.go:64] FLAG: --storage-driver-user="root" Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063168 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063171 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063174 2579 flags.go:64] FLAG: --system-cgroups="" Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063177 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063182 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063185 2579 flags.go:64] FLAG: --tls-cert-file="" Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063188 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063195 2579 flags.go:64] FLAG: --tls-min-version="" Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063199 2579 flags.go:64] FLAG: --tls-private-key-file="" Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063201 2579 flags.go:64] FLAG: --topology-manager-policy="none" Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063205 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063208 2579 flags.go:64] FLAG: --topology-manager-scope="container" Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063211 2579 flags.go:64] FLAG: --v="2" Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063216 2579 flags.go:64] FLAG: --version="false" Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063220 2579 flags.go:64] FLAG: --vmodule="" Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063224 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063227 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063353 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063356 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063359 2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063362 2579 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:29:05.070390 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063366 2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:29:05.071238 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063369 2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:29:05.071238 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063372 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:29:05.071238 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063374 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:29:05.071238 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063377 2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:29:05.071238 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063380 2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:29:05.071238 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063383 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:29:05.071238 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063385 2579 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:29:05.071238 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063388 2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:29:05.071238 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063390 2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:29:05.071238 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063393 2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:29:05.071238 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063395 2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:29:05.071238 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063398 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:29:05.071238 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063416 2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:29:05.071238 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063420 2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:29:05.071238 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063425 2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:29:05.071238 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063429 2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:29:05.071238 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063432 2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:29:05.071238 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063435 2579 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:29:05.071238 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063438 2579 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:29:05.071238 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063440 2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:29:05.071911 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063443 2579 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:29:05.071911 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063445 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:29:05.071911 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063448 2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:29:05.071911 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063452 2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:29:05.071911 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063456 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:29:05.071911 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063459 2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:29:05.071911 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063462 2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:29:05.071911 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063466 2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:29:05.071911 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063468 2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:29:05.071911 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063471 2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:29:05.071911 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063473 2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:29:05.071911 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063477 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:29:05.071911 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063480 2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:29:05.071911 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063482 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:29:05.071911 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063485 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:29:05.071911 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063488 2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:29:05.071911 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063490 2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:29:05.071911 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063493 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:29:05.071911 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063496 2579 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:29:05.072383 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063499 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:29:05.072383 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063502 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:29:05.072383 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063504 2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:29:05.072383 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063507 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:29:05.072383 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063509 2579 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:29:05.072383 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063512 2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:29:05.072383 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063514 2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:29:05.072383 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063517 2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:29:05.072383 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063519 2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:29:05.072383 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063522 2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:29:05.072383 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063524 2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:29:05.072383 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063527 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:29:05.072383 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063530 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:29:05.072383 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063532 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:29:05.072383 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063534 2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:29:05.072383 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063537 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:29:05.072383 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063539 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:29:05.072383 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063542 2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:29:05.072383 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063544 2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:29:05.072840 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063547 2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:29:05.072840 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063551 2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:29:05.072840 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063553 2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:29:05.072840 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063556 2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:29:05.072840 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063559 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:29:05.072840 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063562 2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:29:05.072840 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063565 2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:29:05.072840 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063567 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:29:05.072840 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063570 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:29:05.072840 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063573 2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:29:05.072840 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063575 2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:29:05.072840 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063578 2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:29:05.072840 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063580 2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:29:05.072840 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063583 2579 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:29:05.072840 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063586 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:29:05.072840 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063590 2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:29:05.072840 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063594 2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:29:05.072840 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063598 2579 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:29:05.072840 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063601 2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:29:05.073313 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063603 2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:29:05.073313 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063606 2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:29:05.073313 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063609 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:29:05.073313 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063612 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:29:05.073313 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063615 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:29:05.073313 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063617 2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:29:05.073313 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063620 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:29:05.073313 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063622 2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:29:05.073313 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063625 2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:29:05.073313 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063628 2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:29:05.073313 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063630 2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:29:05.073313 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063633 2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:29:05.073313 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063635 2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:29:05.073313 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063638 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:29:05.073313 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063642 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:29:05.073313 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063644 2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:29:05.073313 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063647 2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:29:05.073313 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063649 2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:29:05.073313 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063654 2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:29:05.073780 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063656 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:29:05.073780 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063659 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:29:05.073780 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063661 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:29:05.073780 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063664 2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:29:05.073780 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063666 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:29:05.073780 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.063692 2579 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 00:29:05.073780 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063729 2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:29:05.073780 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063733 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:29:05.073780 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063736 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:29:05.073780 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063740 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:29:05.073780 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063742 2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:29:05.073780 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063745 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:29:05.073780 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063747 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:29:05.073780 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063750 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:29:05.073780 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063752 2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:29:05.073780 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063755 2579 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:29:05.074149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063758 2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:29:05.074149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063760 2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:29:05.074149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063763 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:29:05.074149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063765 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:29:05.074149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063768 2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:29:05.074149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063771 2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:29:05.074149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063773 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:29:05.074149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063775 2579 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:29:05.074149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063778 2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:29:05.074149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063781 2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:29:05.074149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063783 2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:29:05.074149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063787 2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:29:05.074149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063789 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:29:05.074149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063792 2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:29:05.074149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063794 2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:29:05.074149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063797 2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:29:05.074149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063801 2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:29:05.074149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063804 2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:29:05.074149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063806 2579 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:29:05.074149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063809 2579 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:29:05.074627 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063812 2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:29:05.074627 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063814 2579 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:29:05.074627 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063817 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:29:05.074627 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063819 2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:29:05.074627 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063822 2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:29:05.074627 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063826 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:29:05.074627 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063829 2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:29:05.074627 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063832 2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:29:05.074627 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063834 2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:29:05.074627 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063837 2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:29:05.074627 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063839 2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:29:05.074627 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063842 2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:29:05.074627 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063844 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:29:05.074627 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063846 2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:29:05.074627 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063849 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:29:05.074627 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063852 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:29:05.074627 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063855 2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:29:05.074627 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063857 2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:29:05.074627 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063860 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:29:05.075066 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063862 2579 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:29:05.075066 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063865 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:29:05.075066 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063867 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:29:05.075066 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063870 2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:29:05.075066 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063873 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:29:05.075066 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063876 2579 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:29:05.075066 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063878 2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:29:05.075066 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063881 2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:29:05.075066 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063883 2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:29:05.075066 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063887 2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:29:05.075066 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063889 2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:29:05.075066 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063892 2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:29:05.075066 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063895 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:29:05.075066 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063897 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:29:05.075066 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063900 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:29:05.075066 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063902 2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:29:05.075066 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063905 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:29:05.075066 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063907 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:29:05.075066 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063910 2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:29:05.075066 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063913 2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:29:05.075618 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063916 2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:29:05.075618 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063918 2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:29:05.075618 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063920 2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:29:05.075618 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063923 2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:29:05.075618 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063925 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:29:05.075618 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063928 2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:29:05.075618 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063930 2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:29:05.075618 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063933 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:29:05.075618 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063935 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:29:05.075618 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063939 2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:29:05.075618 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063941 2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:29:05.075618 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063944 2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:29:05.075618 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063946 2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:29:05.075618 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063949 2579 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:29:05.075618 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063952 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:29:05.075618 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063955 2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:29:05.075618 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063961 2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:29:05.075618 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063965 2579 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:29:05.075618 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063968 2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:29:05.076056 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063970 2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:29:05.076056 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063973 2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:29:05.076056 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063977 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:29:05.076056 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063980 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:29:05.076056 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063983 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:29:05.076056 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063985 2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:29:05.076056 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063988 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:29:05.076056 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063991 2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:29:05.076056 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063994 2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:29:05.076056 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063997 2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:29:05.076056 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.063999 2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:29:05.076056 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.064002 2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:29:05.076056 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.064004 2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:29:05.076056 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.064007 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:29:05.076056 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.064010 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:29:05.076056 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.064013 2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:29:05.076056 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.064015 2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:29:05.076056 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.064018 2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:29:05.076056 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.073283 2579 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 31 00:29:05.076516 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.073300 2579 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 31 00:29:05.076516 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.073901 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 31 00:29:05.076516 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.073907 2579 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 31 00:29:05.076516 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.073974 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:29:05.076516 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.073980 2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:29:05.076516 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.073984 2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:29:05.076516 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.073988 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:29:05.076516 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.073991 2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:29:05.076516 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.073994 2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:29:05.076516 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.073996 2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:29:05.076516 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.073999 2579 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:29:05.076516 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074002 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:29:05.076516 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074005 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:29:05.076516 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074008 2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:29:05.076516 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074010 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:29:05.076516 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074013 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:29:05.076516 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074016 2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:29:05.076516 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074020 2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:29:05.076516 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074024 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:29:05.076952 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074027 2579 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:29:05.076952 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074030 2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:29:05.076952 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074039 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:29:05.076952 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074042 2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:29:05.076952 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074045 2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:29:05.076952 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074047 2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:29:05.076952 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074050 2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:29:05.076952 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074053 2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:29:05.076952 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074055 2579 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:29:05.076952 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074058 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:29:05.076952 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074061 2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:29:05.076952 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074064 2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:29:05.076952 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074067 2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:29:05.076952 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074070 2579 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:29:05.076952 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074072 2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:29:05.076952 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074075 2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:29:05.076952 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074078 2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:29:05.076952 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074080 2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:29:05.076952 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074083 2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:29:05.076952 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074086 2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:29:05.077431 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074088 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:29:05.077431 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074091 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:29:05.077431 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074093 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:29:05.077431 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074096 2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:29:05.077431 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074098 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:29:05.077431 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074101 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:29:05.077431 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074104 2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:29:05.077431 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074106 2579 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:29:05.077431 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074109 2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:29:05.077431 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074112 2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:29:05.077431 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074115 2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:29:05.077431 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074117 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:29:05.077431 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074120 2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:29:05.077431 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074122 2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:29:05.077431 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074125 2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:29:05.077431 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074127 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:29:05.077431 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074130 2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:29:05.077431 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074132 2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:29:05.077431 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074135 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:29:05.077872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074137 2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:29:05.077872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074140 2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:29:05.077872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074142 2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:29:05.077872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074145 2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:29:05.077872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074148 2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:29:05.077872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074150 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:29:05.077872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074154 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:29:05.077872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074156 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:29:05.077872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074159 2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:29:05.077872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074162 2579 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:29:05.077872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074165 2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:29:05.077872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074167 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:29:05.077872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074170 2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:29:05.077872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074173 2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:29:05.077872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074175 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:29:05.077872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074177 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:29:05.077872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074180 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:29:05.077872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074183 2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:29:05.077872 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074185 2579 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:29:05.078309 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074189 2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:29:05.078309 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074193 2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:29:05.078309 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074196 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:29:05.078309 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074199 2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:29:05.078309 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074202 2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:29:05.078309 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074205 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:29:05.078309 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074208 2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:29:05.078309 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074211 2579 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:29:05.078309 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074213 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:29:05.078309 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074216 2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:29:05.078309 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074218 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:29:05.078309 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074221 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:29:05.078309 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074223 2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:29:05.078309 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074226 2579 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:29:05.078309 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074228 2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:29:05.078309 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074231 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:29:05.078309 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074233 2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:29:05.078309 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074236 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:29:05.078309 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074239 2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:29:05.078787 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074242 2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:29:05.078787 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074244 2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:29:05.078787 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074247 2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:29:05.078787 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074250 2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:29:05.078787 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074253 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:29:05.078787 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074255 2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:29:05.078787 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074258 2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:29:05.078787 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074260 2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:29:05.078787 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074263 2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:29:05.078787 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074266 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:29:05.078787 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074268 2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:29:05.078787 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074271 2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:29:05.078787 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074273 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:29:05.078787 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.074303 2579 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 00:29:05.078787 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074470 2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:29:05.079136 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074475 2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:29:05.079136 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074477 2579 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:29:05.079136 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074480 2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:29:05.079136 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074483 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:29:05.079136 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074486 2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:29:05.079136 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074489 2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:29:05.079136 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074492 2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:29:05.079136 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074494 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:29:05.079136 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074497 2579 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:29:05.079136 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074500 2579 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:29:05.079136 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074503 2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:29:05.079136 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074506 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:29:05.079136 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074508 2579 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:29:05.079136 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074510 2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:29:05.079136 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074513 2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:29:05.079136 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074516 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:29:05.079136 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074519 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:29:05.079136 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074522 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:29:05.079136 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074525 2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:29:05.079581 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074527 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:29:05.079581 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074530 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:29:05.079581 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074533 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:29:05.079581 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074535 2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:29:05.079581 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074538 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:29:05.079581 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074540 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:29:05.079581 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074543 2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:29:05.079581 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074545 2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:29:05.079581 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074548 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:29:05.079581 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074550 2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:29:05.079581 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074553 2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:29:05.079581 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074557 2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:29:05.079581 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074561 2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:29:05.079581 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074566 2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:29:05.079581 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074569 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:29:05.079581 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074571 2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:29:05.079581 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074574 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:29:05.079581 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074577 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:29:05.080002 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074580 2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:29:05.080002 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074583 2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:29:05.080002 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074585 2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:29:05.080002 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074588 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:29:05.080002 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074590 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:29:05.080002 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074593 2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:29:05.080002 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074595 2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:29:05.080002 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074598 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:29:05.080002 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074601 2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:29:05.080002 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074603 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:29:05.080002 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074606 2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:29:05.080002 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074609 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:29:05.080002 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074611 2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:29:05.080002 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074614 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:29:05.080002 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074617 2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:29:05.080002 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074619 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:29:05.080002 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074622 2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:29:05.080002 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074624 2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:29:05.080002 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074627 2579 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:29:05.080458 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074629 2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:29:05.080458 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074632 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:29:05.080458 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074635 2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:29:05.080458 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074638 2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:29:05.080458 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074640 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:29:05.080458 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074643 2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:29:05.080458 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074645 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:29:05.080458 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074648 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:29:05.080458 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074651 2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:29:05.080458 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074653 2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:29:05.080458 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074656 2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:29:05.080458 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074659 2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:29:05.080458 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074661 2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:29:05.080458 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074663 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:29:05.080458 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074666 2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:29:05.080458 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074669 2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:29:05.080458 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074671 2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:29:05.080458 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074674 2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:29:05.080458 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074677 2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:29:05.080905 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074679 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:29:05.080905 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074682 2579 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:29:05.080905 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074684 2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:29:05.080905 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074687 2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:29:05.080905 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074690 2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:29:05.080905 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074692 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:29:05.080905 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074695 2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:29:05.080905 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074697 2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:29:05.080905 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074700 2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:29:05.080905 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074702 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:29:05.080905 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074705 2579 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:29:05.080905 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074707 2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:29:05.080905 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074710 2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:29:05.080905 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074713 2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:29:05.080905 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074715 2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:29:05.080905 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074718 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:29:05.080905 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074720 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:29:05.080905 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074723 2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:29:05.080905 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074726 2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:29:05.080905 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074728 2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:29:05.081365 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074731 2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:29:05.081365 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074733 2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:29:05.081365 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074736 2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:29:05.081365 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074738 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:29:05.081365 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074741 2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:29:05.081365 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074744 2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:29:05.081365 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074746 2579 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:29:05.081365 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074749 2579 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:29:05.081365 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074752 2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:29:05.081365 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074755 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:29:05.081365 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.074778 2579 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 00:29:05.081365 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074810 2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:29:05.081365 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074814 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:29:05.081365 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074817 2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:29:05.081365 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074821 2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:29:05.081365 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074824 2579 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:29:05.081791 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074826 2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:29:05.081791 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074829 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:29:05.081791 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074832 2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:29:05.081791 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074834 2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:29:05.081791 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074837 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:29:05.081791 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074840 2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:29:05.081791 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074842 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:29:05.081791 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074845 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:29:05.081791 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074847 2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:29:05.081791 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074850 2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:29:05.081791 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074853 2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:29:05.081791 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074855 2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:29:05.081791 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074857 2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:29:05.081791 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074860 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:29:05.081791 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074862 2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:29:05.081791 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074865 2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:29:05.081791 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074867 2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:29:05.081791 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074870 2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:29:05.081791 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074872 2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:29:05.082221 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074875 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:29:05.082221 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074877 2579 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:29:05.082221 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074883 2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:29:05.082221 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074885 2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:29:05.082221 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074888 2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:29:05.082221 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074890 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:29:05.082221 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074893 2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:29:05.082221 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074896 2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:29:05.082221 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074898 2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:29:05.082221 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074901 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:29:05.082221 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074904 2579 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:29:05.082221 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074906 2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:29:05.082221 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074909 2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:29:05.082221 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074911 2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:29:05.082221 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074914 2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:29:05.082221 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074916 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:29:05.082221 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074919 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:29:05.082221 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074921 2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:29:05.082221 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074924 2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:29:05.082221 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074927 2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:29:05.082693 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074930 2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:29:05.082693 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074932 2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:29:05.082693 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074935 2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:29:05.082693 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074937 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:29:05.082693 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074940 2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:29:05.082693 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074943 2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:29:05.082693 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074945 2579 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:29:05.082693 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074948 2579 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:29:05.082693 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074950 2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:29:05.082693 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074953 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:29:05.082693 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074955 2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:29:05.082693 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074958 2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:29:05.082693 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074960 2579 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:29:05.082693 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074963 2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:29:05.082693 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074967 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:29:05.082693 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074970 2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:29:05.082693 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074972 2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:29:05.082693 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074975 2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:29:05.082693 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074978 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:29:05.082693 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074981 2579 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:29:05.083160 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074984 2579 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:29:05.083160 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074987 2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:29:05.083160 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074989 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:29:05.083160 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074992 2579 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:29:05.083160 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074994 2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:29:05.083160 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074997 2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:29:05.083160 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.074999 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:29:05.083160 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075002 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:29:05.083160 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075004 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:29:05.083160 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075007 2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:29:05.083160 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075010 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:29:05.083160 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075012 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:29:05.083160 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075015 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:29:05.083160 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075017 2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:29:05.083160 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075020 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:29:05.083160 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075022 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:29:05.083160 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075025 2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:29:05.083160 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075027 2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:29:05.083160 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075030 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:29:05.083613 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075032 2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:29:05.083613 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075035 2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:29:05.083613 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075039 2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:29:05.083613 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075043 2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:29:05.083613 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075047 2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:29:05.083613 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075051 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:29:05.083613 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075054 2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:29:05.083613 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075058 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:29:05.083613 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075060 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:29:05.083613 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075063 2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:29:05.083613 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075066 2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:29:05.083613 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075069 2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:29:05.083613 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075072 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:29:05.083613 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075075 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:29:05.083613 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075078 2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:29:05.083613 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075081 2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:29:05.083613 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075084 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:29:05.083613 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075086 2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:29:05.084032 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075089 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:29:05.084032 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075091 2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:29:05.084032 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075094 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:29:05.084032 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075096 2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:29:05.084032 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:05.075099 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:29:05.084032 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.075154 2579 server.go:957] "Client rotation is on, will bootstrap in background" Oct 31 00:29:05.084032 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.078224 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 31 00:29:05.084032 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.079253 2579 server.go:1014] "Starting client certificate rotation" Oct 31 00:29:05.084032 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.079355 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 31 00:29:05.084032 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.079387 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 31 00:29:05.084032 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.081487 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 31 00:29:05.084032 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.082630 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 31 00:29:05.091729 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.091715 2579 log.go:25] "Validated CRI v1 runtime API" Oct 31 00:29:05.095634 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.095616 2579 log.go:25] "Validated CRI v1 image API" Oct 31 00:29:05.096444 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.096423 2579 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 31 00:29:05.098957 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.098934 2579 fs.go:135] Filesystem UUIDs: map[088fd590-46cb-4ee8-898e-fa1bd20c910e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 905224ef-804c-439c-9156-897b1fffa6ee:/dev/nvme0n1p3] Oct 31 00:29:05.099012 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.098955 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 31 00:29:05.106301 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.106186 2579 manager.go:217] Machine: {Timestamp:2026-10-31 00:29:05.104760606 +0000 UTC m=+0.375967344 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099865 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec299f2ba534d82310d7400151fda92d SystemUUID:ec299f2b-a534-d823-10d7-400151fda92d BootID:9a3bc226-f53e-4400-bda6-e916605031c0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c7:76:b9:69 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c7:76:b9:69 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:47:5c:c7:57:0b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 31 00:29:05.106301 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.106293 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 31 00:29:05.106438 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.106374 2579 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 31 00:29:05.109140 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.109114 2579 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 31 00:29:05.109267 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.109142 2579 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-90.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 31 00:29:05.109309 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.109269 2579 topology_manager.go:143] "Creating topology manager with none policy" Oct 31 00:29:05.109309 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.109277 2579 container_manager_linux.go:311] "Creating device plugin manager" Oct 31 00:29:05.109362 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.109309 2579 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 31 00:29:05.109362 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.109329 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 31 00:29:05.110467 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.110456 2579 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 31 00:29:05.113720 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.113708 2579 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 31 00:29:05.113838 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.113829 2579 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 31 00:29:05.114631 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.114623 2579 kubelet.go:493] "Attempting to sync node with API server" Oct 31 00:29:05.114668 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.114636 2579 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 31 00:29:05.114668 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.114646 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 31 00:29:05.114668 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.114654 2579 kubelet.go:405] "Adding apiserver pod source" Oct 31 00:29:05.114668 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.114663 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 31 00:29:05.115045 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.115030 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 31 00:29:05.117491 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.117474 2579 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 31 00:29:05.124198 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.124186 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 31 00:29:05.125127 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.125113 2579 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 31 00:29:05.125169 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.125152 2579 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 31 00:29:05.125313 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.125303 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 31 00:29:05.125351 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.125319 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 31 00:29:05.125351 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.125325 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 31 00:29:05.125351 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.125331 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 31 00:29:05.125351 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.125337 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 31 00:29:05.125351 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.125345 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 31 00:29:05.126097 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.126089 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 31 00:29:05.126125 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.126098 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 31 00:29:05.126125 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.126106 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 31 00:29:05.126125 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.126112 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 31 00:29:05.126125 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.126121 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 31 00:29:05.126281 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.126129 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 31 00:29:05.126845 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.126835 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 31 00:29:05.126880 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.126848 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 31 00:29:05.130645 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.130631 2579 server.go:1263] "Started kubelet" Oct 31 00:29:05.130728 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.130697 2579 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 31 00:29:05.130782 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.130728 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 31 00:29:05.130826 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.130811 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 31 00:29:05.131477 ip-10-0-131-90 systemd[1]: Started Kubernetes Kubelet. Oct 31 00:29:05.132499 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.132470 2579 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 31 00:29:05.135131 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.134228 2579 server.go:317] "Adding debug handlers to kubelet server" Oct 31 00:29:05.137703 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.137684 2579 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 31 00:29:05.140201 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.140180 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 31 00:29:05.141580 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.141565 2579 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 31 00:29:05.142182 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.141668 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-90.ec2.internal\" not found" Oct 31 00:29:05.142341 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.142327 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 31 00:29:05.142449 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.142328 2579 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 31 00:29:05.142449 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.142451 2579 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 31 00:29:05.142619 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.142537 2579 reconstruct.go:97] "Volume reconstruction finished" Oct 31 00:29:05.142619 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.142548 2579 reconciler.go:29] "Reconciler: start to sync state" Oct 31 00:29:05.142619 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.142589 2579 factory.go:55] Registering systemd factory Oct 31 00:29:05.142619 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.142603 2579 factory.go:223] Registration of the systemd container factory successfully Oct 31 00:29:05.142827 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.142814 2579 factory.go:153] Registering CRI-O factory Oct 31 00:29:05.142879 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.142831 2579 factory.go:223] Registration of the crio container factory successfully Oct 31 00:29:05.142932 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.142880 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 31 00:29:05.142932 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.142900 2579 factory.go:103] Registering Raw factory Oct 31 00:29:05.142932 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.142914 2579 manager.go:1199] Started watching for new ooms in manager Oct 31 00:29:05.143908 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.143895 2579 manager.go:319] Starting recovery of all containers Oct 31 00:29:05.158266 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.158246 2579 manager.go:324] Recovery completed Oct 31 00:29:05.162314 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.162298 2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:29:05.162538 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.162512 2579 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-90.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 31 00:29:05.162538 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.162521 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-90.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 31 00:29:05.163772 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.162788 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-90.ec2.internal.18e375c03c5ed5e1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-90.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-90.ec2.internal,},FirstTimestamp:2026-10-31 00:29:05.130608097 +0000 UTC m=+0.401814834,LastTimestamp:2026-10-31 00:29:05.130608097 +0000 UTC m=+0.401814834,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-90.ec2.internal,}" Oct 31 00:29:05.164211 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.164185 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasSufficientMemory" Oct 31 00:29:05.164268 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.164219 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasNoDiskPressure" Oct 31 00:29:05.164268 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.164231 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasSufficientPID" Oct 31 00:29:05.164821 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.164808 2579 cpu_manager.go:226] "Starting" policy="none" Oct 31 00:29:05.164821 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.164817 2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:29:05.164937 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.164819 2579 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 31 00:29:05.164937 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.164891 2579 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 31 00:29:05.165515 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.165499 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasSufficientMemory" Oct 31 00:29:05.165587 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.165564 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasNoDiskPressure" Oct 31 00:29:05.165587 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.165580 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasSufficientPID" Oct 31 00:29:05.166220 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.166204 2579 policy_none.go:50] "Start" Oct 31 00:29:05.166220 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.166222 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 31 00:29:05.166326 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.166234 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 31 00:29:05.167494 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.167479 2579 policy_none.go:44] "Start" Oct 31 00:29:05.168778 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.168752 2579 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 31 00:29:05.175745 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.175727 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bzgbg" Oct 31 00:29:05.178098 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.178078 2579 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Oct 31 00:29:05.178283 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.178251 2579 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-90.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Oct 31 00:29:05.178362 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.178257 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-90.ec2.internal.18e375c03e5f742e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-90.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-90.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-90.ec2.internal,},FirstTimestamp:2026-10-31 00:29:05.164203054 +0000 UTC m=+0.435409795,LastTimestamp:2026-10-31 00:29:05.164203054 +0000 UTC m=+0.435409795,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-90.ec2.internal,}" Oct 31 00:29:05.178576 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.178478 2579 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Oct 31 00:29:05.193542 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.193526 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bzgbg" Oct 31 00:29:05.201541 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.201482 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-90.ec2.internal.18e375c03e5fca42 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-90.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-90.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-90.ec2.internal,},FirstTimestamp:2026-10-31 00:29:05.16422509 +0000 UTC m=+0.435431832,LastTimestamp:2026-10-31 00:29:05.16422509 +0000 UTC m=+0.435431832,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-90.ec2.internal,}" Oct 31 00:29:05.207964 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.207935 2579 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 31 00:29:05.210345 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.210334 2579 manager.go:341] "Starting Device Plugin manager" Oct 31 00:29:05.210427 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.210357 2579 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 31 00:29:05.210427 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.210365 2579 server.go:87] "Starting device plugin registration server" Oct 31 00:29:05.210594 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.210581 2579 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 31 00:29:05.210650 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.210599 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 31 00:29:05.210793 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.210779 2579 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 31 00:29:05.210863 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.210851 2579 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 31 00:29:05.210901 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.210864 2579 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 31 00:29:05.211674 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.211655 2579 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 31 00:29:05.211754 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.211696 2579 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-90.ec2.internal\" not found" Oct 31 00:29:05.270880 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.270860 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 31 00:29:05.272019 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.272001 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 31 00:29:05.272092 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.272030 2579 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 31 00:29:05.272092 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.272048 2579 kubelet.go:2521] "Starting kubelet main sync loop" Oct 31 00:29:05.272092 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.272076 2579 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Oct 31 00:29:05.287102 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.287085 2579 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:29:05.310849 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.310801 2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:29:05.311540 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.311524 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasSufficientMemory" Oct 31 00:29:05.311626 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.311554 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasNoDiskPressure" Oct 31 00:29:05.311626 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.311569 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasSufficientPID" Oct 31 00:29:05.311626 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.311597 2579 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-131-90.ec2.internal" Oct 31 00:29:05.329300 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.329281 2579 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-131-90.ec2.internal" Oct 31 00:29:05.329370 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.329302 2579 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-90.ec2.internal\": node \"ip-10-0-131-90.ec2.internal\" not found" Oct 31 00:29:05.368612 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.368471 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-90.ec2.internal\" not found" Oct 31 00:29:05.373094 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.373066 2579 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal"] Oct 31 00:29:05.373143 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.373126 2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:29:05.374815 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.374797 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasSufficientMemory" Oct 31 00:29:05.374890 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.374822 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasNoDiskPressure" Oct 31 00:29:05.374890 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.374832 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasSufficientPID" Oct 31 00:29:05.376006 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.375994 2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:29:05.376159 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.376141 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" Oct 31 00:29:05.376199 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.376175 2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:29:05.377148 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.377127 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasSufficientMemory" Oct 31 00:29:05.377212 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.377149 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasNoDiskPressure" Oct 31 00:29:05.377212 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.377161 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasSufficientPID" Oct 31 00:29:05.377212 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.377181 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasSufficientMemory" Oct 31 00:29:05.377212 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.377200 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasNoDiskPressure" Oct 31 00:29:05.377212 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.377209 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasSufficientPID" Oct 31 00:29:05.378328 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.378315 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal" Oct 31 00:29:05.378392 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.378338 2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:29:05.379026 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.379013 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasSufficientMemory" Oct 31 00:29:05.379082 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.379033 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasNoDiskPressure" Oct 31 00:29:05.379082 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.379046 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasSufficientPID" Oct 31 00:29:05.408966 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.408947 2579 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-90.ec2.internal\" not found" node="ip-10-0-131-90.ec2.internal" Oct 31 00:29:05.412981 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.412964 2579 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-90.ec2.internal\" not found" node="ip-10-0-131-90.ec2.internal" Oct 31 00:29:05.443749 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.443732 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a486685e4aa272e6e3121222626b7fe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal\" (UID: \"6a486685e4aa272e6e3121222626b7fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" Oct 31 00:29:05.443826 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.443756 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a486685e4aa272e6e3121222626b7fe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal\" (UID: \"6a486685e4aa272e6e3121222626b7fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" Oct 31 00:29:05.443826 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.443778 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a11e2d9565d47e2d9d5101c74a24023b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-90.ec2.internal\" (UID: \"a11e2d9565d47e2d9d5101c74a24023b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal" Oct 31 00:29:05.469198 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.469177 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-90.ec2.internal\" not found" Oct 31 00:29:05.544730 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.544707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a486685e4aa272e6e3121222626b7fe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal\" (UID: \"6a486685e4aa272e6e3121222626b7fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" Oct 31 00:29:05.544817 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.544738 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a486685e4aa272e6e3121222626b7fe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal\" (UID: \"6a486685e4aa272e6e3121222626b7fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" Oct 31 00:29:05.544817 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.544762 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a11e2d9565d47e2d9d5101c74a24023b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-90.ec2.internal\" (UID: \"a11e2d9565d47e2d9d5101c74a24023b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal" Oct 31 00:29:05.544817 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.544810 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a486685e4aa272e6e3121222626b7fe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal\" (UID: \"6a486685e4aa272e6e3121222626b7fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" Oct 31 00:29:05.544927 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.544812 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a486685e4aa272e6e3121222626b7fe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal\" (UID: \"6a486685e4aa272e6e3121222626b7fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" Oct 31 00:29:05.544927 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.544835 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a11e2d9565d47e2d9d5101c74a24023b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-90.ec2.internal\" (UID: \"a11e2d9565d47e2d9d5101c74a24023b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal" Oct 31 00:29:05.570195 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.570152 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-90.ec2.internal\" not found" Oct 31 00:29:05.671128 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.671107 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-90.ec2.internal\" not found" Oct 31 00:29:05.713144 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.713125 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" Oct 31 00:29:05.715736 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:05.715720 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal" Oct 31 00:29:05.771753 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.771728 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-90.ec2.internal\" not found" Oct 31 00:29:05.872278 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.872228 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-90.ec2.internal\" not found" Oct 31 00:29:05.973313 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:05.973285 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-90.ec2.internal\" not found" Oct 31 00:29:06.061986 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:06.061953 2579 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:29:06.073812 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:06.073787 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-90.ec2.internal\" not found" Oct 31 00:29:06.079240 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:06.079223 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 31 00:29:06.079399 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:06.079373 2579 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 31 00:29:06.079454 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:06.079399 2579 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 31 00:29:06.173891 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:06.173854 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-90.ec2.internal\" not found" Oct 31 00:29:06.197493 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:06.197382 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 00:24:05 +0000 UTC" deadline="2028-05-21 05:21:32.786294062 +0000 UTC" Oct 31 00:29:06.197493 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:06.197421 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13636h52m26.588876642s" Oct 31 00:29:06.213748 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:06.213722 2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:29:06.215091 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:06.215075 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasSufficientMemory" Oct 31 00:29:06.215164 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:06.215114 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasNoDiskPressure" Oct 31 00:29:06.215164 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:06.215129 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasSufficientPID" Oct 31 00:29:06.268547 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:06.268497 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a486685e4aa272e6e3121222626b7fe.slice/crio-3bffdfec1899b046e81a94bd11fd454fdbf030d95f4a0310bf5afa90771e4ca7 WatchSource:0}: Error finding container 3bffdfec1899b046e81a94bd11fd454fdbf030d95f4a0310bf5afa90771e4ca7: Status 404 returned error can't find the container with id 3bffdfec1899b046e81a94bd11fd454fdbf030d95f4a0310bf5afa90771e4ca7 Oct 31 00:29:06.269325 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:06.269300 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda11e2d9565d47e2d9d5101c74a24023b.slice/crio-f1eee17fff7498d26c950d9bd44b717fc14da4697b84dc174523561642120c08 WatchSource:0}: Error finding container f1eee17fff7498d26c950d9bd44b717fc14da4697b84dc174523561642120c08: Status 404 returned error can't find the container with id f1eee17fff7498d26c950d9bd44b717fc14da4697b84dc174523561642120c08 Oct 31 00:29:06.270932 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:06.270907 2579 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:29:06.274034 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:06.273932 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-90.ec2.internal\" not found" Oct 31 00:29:06.274343 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:06.274329 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 31 00:29:06.275231 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:06.275189 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal" event={"ID":"a11e2d9565d47e2d9d5101c74a24023b","Type":"ContainerStarted","Data":"f1eee17fff7498d26c950d9bd44b717fc14da4697b84dc174523561642120c08"} Oct 31 00:29:06.276213 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:06.276189 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" event={"ID":"6a486685e4aa272e6e3121222626b7fe","Type":"ContainerStarted","Data":"3bffdfec1899b046e81a94bd11fd454fdbf030d95f4a0310bf5afa90771e4ca7"} Oct 31 00:29:06.375322 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:06.375294 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-90.ec2.internal\" not found" Oct 31 00:29:06.415919 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:06.415867 2579 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:29:06.442192 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:06.442168 2579 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" Oct 31 00:29:06.467008 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:06.466988 2579 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 00:29:06.468055 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:06.468041 2579 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal" Oct 31 00:29:06.488777 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:06.488754 2579 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 00:29:07.118470 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.118440 2579 apiserver.go:52] "Watching apiserver" Oct 31 00:29:07.141341 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.141311 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 31 00:29:07.160649 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.160622 2579 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:29:07.161228 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.161208 2579 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 31 00:29:07.161758 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.161733 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-kpvff","openshift-image-registry/node-ca-cqfvp","openshift-multus/multus-additional-cni-plugins-cpmxb","openshift-multus/network-metrics-daemon-cbb78","openshift-network-operator/iptables-alerter-rrrwt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2","openshift-multus/multus-tk7rq","kube-system/global-pull-secret-syncer-j7fh7","kube-system/konnectivity-agent-7ttgh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal","openshift-network-diagnostics/network-check-target-72nks","openshift-ovn-kubernetes/ovnkube-node-hc5x9","kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal","openshift-cluster-node-tuning-operator/tuned-h6n9q"] Oct 31 00:29:07.163686 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.163648 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kpvff" Oct 31 00:29:07.167032 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.167009 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rrrwt" Oct 31 00:29:07.167582 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.167552 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.168086 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.168067 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:07.168552 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:07.168229 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbb78" podUID="671b2592-db78-4be6-9a9c-83ade9a48bce" Oct 31 00:29:07.169265 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.169243 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.176345 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.170771 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.176873 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.176811 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cqfvp" Oct 31 00:29:07.178240 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.178218 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:07.178336 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:07.178293 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7fh7" podUID="bdd36c3c-acec-474f-b4aa-27ae4490c39b" Oct 31 00:29:07.179689 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.179666 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7ttgh" Oct 31 00:29:07.180420 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.180403 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 31 00:29:07.180523 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.180460 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 31 00:29:07.181243 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.181221 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:07.181330 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:07.181282 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72nks" podUID="7e87fd11-4685-4e33-8230-b6b53747c9a9" Oct 31 00:29:07.182320 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.182301 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j6h9g\"" Oct 31 00:29:07.182493 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.182464 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dwrd5\"" Oct 31 00:29:07.182646 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.182622 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:29:07.182759 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.182648 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 31 00:29:07.182986 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.182968 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 31 00:29:07.182986 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.182972 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.184837 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.184820 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.191862 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.191842 2579 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 31 00:29:07.243347 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.243327 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 31 00:29:07.252747 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.252724 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/177f7e75-1990-4afa-9740-6f3e0665b311-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.252870 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.252754 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-registration-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.252870 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.252794 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d8e4f707-7f3f-4081-9ad9-df7e33efb927-konnectivity-ca\") pod \"konnectivity-agent-7ttgh\" (UID: \"d8e4f707-7f3f-4081-9ad9-df7e33efb927\") " pod="kube-system/konnectivity-agent-7ttgh" Oct 31 00:29:07.252996 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.252862 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-run-k8s-cni-cncf-io\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.252996 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.252904 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-daemon-config\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.252996 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.252941 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-etc-kubernetes\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.252996 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.252963 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs\") pod \"network-metrics-daemon-cbb78\" (UID: \"671b2592-db78-4be6-9a9c-83ade9a48bce\") " pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:07.252996 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.252992 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/177f7e75-1990-4afa-9740-6f3e0665b311-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.253242 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253035 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-env-overrides\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.253242 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253078 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-sysconfig\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.253242 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253150 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcrwb\" (UniqueName: \"kubernetes.io/projected/8597a843-682b-45d5-9e4a-da5fff7573a1-kube-api-access-qcrwb\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.253242 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253177 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/758d2e0b-39da-418e-9e35-2c817915ebce-host\") pod \"node-ca-cqfvp\" (UID: \"758d2e0b-39da-418e-9e35-2c817915ebce\") " pod="openshift-image-registry/node-ca-cqfvp" Oct 31 00:29:07.253242 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253202 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-device-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.253490 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253284 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-etc-selinux\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.253490 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253308 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-run-ovn\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.253490 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253331 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-sysctl-d\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.253490 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-socket-dir-parent\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.253490 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253367 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/177f7e75-1990-4afa-9740-6f3e0665b311-cni-binary-copy\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.253490 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253383 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/177f7e75-1990-4afa-9740-6f3e0665b311-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.253490 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253408 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-etc-openvswitch\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.253490 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253457 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-run-multus-certs\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.253874 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253503 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrwq7\" (UniqueName: \"kubernetes.io/projected/671b2592-db78-4be6-9a9c-83ade9a48bce-kube-api-access-hrwq7\") pod \"network-metrics-daemon-cbb78\" (UID: \"671b2592-db78-4be6-9a9c-83ade9a48bce\") " pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:07.253874 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253526 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/177f7e75-1990-4afa-9740-6f3e0665b311-system-cni-dir\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.253874 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253549 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfltg\" (UniqueName: \"kubernetes.io/projected/758d2e0b-39da-418e-9e35-2c817915ebce-kube-api-access-sfltg\") pod \"node-ca-cqfvp\" (UID: \"758d2e0b-39da-418e-9e35-2c817915ebce\") " pod="openshift-image-registry/node-ca-cqfvp" Oct 31 00:29:07.253874 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253565 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.253874 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253589 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-run-netns\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.253874 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253631 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-var-lib-openvswitch\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.253874 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253663 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-sys-fs\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.253874 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253724 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-sys\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.253874 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253773 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb75l\" (UniqueName: \"kubernetes.io/projected/33de1dca-4062-4401-9d55-af069d8874f3-kube-api-access-gb75l\") pod \"node-resolver-kpvff\" (UID: \"33de1dca-4062-4401-9d55-af069d8874f3\") " pod="openshift-dns/node-resolver-kpvff" Oct 31 00:29:07.253874 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253817 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-conf-dir\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.253874 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253843 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d8e4f707-7f3f-4081-9ad9-df7e33efb927-agent-certs\") pod \"konnectivity-agent-7ttgh\" (UID: \"d8e4f707-7f3f-4081-9ad9-df7e33efb927\") " pod="kube-system/konnectivity-agent-7ttgh" Oct 31 00:29:07.253874 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253870 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-kubelet\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.254359 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253905 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-ovnkube-config\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.254359 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253930 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-tuned\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.254359 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253958 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-tmp\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.254359 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.253998 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-cnibin\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.254359 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254047 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.254359 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254084 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-lib-modules\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.254359 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254111 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-cni-dir\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.254359 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254135 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8597a843-682b-45d5-9e4a-da5fff7573a1-cni-binary-copy\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.254359 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254161 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:07.254359 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254186 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-slash\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.254359 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254211 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-cni-netd\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.254359 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254238 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-ovnkube-script-lib\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.254359 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254264 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsgjr\" (UniqueName: \"kubernetes.io/projected/92956936-d054-482d-a78a-784cf0eeeeb3-kube-api-access-rsgjr\") pod \"iptables-alerter-rrrwt\" (UID: \"92956936-d054-482d-a78a-784cf0eeeeb3\") " pod="openshift-network-operator/iptables-alerter-rrrwt" Oct 31 00:29:07.254359 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254289 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-socket-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.254359 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254339 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-run-openvswitch\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.255048 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254383 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.255048 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254408 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-cni-bin\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.255048 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254431 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-host\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.255048 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254476 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33de1dca-4062-4401-9d55-af069d8874f3-hosts-file\") pod \"node-resolver-kpvff\" (UID: \"33de1dca-4062-4401-9d55-af069d8874f3\") " pod="openshift-dns/node-resolver-kpvff" Oct 31 00:29:07.255048 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254502 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-hostroot\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.255048 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254525 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-system-cni-dir\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.255048 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254576 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-var-lib-kubelet\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.255048 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254635 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/177f7e75-1990-4afa-9740-6f3e0665b311-cnibin\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.255048 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254666 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv6qc\" (UniqueName: \"kubernetes.io/projected/177f7e75-1990-4afa-9740-6f3e0665b311-kube-api-access-lv6qc\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.255048 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254700 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/758d2e0b-39da-418e-9e35-2c817915ebce-serviceca\") pod \"node-ca-cqfvp\" (UID: \"758d2e0b-39da-418e-9e35-2c817915ebce\") " pod="openshift-image-registry/node-ca-cqfvp" Oct 31 00:29:07.255048 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254726 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfkv4\" (UniqueName: \"kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4\") pod \"network-check-target-72nks\" (UID: \"7e87fd11-4685-4e33-8230-b6b53747c9a9\") " pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:07.255048 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254750 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-kubernetes\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.255048 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254778 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lgpc\" (UniqueName: \"kubernetes.io/projected/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-kube-api-access-6lgpc\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.255048 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254823 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/92956936-d054-482d-a78a-784cf0eeeeb3-iptables-alerter-script\") pod \"iptables-alerter-rrrwt\" (UID: \"92956936-d054-482d-a78a-784cf0eeeeb3\") " pod="openshift-network-operator/iptables-alerter-rrrwt" Oct 31 00:29:07.255048 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254847 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-log-socket\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.255048 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254873 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txp8g\" (UniqueName: \"kubernetes.io/projected/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-kube-api-access-txp8g\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.255637 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254898 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-modprobe-d\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.255637 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254922 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-var-lib-kubelet\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.255637 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254948 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-var-lib-cni-multus\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.255637 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254972 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92956936-d054-482d-a78a-784cf0eeeeb3-host-slash\") pod \"iptables-alerter-rrrwt\" (UID: \"92956936-d054-482d-a78a-784cf0eeeeb3\") " pod="openshift-network-operator/iptables-alerter-rrrwt" Oct 31 00:29:07.255637 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.254998 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bdd36c3c-acec-474f-b4aa-27ae4490c39b-kubelet-config\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:07.255637 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.255059 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bdd36c3c-acec-474f-b4aa-27ae4490c39b-dbus\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:07.255637 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.255088 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxhhb\" (UniqueName: \"kubernetes.io/projected/d402f509-6848-43fb-bedd-2d82bfceb0c2-kube-api-access-wxhhb\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.255637 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.255112 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-systemd-units\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.255637 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.255134 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-node-log\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.255637 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.255158 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-ovn-node-metrics-cert\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.255637 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.255183 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-var-lib-cni-bin\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.255637 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.255209 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-sysctl-conf\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.255637 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.255233 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-systemd\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.255637 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.255257 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-run\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.255637 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.255281 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33de1dca-4062-4401-9d55-af069d8874f3-tmp-dir\") pod \"node-resolver-kpvff\" (UID: \"33de1dca-4062-4401-9d55-af069d8874f3\") " pod="openshift-dns/node-resolver-kpvff" Oct 31 00:29:07.255637 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.255304 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-run-systemd\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.256163 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.255329 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-run-netns\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.289483 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.289455 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 31 00:29:07.289607 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.289471 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mhfmv\"" Oct 31 00:29:07.289607 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.289455 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 31 00:29:07.290019 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.289843 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 31 00:29:07.290019 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.289855 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-5lgq7\"" Oct 31 00:29:07.290019 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.289881 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 31 00:29:07.290019 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.289885 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 31 00:29:07.290019 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.289913 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 31 00:29:07.290019 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.289922 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 31 00:29:07.290019 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.289969 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 31 00:29:07.290019 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.289979 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fb5fv\"" Oct 31 00:29:07.290019 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.289985 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 31 00:29:07.290488 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.290035 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 31 00:29:07.290488 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.290050 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pnxsg\"" Oct 31 00:29:07.290488 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.290218 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 31 00:29:07.290488 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.290235 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:29:07.290488 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.290257 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 31 00:29:07.290488 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.290319 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 31 00:29:07.301999 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.301934 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hvmr7\"" Oct 31 00:29:07.301999 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.301946 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 31 00:29:07.301999 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.301944 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 31 00:29:07.301999 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.301968 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 31 00:29:07.301999 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.301967 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-s6nvb\"" Oct 31 00:29:07.302258 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.302016 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 31 00:29:07.302519 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.302456 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 31 00:29:07.302519 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.302490 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 31 00:29:07.302519 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.302513 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 31 00:29:07.302787 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.302547 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 31 00:29:07.302787 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.302611 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7r7qx\"" Oct 31 00:29:07.355807 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.355785 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-var-lib-cni-bin\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.355918 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.355818 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-sysctl-conf\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.355918 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.355844 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-systemd\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.355918 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.355866 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-run\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.355918 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.355883 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33de1dca-4062-4401-9d55-af069d8874f3-tmp-dir\") pod \"node-resolver-kpvff\" (UID: \"33de1dca-4062-4401-9d55-af069d8874f3\") " pod="openshift-dns/node-resolver-kpvff" Oct 31 00:29:07.355918 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.355899 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-run-systemd\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.356190 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.355923 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-run-netns\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.356190 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.355949 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/177f7e75-1990-4afa-9740-6f3e0665b311-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.356190 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.355969 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-registration-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.356190 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.355995 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d8e4f707-7f3f-4081-9ad9-df7e33efb927-konnectivity-ca\") pod \"konnectivity-agent-7ttgh\" (UID: \"d8e4f707-7f3f-4081-9ad9-df7e33efb927\") " pod="kube-system/konnectivity-agent-7ttgh" Oct 31 00:29:07.356190 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356060 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-run-netns\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.356190 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356109 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-run-k8s-cni-cncf-io\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.356190 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356144 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-daemon-config\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.356190 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356173 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-etc-kubernetes\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.356641 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356200 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs\") pod \"network-metrics-daemon-cbb78\" (UID: \"671b2592-db78-4be6-9a9c-83ade9a48bce\") " pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:07.356641 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356228 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/177f7e75-1990-4afa-9740-6f3e0665b311-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.356641 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-env-overrides\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.356641 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356279 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-sysconfig\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.356641 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356337 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcrwb\" (UniqueName: \"kubernetes.io/projected/8597a843-682b-45d5-9e4a-da5fff7573a1-kube-api-access-qcrwb\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.356641 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356362 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/758d2e0b-39da-418e-9e35-2c817915ebce-host\") pod \"node-ca-cqfvp\" (UID: \"758d2e0b-39da-418e-9e35-2c817915ebce\") " pod="openshift-image-registry/node-ca-cqfvp" Oct 31 00:29:07.356641 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356387 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-device-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.356641 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356412 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-etc-selinux\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.356641 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356439 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-run-ovn\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.356641 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356482 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-sysctl-d\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.356641 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356508 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-socket-dir-parent\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.356641 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356534 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/177f7e75-1990-4afa-9740-6f3e0665b311-cni-binary-copy\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.356641 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356561 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/177f7e75-1990-4afa-9740-6f3e0665b311-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.356641 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356587 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-etc-openvswitch\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.356641 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356623 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-run-multus-certs\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.357346 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356649 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrwq7\" (UniqueName: \"kubernetes.io/projected/671b2592-db78-4be6-9a9c-83ade9a48bce-kube-api-access-hrwq7\") pod \"network-metrics-daemon-cbb78\" (UID: \"671b2592-db78-4be6-9a9c-83ade9a48bce\") " pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:07.357346 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356675 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/177f7e75-1990-4afa-9740-6f3e0665b311-system-cni-dir\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.357346 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfltg\" (UniqueName: \"kubernetes.io/projected/758d2e0b-39da-418e-9e35-2c817915ebce-kube-api-access-sfltg\") pod \"node-ca-cqfvp\" (UID: \"758d2e0b-39da-418e-9e35-2c817915ebce\") " pod="openshift-image-registry/node-ca-cqfvp" Oct 31 00:29:07.357346 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356739 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.357346 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356764 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-run-netns\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.357346 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356812 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-var-lib-openvswitch\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.357346 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356841 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-sys-fs\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.357346 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-sys\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.357346 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356924 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb75l\" (UniqueName: \"kubernetes.io/projected/33de1dca-4062-4401-9d55-af069d8874f3-kube-api-access-gb75l\") pod \"node-resolver-kpvff\" (UID: \"33de1dca-4062-4401-9d55-af069d8874f3\") " pod="openshift-dns/node-resolver-kpvff" Oct 31 00:29:07.357346 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356938 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-registration-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.357346 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356951 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-conf-dir\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.357346 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.356984 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d8e4f707-7f3f-4081-9ad9-df7e33efb927-agent-certs\") pod \"konnectivity-agent-7ttgh\" (UID: \"d8e4f707-7f3f-4081-9ad9-df7e33efb927\") " pod="kube-system/konnectivity-agent-7ttgh" Oct 31 00:29:07.357346 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357002 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-conf-dir\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.357346 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357003 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-kubelet\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.357346 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357042 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-ovnkube-config\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.357346 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357068 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-tuned\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.357346 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357094 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-tmp\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.358198 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357114 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-cnibin\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.358198 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357161 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-cnibin\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.358198 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357219 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-systemd\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.358198 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357263 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-sysctl-conf\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.358198 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357286 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-var-lib-cni-bin\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.358198 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357300 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.358198 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357335 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-lib-modules\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.358198 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357362 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-cni-dir\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.358198 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357389 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8597a843-682b-45d5-9e4a-da5fff7573a1-cni-binary-copy\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.358198 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357436 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d8e4f707-7f3f-4081-9ad9-df7e33efb927-konnectivity-ca\") pod \"konnectivity-agent-7ttgh\" (UID: \"d8e4f707-7f3f-4081-9ad9-df7e33efb927\") " pod="kube-system/konnectivity-agent-7ttgh" Oct 31 00:29:07.358198 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357461 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-sysctl-d\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.358198 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357518 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:07.358198 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357568 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-socket-dir-parent\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.358198 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357699 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-run-multus-certs\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.358198 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357701 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.358198 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357730 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-run-systemd\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.358198 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357752 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-run-netns\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.358198 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357771 2579 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 31 00:29:07.359010 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357790 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-etc-selinux\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.359010 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357814 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-run-k8s-cni-cncf-io\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.359010 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357843 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-sys\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.359010 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357874 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-etc-kubernetes\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.359010 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357893 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-device-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.359010 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.358003 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-run-ovn\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.359010 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.358067 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-kubelet\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.359010 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.358073 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-sys-fs\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.359010 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.358113 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.359010 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.358124 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-sysconfig\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.359010 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.358158 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/177f7e75-1990-4afa-9740-6f3e0665b311-system-cni-dir\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.359010 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.358162 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-slash\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.359010 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.358167 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-var-lib-openvswitch\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.359010 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.358190 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-cni-netd\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.359010 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.358215 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-ovnkube-script-lib\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.359010 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.358243 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsgjr\" (UniqueName: \"kubernetes.io/projected/92956936-d054-482d-a78a-784cf0eeeeb3-kube-api-access-rsgjr\") pod \"iptables-alerter-rrrwt\" (UID: \"92956936-d054-482d-a78a-784cf0eeeeb3\") " pod="openshift-network-operator/iptables-alerter-rrrwt" Oct 31 00:29:07.359010 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.358251 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-lib-modules\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.359919 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.358279 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-socket-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.359919 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.358332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-run-openvswitch\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.359919 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.358362 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.359919 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.358408 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-cni-bin\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.359919 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.358420 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-daemon-config\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.359919 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357844 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-ovnkube-config\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.359919 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.358454 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-host\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.359919 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.358691 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-run\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.359919 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.358887 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-cni-dir\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.359919 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:07.358334 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:07.359919 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:07.358612 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:07.359919 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:07.359119 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret podName:bdd36c3c-acec-474f-b4aa-27ae4490c39b nodeName:}" failed. No retries permitted until 2026-10-31 00:29:07.859097757 +0000 UTC m=+3.130304500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret") pod "global-pull-secret-syncer-j7fh7" (UID: "bdd36c3c-acec-474f-b4aa-27ae4490c39b") : object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:07.359919 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:07.359198 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs podName:671b2592-db78-4be6-9a9c-83ade9a48bce nodeName:}" failed. No retries permitted until 2026-10-31 00:29:07.859167245 +0000 UTC m=+3.130373986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs") pod "network-metrics-daemon-cbb78" (UID: "671b2592-db78-4be6-9a9c-83ade9a48bce") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:07.359919 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359219 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.359919 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359242 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-cni-bin\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.359919 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359248 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-socket-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.359919 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359320 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/177f7e75-1990-4afa-9740-6f3e0665b311-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.360675 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359333 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-host\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.360675 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359365 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-slash\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.360675 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359391 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-run-openvswitch\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.360675 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359403 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-etc-openvswitch\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.360675 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359424 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-cni-netd\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.360675 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.357766 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/758d2e0b-39da-418e-9e35-2c817915ebce-host\") pod \"node-ca-cqfvp\" (UID: \"758d2e0b-39da-418e-9e35-2c817915ebce\") " pod="openshift-image-registry/node-ca-cqfvp" Oct 31 00:29:07.360675 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359465 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33de1dca-4062-4401-9d55-af069d8874f3-hosts-file\") pod \"node-resolver-kpvff\" (UID: \"33de1dca-4062-4401-9d55-af069d8874f3\") " pod="openshift-dns/node-resolver-kpvff" Oct 31 00:29:07.360675 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359565 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/177f7e75-1990-4afa-9740-6f3e0665b311-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.360675 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359587 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-hostroot\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.360675 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359621 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-system-cni-dir\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.360675 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359662 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-var-lib-kubelet\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.360675 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/177f7e75-1990-4afa-9740-6f3e0665b311-cnibin\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.360675 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359730 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/177f7e75-1990-4afa-9740-6f3e0665b311-cni-binary-copy\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.360675 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359734 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv6qc\" (UniqueName: \"kubernetes.io/projected/177f7e75-1990-4afa-9740-6f3e0665b311-kube-api-access-lv6qc\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.360675 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359865 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8597a843-682b-45d5-9e4a-da5fff7573a1-cni-binary-copy\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.360675 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359911 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33de1dca-4062-4401-9d55-af069d8874f3-tmp-dir\") pod \"node-resolver-kpvff\" (UID: \"33de1dca-4062-4401-9d55-af069d8874f3\") " pod="openshift-dns/node-resolver-kpvff" Oct 31 00:29:07.360675 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359963 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/758d2e0b-39da-418e-9e35-2c817915ebce-serviceca\") pod \"node-ca-cqfvp\" (UID: \"758d2e0b-39da-418e-9e35-2c817915ebce\") " pod="openshift-image-registry/node-ca-cqfvp" Oct 31 00:29:07.360675 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359990 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-hostroot\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.361384 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.359992 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfkv4\" (UniqueName: \"kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4\") pod \"network-check-target-72nks\" (UID: \"7e87fd11-4685-4e33-8230-b6b53747c9a9\") " pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:07.361384 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.360047 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-kubernetes\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.361384 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.360082 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lgpc\" (UniqueName: \"kubernetes.io/projected/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-kube-api-access-6lgpc\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.361384 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.360145 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/92956936-d054-482d-a78a-784cf0eeeeb3-iptables-alerter-script\") pod \"iptables-alerter-rrrwt\" (UID: \"92956936-d054-482d-a78a-784cf0eeeeb3\") " pod="openshift-network-operator/iptables-alerter-rrrwt" Oct 31 00:29:07.361384 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.360171 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-var-lib-kubelet\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.361384 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.360218 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-log-socket\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.361384 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.360254 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/177f7e75-1990-4afa-9740-6f3e0665b311-cnibin\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.361384 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.360513 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-env-overrides\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.361384 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.360721 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/758d2e0b-39da-418e-9e35-2c817915ebce-serviceca\") pod \"node-ca-cqfvp\" (UID: \"758d2e0b-39da-418e-9e35-2c817915ebce\") " pod="openshift-image-registry/node-ca-cqfvp" Oct 31 00:29:07.361384 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.360175 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-log-socket\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.361384 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.360801 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txp8g\" (UniqueName: \"kubernetes.io/projected/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-kube-api-access-txp8g\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.361384 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.360823 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/177f7e75-1990-4afa-9740-6f3e0665b311-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.361384 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.360825 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-ovnkube-script-lib\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.361384 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.360834 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-modprobe-d\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.361384 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.360876 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-kubernetes\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.361384 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.360895 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-var-lib-kubelet\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.361384 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.360918 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-modprobe-d\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.362161 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.360923 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-var-lib-cni-multus\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.362161 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.360940 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33de1dca-4062-4401-9d55-af069d8874f3-hosts-file\") pod \"node-resolver-kpvff\" (UID: \"33de1dca-4062-4401-9d55-af069d8874f3\") " pod="openshift-dns/node-resolver-kpvff" Oct 31 00:29:07.362161 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.360959 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92956936-d054-482d-a78a-784cf0eeeeb3-host-slash\") pod \"iptables-alerter-rrrwt\" (UID: \"92956936-d054-482d-a78a-784cf0eeeeb3\") " pod="openshift-network-operator/iptables-alerter-rrrwt" Oct 31 00:29:07.362161 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.360979 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-system-cni-dir\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.362161 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.361073 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-var-lib-cni-multus\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.362161 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.361078 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92956936-d054-482d-a78a-784cf0eeeeb3-host-slash\") pod \"iptables-alerter-rrrwt\" (UID: \"92956936-d054-482d-a78a-784cf0eeeeb3\") " pod="openshift-network-operator/iptables-alerter-rrrwt" Oct 31 00:29:07.362161 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.361133 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-var-lib-kubelet\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.362161 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.361355 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bdd36c3c-acec-474f-b4aa-27ae4490c39b-kubelet-config\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:07.362161 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.361384 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bdd36c3c-acec-474f-b4aa-27ae4490c39b-dbus\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:07.362161 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.361561 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxhhb\" (UniqueName: \"kubernetes.io/projected/d402f509-6848-43fb-bedd-2d82bfceb0c2-kube-api-access-wxhhb\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.362161 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.361649 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/92956936-d054-482d-a78a-784cf0eeeeb3-iptables-alerter-script\") pod \"iptables-alerter-rrrwt\" (UID: \"92956936-d054-482d-a78a-784cf0eeeeb3\") " pod="openshift-network-operator/iptables-alerter-rrrwt" Oct 31 00:29:07.362161 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.361478 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bdd36c3c-acec-474f-b4aa-27ae4490c39b-kubelet-config\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:07.362161 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.361487 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bdd36c3c-acec-474f-b4aa-27ae4490c39b-dbus\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:07.362161 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.361804 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-systemd-units\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.362161 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.361844 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-systemd-units\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.362161 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.361950 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-node-log\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.362161 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.361885 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-node-log\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.363009 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.362027 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-ovn-node-metrics-cert\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.363009 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.362992 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d8e4f707-7f3f-4081-9ad9-df7e33efb927-agent-certs\") pod \"konnectivity-agent-7ttgh\" (UID: \"d8e4f707-7f3f-4081-9ad9-df7e33efb927\") " pod="kube-system/konnectivity-agent-7ttgh" Oct 31 00:29:07.364294 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.364272 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-tmp\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.364847 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.364804 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-tuned\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.365997 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.365976 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-ovn-node-metrics-cert\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.385633 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:07.385567 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 00:29:07.385633 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:07.385590 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 00:29:07.385633 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:07.385603 2579 projected.go:196] Error preparing data for projected volume kube-api-access-pfkv4 for pod openshift-network-diagnostics/network-check-target-72nks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:07.385813 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:07.385674 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4 podName:7e87fd11-4685-4e33-8230-b6b53747c9a9 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:07.88565523 +0000 UTC m=+3.156861978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pfkv4" (UniqueName: "kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4") pod "network-check-target-72nks" (UID: "7e87fd11-4685-4e33-8230-b6b53747c9a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:07.388949 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.388923 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb75l\" (UniqueName: \"kubernetes.io/projected/33de1dca-4062-4401-9d55-af069d8874f3-kube-api-access-gb75l\") pod \"node-resolver-kpvff\" (UID: \"33de1dca-4062-4401-9d55-af069d8874f3\") " pod="openshift-dns/node-resolver-kpvff" Oct 31 00:29:07.390277 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.390252 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lgpc\" (UniqueName: \"kubernetes.io/projected/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-kube-api-access-6lgpc\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.391233 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.391204 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txp8g\" (UniqueName: \"kubernetes.io/projected/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-kube-api-access-txp8g\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.391700 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.391630 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv6qc\" (UniqueName: \"kubernetes.io/projected/177f7e75-1990-4afa-9740-6f3e0665b311-kube-api-access-lv6qc\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.392019 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.391979 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrwq7\" (UniqueName: \"kubernetes.io/projected/671b2592-db78-4be6-9a9c-83ade9a48bce-kube-api-access-hrwq7\") pod \"network-metrics-daemon-cbb78\" (UID: \"671b2592-db78-4be6-9a9c-83ade9a48bce\") " pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:07.392451 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.392426 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcrwb\" (UniqueName: \"kubernetes.io/projected/8597a843-682b-45d5-9e4a-da5fff7573a1-kube-api-access-qcrwb\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.393130 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.393078 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxhhb\" (UniqueName: \"kubernetes.io/projected/d402f509-6848-43fb-bedd-2d82bfceb0c2-kube-api-access-wxhhb\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.395334 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.395311 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsgjr\" (UniqueName: \"kubernetes.io/projected/92956936-d054-482d-a78a-784cf0eeeeb3-kube-api-access-rsgjr\") pod \"iptables-alerter-rrrwt\" (UID: \"92956936-d054-482d-a78a-784cf0eeeeb3\") " pod="openshift-network-operator/iptables-alerter-rrrwt" Oct 31 00:29:07.397124 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.397099 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfltg\" (UniqueName: \"kubernetes.io/projected/758d2e0b-39da-418e-9e35-2c817915ebce-kube-api-access-sfltg\") pod \"node-ca-cqfvp\" (UID: \"758d2e0b-39da-418e-9e35-2c817915ebce\") " pod="openshift-image-registry/node-ca-cqfvp" Oct 31 00:29:07.482006 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.481973 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kpvff" Oct 31 00:29:07.491163 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.491137 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rrrwt" Oct 31 00:29:07.492149 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:07.492116 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33de1dca_4062_4401_9d55_af069d8874f3.slice/crio-6a74b46d566d947ea3c1c76bba79d4d116678b3ccd86afaf6f6ea0552b898cd6 WatchSource:0}: Error finding container 6a74b46d566d947ea3c1c76bba79d4d116678b3ccd86afaf6f6ea0552b898cd6: Status 404 returned error can't find the container with id 6a74b46d566d947ea3c1c76bba79d4d116678b3ccd86afaf6f6ea0552b898cd6 Oct 31 00:29:07.500423 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:07.500397 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92956936_d054_482d_a78a_784cf0eeeeb3.slice/crio-81a0107b1569584cd86d51f80c323dbd711bfe30d92e64bdf7e6010d0e8fbb99 WatchSource:0}: Error finding container 81a0107b1569584cd86d51f80c323dbd711bfe30d92e64bdf7e6010d0e8fbb99: Status 404 returned error can't find the container with id 81a0107b1569584cd86d51f80c323dbd711bfe30d92e64bdf7e6010d0e8fbb99 Oct 31 00:29:07.501377 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.501358 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tk7rq" Oct 31 00:29:07.511349 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:07.511316 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8597a843_682b_45d5_9e4a_da5fff7573a1.slice/crio-f95cec2d18239966c0271e0de042d406263b703f3663251e76de73ba38cd0865 WatchSource:0}: Error finding container f95cec2d18239966c0271e0de042d406263b703f3663251e76de73ba38cd0865: Status 404 returned error can't find the container with id f95cec2d18239966c0271e0de042d406263b703f3663251e76de73ba38cd0865 Oct 31 00:29:07.516148 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.516122 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:07.518877 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.518856 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:07.525159 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.525138 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cqfvp" Oct 31 00:29:07.526782 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:07.526756 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod177f7e75_1990_4afa_9740_6f3e0665b311.slice/crio-c66d4783dba85c7977a61bb94ff211f46abfabb2eeec19e6363388e5be695100 WatchSource:0}: Error finding container c66d4783dba85c7977a61bb94ff211f46abfabb2eeec19e6363388e5be695100: Status 404 returned error can't find the container with id c66d4783dba85c7977a61bb94ff211f46abfabb2eeec19e6363388e5be695100 Oct 31 00:29:07.529789 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:07.529758 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd402f509_6848_43fb_bedd_2d82bfceb0c2.slice/crio-2d176be3b8ad8b13b103c4c25f84c98979707788e4bf135eb410d5ed757c923b WatchSource:0}: Error finding container 2d176be3b8ad8b13b103c4c25f84c98979707788e4bf135eb410d5ed757c923b: Status 404 returned error can't find the container with id 2d176be3b8ad8b13b103c4c25f84c98979707788e4bf135eb410d5ed757c923b Oct 31 00:29:07.533721 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.533642 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7ttgh" Oct 31 00:29:07.536429 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:07.536365 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod758d2e0b_39da_418e_9e35_2c817915ebce.slice/crio-05a6fae4f0c2d528763c61e72248343035dbd91b5a4c8d19d5a8017c7d7e4ca4 WatchSource:0}: Error finding container 05a6fae4f0c2d528763c61e72248343035dbd91b5a4c8d19d5a8017c7d7e4ca4: Status 404 returned error can't find the container with id 05a6fae4f0c2d528763c61e72248343035dbd91b5a4c8d19d5a8017c7d7e4ca4 Oct 31 00:29:07.544282 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:07.544262 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8e4f707_7f3f_4081_9ad9_df7e33efb927.slice/crio-e1ec842d0ebe83c4ebcbd4a5d854be9141398f2cd36e0e866d24af8bf05174f1 WatchSource:0}: Error finding container e1ec842d0ebe83c4ebcbd4a5d854be9141398f2cd36e0e866d24af8bf05174f1: Status 404 returned error can't find the container with id e1ec842d0ebe83c4ebcbd4a5d854be9141398f2cd36e0e866d24af8bf05174f1 Oct 31 00:29:07.550125 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.550105 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:07.551489 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.551462 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:07.560395 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:07.560215 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0663de32_3f4f_4eb1_9bba_e7dc1ddfa7d7.slice/crio-c8278c6d1f5d07babd0d1eab57ba7174bc0b476c2431eec78143cbc3808c855e WatchSource:0}: Error finding container c8278c6d1f5d07babd0d1eab57ba7174bc0b476c2431eec78143cbc3808c855e: Status 404 returned error can't find the container with id c8278c6d1f5d07babd0d1eab57ba7174bc0b476c2431eec78143cbc3808c855e Oct 31 00:29:07.563904 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:07.563881 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod671e4bc9_b45d_41f0_ab5c_0b40b7742a8d.slice/crio-4707a2d22f14ce313b76b75e8a772366fdb74284f89743666880e9516086ecd8 WatchSource:0}: Error finding container 4707a2d22f14ce313b76b75e8a772366fdb74284f89743666880e9516086ecd8: Status 404 returned error can't find the container with id 4707a2d22f14ce313b76b75e8a772366fdb74284f89743666880e9516086ecd8 Oct 31 00:29:07.865138 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.865102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:07.865284 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.865175 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs\") pod \"network-metrics-daemon-cbb78\" (UID: \"671b2592-db78-4be6-9a9c-83ade9a48bce\") " pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:07.865284 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:07.865268 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:07.865361 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:07.865322 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs podName:671b2592-db78-4be6-9a9c-83ade9a48bce nodeName:}" failed. No retries permitted until 2026-10-31 00:29:08.865309245 +0000 UTC m=+4.136515969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs") pod "network-metrics-daemon-cbb78" (UID: "671b2592-db78-4be6-9a9c-83ade9a48bce") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:07.865361 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:07.865268 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:07.865451 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:07.865437 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret podName:bdd36c3c-acec-474f-b4aa-27ae4490c39b nodeName:}" failed. No retries permitted until 2026-10-31 00:29:08.865416857 +0000 UTC m=+4.136623598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret") pod "global-pull-secret-syncer-j7fh7" (UID: "bdd36c3c-acec-474f-b4aa-27ae4490c39b") : object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:07.966076 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:07.966043 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfkv4\" (UniqueName: \"kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4\") pod \"network-check-target-72nks\" (UID: \"7e87fd11-4685-4e33-8230-b6b53747c9a9\") " pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:07.966234 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:07.966218 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 00:29:07.966312 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:07.966246 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 00:29:07.966312 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:07.966259 2579 projected.go:196] Error preparing data for projected volume kube-api-access-pfkv4 for pod openshift-network-diagnostics/network-check-target-72nks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:07.966422 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:07.966315 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4 podName:7e87fd11-4685-4e33-8230-b6b53747c9a9 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:08.966295962 +0000 UTC m=+4.237502689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfkv4" (UniqueName: "kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4") pod "network-check-target-72nks" (UID: "7e87fd11-4685-4e33-8230-b6b53747c9a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:08.301005 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:08.300678 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7ttgh" event={"ID":"d8e4f707-7f3f-4081-9ad9-df7e33efb927","Type":"ContainerStarted","Data":"e1ec842d0ebe83c4ebcbd4a5d854be9141398f2cd36e0e866d24af8bf05174f1"} Oct 31 00:29:08.307080 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:08.307048 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" event={"ID":"d402f509-6848-43fb-bedd-2d82bfceb0c2","Type":"ContainerStarted","Data":"2d176be3b8ad8b13b103c4c25f84c98979707788e4bf135eb410d5ed757c923b"} Oct 31 00:29:08.321124 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:08.321097 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tk7rq" event={"ID":"8597a843-682b-45d5-9e4a-da5fff7573a1","Type":"ContainerStarted","Data":"f95cec2d18239966c0271e0de042d406263b703f3663251e76de73ba38cd0865"} Oct 31 00:29:08.323701 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:08.323578 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rrrwt" event={"ID":"92956936-d054-482d-a78a-784cf0eeeeb3","Type":"ContainerStarted","Data":"81a0107b1569584cd86d51f80c323dbd711bfe30d92e64bdf7e6010d0e8fbb99"} Oct 31 00:29:08.327387 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:08.326739 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" event={"ID":"6a486685e4aa272e6e3121222626b7fe","Type":"ContainerStarted","Data":"a6811314d59e6861462ba47d4eb8c814218027702682b64f84661734c39dca0c"} Oct 31 00:29:08.334686 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:08.334650 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" event={"ID":"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d","Type":"ContainerStarted","Data":"4707a2d22f14ce313b76b75e8a772366fdb74284f89743666880e9516086ecd8"} Oct 31 00:29:08.344007 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:08.343979 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" event={"ID":"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7","Type":"ContainerStarted","Data":"c8278c6d1f5d07babd0d1eab57ba7174bc0b476c2431eec78143cbc3808c855e"} Oct 31 00:29:08.346967 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:08.346901 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cqfvp" event={"ID":"758d2e0b-39da-418e-9e35-2c817915ebce","Type":"ContainerStarted","Data":"05a6fae4f0c2d528763c61e72248343035dbd91b5a4c8d19d5a8017c7d7e4ca4"} Oct 31 00:29:08.352610 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:08.352582 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpmxb" event={"ID":"177f7e75-1990-4afa-9740-6f3e0665b311","Type":"ContainerStarted","Data":"c66d4783dba85c7977a61bb94ff211f46abfabb2eeec19e6363388e5be695100"} Oct 31 00:29:08.358423 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:08.358386 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kpvff" event={"ID":"33de1dca-4062-4401-9d55-af069d8874f3","Type":"ContainerStarted","Data":"6a74b46d566d947ea3c1c76bba79d4d116678b3ccd86afaf6f6ea0552b898cd6"} Oct 31 00:29:08.370830 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:08.370805 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal" event={"ID":"a11e2d9565d47e2d9d5101c74a24023b","Type":"ContainerStarted","Data":"14971062c2cce3443caed5a428edbba2c30ba9bf20c0d9d63fdaf59ec5f11e01"} Oct 31 00:29:08.516549 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:08.516384 2579 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:29:08.874280 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:08.874241 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:08.874498 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:08.874322 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs\") pod \"network-metrics-daemon-cbb78\" (UID: \"671b2592-db78-4be6-9a9c-83ade9a48bce\") " pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:08.874585 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:08.874510 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:08.874585 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:08.874574 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs podName:671b2592-db78-4be6-9a9c-83ade9a48bce nodeName:}" failed. No retries permitted until 2026-10-31 00:29:10.874553498 +0000 UTC m=+6.145760225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs") pod "network-metrics-daemon-cbb78" (UID: "671b2592-db78-4be6-9a9c-83ade9a48bce") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:08.874933 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:08.874810 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:08.874933 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:08.874873 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret podName:bdd36c3c-acec-474f-b4aa-27ae4490c39b nodeName:}" failed. No retries permitted until 2026-10-31 00:29:10.874848599 +0000 UTC m=+6.146055342 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret") pod "global-pull-secret-syncer-j7fh7" (UID: "bdd36c3c-acec-474f-b4aa-27ae4490c39b") : object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:08.975288 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:08.975255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfkv4\" (UniqueName: \"kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4\") pod \"network-check-target-72nks\" (UID: \"7e87fd11-4685-4e33-8230-b6b53747c9a9\") " pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:08.975960 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:08.975495 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 00:29:08.975960 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:08.975522 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 00:29:08.975960 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:08.975543 2579 projected.go:196] Error preparing data for projected volume kube-api-access-pfkv4 for pod openshift-network-diagnostics/network-check-target-72nks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:08.975960 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:08.975600 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4 podName:7e87fd11-4685-4e33-8230-b6b53747c9a9 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:10.975581077 +0000 UTC m=+6.246787808 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfkv4" (UniqueName: "kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4") pod "network-check-target-72nks" (UID: "7e87fd11-4685-4e33-8230-b6b53747c9a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:09.277163 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:09.276309 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:09.277163 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:09.276512 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbb78" podUID="671b2592-db78-4be6-9a9c-83ade9a48bce" Oct 31 00:29:09.277163 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:09.276601 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:09.277163 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:09.276750 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7fh7" podUID="bdd36c3c-acec-474f-b4aa-27ae4490c39b" Oct 31 00:29:09.277163 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:09.276860 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:09.277163 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:09.276934 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72nks" podUID="7e87fd11-4685-4e33-8230-b6b53747c9a9" Oct 31 00:29:10.450963 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:10.450899 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jz6qs" Oct 31 00:29:10.463729 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:10.463704 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jz6qs" Oct 31 00:29:10.890795 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:10.890206 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs\") pod \"network-metrics-daemon-cbb78\" (UID: \"671b2592-db78-4be6-9a9c-83ade9a48bce\") " pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:10.890795 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:10.890275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:10.890795 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:10.890372 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:10.890795 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:10.890390 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:10.890795 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:10.890467 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs podName:671b2592-db78-4be6-9a9c-83ade9a48bce nodeName:}" failed. No retries permitted until 2026-10-31 00:29:14.890442099 +0000 UTC m=+10.161648864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs") pod "network-metrics-daemon-cbb78" (UID: "671b2592-db78-4be6-9a9c-83ade9a48bce") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:10.890795 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:10.890490 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret podName:bdd36c3c-acec-474f-b4aa-27ae4490c39b nodeName:}" failed. No retries permitted until 2026-10-31 00:29:14.890479043 +0000 UTC m=+10.161685774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret") pod "global-pull-secret-syncer-j7fh7" (UID: "bdd36c3c-acec-474f-b4aa-27ae4490c39b") : object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:10.991686 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:10.990993 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfkv4\" (UniqueName: \"kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4\") pod \"network-check-target-72nks\" (UID: \"7e87fd11-4685-4e33-8230-b6b53747c9a9\") " pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:10.991686 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:10.991173 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 00:29:10.991686 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:10.991197 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 00:29:10.991686 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:10.991208 2579 projected.go:196] Error preparing data for projected volume kube-api-access-pfkv4 for pod openshift-network-diagnostics/network-check-target-72nks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:10.991686 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:10.991252 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4 podName:7e87fd11-4685-4e33-8230-b6b53747c9a9 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:14.991238991 +0000 UTC m=+10.262445731 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfkv4" (UniqueName: "kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4") pod "network-check-target-72nks" (UID: "7e87fd11-4685-4e33-8230-b6b53747c9a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:11.273474 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:11.273372 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:11.273635 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:11.273543 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7fh7" podUID="bdd36c3c-acec-474f-b4aa-27ae4490c39b" Oct 31 00:29:11.274036 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:11.274011 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:11.274162 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:11.274111 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72nks" podUID="7e87fd11-4685-4e33-8230-b6b53747c9a9" Oct 31 00:29:11.274225 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:11.274177 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:11.274277 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:11.274241 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbb78" podUID="671b2592-db78-4be6-9a9c-83ade9a48bce" Oct 31 00:29:11.397331 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:11.396439 2579 generic.go:356] "Generic (PLEG): container finished" podID="6a486685e4aa272e6e3121222626b7fe" containerID="a6811314d59e6861462ba47d4eb8c814218027702682b64f84661734c39dca0c" exitCode=0 Oct 31 00:29:11.397331 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:11.396555 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" event={"ID":"6a486685e4aa272e6e3121222626b7fe","Type":"ContainerDied","Data":"a6811314d59e6861462ba47d4eb8c814218027702682b64f84661734c39dca0c"} Oct 31 00:29:11.403368 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:11.403342 2579 generic.go:356] "Generic (PLEG): container finished" podID="177f7e75-1990-4afa-9740-6f3e0665b311" containerID="f576202c51bebe9ad9a3224030fa677db6d672a11fda9ad349e50dd8e5fd5581" exitCode=0 Oct 31 00:29:11.404242 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:11.403565 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpmxb" event={"ID":"177f7e75-1990-4afa-9740-6f3e0665b311","Type":"ContainerDied","Data":"f576202c51bebe9ad9a3224030fa677db6d672a11fda9ad349e50dd8e5fd5581"} Oct 31 00:29:11.452802 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:11.452745 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal" podStartSLOduration=4.452726832 podStartE2EDuration="4.452726832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:29:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:08.414978861 +0000 UTC m=+3.686185612" watchObservedRunningTime="2026-10-31 00:29:11.452726832 +0000 UTC m=+6.723933585" Oct 31 00:29:11.470188 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:11.470157 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 00:24:10 +0000 UTC" deadline="2028-05-20 15:40:12.947180846 +0000 UTC" Oct 31 00:29:11.470188 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:11.470189 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13623h11m1.476996839s" Oct 31 00:29:12.414745 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:12.414702 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7ttgh" event={"ID":"d8e4f707-7f3f-4081-9ad9-df7e33efb927","Type":"ContainerStarted","Data":"5be721f54ff8dd2d71f5f326d0c68f8e9fb0f736755ebed8104dfc60413a8f8c"} Oct 31 00:29:12.421665 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:12.421195 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" event={"ID":"6a486685e4aa272e6e3121222626b7fe","Type":"ContainerStarted","Data":"f7982ed336e0cce8478bcfbe7b2b2c4e52b06735e7da6c29ac5d01c4b003c562"} Oct 31 00:29:12.458944 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:12.458062 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7ttgh" podStartSLOduration=2.505444142 podStartE2EDuration="6.45804269s" totalImagesPullingTime="3.952598548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:12.457510498 +0000 UTC m=+7.728717249" watchObservedRunningTime="2026-10-31 00:29:12.45804269 +0000 UTC m=+7.729249444" Oct 31 00:29:12.471224 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:12.471156 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 00:24:10 +0000 UTC" deadline="2028-04-14 07:18:06.773983793 +0000 UTC" Oct 31 00:29:12.471224 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:12.471193 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12750h48m54.302797626s" Oct 31 00:29:12.500517 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:12.500329 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" podStartSLOduration=5.500309076 podStartE2EDuration="5.500309076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:29:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:12.499160951 +0000 UTC m=+7.770367703" watchObservedRunningTime="2026-10-31 00:29:12.500309076 +0000 UTC m=+7.771515827" Oct 31 00:29:13.272878 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:13.272846 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:13.273055 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:13.272991 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72nks" podUID="7e87fd11-4685-4e33-8230-b6b53747c9a9" Oct 31 00:29:13.273653 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:13.273628 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:13.273773 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:13.273746 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbb78" podUID="671b2592-db78-4be6-9a9c-83ade9a48bce" Oct 31 00:29:13.273835 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:13.273809 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:13.273905 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:13.273885 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7fh7" podUID="bdd36c3c-acec-474f-b4aa-27ae4490c39b" Oct 31 00:29:13.430959 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:13.430923 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cqfvp" event={"ID":"758d2e0b-39da-418e-9e35-2c817915ebce","Type":"ContainerStarted","Data":"6bf519dc1a62fba957dd5fa60cb8c819807d186e280f2105a652384f4efd585b"} Oct 31 00:29:13.477891 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:13.477828 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cqfvp" podStartSLOduration=2.424630412 podStartE2EDuration="7.477808248s" totalImagesPullingTime="5.053177836s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:13.477112076 +0000 UTC m=+8.748318831" watchObservedRunningTime="2026-10-31 00:29:13.477808248 +0000 UTC m=+8.749015001" Oct 31 00:29:14.053436 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:14.053304 2579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7ttgh" Oct 31 00:29:14.054295 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:14.054269 2579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7ttgh" Oct 31 00:29:14.437548 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:14.437474 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" event={"ID":"d402f509-6848-43fb-bedd-2d82bfceb0c2","Type":"ContainerStarted","Data":"b9c28039cd937d9a481eee586a9b9763ad89d84ef3922e1ce2ca05f6898c54ec"} Oct 31 00:29:14.924544 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:14.924472 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs\") pod \"network-metrics-daemon-cbb78\" (UID: \"671b2592-db78-4be6-9a9c-83ade9a48bce\") " pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:14.924544 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:14.924539 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:14.925052 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:14.924693 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:14.925052 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:14.924787 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret podName:bdd36c3c-acec-474f-b4aa-27ae4490c39b nodeName:}" failed. No retries permitted until 2026-10-31 00:29:22.924767428 +0000 UTC m=+18.195974165 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret") pod "global-pull-secret-syncer-j7fh7" (UID: "bdd36c3c-acec-474f-b4aa-27ae4490c39b") : object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:14.925676 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:14.925213 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:14.925676 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:14.925268 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs podName:671b2592-db78-4be6-9a9c-83ade9a48bce nodeName:}" failed. No retries permitted until 2026-10-31 00:29:22.925253467 +0000 UTC m=+18.196460203 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs") pod "network-metrics-daemon-cbb78" (UID: "671b2592-db78-4be6-9a9c-83ade9a48bce") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:15.025534 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:15.024895 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfkv4\" (UniqueName: \"kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4\") pod \"network-check-target-72nks\" (UID: \"7e87fd11-4685-4e33-8230-b6b53747c9a9\") " pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:15.025534 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:15.025070 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 00:29:15.025534 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:15.025091 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 00:29:15.025534 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:15.025104 2579 projected.go:196] Error preparing data for projected volume kube-api-access-pfkv4 for pod openshift-network-diagnostics/network-check-target-72nks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:15.025534 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:15.025163 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4 podName:7e87fd11-4685-4e33-8230-b6b53747c9a9 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:23.025144494 +0000 UTC m=+18.296351222 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfkv4" (UniqueName: "kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4") pod "network-check-target-72nks" (UID: "7e87fd11-4685-4e33-8230-b6b53747c9a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:15.274424 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:15.273606 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:15.274424 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:15.273707 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72nks" podUID="7e87fd11-4685-4e33-8230-b6b53747c9a9" Oct 31 00:29:15.274424 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:15.274102 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:15.274424 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:15.274200 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbb78" podUID="671b2592-db78-4be6-9a9c-83ade9a48bce" Oct 31 00:29:15.274424 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:15.274262 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:15.274424 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:15.274349 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7fh7" podUID="bdd36c3c-acec-474f-b4aa-27ae4490c39b" Oct 31 00:29:15.320793 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:15.320375 2579 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 31 00:29:15.445695 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:15.445096 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" event={"ID":"d402f509-6848-43fb-bedd-2d82bfceb0c2","Type":"ContainerStarted","Data":"bc8c09b0c3bdbc7ad9f4660e1afd74431aebbe1eba950a8c304a0874cafd0acf"} Oct 31 00:29:15.445695 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:15.445121 2579 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 31 00:29:16.223653 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:16.223304 2579 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T00:29:15.320395614Z","UUID":"cd43d9eb-9a76-409c-9979-cf55a44162df","Handler":null,"Name":"","Endpoint":""} Oct 31 00:29:16.225464 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:16.225440 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 31 00:29:16.225464 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:16.225468 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 31 00:29:16.449061 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:16.448835 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tk7rq" event={"ID":"8597a843-682b-45d5-9e4a-da5fff7573a1","Type":"ContainerStarted","Data":"a939e04ea8092d49ed13b5533e7c455b3777a5d0fe4e8ae8dc19396af3ae191f"} Oct 31 00:29:16.452665 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:16.451872 2579 generic.go:356] "Generic (PLEG): container finished" podID="177f7e75-1990-4afa-9740-6f3e0665b311" containerID="a3c8200d479ef29de9cac0236f9969dfbe9358d7cb02bc3ffe4abe5475852ace" exitCode=0 Oct 31 00:29:16.452665 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:16.451940 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpmxb" event={"ID":"177f7e75-1990-4afa-9740-6f3e0665b311","Type":"ContainerDied","Data":"a3c8200d479ef29de9cac0236f9969dfbe9358d7cb02bc3ffe4abe5475852ace"} Oct 31 00:29:16.454721 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:16.454698 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kpvff" event={"ID":"33de1dca-4062-4401-9d55-af069d8874f3","Type":"ContainerStarted","Data":"2a33cc80a3b8f7a4a9eb69f5a7ea5bfb87437dd5bd29bff6912edc7144f783e3"} Oct 31 00:29:16.533657 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:16.533602 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-kpvff" podStartSLOduration=3.314951272 podStartE2EDuration="11.533586759s" totalImagesPullingTime="8.218635487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:29:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:16.533522934 +0000 UTC m=+11.804729682" watchObservedRunningTime="2026-10-31 00:29:16.533586759 +0000 UTC m=+11.804793504" Oct 31 00:29:16.534035 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:16.534007 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-tk7rq" podStartSLOduration=3.434039524 podStartE2EDuration="11.533996666s" totalImagesPullingTime="8.099957142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:29:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:16.496476008 +0000 UTC m=+11.767682758" watchObservedRunningTime="2026-10-31 00:29:16.533996666 +0000 UTC m=+11.805203411" Oct 31 00:29:17.276287 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:17.276217 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:17.276744 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:17.276300 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:17.276744 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:17.276421 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:17.276744 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:17.276434 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72nks" podUID="7e87fd11-4685-4e33-8230-b6b53747c9a9" Oct 31 00:29:17.276744 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:17.276498 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7fh7" podUID="bdd36c3c-acec-474f-b4aa-27ae4490c39b" Oct 31 00:29:17.276744 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:17.276597 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbb78" podUID="671b2592-db78-4be6-9a9c-83ade9a48bce" Oct 31 00:29:17.354157 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:17.354120 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7ttgh" Oct 31 00:29:17.354291 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:17.354252 2579 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 31 00:29:17.355074 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:17.355044 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7ttgh" Oct 31 00:29:17.460654 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:17.460557 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" event={"ID":"d402f509-6848-43fb-bedd-2d82bfceb0c2","Type":"ContainerStarted","Data":"be2c2363002a99159a2427323c4cd9a9811e6d238133eae3dd9da1166e3f3c69"} Oct 31 00:29:17.462981 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:17.462928 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rrrwt" event={"ID":"92956936-d054-482d-a78a-784cf0eeeeb3","Type":"ContainerStarted","Data":"f3dea5257d8799d20caa908fdc381c6f5eb47890d024e3a75e7225d0ce397ddc"} Oct 31 00:29:17.465867 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:17.465830 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpmxb" event={"ID":"177f7e75-1990-4afa-9740-6f3e0665b311","Type":"ContainerStarted","Data":"463e091f120ac813d0fc2a1bd290a51c5b052c2e8891c942bc4a3a6c9a050ad7"} Oct 31 00:29:17.502967 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:17.502920 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" podStartSLOduration=3.097996755 podStartE2EDuration="11.502902472s" totalImagesPullingTime="8.404905717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:29:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:17.50259511 +0000 UTC m=+12.773801884" watchObservedRunningTime="2026-10-31 00:29:17.502902472 +0000 UTC m=+12.774109219" Oct 31 00:29:17.545201 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:17.545116 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rrrwt" podStartSLOduration=4.526531952 podStartE2EDuration="12.545097768s" totalImagesPullingTime="8.018565816s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:29:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:17.544818105 +0000 UTC m=+12.816024852" watchObservedRunningTime="2026-10-31 00:29:17.545097768 +0000 UTC m=+12.816304515" Oct 31 00:29:18.469086 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:18.469039 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" event={"ID":"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d","Type":"ContainerStarted","Data":"3b8fd195239c22f51e33f66754533f0bc1b596177423b6babf4bc9f8c30bdf97"} Oct 31 00:29:18.471313 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:18.471289 2579 generic.go:356] "Generic (PLEG): container finished" podID="177f7e75-1990-4afa-9740-6f3e0665b311" containerID="463e091f120ac813d0fc2a1bd290a51c5b052c2e8891c942bc4a3a6c9a050ad7" exitCode=0 Oct 31 00:29:18.471440 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:18.471369 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpmxb" event={"ID":"177f7e75-1990-4afa-9740-6f3e0665b311","Type":"ContainerDied","Data":"463e091f120ac813d0fc2a1bd290a51c5b052c2e8891c942bc4a3a6c9a050ad7"} Oct 31 00:29:18.554872 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:18.554811 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" podStartSLOduration=2.258103846 podStartE2EDuration="12.554796902s" totalImagesPullingTime="10.296693056s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:18.509966686 +0000 UTC m=+13.781173435" watchObservedRunningTime="2026-10-31 00:29:18.554796902 +0000 UTC m=+13.826003641" Oct 31 00:29:19.273322 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:19.273297 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:19.273322 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:19.273318 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:19.273514 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:19.273461 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7fh7" podUID="bdd36c3c-acec-474f-b4aa-27ae4490c39b" Oct 31 00:29:19.273860 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:19.273591 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72nks" podUID="7e87fd11-4685-4e33-8230-b6b53747c9a9" Oct 31 00:29:19.273860 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:19.273683 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:19.273860 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:19.273818 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbb78" podUID="671b2592-db78-4be6-9a9c-83ade9a48bce" Oct 31 00:29:19.476106 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:19.476072 2579 generic.go:356] "Generic (PLEG): container finished" podID="177f7e75-1990-4afa-9740-6f3e0665b311" containerID="5fa8beba5123c541433d0ca8ca0775bcf09d26bca2844ab544337904bf347b9c" exitCode=0 Oct 31 00:29:19.476720 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:19.476115 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpmxb" event={"ID":"177f7e75-1990-4afa-9740-6f3e0665b311","Type":"ContainerDied","Data":"5fa8beba5123c541433d0ca8ca0775bcf09d26bca2844ab544337904bf347b9c"} Oct 31 00:29:21.272662 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:21.272472 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:21.273033 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:21.272464 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:21.273033 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:21.272753 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72nks" podUID="7e87fd11-4685-4e33-8230-b6b53747c9a9" Oct 31 00:29:21.273033 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:21.272515 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:21.273033 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:21.272824 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7fh7" podUID="bdd36c3c-acec-474f-b4aa-27ae4490c39b" Oct 31 00:29:21.273033 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:21.272919 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbb78" podUID="671b2592-db78-4be6-9a9c-83ade9a48bce" Oct 31 00:29:21.483459 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:21.483351 2579 generic.go:356] "Generic (PLEG): container finished" podID="177f7e75-1990-4afa-9740-6f3e0665b311" containerID="d8aa19ff90ef3e6cabb65cea20ebf8b49b99ec1f15102e43574f21d232dc65d8" exitCode=0 Oct 31 00:29:21.483459 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:21.483428 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpmxb" event={"ID":"177f7e75-1990-4afa-9740-6f3e0665b311","Type":"ContainerDied","Data":"d8aa19ff90ef3e6cabb65cea20ebf8b49b99ec1f15102e43574f21d232dc65d8"} Oct 31 00:29:22.487786 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:22.487624 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" event={"ID":"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7","Type":"ContainerStarted","Data":"be788d9bb4ad95215322089c9ff363171ffa6bf41d7680e9613902a17a653356"} Oct 31 00:29:22.488122 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:22.487857 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" event={"ID":"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7","Type":"ContainerStarted","Data":"bd9c839db614612821bac0a0c7c3318ac2a6eef6c7cf4810ebd221c7587787da"} Oct 31 00:29:22.491159 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:22.491131 2579 generic.go:356] "Generic (PLEG): container finished" podID="177f7e75-1990-4afa-9740-6f3e0665b311" containerID="741a0d3cca121dff133bcd9df6b0363e49db25a7e6e4e702dbc4b32973fd4689" exitCode=0 Oct 31 00:29:22.491235 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:22.491173 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpmxb" event={"ID":"177f7e75-1990-4afa-9740-6f3e0665b311","Type":"ContainerDied","Data":"741a0d3cca121dff133bcd9df6b0363e49db25a7e6e4e702dbc4b32973fd4689"} Oct 31 00:29:22.984314 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:22.984222 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs\") pod \"network-metrics-daemon-cbb78\" (UID: \"671b2592-db78-4be6-9a9c-83ade9a48bce\") " pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:22.984314 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:22.984275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:22.984500 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:22.984367 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:22.984500 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:22.984368 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:22.984500 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:22.984444 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs podName:671b2592-db78-4be6-9a9c-83ade9a48bce nodeName:}" failed. No retries permitted until 2026-10-31 00:29:38.984417214 +0000 UTC m=+34.255623942 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs") pod "network-metrics-daemon-cbb78" (UID: "671b2592-db78-4be6-9a9c-83ade9a48bce") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:22.984500 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:22.984459 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret podName:bdd36c3c-acec-474f-b4aa-27ae4490c39b nodeName:}" failed. No retries permitted until 2026-10-31 00:29:38.984452668 +0000 UTC m=+34.255659393 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret") pod "global-pull-secret-syncer-j7fh7" (UID: "bdd36c3c-acec-474f-b4aa-27ae4490c39b") : object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:23.085170 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:23.085137 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfkv4\" (UniqueName: \"kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4\") pod \"network-check-target-72nks\" (UID: \"7e87fd11-4685-4e33-8230-b6b53747c9a9\") " pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:23.085307 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:23.085292 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 00:29:23.085344 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:23.085310 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 00:29:23.085344 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:23.085319 2579 projected.go:196] Error preparing data for projected volume kube-api-access-pfkv4 for pod openshift-network-diagnostics/network-check-target-72nks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:23.085454 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:23.085360 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4 podName:7e87fd11-4685-4e33-8230-b6b53747c9a9 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:39.085349079 +0000 UTC m=+34.356555819 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfkv4" (UniqueName: "kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4") pod "network-check-target-72nks" (UID: "7e87fd11-4685-4e33-8230-b6b53747c9a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:23.272605 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:23.272532 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:23.272605 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:23.272563 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:23.272752 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:23.272692 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:23.272752 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:23.272689 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72nks" podUID="7e87fd11-4685-4e33-8230-b6b53747c9a9" Oct 31 00:29:23.272824 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:23.272793 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7fh7" podUID="bdd36c3c-acec-474f-b4aa-27ae4490c39b" Oct 31 00:29:23.272907 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:23.272889 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbb78" podUID="671b2592-db78-4be6-9a9c-83ade9a48bce" Oct 31 00:29:23.495870 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:23.495833 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpmxb" event={"ID":"177f7e75-1990-4afa-9740-6f3e0665b311","Type":"ContainerStarted","Data":"cd783a4f5d0454e61fd8b84f8262c4ecf91e3235946fb24ff88baffe4e6e7c89"} Oct 31 00:29:23.498697 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:23.498679 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" event={"ID":"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7","Type":"ContainerStarted","Data":"c6b89ace9229c1b766a76952ae317bb97853ada1918276223ff906f79b9a023d"} Oct 31 00:29:23.498783 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:23.498730 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" event={"ID":"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7","Type":"ContainerStarted","Data":"5a714ecde153083e6e1bbc189033a51e91494997b313405aa53e7380cc3f9e4d"} Oct 31 00:29:23.498783 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:23.498770 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" event={"ID":"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7","Type":"ContainerStarted","Data":"ada5cda5f48cf37043f84f9afb494d6ce47d47afc0499f0ee9a86a816d637bfd"} Oct 31 00:29:23.498844 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:23.498797 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" event={"ID":"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7","Type":"ContainerStarted","Data":"612f124c93bce476c18f7b987972580b774dfabca8a9f9faebf12f8c133c6b4c"} Oct 31 00:29:23.541694 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:23.541629 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cpmxb" podStartSLOduration=6.948866389 podStartE2EDuration="17.54161827s" totalImagesPullingTime="10.592751881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:29:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:23.541523775 +0000 UTC m=+18.812730521" watchObservedRunningTime="2026-10-31 00:29:23.54161827 +0000 UTC m=+18.812825015" Oct 31 00:29:25.273685 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:25.273651 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:25.274220 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:25.273757 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbb78" podUID="671b2592-db78-4be6-9a9c-83ade9a48bce" Oct 31 00:29:25.274220 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:25.273840 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:25.274220 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:25.273920 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72nks" podUID="7e87fd11-4685-4e33-8230-b6b53747c9a9" Oct 31 00:29:25.274220 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:25.273965 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:25.274220 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:25.274006 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7fh7" podUID="bdd36c3c-acec-474f-b4aa-27ae4490c39b" Oct 31 00:29:25.505344 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:25.505314 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" event={"ID":"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7","Type":"ContainerStarted","Data":"142a4f622f22b4bc44d2646f1da64cfdad417079c396fbf4ce01e1209bdec960"} Oct 31 00:29:27.272908 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:27.272736 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:27.273565 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:27.272749 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:27.273565 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:27.272983 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72nks" podUID="7e87fd11-4685-4e33-8230-b6b53747c9a9" Oct 31 00:29:27.273565 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:27.272809 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:27.273565 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:27.273052 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbb78" podUID="671b2592-db78-4be6-9a9c-83ade9a48bce" Oct 31 00:29:27.273565 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:27.273198 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7fh7" podUID="bdd36c3c-acec-474f-b4aa-27ae4490c39b" Oct 31 00:29:27.513615 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:27.513581 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" event={"ID":"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7","Type":"ContainerStarted","Data":"91413adf1de68daca7e15984ecb138fbf068f6904867175bb7e91a4b51b58ddc"} Oct 31 00:29:27.513955 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:27.513935 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:27.529009 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:27.528936 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:27.600813 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:27.600766 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" podStartSLOduration=6.846371498 podStartE2EDuration="21.600753437s" totalImagesPullingTime="14.754381939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:27.600284372 +0000 UTC m=+22.871491119" watchObservedRunningTime="2026-10-31 00:29:27.600753437 +0000 UTC m=+22.871960198" Oct 31 00:29:28.515503 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:28.515480 2579 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 31 00:29:28.515903 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:28.515883 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:28.531007 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:28.530987 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:28.825886 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:28.825823 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j7fh7"] Oct 31 00:29:28.826094 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:28.825927 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:28.826094 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:28.826015 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7fh7" podUID="bdd36c3c-acec-474f-b4aa-27ae4490c39b" Oct 31 00:29:28.829067 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:28.829040 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-72nks"] Oct 31 00:29:28.829206 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:28.829147 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:28.829274 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:28.829227 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72nks" podUID="7e87fd11-4685-4e33-8230-b6b53747c9a9" Oct 31 00:29:28.829773 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:28.829750 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cbb78"] Oct 31 00:29:28.829890 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:28.829854 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:28.829968 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:28.829950 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbb78" podUID="671b2592-db78-4be6-9a9c-83ade9a48bce" Oct 31 00:29:29.517181 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:29.517155 2579 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 31 00:29:30.273197 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:30.273155 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:30.273197 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:30.273187 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:30.273391 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:30.273263 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:30.273391 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:30.273275 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72nks" podUID="7e87fd11-4685-4e33-8230-b6b53747c9a9" Oct 31 00:29:30.273391 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:30.273322 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7fh7" podUID="bdd36c3c-acec-474f-b4aa-27ae4490c39b" Oct 31 00:29:30.273507 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:30.273419 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbb78" podUID="671b2592-db78-4be6-9a9c-83ade9a48bce" Oct 31 00:29:30.428507 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:30.428475 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:31.533049 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:31.533006 2579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" podUID="0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7" containerName="ovnkube-controller" probeResult="failure" output="" Oct 31 00:29:32.215299 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:32.215266 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:32.272760 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:32.272735 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:32.272890 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:32.272772 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:32.272890 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:32.272826 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbb78" podUID="671b2592-db78-4be6-9a9c-83ade9a48bce" Oct 31 00:29:32.272976 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:32.272898 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:32.273026 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:32.272970 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7fh7" podUID="bdd36c3c-acec-474f-b4aa-27ae4490c39b" Oct 31 00:29:32.273077 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:32.273029 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72nks" podUID="7e87fd11-4685-4e33-8230-b6b53747c9a9" Oct 31 00:29:32.374483 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:32.374458 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:32.944257 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:32.944229 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:33.053092 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:33.053056 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:33.547700 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:33.547668 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:34.272975 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:34.272948 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:34.273386 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:34.272948 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:34.273386 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:34.273053 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbb78" podUID="671b2592-db78-4be6-9a9c-83ade9a48bce" Oct 31 00:29:34.273386 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:34.272950 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:34.273386 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:34.273119 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72nks" podUID="7e87fd11-4685-4e33-8230-b6b53747c9a9" Oct 31 00:29:34.273386 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:34.273181 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7fh7" podUID="bdd36c3c-acec-474f-b4aa-27ae4490c39b" Oct 31 00:29:35.266749 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.266584 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:35.383015 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.382982 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:35.502777 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.502753 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeReady" Oct 31 00:29:35.502901 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.502858 2579 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 31 00:29:35.562197 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.562135 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zd5x6"] Oct 31 00:29:35.569848 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.569827 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xbqw2"] Oct 31 00:29:35.569955 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.569941 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zd5x6" Oct 31 00:29:35.573362 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.573344 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:35.584210 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.584191 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zd5x6"] Oct 31 00:29:35.585710 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.585661 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 31 00:29:35.585710 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.585682 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 31 00:29:35.585710 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.585685 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 31 00:29:35.585886 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.585735 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-qw5lv\"" Oct 31 00:29:35.590319 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.590300 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xbqw2"] Oct 31 00:29:35.676780 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.676759 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13a9c69b-60c2-4c1d-a77c-5b56b234729c-tmp-dir\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:35.676906 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.676790 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgmhd\" (UniqueName: \"kubernetes.io/projected/f47d176e-65b0-49d3-a77a-f593c25c65fa-kube-api-access-lgmhd\") pod \"ingress-canary-zd5x6\" (UID: \"f47d176e-65b0-49d3-a77a-f593c25c65fa\") " pod="openshift-ingress-canary/ingress-canary-zd5x6" Oct 31 00:29:35.676906 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.676820 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f47d176e-65b0-49d3-a77a-f593c25c65fa-cert\") pod \"ingress-canary-zd5x6\" (UID: \"f47d176e-65b0-49d3-a77a-f593c25c65fa\") " pod="openshift-ingress-canary/ingress-canary-zd5x6" Oct 31 00:29:35.676906 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.676873 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13a9c69b-60c2-4c1d-a77c-5b56b234729c-metrics-tls\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:35.677029 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.676907 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/13a9c69b-60c2-4c1d-a77c-5b56b234729c-config-volume\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:35.677029 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.676956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmc22\" (UniqueName: \"kubernetes.io/projected/13a9c69b-60c2-4c1d-a77c-5b56b234729c-kube-api-access-xmc22\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:35.685837 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.685819 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 31 00:29:35.685951 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.685937 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 31 00:29:35.686078 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.686066 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9xqcf\"" Oct 31 00:29:35.777503 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.777476 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f47d176e-65b0-49d3-a77a-f593c25c65fa-cert\") pod \"ingress-canary-zd5x6\" (UID: \"f47d176e-65b0-49d3-a77a-f593c25c65fa\") " pod="openshift-ingress-canary/ingress-canary-zd5x6" Oct 31 00:29:35.777503 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.777506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13a9c69b-60c2-4c1d-a77c-5b56b234729c-metrics-tls\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:35.777645 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.777526 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/13a9c69b-60c2-4c1d-a77c-5b56b234729c-config-volume\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:35.777645 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.777547 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmc22\" (UniqueName: \"kubernetes.io/projected/13a9c69b-60c2-4c1d-a77c-5b56b234729c-kube-api-access-xmc22\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:35.777645 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.777618 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13a9c69b-60c2-4c1d-a77c-5b56b234729c-tmp-dir\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:35.777645 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:35.777636 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 31 00:29:35.777645 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.777641 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgmhd\" (UniqueName: \"kubernetes.io/projected/f47d176e-65b0-49d3-a77a-f593c25c65fa-kube-api-access-lgmhd\") pod \"ingress-canary-zd5x6\" (UID: \"f47d176e-65b0-49d3-a77a-f593c25c65fa\") " pod="openshift-ingress-canary/ingress-canary-zd5x6" Oct 31 00:29:35.777847 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:35.777691 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a9c69b-60c2-4c1d-a77c-5b56b234729c-metrics-tls podName:13a9c69b-60c2-4c1d-a77c-5b56b234729c nodeName:}" failed. No retries permitted until 2026-10-31 00:29:36.277673917 +0000 UTC m=+31.548880648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13a9c69b-60c2-4c1d-a77c-5b56b234729c-metrics-tls") pod "dns-default-xbqw2" (UID: "13a9c69b-60c2-4c1d-a77c-5b56b234729c") : secret "dns-default-metrics-tls" not found Oct 31 00:29:35.778167 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.778146 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13a9c69b-60c2-4c1d-a77c-5b56b234729c-tmp-dir\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:35.778384 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.778368 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/13a9c69b-60c2-4c1d-a77c-5b56b234729c-config-volume\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:35.781598 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.781580 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f47d176e-65b0-49d3-a77a-f593c25c65fa-cert\") pod \"ingress-canary-zd5x6\" (UID: \"f47d176e-65b0-49d3-a77a-f593c25c65fa\") " pod="openshift-ingress-canary/ingress-canary-zd5x6" Oct 31 00:29:35.800892 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.800863 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmc22\" (UniqueName: \"kubernetes.io/projected/13a9c69b-60c2-4c1d-a77c-5b56b234729c-kube-api-access-xmc22\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:35.800985 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.800889 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgmhd\" (UniqueName: \"kubernetes.io/projected/f47d176e-65b0-49d3-a77a-f593c25c65fa-kube-api-access-lgmhd\") pod \"ingress-canary-zd5x6\" (UID: \"f47d176e-65b0-49d3-a77a-f593c25c65fa\") " pod="openshift-ingress-canary/ingress-canary-zd5x6" Oct 31 00:29:35.881962 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:35.881902 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zd5x6" Oct 31 00:29:36.244784 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:36.244758 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zd5x6"] Oct 31 00:29:36.249917 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:36.249894 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf47d176e_65b0_49d3_a77a_f593c25c65fa.slice/crio-33acb70d189cfce59ef4ab9d7905426939d52a7b20aeafb5af8b5f4f910383ae WatchSource:0}: Error finding container 33acb70d189cfce59ef4ab9d7905426939d52a7b20aeafb5af8b5f4f910383ae: Status 404 returned error can't find the container with id 33acb70d189cfce59ef4ab9d7905426939d52a7b20aeafb5af8b5f4f910383ae Oct 31 00:29:36.272895 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:36.272874 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:36.272969 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:36.272901 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:36.273002 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:36.272969 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:36.278620 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:36.278583 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:36.281777 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:36.281757 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13a9c69b-60c2-4c1d-a77c-5b56b234729c-metrics-tls\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:36.281869 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:36.281857 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 31 00:29:36.281908 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:36.281902 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a9c69b-60c2-4c1d-a77c-5b56b234729c-metrics-tls podName:13a9c69b-60c2-4c1d-a77c-5b56b234729c nodeName:}" failed. No retries permitted until 2026-10-31 00:29:37.281889432 +0000 UTC m=+32.553096173 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13a9c69b-60c2-4c1d-a77c-5b56b234729c-metrics-tls") pod "dns-default-xbqw2" (UID: "13a9c69b-60c2-4c1d-a77c-5b56b234729c") : secret "dns-default-metrics-tls" not found Oct 31 00:29:36.292693 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:36.292658 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 31 00:29:36.292818 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:36.292804 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 31 00:29:36.292978 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:36.292956 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 31 00:29:36.293038 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:36.292994 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-7zk7c\"" Oct 31 00:29:36.293105 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:36.293088 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 31 00:29:36.293187 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:36.293162 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-59g6b\"" Oct 31 00:29:36.293279 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:36.293238 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5whcb\"" Oct 31 00:29:36.399111 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:36.399089 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:36.532110 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:36.532041 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zd5x6" event={"ID":"f47d176e-65b0-49d3-a77a-f593c25c65fa","Type":"ContainerStarted","Data":"33acb70d189cfce59ef4ab9d7905426939d52a7b20aeafb5af8b5f4f910383ae"} Oct 31 00:29:37.289244 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:37.289211 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13a9c69b-60c2-4c1d-a77c-5b56b234729c-metrics-tls\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:37.289421 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:37.289338 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 31 00:29:37.289481 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:37.289424 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a9c69b-60c2-4c1d-a77c-5b56b234729c-metrics-tls podName:13a9c69b-60c2-4c1d-a77c-5b56b234729c nodeName:}" failed. No retries permitted until 2026-10-31 00:29:39.289392474 +0000 UTC m=+34.560599203 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13a9c69b-60c2-4c1d-a77c-5b56b234729c-metrics-tls") pod "dns-default-xbqw2" (UID: "13a9c69b-60c2-4c1d-a77c-5b56b234729c") : secret "dns-default-metrics-tls" not found Oct 31 00:29:38.705494 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.705460 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qf2jx"] Oct 31 00:29:38.708739 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.708721 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:38.724610 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.724588 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 31 00:29:38.724696 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.724622 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 31 00:29:38.735677 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.735660 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 31 00:29:38.735802 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.735708 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fcc5b\"" Oct 31 00:29:38.735802 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.735718 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 31 00:29:38.736376 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.736358 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qf2jx"] Oct 31 00:29:38.772885 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.772860 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:38.801105 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.801061 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7340ba78-0fa3-4677-95b4-9dada26be5a5-crio-socket\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:38.801105 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.801092 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:38.801232 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.801109 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c78pb\" (UniqueName: \"kubernetes.io/projected/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-api-access-c78pb\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:38.801232 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.801180 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:38.801297 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.801238 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7340ba78-0fa3-4677-95b4-9dada26be5a5-data-volume\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:38.808393 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.808371 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-wsp74-v7vxc"] Oct 31 00:29:38.827944 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.827926 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:38.830945 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.830927 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-wsp74-v7vxc"] Oct 31 00:29:38.842950 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.842928 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6qgws\"" Oct 31 00:29:38.901666 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.901645 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7340ba78-0fa3-4677-95b4-9dada26be5a5-crio-socket\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:38.901773 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.901673 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:38.901773 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.901692 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c78pb\" (UniqueName: \"kubernetes.io/projected/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-api-access-c78pb\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:38.901773 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.901711 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-archives-path\") pod \"periodic-gathering-wsp74-v7vxc\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:38.901773 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.901752 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-service-ca-bundle\") pod \"periodic-gathering-wsp74-v7vxc\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:38.901979 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:38.901789 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 31 00:29:38.901979 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.901817 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-trusted-ca-bundle\") pod \"periodic-gathering-wsp74-v7vxc\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:38.901979 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:38.901843 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-rbac-proxy-cm podName:7340ba78-0fa3-4677-95b4-9dada26be5a5 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:39.401828055 +0000 UTC m=+34.673034815 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qf2jx" (UID: "7340ba78-0fa3-4677-95b4-9dada26be5a5") : configmap "kube-rbac-proxy" not found Oct 31 00:29:38.901979 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.901876 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lc56\" (UniqueName: \"kubernetes.io/projected/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-kube-api-access-8lc56\") pod \"periodic-gathering-wsp74-v7vxc\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:38.901979 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.901882 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7340ba78-0fa3-4677-95b4-9dada26be5a5-crio-socket\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:38.901979 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.901916 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:38.902167 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.901983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7340ba78-0fa3-4677-95b4-9dada26be5a5-data-volume\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:38.902167 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:38.902039 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 31 00:29:38.902167 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:38.902081 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls podName:7340ba78-0fa3-4677-95b4-9dada26be5a5 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:39.402068769 +0000 UTC m=+34.673275493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qf2jx" (UID: "7340ba78-0fa3-4677-95b4-9dada26be5a5") : secret "insights-runtime-extractor-tls" not found Oct 31 00:29:38.902259 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.902200 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7340ba78-0fa3-4677-95b4-9dada26be5a5-data-volume\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:38.907188 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.907166 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:38.924839 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.924818 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Oct 31 00:29:38.925418 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.925387 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c78pb\" (UniqueName: \"kubernetes.io/projected/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-api-access-c78pb\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:38.948733 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:38.948708 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Oct 31 00:29:39.002631 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.002607 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:39.002725 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.002709 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-archives-path\") pod \"periodic-gathering-wsp74-v7vxc\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:39.002782 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.002745 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-service-ca-bundle\") pod \"periodic-gathering-wsp74-v7vxc\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:39.002832 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.002779 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs\") pod \"network-metrics-daemon-cbb78\" (UID: \"671b2592-db78-4be6-9a9c-83ade9a48bce\") " pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:39.002832 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.002810 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-trusted-ca-bundle\") pod \"periodic-gathering-wsp74-v7vxc\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:39.002919 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.002837 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lc56\" (UniqueName: \"kubernetes.io/projected/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-kube-api-access-8lc56\") pod \"periodic-gathering-wsp74-v7vxc\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:39.002974 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:39.002930 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 31 00:29:39.003029 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:39.003013 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs podName:671b2592-db78-4be6-9a9c-83ade9a48bce nodeName:}" failed. No retries permitted until 2026-10-31 00:30:11.002990716 +0000 UTC m=+66.274197452 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs") pod "network-metrics-daemon-cbb78" (UID: "671b2592-db78-4be6-9a9c-83ade9a48bce") : secret "metrics-daemon-secret" not found Oct 31 00:29:39.003151 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.003131 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-archives-path\") pod \"periodic-gathering-wsp74-v7vxc\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:39.003444 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.003423 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-service-ca-bundle\") pod \"periodic-gathering-wsp74-v7vxc\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:39.003695 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.003675 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-trusted-ca-bundle\") pod \"periodic-gathering-wsp74-v7vxc\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:39.004992 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.004973 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:39.026330 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.026309 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lc56\" (UniqueName: \"kubernetes.io/projected/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-kube-api-access-8lc56\") pod \"periodic-gathering-wsp74-v7vxc\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:39.031095 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.031073 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:39.109844 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.106792 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfkv4\" (UniqueName: \"kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4\") pod \"network-check-target-72nks\" (UID: \"7e87fd11-4685-4e33-8230-b6b53747c9a9\") " pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:39.110950 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.110452 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfkv4\" (UniqueName: \"kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4\") pod \"network-check-target-72nks\" (UID: \"7e87fd11-4685-4e33-8230-b6b53747c9a9\") " pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:39.158469 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.158435 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:39.278171 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.278146 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-c45b2"] Oct 31 00:29:39.300490 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.300465 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-c45b2" Oct 31 00:29:39.301486 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.301459 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-c45b2"] Oct 31 00:29:39.305802 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.305743 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:39.307882 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.307857 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13a9c69b-60c2-4c1d-a77c-5b56b234729c-metrics-tls\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:39.307993 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:39.307978 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 31 00:29:39.308051 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:39.308041 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a9c69b-60c2-4c1d-a77c-5b56b234729c-metrics-tls podName:13a9c69b-60c2-4c1d-a77c-5b56b234729c nodeName:}" failed. No retries permitted until 2026-10-31 00:29:43.30802685 +0000 UTC m=+38.579233575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13a9c69b-60c2-4c1d-a77c-5b56b234729c-metrics-tls") pod "dns-default-xbqw2" (UID: "13a9c69b-60c2-4c1d-a77c-5b56b234729c") : secret "dns-default-metrics-tls" not found Oct 31 00:29:39.316050 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.316026 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-v9vbh\"" Oct 31 00:29:39.316142 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.316110 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Oct 31 00:29:39.316142 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.316135 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Oct 31 00:29:39.316246 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.316157 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Oct 31 00:29:39.316246 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.316164 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Oct 31 00:29:39.355215 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.355180 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j7fh7"] Oct 31 00:29:39.360649 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:39.360619 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd36c3c_acec_474f_b4aa_27ae4490c39b.slice/crio-0c9d9e26fbf83d27da5653abd677908bef35d8cc75f875673fee15bd56dbf95b WatchSource:0}: Error finding container 0c9d9e26fbf83d27da5653abd677908bef35d8cc75f875673fee15bd56dbf95b: Status 404 returned error can't find the container with id 0c9d9e26fbf83d27da5653abd677908bef35d8cc75f875673fee15bd56dbf95b Oct 31 00:29:39.408828 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.408805 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:39.408941 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.408837 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/031b50be-28d6-4dcc-89e4-99e9558738f2-signing-key\") pod \"service-ca-5fffc97bdf-c45b2\" (UID: \"031b50be-28d6-4dcc-89e4-99e9558738f2\") " pod="openshift-service-ca/service-ca-5fffc97bdf-c45b2" Oct 31 00:29:39.408941 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.408872 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/031b50be-28d6-4dcc-89e4-99e9558738f2-signing-cabundle\") pod \"service-ca-5fffc97bdf-c45b2\" (UID: \"031b50be-28d6-4dcc-89e4-99e9558738f2\") " pod="openshift-service-ca/service-ca-5fffc97bdf-c45b2" Oct 31 00:29:39.408941 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.408892 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s87w5\" (UniqueName: \"kubernetes.io/projected/031b50be-28d6-4dcc-89e4-99e9558738f2-kube-api-access-s87w5\") pod \"service-ca-5fffc97bdf-c45b2\" (UID: \"031b50be-28d6-4dcc-89e4-99e9558738f2\") " pod="openshift-service-ca/service-ca-5fffc97bdf-c45b2" Oct 31 00:29:39.409090 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:39.408944 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 31 00:29:39.409090 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:39.409021 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-rbac-proxy-cm podName:7340ba78-0fa3-4677-95b4-9dada26be5a5 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:40.408999314 +0000 UTC m=+35.680206052 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qf2jx" (UID: "7340ba78-0fa3-4677-95b4-9dada26be5a5") : configmap "kube-rbac-proxy" not found Oct 31 00:29:39.409090 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.409053 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:39.409232 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:39.409214 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 31 00:29:39.409288 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:39.409277 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls podName:7340ba78-0fa3-4677-95b4-9dada26be5a5 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:40.409259063 +0000 UTC m=+35.680465800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qf2jx" (UID: "7340ba78-0fa3-4677-95b4-9dada26be5a5") : secret "insights-runtime-extractor-tls" not found Oct 31 00:29:39.433230 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.433195 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:39.468388 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.468222 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-6w8wz"] Oct 31 00:29:39.487925 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.487905 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-6w8wz" Oct 31 00:29:39.491218 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.491202 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-wsp74-v7vxc"] Oct 31 00:29:39.495650 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.495627 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-6w8wz"] Oct 31 00:29:39.497036 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:39.497009 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdbe3b25_0ac2_4e8d_89cd_0d1a8e6ba69f.slice/crio-e807bc96b27ed8944bebe9f12a13e530aecf4b0aa93cbb1b2f675645bc15be20 WatchSource:0}: Error finding container e807bc96b27ed8944bebe9f12a13e530aecf4b0aa93cbb1b2f675645bc15be20: Status 404 returned error can't find the container with id e807bc96b27ed8944bebe9f12a13e530aecf4b0aa93cbb1b2f675645bc15be20 Oct 31 00:29:39.505446 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.505390 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-d84gp\"" Oct 31 00:29:39.505557 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.505534 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 31 00:29:39.505557 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.505546 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 31 00:29:39.509941 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.509921 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/031b50be-28d6-4dcc-89e4-99e9558738f2-signing-key\") pod \"service-ca-5fffc97bdf-c45b2\" (UID: \"031b50be-28d6-4dcc-89e4-99e9558738f2\") " pod="openshift-service-ca/service-ca-5fffc97bdf-c45b2" Oct 31 00:29:39.510093 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.509971 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/031b50be-28d6-4dcc-89e4-99e9558738f2-signing-cabundle\") pod \"service-ca-5fffc97bdf-c45b2\" (UID: \"031b50be-28d6-4dcc-89e4-99e9558738f2\") " pod="openshift-service-ca/service-ca-5fffc97bdf-c45b2" Oct 31 00:29:39.510093 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.509992 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s87w5\" (UniqueName: \"kubernetes.io/projected/031b50be-28d6-4dcc-89e4-99e9558738f2-kube-api-access-s87w5\") pod \"service-ca-5fffc97bdf-c45b2\" (UID: \"031b50be-28d6-4dcc-89e4-99e9558738f2\") " pod="openshift-service-ca/service-ca-5fffc97bdf-c45b2" Oct 31 00:29:39.510666 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.510649 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/031b50be-28d6-4dcc-89e4-99e9558738f2-signing-cabundle\") pod \"service-ca-5fffc97bdf-c45b2\" (UID: \"031b50be-28d6-4dcc-89e4-99e9558738f2\") " pod="openshift-service-ca/service-ca-5fffc97bdf-c45b2" Oct 31 00:29:39.512199 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.512182 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/031b50be-28d6-4dcc-89e4-99e9558738f2-signing-key\") pod \"service-ca-5fffc97bdf-c45b2\" (UID: \"031b50be-28d6-4dcc-89e4-99e9558738f2\") " pod="openshift-service-ca/service-ca-5fffc97bdf-c45b2" Oct 31 00:29:39.538651 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.538625 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s87w5\" (UniqueName: \"kubernetes.io/projected/031b50be-28d6-4dcc-89e4-99e9558738f2-kube-api-access-s87w5\") pod \"service-ca-5fffc97bdf-c45b2\" (UID: \"031b50be-28d6-4dcc-89e4-99e9558738f2\") " pod="openshift-service-ca/service-ca-5fffc97bdf-c45b2" Oct 31 00:29:39.539548 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.539521 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-wsp74-v7vxc" event={"ID":"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f","Type":"ContainerStarted","Data":"e807bc96b27ed8944bebe9f12a13e530aecf4b0aa93cbb1b2f675645bc15be20"} Oct 31 00:29:39.540600 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.540574 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j7fh7" event={"ID":"bdd36c3c-acec-474f-b4aa-27ae4490c39b","Type":"ContainerStarted","Data":"0c9d9e26fbf83d27da5653abd677908bef35d8cc75f875673fee15bd56dbf95b"} Oct 31 00:29:39.541888 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.541869 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zd5x6" event={"ID":"f47d176e-65b0-49d3-a77a-f593c25c65fa","Type":"ContainerStarted","Data":"a4197724d1180e9ec3d967989d918a5688fb13f67c870bdbc305b56f4400623e"} Oct 31 00:29:39.564760 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.564713 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:39.584252 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.584210 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zd5x6" podStartSLOduration=1.8398505649999999 podStartE2EDuration="4.584197745s" totalImagesPullingTime="2.74434718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:39.584043648 +0000 UTC m=+34.855250396" watchObservedRunningTime="2026-10-31 00:29:39.584197745 +0000 UTC m=+34.855404491" Oct 31 00:29:39.608165 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.608142 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-72nks"] Oct 31 00:29:39.611220 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.611199 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfbxg\" (UniqueName: \"kubernetes.io/projected/85b085b5-122b-4fed-9b61-ea83fd294c9f-kube-api-access-lfbxg\") pod \"migrator-66df5d496b-6w8wz\" (UID: \"85b085b5-122b-4fed-9b61-ea83fd294c9f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-6w8wz" Oct 31 00:29:39.612604 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:39.612584 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e87fd11_4685_4e33_8230_b6b53747c9a9.slice/crio-6011bbc3ec404cd597ed4c6dafabfbf6c7be88d089d628a1e9099f24ec54e8d6 WatchSource:0}: Error finding container 6011bbc3ec404cd597ed4c6dafabfbf6c7be88d089d628a1e9099f24ec54e8d6: Status 404 returned error can't find the container with id 6011bbc3ec404cd597ed4c6dafabfbf6c7be88d089d628a1e9099f24ec54e8d6 Oct 31 00:29:39.619452 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.619399 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-c45b2" Oct 31 00:29:39.684298 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.684268 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:39.711838 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.711810 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfbxg\" (UniqueName: \"kubernetes.io/projected/85b085b5-122b-4fed-9b61-ea83fd294c9f-kube-api-access-lfbxg\") pod \"migrator-66df5d496b-6w8wz\" (UID: \"85b085b5-122b-4fed-9b61-ea83fd294c9f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-6w8wz" Oct 31 00:29:39.735499 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.735480 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfbxg\" (UniqueName: \"kubernetes.io/projected/85b085b5-122b-4fed-9b61-ea83fd294c9f-kube-api-access-lfbxg\") pod \"migrator-66df5d496b-6w8wz\" (UID: \"85b085b5-122b-4fed-9b61-ea83fd294c9f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-6w8wz" Oct 31 00:29:39.818436 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.818350 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:39.825154 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.825135 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-6w8wz" Oct 31 00:29:39.939590 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:39.939564 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-c45b2"] Oct 31 00:29:39.945999 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:39.945186 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod031b50be_28d6_4dcc_89e4_99e9558738f2.slice/crio-6b1c1b90ac87f9ca4ef74f4f2463dddd4aaa82c58ffdc6d8ac97502350b5b598 WatchSource:0}: Error finding container 6b1c1b90ac87f9ca4ef74f4f2463dddd4aaa82c58ffdc6d8ac97502350b5b598: Status 404 returned error can't find the container with id 6b1c1b90ac87f9ca4ef74f4f2463dddd4aaa82c58ffdc6d8ac97502350b5b598 Oct 31 00:29:40.166453 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:40.166326 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-6w8wz"] Oct 31 00:29:40.173603 ip-10-0-131-90 kubenswrapper[2579]: W1031 00:29:40.173575 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b085b5_122b_4fed_9b61_ea83fd294c9f.slice/crio-ec90db55df227da240ad2e4b0c733dadf744b0f3e9406c5b11345c20c65f1f54 WatchSource:0}: Error finding container ec90db55df227da240ad2e4b0c733dadf744b0f3e9406c5b11345c20c65f1f54: Status 404 returned error can't find the container with id ec90db55df227da240ad2e4b0c733dadf744b0f3e9406c5b11345c20c65f1f54 Oct 31 00:29:40.192124 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:40.192063 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:40.417473 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:40.416700 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:40.417473 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:40.416786 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:40.417473 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:40.416888 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 31 00:29:40.417473 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:40.416947 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-rbac-proxy-cm podName:7340ba78-0fa3-4677-95b4-9dada26be5a5 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:42.416928831 +0000 UTC m=+37.688135572 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qf2jx" (UID: "7340ba78-0fa3-4677-95b4-9dada26be5a5") : configmap "kube-rbac-proxy" not found Oct 31 00:29:40.417473 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:40.417330 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 31 00:29:40.417473 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:40.417386 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls podName:7340ba78-0fa3-4677-95b4-9dada26be5a5 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:42.417372183 +0000 UTC m=+37.688578922 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qf2jx" (UID: "7340ba78-0fa3-4677-95b4-9dada26be5a5") : secret "insights-runtime-extractor-tls" not found Oct 31 00:29:40.546954 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:40.546926 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-6w8wz" event={"ID":"85b085b5-122b-4fed-9b61-ea83fd294c9f","Type":"ContainerStarted","Data":"ec90db55df227da240ad2e4b0c733dadf744b0f3e9406c5b11345c20c65f1f54"} Oct 31 00:29:40.548644 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:40.548615 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-c45b2" event={"ID":"031b50be-28d6-4dcc-89e4-99e9558738f2","Type":"ContainerStarted","Data":"6b1c1b90ac87f9ca4ef74f4f2463dddd4aaa82c58ffdc6d8ac97502350b5b598"} Oct 31 00:29:40.550386 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:40.550362 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-72nks" event={"ID":"7e87fd11-4685-4e33-8230-b6b53747c9a9","Type":"ContainerStarted","Data":"6011bbc3ec404cd597ed4c6dafabfbf6c7be88d089d628a1e9099f24ec54e8d6"} Oct 31 00:29:42.433439 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:42.433338 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:42.433439 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:42.433433 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:42.433933 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:42.433479 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 31 00:29:42.433933 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:42.433568 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-rbac-proxy-cm podName:7340ba78-0fa3-4677-95b4-9dada26be5a5 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:46.433546221 +0000 UTC m=+41.704752951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qf2jx" (UID: "7340ba78-0fa3-4677-95b4-9dada26be5a5") : configmap "kube-rbac-proxy" not found Oct 31 00:29:42.433933 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:42.433585 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 31 00:29:42.433933 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:42.433638 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls podName:7340ba78-0fa3-4677-95b4-9dada26be5a5 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:46.433623688 +0000 UTC m=+41.704830413 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qf2jx" (UID: "7340ba78-0fa3-4677-95b4-9dada26be5a5") : secret "insights-runtime-extractor-tls" not found Oct 31 00:29:42.562704 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:42.562670 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-6w8wz" event={"ID":"85b085b5-122b-4fed-9b61-ea83fd294c9f","Type":"ContainerStarted","Data":"ba79f44baa54602117b75ea146b1f2635fe46d49bb5deb2fd9858f235195ede9"} Oct 31 00:29:43.174921 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:43.174886 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:43.340234 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:43.340202 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13a9c69b-60c2-4c1d-a77c-5b56b234729c-metrics-tls\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:43.340474 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:43.340322 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 31 00:29:43.340474 ip-10-0-131-90 kubenswrapper[2579]: E1031 00:29:43.340397 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a9c69b-60c2-4c1d-a77c-5b56b234729c-metrics-tls podName:13a9c69b-60c2-4c1d-a77c-5b56b234729c nodeName:}" failed. No retries permitted until 2026-10-31 00:29:51.340377151 +0000 UTC m=+46.611583894 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13a9c69b-60c2-4c1d-a77c-5b56b234729c-metrics-tls") pod "dns-default-xbqw2" (UID: "13a9c69b-60c2-4c1d-a77c-5b56b234729c") : secret "dns-default-metrics-tls" not found Oct 31 00:29:43.568243 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:43.568169 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-wsp74-v7vxc" event={"ID":"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f","Type":"ContainerStarted","Data":"006cafdc7a00d04f0579d07691858e641b5e4d0feb38c5ac911a3a2722288400"} Oct 31 00:29:43.609752 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:43.609651 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-wsp74-v7vxc" podStartSLOduration=2.149331601 podStartE2EDuration="5.60963467s" totalImagesPullingTime="3.460303069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:43.60860562 +0000 UTC m=+38.879812379" watchObservedRunningTime="2026-10-31 00:29:43.60963467 +0000 UTC m=+38.880841430" Oct 31 00:29:43.609905 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:43.609779 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-6w8wz" podStartSLOduration=2.615781649 podStartE2EDuration="4.609771583s" totalImagesPullingTime="1.993989934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:42.61070705 +0000 UTC m=+37.881913797" watchObservedRunningTime="2026-10-31 00:29:43.609771583 +0000 UTC m=+38.880978333" Oct 31 00:29:44.474911 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:44.474872 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:44.573542 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:44.573505 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-c45b2" event={"ID":"031b50be-28d6-4dcc-89e4-99e9558738f2","Type":"ContainerStarted","Data":"45f1f9d83db8442196757ce1474733053c4a4cbe4e776ddcd74c27b0911a2d73"} Oct 31 00:29:44.576659 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:44.576631 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-72nks" event={"ID":"7e87fd11-4685-4e33-8230-b6b53747c9a9","Type":"ContainerStarted","Data":"ceffe4e41b47836a7366e68c68a817d26b1cc51352ef24c1472dbf69b170df6c"} Oct 31 00:29:44.576767 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:44.576678 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:44.580180 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:44.580146 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:44.614249 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:44.614202 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-c45b2" podStartSLOduration=1.878496331 podStartE2EDuration="5.614186387s" totalImagesPullingTime="3.735690056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:44.612644909 +0000 UTC m=+39.883851655" watchObservedRunningTime="2026-10-31 00:29:44.614186387 +0000 UTC m=+39.885393134" Oct 31 00:29:44.651396 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:44.651359 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-72nks" podStartSLOduration=34.22955976 podStartE2EDuration="38.65134643s" totalImagesPullingTime="4.42178667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:44.651120375 +0000 UTC m=+39.922327120" watchObservedRunningTime="2026-10-31 00:29:44.65134643 +0000 UTC m=+39.922553173" Oct 31 00:29:44.694246 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:44.694208 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:45.364626 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:45.361557 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:45.580018 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:45.579984 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j7fh7" event={"ID":"bdd36c3c-acec-474f-b4aa-27ae4490c39b","Type":"ContainerStarted","Data":"55fc31fb9f8d493702d894ad5a84f0dfadcfb546e1534f6f06f8fd8a2f44a686"} Oct 31 00:29:45.619026 ip-10-0-131-90 kubenswrapper[2579]: I1031 00:29:45.618930 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j7fh7" podStartSLOduration=33.639526124 podStartE2EDuration="39.618913264s" totalImagesPullingTime="5.97938714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:45.618085306 +0000 UTC m=+40.889292053" watchObservedRunningTime="2026-10-31 00:29:45.618913264 +0000 UTC m=+40.890120010" Oct 31 00:29:45.619247 ip-10-0-131-90 systemd[1]: Stopping Kubernetes Kubelet... Oct 31 00:29:45.630766 ip-10-0-131-90 systemd[1]: kubelet.service: Deactivated successfully. Oct 31 00:29:45.630987 ip-10-0-131-90 systemd[1]: Stopped Kubernetes Kubelet. Oct 31 00:29:45.631048 ip-10-0-131-90 systemd[1]: kubelet.service: Consumed 2.345s CPU time. Oct 31 00:29:45.646989 ip-10-0-131-90 systemd[1]: Starting Kubernetes Kubelet... Oct 31 00:29:45.745375 ip-10-0-131-90 kubenswrapper[4557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 00:29:45.745375 ip-10-0-131-90 kubenswrapper[4557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 31 00:29:45.745375 ip-10-0-131-90 kubenswrapper[4557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 00:29:45.745375 ip-10-0-131-90 kubenswrapper[4557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 00:29:45.747361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747296 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:29:45.747361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747361 4557 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:29:45.747361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747365 4557 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:29:45.747481 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747368 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:29:45.747481 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747371 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:29:45.747481 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747374 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:29:45.747481 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747382 4557 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:29:45.747481 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747385 4557 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:29:45.747481 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747387 4557 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:29:45.747481 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747390 4557 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:29:45.747481 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747393 4557 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:29:45.747481 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747396 4557 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:29:45.747481 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747398 4557 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:29:45.747481 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747416 4557 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:29:45.747481 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747420 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:29:45.747481 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747423 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:29:45.747481 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747425 4557 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:29:45.747481 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747428 4557 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:29:45.747481 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747430 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:29:45.747481 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747433 4557 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:29:45.747481 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747436 4557 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:29:45.747481 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747438 4557 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:29:45.747959 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747441 4557 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:29:45.747959 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747444 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:29:45.747959 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747447 4557 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:29:45.747959 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747450 4557 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:29:45.747959 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747452 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:29:45.747959 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747455 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:29:45.747959 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747457 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:29:45.747959 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747460 4557 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:29:45.747959 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747462 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:29:45.747959 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747465 4557 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:29:45.747959 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747468 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:29:45.747959 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747470 4557 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:29:45.747959 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747473 4557 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:29:45.747959 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747475 4557 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:29:45.747959 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747478 4557 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:29:45.747959 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747480 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:29:45.747959 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747483 4557 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:29:45.747959 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747486 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:29:45.747959 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747489 4557 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:29:45.747959 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747493 4557 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:29:45.748461 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747495 4557 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:29:45.748461 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747498 4557 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:29:45.748461 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747500 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:29:45.748461 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747503 4557 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:29:45.748461 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747505 4557 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:29:45.748461 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747508 4557 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:29:45.748461 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747510 4557 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:29:45.748461 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747512 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:29:45.748461 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747515 4557 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:29:45.748461 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747517 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:29:45.748461 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747520 4557 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:29:45.748461 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747523 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:29:45.748461 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747525 4557 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:29:45.748461 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747529 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:29:45.748461 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747532 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:29:45.748461 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747535 4557 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:29:45.748461 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747537 4557 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:29:45.748461 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747540 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:29:45.748461 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747543 4557 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:29:45.748461 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747545 4557 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:29:45.748957 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747548 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:29:45.748957 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747550 4557 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:29:45.748957 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747553 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:29:45.748957 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747556 4557 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:29:45.748957 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747559 4557 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:29:45.748957 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747563 4557 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:29:45.748957 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747567 4557 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:29:45.748957 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747570 4557 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:29:45.748957 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747574 4557 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:29:45.748957 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747578 4557 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:29:45.748957 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747581 4557 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:29:45.748957 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747585 4557 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:29:45.748957 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747588 4557 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:29:45.748957 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747591 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:29:45.748957 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747593 4557 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:29:45.748957 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747596 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:29:45.748957 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747598 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:29:45.748957 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747601 4557 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:29:45.748957 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747603 4557 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:29:45.749425 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747606 4557 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:29:45.749425 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747609 4557 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:29:45.749425 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747611 4557 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:29:45.749425 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747614 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:29:45.749425 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747617 4557 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:29:45.749425 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747620 4557 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:29:45.749425 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747623 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:29:45.749425 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747625 4557 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:29:45.749425 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747628 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:29:45.749425 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747631 4557 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:29:45.749425 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747633 4557 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:29:45.749425 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747636 4557 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:29:45.749425 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747639 4557 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:29:45.749425 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747641 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:29:45.749425 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747644 4557 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:29:45.749425 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747646 4557 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:29:45.749425 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747649 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:29:45.749425 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747651 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:29:45.749425 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747654 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:29:45.749921 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747656 4557 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:29:45.749921 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747659 4557 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:29:45.749921 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747662 4557 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:29:45.749921 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747665 4557 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:29:45.749921 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747668 4557 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:29:45.749921 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.747672 4557 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:29:45.749921 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748390 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:29:45.749921 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748397 4557 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:29:45.749921 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748414 4557 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:29:45.749921 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748419 4557 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:29:45.749921 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748423 4557 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:29:45.749921 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748426 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:29:45.749921 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748429 4557 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:29:45.749921 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748435 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:29:45.749921 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748437 4557 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:29:45.749921 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748440 4557 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:29:45.749921 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748442 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:29:45.749921 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748445 4557 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:29:45.749921 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748447 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:29:45.750415 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748450 4557 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:29:45.750415 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748453 4557 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:29:45.750415 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748456 4557 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:29:45.750415 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748458 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:29:45.750415 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748461 4557 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:29:45.750415 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748463 4557 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:29:45.750415 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748466 4557 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:29:45.750415 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748469 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:29:45.750415 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748472 4557 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:29:45.750415 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748474 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:29:45.750415 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748477 4557 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:29:45.750415 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748479 4557 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:29:45.750415 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748482 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:29:45.750415 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748484 4557 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:29:45.750415 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748487 4557 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:29:45.750415 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748489 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:29:45.750415 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748492 4557 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:29:45.750415 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748494 4557 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:29:45.750415 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748497 4557 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:29:45.750415 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748500 4557 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:29:45.750911 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748503 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:29:45.750911 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748505 4557 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:29:45.750911 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748508 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:29:45.750911 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748510 4557 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:29:45.750911 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748513 4557 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:29:45.750911 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748517 4557 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:29:45.750911 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748522 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:29:45.750911 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748525 4557 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:29:45.750911 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748527 4557 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:29:45.750911 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748530 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:29:45.750911 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748533 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:29:45.750911 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748535 4557 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:29:45.750911 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748539 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:29:45.750911 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748541 4557 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:29:45.750911 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748544 4557 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:29:45.750911 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748547 4557 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:29:45.750911 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748549 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:29:45.750911 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748552 4557 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:29:45.750911 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748555 4557 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:29:45.751373 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748557 4557 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:29:45.751373 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748560 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:29:45.751373 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748562 4557 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:29:45.751373 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748565 4557 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:29:45.751373 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748567 4557 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:29:45.751373 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748570 4557 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:29:45.751373 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748573 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:29:45.751373 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748576 4557 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:29:45.751373 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748578 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:29:45.751373 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748581 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:29:45.751373 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748583 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:29:45.751373 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748586 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:29:45.751373 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748588 4557 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:29:45.751373 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748592 4557 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:29:45.751373 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748594 4557 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:29:45.751373 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748597 4557 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:29:45.751373 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748599 4557 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:29:45.751373 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748602 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:29:45.751373 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748605 4557 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:29:45.751373 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748608 4557 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:29:45.751904 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748611 4557 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:29:45.751904 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748614 4557 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:29:45.751904 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748617 4557 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:29:45.751904 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748619 4557 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:29:45.751904 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748622 4557 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:29:45.751904 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748624 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:29:45.751904 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748627 4557 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:29:45.751904 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748629 4557 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:29:45.751904 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748632 4557 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:29:45.751904 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748635 4557 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:29:45.751904 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748639 4557 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:29:45.751904 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748644 4557 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:29:45.751904 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748647 4557 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:29:45.751904 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748651 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:29:45.751904 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748653 4557 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:29:45.751904 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748656 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:29:45.751904 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748658 4557 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:29:45.751904 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748661 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:29:45.751904 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748663 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:29:45.752429 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748666 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:29:45.752429 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748668 4557 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:29:45.752429 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748671 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:29:45.752429 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748674 4557 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:29:45.752429 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748677 4557 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:29:45.752429 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748679 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:29:45.752429 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748681 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:29:45.752429 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748687 4557 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:29:45.752429 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748690 4557 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:29:45.752429 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748693 4557 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:29:45.752429 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748695 4557 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:29:45.752429 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748698 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:29:45.752429 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748702 4557 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:29:45.752429 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748705 4557 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:29:45.752429 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.748708 4557 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:29:45.752429 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749171 4557 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:29:45.752429 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749176 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:29:45.752429 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749179 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:29:45.752429 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749181 4557 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:29:45.752429 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749184 4557 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:29:45.753013 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749187 4557 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:29:45.753013 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749190 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:29:45.753013 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749192 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:29:45.753013 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749195 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:29:45.753013 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749197 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:29:45.753013 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749200 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:29:45.753013 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749203 4557 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:29:45.753013 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749205 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:29:45.753013 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749208 4557 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:29:45.753013 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749211 4557 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:29:45.753013 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749213 4557 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:29:45.753013 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749216 4557 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:29:45.753013 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749218 4557 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:29:45.753013 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749221 4557 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:29:45.753013 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749223 4557 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:29:45.753013 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749226 4557 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:29:45.753013 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749228 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:29:45.753013 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749231 4557 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:29:45.753013 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749233 4557 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:29:45.753013 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749241 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:29:45.753819 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749244 4557 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:29:45.753819 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749247 4557 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:29:45.753819 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749250 4557 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:29:45.753819 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749253 4557 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:29:45.753819 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749257 4557 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:29:45.753819 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749260 4557 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:29:45.753819 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749263 4557 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:29:45.753819 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749265 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:29:45.753819 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749268 4557 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:29:45.753819 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749270 4557 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:29:45.753819 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749273 4557 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:29:45.753819 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749275 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:29:45.753819 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749278 4557 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:29:45.753819 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749280 4557 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:29:45.753819 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749283 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:29:45.753819 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749285 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:29:45.753819 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749288 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:29:45.753819 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749291 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:29:45.753819 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749293 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:29:45.754441 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749296 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:29:45.754441 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749299 4557 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:29:45.754441 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749302 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:29:45.754441 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749304 4557 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:29:45.754441 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749308 4557 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:29:45.754441 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749312 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:29:45.754441 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749314 4557 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:29:45.754441 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749317 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:29:45.754441 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749319 4557 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:29:45.754441 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749322 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:29:45.754441 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749324 4557 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:29:45.754441 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749327 4557 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:29:45.754441 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749329 4557 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:29:45.754441 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749332 4557 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:29:45.754441 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749335 4557 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:29:45.754441 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749338 4557 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:29:45.754441 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749340 4557 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:29:45.754441 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749344 4557 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:29:45.754441 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749347 4557 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:29:45.754906 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749349 4557 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:29:45.754906 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749352 4557 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:29:45.754906 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749354 4557 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:29:45.754906 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749357 4557 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:29:45.754906 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749359 4557 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:29:45.754906 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749362 4557 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:29:45.754906 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749364 4557 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:29:45.754906 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749367 4557 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:29:45.754906 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749369 4557 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:29:45.754906 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749372 4557 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:29:45.754906 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749374 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:29:45.754906 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749377 4557 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:29:45.754906 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749381 4557 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:29:45.754906 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749385 4557 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:29:45.754906 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749388 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:29:45.754906 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749391 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:29:45.754906 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749394 4557 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:29:45.754906 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749397 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:29:45.754906 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749414 4557 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:29:45.755361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749418 4557 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:29:45.755361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749421 4557 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:29:45.755361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749424 4557 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:29:45.755361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749426 4557 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:29:45.755361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749429 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:29:45.755361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749431 4557 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:29:45.755361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749434 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:29:45.755361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749437 4557 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:29:45.755361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749441 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:29:45.755361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749443 4557 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:29:45.755361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749446 4557 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:29:45.755361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749450 4557 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:29:45.755361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749453 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:29:45.755361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749456 4557 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:29:45.755361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749458 4557 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:29:45.755361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749461 4557 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:29:45.755361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749464 4557 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:29:45.755361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749467 4557 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:29:45.755361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749469 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:29:45.755361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749472 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749474 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749477 4557 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749480 4557 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.749482 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749576 4557 flags.go:64] FLAG: --address="0.0.0.0" Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749584 4557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749590 4557 flags.go:64] FLAG: --anonymous-auth="true" Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749595 4557 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749599 4557 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749603 4557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749610 4557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749614 4557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749617 4557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749621 4557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749624 4557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749627 4557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749631 4557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749634 4557 flags.go:64] FLAG: --cgroup-root="" Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749637 4557 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749640 4557 flags.go:64] FLAG: --client-ca-file="" Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749643 4557 flags.go:64] FLAG: --cloud-provider="external" Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749646 4557 flags.go:64] FLAG: --cluster-dns="[]" Oct 31 00:29:45.755966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749649 4557 flags.go:64] FLAG: --cluster-domain="" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749655 4557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749659 4557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749662 4557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749665 4557 flags.go:64] FLAG: --container-log-max-files="5" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749669 4557 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749672 4557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749675 4557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749678 4557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749681 4557 flags.go:64] FLAG: --contention-profiling="false" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749684 4557 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749687 4557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749690 4557 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749693 4557 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749697 4557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749700 4557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749703 4557 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749706 4557 flags.go:64] FLAG: --enable-load-reader="false" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749709 4557 flags.go:64] FLAG: --enable-server="true" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749712 4557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749717 4557 flags.go:64] FLAG: --event-burst="100" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749720 4557 flags.go:64] FLAG: --event-qps="50" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749723 4557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749726 4557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 31 00:29:45.756545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749729 4557 flags.go:64] FLAG: --eviction-hard="" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749733 4557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749736 4557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749739 4557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749742 4557 flags.go:64] FLAG: --eviction-soft="" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749745 4557 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749749 4557 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749752 4557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749755 4557 flags.go:64] FLAG: --experimental-mounter-path="" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749760 4557 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749764 4557 flags.go:64] FLAG: --fail-swap-on="true" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749767 4557 flags.go:64] FLAG: --feature-gates="" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749771 4557 flags.go:64] FLAG: --file-check-frequency="20s" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749774 4557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749777 4557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749780 4557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749783 4557 flags.go:64] FLAG: --healthz-port="10248" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749786 4557 flags.go:64] FLAG: --help="false" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749789 4557 flags.go:64] FLAG: --hostname-override="ip-10-0-131-90.ec2.internal" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749792 4557 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749796 4557 flags.go:64] FLAG: --http-check-frequency="20s" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749799 4557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749802 4557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 31 00:29:45.757160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749805 4557 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749808 4557 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749811 4557 flags.go:64] FLAG: --image-service-endpoint="" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749814 4557 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749817 4557 flags.go:64] FLAG: --kube-api-burst="100" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749820 4557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749823 4557 flags.go:64] FLAG: --kube-api-qps="50" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749826 4557 flags.go:64] FLAG: --kube-reserved="" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749829 4557 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749832 4557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749835 4557 flags.go:64] FLAG: --kubelet-cgroups="" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749837 4557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749841 4557 flags.go:64] FLAG: --lock-file="" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749844 4557 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749847 4557 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749849 4557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749855 4557 flags.go:64] FLAG: --log-json-split-stream="false" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749858 4557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749863 4557 flags.go:64] FLAG: --log-text-split-stream="false" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749866 4557 flags.go:64] FLAG: --logging-format="text" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749869 4557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749873 4557 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749876 4557 flags.go:64] FLAG: --manifest-url="" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749879 4557 flags.go:64] FLAG: --manifest-url-header="" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749883 4557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 31 00:29:45.757931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749886 4557 flags.go:64] FLAG: --max-open-files="1000000" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749890 4557 flags.go:64] FLAG: --max-pods="110" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749893 4557 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749896 4557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749899 4557 flags.go:64] FLAG: --memory-manager-policy="None" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749902 4557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749905 4557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749908 4557 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749911 4557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749918 4557 flags.go:64] FLAG: --node-status-max-images="50" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749921 4557 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749924 4557 flags.go:64] FLAG: --oom-score-adj="-999" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749927 4557 flags.go:64] FLAG: --pod-cidr="" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749930 4557 flags.go:64] FLAG: --pod-manifest-path="" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749933 4557 flags.go:64] FLAG: --pod-max-pids="-1" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749936 4557 flags.go:64] FLAG: --pods-per-core="0" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749939 4557 flags.go:64] FLAG: --port="10250" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749942 4557 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749945 4557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-069c2cd15c7a758dd" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749949 4557 flags.go:64] FLAG: --qos-reserved="" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749952 4557 flags.go:64] FLAG: --read-only-port="10255" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749954 4557 flags.go:64] FLAG: --register-node="true" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749957 4557 flags.go:64] FLAG: --register-with-taints="" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749961 4557 flags.go:64] FLAG: --registry-burst="10" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749964 4557 flags.go:64] FLAG: --registry-qps="5" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749969 4557 flags.go:64] FLAG: --reserved-cpus="" Oct 31 00:29:45.758586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749972 4557 flags.go:64] FLAG: --reserved-memory="" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749976 4557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749979 4557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749982 4557 flags.go:64] FLAG: --rotate-certificates="false" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749985 4557 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749988 4557 flags.go:64] FLAG: --runonce="false" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749991 4557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749994 4557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.749997 4557 flags.go:64] FLAG: --seccomp-default="false" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750000 4557 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750003 4557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750006 4557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750009 4557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750012 4557 flags.go:64] FLAG: --storage-driver-password="root" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750015 4557 flags.go:64] FLAG: --storage-driver-secure="false" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750018 4557 flags.go:64] FLAG: --storage-driver-table="stats" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750020 4557 flags.go:64] FLAG: --storage-driver-user="root" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750023 4557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750026 4557 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750030 4557 flags.go:64] FLAG: --system-cgroups="" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750032 4557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750037 4557 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750040 4557 flags.go:64] FLAG: --tls-cert-file="" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750043 4557 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750046 4557 flags.go:64] FLAG: --tls-min-version="" Oct 31 00:29:45.759222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750049 4557 flags.go:64] FLAG: --tls-private-key-file="" Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750052 4557 flags.go:64] FLAG: --topology-manager-policy="none" Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750054 4557 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750058 4557 flags.go:64] FLAG: --topology-manager-scope="container" Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750061 4557 flags.go:64] FLAG: --v="2" Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750065 4557 flags.go:64] FLAG: --version="false" Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750070 4557 flags.go:64] FLAG: --vmodule="" Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750074 4557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750078 4557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750196 4557 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750201 4557 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750204 4557 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750207 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750210 4557 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750212 4557 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750214 4557 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750217 4557 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750219 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750222 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750225 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750227 4557 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:29:45.759955 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750230 4557 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:29:45.760672 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750232 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:29:45.760672 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750235 4557 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:29:45.760672 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750238 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:29:45.760672 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750240 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:29:45.760672 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750243 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:29:45.760672 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750245 4557 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:29:45.760672 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750248 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:29:45.760672 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750251 4557 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:29:45.760672 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750253 4557 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:29:45.760672 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750256 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:29:45.760672 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750258 4557 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:29:45.760672 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750261 4557 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:29:45.760672 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750264 4557 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:29:45.760672 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750267 4557 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:29:45.760672 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750269 4557 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:29:45.760672 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750272 4557 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:29:45.760672 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750276 4557 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:29:45.760672 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750278 4557 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:29:45.761153 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750281 4557 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:29:45.761153 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750286 4557 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:29:45.761153 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750289 4557 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:29:45.761153 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750293 4557 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:29:45.761153 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750296 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:29:45.761153 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750300 4557 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:29:45.761153 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750304 4557 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:29:45.761153 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750306 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:29:45.761153 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750309 4557 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:29:45.761153 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750312 4557 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:29:45.761153 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750314 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:29:45.761153 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750317 4557 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:29:45.761153 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750319 4557 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:29:45.761153 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750322 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:29:45.761153 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750325 4557 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:29:45.761153 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750327 4557 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:29:45.761153 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750330 4557 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:29:45.761153 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750340 4557 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:29:45.761153 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750343 4557 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:29:45.761153 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750345 4557 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:29:45.761744 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750348 4557 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:29:45.761744 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750350 4557 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:29:45.761744 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750353 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:29:45.761744 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750356 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:29:45.761744 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750358 4557 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:29:45.761744 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750361 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:29:45.761744 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750363 4557 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:29:45.761744 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750366 4557 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:29:45.761744 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750368 4557 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:29:45.761744 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750371 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:29:45.761744 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750375 4557 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:29:45.761744 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750377 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:29:45.761744 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750380 4557 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:29:45.761744 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750383 4557 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:29:45.761744 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750386 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:29:45.761744 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750388 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:29:45.761744 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750391 4557 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:29:45.761744 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750394 4557 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:29:45.761744 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750396 4557 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:29:45.761744 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750412 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:29:45.762234 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750417 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:29:45.762234 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750420 4557 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:29:45.762234 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750424 4557 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:29:45.762234 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750429 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:29:45.762234 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750433 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:29:45.762234 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750435 4557 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:29:45.762234 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750438 4557 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:29:45.762234 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750441 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:29:45.762234 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750444 4557 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:29:45.762234 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750446 4557 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:29:45.762234 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750449 4557 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:29:45.762234 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750451 4557 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:29:45.762234 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750454 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:29:45.762234 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750457 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:29:45.762234 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750459 4557 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:29:45.762234 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750462 4557 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:29:45.762234 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750465 4557 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:29:45.762234 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750467 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:29:45.762234 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750470 4557 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:29:45.762234 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750473 4557 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:29:45.762889 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750475 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:29:45.762889 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750478 4557 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:29:45.762889 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750481 4557 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:29:45.762889 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750484 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:29:45.762889 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750487 4557 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:29:45.762889 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750490 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:29:45.762889 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750492 4557 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:29:45.762889 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750495 4557 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:29:45.762889 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750498 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:29:45.762889 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750501 4557 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:29:45.762889 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750503 4557 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:29:45.762889 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750506 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:29:45.762889 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750508 4557 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:29:45.762889 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750511 4557 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:29:45.762889 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750513 4557 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:29:45.762889 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.750543 4557 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 00:29:45.763432 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750598 4557 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:29:45.763432 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750602 4557 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:29:45.763432 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750605 4557 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:29:45.763432 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750609 4557 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:29:45.763432 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750612 4557 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:29:45.763432 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750615 4557 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:29:45.763432 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750617 4557 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:29:45.763432 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750620 4557 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:29:45.763432 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750622 4557 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:29:45.763432 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750626 4557 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:29:45.763432 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750630 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:29:45.763432 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750633 4557 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:29:45.763432 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750636 4557 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:29:45.763432 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750639 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:29:45.763432 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750641 4557 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:29:45.763432 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750644 4557 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:29:45.763432 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750646 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:29:45.763432 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750649 4557 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:29:45.763432 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750653 4557 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:29:45.763953 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750656 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:29:45.763953 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750658 4557 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:29:45.763953 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750661 4557 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:29:45.763953 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750675 4557 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:29:45.763953 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750678 4557 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:29:45.763953 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750682 4557 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:29:45.763953 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750684 4557 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:29:45.763953 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750687 4557 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:29:45.763953 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750689 4557 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:29:45.763953 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750692 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:29:45.763953 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750695 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:29:45.763953 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750697 4557 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:29:45.763953 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750700 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:29:45.763953 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750704 4557 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:29:45.763953 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750706 4557 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:29:45.763953 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750709 4557 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:29:45.763953 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750711 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:29:45.763953 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750714 4557 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:29:45.763953 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750717 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:29:45.763953 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750719 4557 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:29:45.764490 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750722 4557 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:29:45.764490 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750725 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:29:45.764490 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750727 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:29:45.764490 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750730 4557 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:29:45.764490 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750732 4557 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:29:45.764490 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750735 4557 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:29:45.764490 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750738 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:29:45.764490 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750740 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:29:45.764490 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750742 4557 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:29:45.764490 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750746 4557 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:29:45.764490 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750750 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:29:45.764490 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750755 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:29:45.764490 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750757 4557 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:29:45.764490 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750760 4557 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:29:45.764490 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750763 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:29:45.764490 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750766 4557 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:29:45.764490 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750768 4557 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:29:45.764490 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750771 4557 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:29:45.764490 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750774 4557 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:29:45.764940 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750776 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:29:45.764940 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750779 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:29:45.764940 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750781 4557 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:29:45.764940 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750784 4557 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:29:45.764940 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750787 4557 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:29:45.764940 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750790 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:29:45.764940 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750794 4557 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:29:45.764940 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750797 4557 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:29:45.764940 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750799 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:29:45.764940 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750802 4557 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:29:45.764940 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750804 4557 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:29:45.764940 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750807 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:29:45.764940 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750810 4557 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:29:45.764940 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750812 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:29:45.764940 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750815 4557 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:29:45.764940 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750817 4557 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:29:45.764940 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750820 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:29:45.764940 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750823 4557 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:29:45.764940 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750826 4557 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:29:45.764940 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750828 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:29:45.765438 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750831 4557 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:29:45.765438 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750833 4557 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:29:45.765438 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750836 4557 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:29:45.765438 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750839 4557 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:29:45.765438 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750842 4557 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:29:45.765438 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750845 4557 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:29:45.765438 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750848 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:29:45.765438 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750850 4557 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:29:45.765438 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750853 4557 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:29:45.765438 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750855 4557 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:29:45.765438 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750858 4557 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:29:45.765438 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750860 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:29:45.765438 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750863 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:29:45.765438 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750866 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:29:45.765438 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750868 4557 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:29:45.765438 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750871 4557 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:29:45.765438 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750873 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:29:45.765438 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750876 4557 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:29:45.765438 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750879 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:29:45.765891 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750882 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:29:45.765891 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750885 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:29:45.765891 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750887 4557 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:29:45.765891 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750891 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:29:45.765891 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750893 4557 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:29:45.765891 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750896 4557 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:29:45.765891 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750898 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:29:45.765891 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750901 4557 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:29:45.765891 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.750904 4557 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:29:45.765891 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.755532 4557 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 31 00:29:45.765891 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.755549 4557 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 31 00:29:45.765891 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.755567 4557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 31 00:29:45.765891 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.755572 4557 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 31 00:29:45.765891 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755630 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:29:45.765891 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755635 4557 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:29:45.765891 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755638 4557 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:29:45.765891 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755641 4557 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:29:45.765891 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755643 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:29:45.766321 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755646 4557 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:29:45.766321 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755649 4557 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:29:45.766321 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755652 4557 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:29:45.766321 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755654 4557 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:29:45.766321 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755657 4557 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:29:45.766321 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755659 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:29:45.766321 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755662 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:29:45.766321 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755665 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:29:45.766321 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755667 4557 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:29:45.766321 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755670 4557 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:29:45.766321 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755673 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:29:45.766321 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755676 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:29:45.766321 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755678 4557 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:29:45.766321 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755681 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:29:45.766321 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755684 4557 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:29:45.766321 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755686 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:29:45.766321 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755689 4557 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:29:45.766321 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755692 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:29:45.766321 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755695 4557 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:29:45.766321 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755698 4557 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:29:45.766886 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755701 4557 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:29:45.766886 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755703 4557 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:29:45.766886 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755706 4557 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:29:45.766886 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755709 4557 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:29:45.766886 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755713 4557 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:29:45.766886 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755715 4557 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:29:45.766886 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755718 4557 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:29:45.766886 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755721 4557 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:29:45.766886 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755723 4557 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:29:45.766886 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755726 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:29:45.766886 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755728 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:29:45.766886 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755731 4557 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:29:45.766886 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755733 4557 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:29:45.766886 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755736 4557 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:29:45.766886 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755739 4557 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:29:45.766886 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755741 4557 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:29:45.766886 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755744 4557 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:29:45.766886 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755746 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:29:45.766886 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755749 4557 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:29:45.766886 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755752 4557 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:29:45.767365 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755754 4557 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:29:45.767365 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755758 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:29:45.767365 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755760 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:29:45.767365 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755763 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:29:45.767365 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755766 4557 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:29:45.767365 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755769 4557 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:29:45.767365 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755771 4557 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:29:45.767365 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755774 4557 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:29:45.767365 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755776 4557 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:29:45.767365 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755779 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:29:45.767365 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755782 4557 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:29:45.767365 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755785 4557 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:29:45.767365 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755787 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:29:45.767365 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755790 4557 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:29:45.767365 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755793 4557 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:29:45.767365 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755795 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:29:45.767365 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755799 4557 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:29:45.767365 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755801 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:29:45.767365 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755804 4557 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:29:45.767856 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755807 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:29:45.767856 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755810 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:29:45.767856 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755812 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:29:45.767856 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755815 4557 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:29:45.767856 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755818 4557 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:29:45.767856 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755820 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:29:45.767856 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755823 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:29:45.767856 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755826 4557 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:29:45.767856 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755828 4557 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:29:45.767856 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755831 4557 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:29:45.767856 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755834 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:29:45.767856 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755836 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:29:45.767856 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755839 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:29:45.767856 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755842 4557 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:29:45.767856 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755844 4557 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:29:45.767856 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755848 4557 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:29:45.767856 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755851 4557 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:29:45.767856 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755853 4557 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:29:45.767856 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755856 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:29:45.768678 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755859 4557 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:29:45.768678 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755861 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:29:45.768678 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755864 4557 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:29:45.768678 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755868 4557 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:29:45.768678 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755872 4557 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:29:45.768678 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755875 4557 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:29:45.768678 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755879 4557 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:29:45.768678 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755882 4557 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:29:45.768678 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755885 4557 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:29:45.768678 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755887 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:29:45.768678 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755890 4557 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:29:45.768678 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755893 4557 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:29:45.768678 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755896 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:29:45.768678 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755898 4557 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:29:45.768678 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755901 4557 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:29:45.768678 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755904 4557 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:29:45.768678 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755906 4557 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:29:45.768678 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755909 4557 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:29:45.768678 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755911 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:29:45.769431 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755914 4557 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:29:45.769431 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755918 4557 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:29:45.769431 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755921 4557 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:29:45.769431 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.755924 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:29:45.769431 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.755951 4557 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 00:29:45.769431 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756079 4557 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:29:45.769431 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756084 4557 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:29:45.769431 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756087 4557 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:29:45.769431 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756090 4557 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:29:45.769431 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756092 4557 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:29:45.769431 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756095 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:29:45.769431 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756098 4557 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:29:45.769431 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756101 4557 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:29:45.769431 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756103 4557 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:29:45.769431 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756106 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:29:45.769855 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756109 4557 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:29:45.769855 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756112 4557 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:29:45.769855 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756115 4557 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:29:45.769855 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756117 4557 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:29:45.769855 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756120 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:29:45.769855 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756123 4557 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:29:45.769855 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756126 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:29:45.769855 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756128 4557 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:29:45.769855 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756131 4557 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:29:45.769855 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756134 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:29:45.769855 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756137 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:29:45.769855 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756140 4557 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:29:45.769855 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756142 4557 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:29:45.769855 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756145 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:29:45.769855 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756147 4557 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:29:45.769855 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756150 4557 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:29:45.769855 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756152 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:29:45.769855 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756155 4557 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:29:45.769855 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756157 4557 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:29:45.769855 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756160 4557 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:29:45.770543 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756162 4557 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:29:45.770543 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756165 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:29:45.770543 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756167 4557 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:29:45.770543 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756170 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:29:45.770543 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756172 4557 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:29:45.770543 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756175 4557 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:29:45.770543 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756178 4557 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:29:45.770543 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756180 4557 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:29:45.770543 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756183 4557 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:29:45.770543 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756186 4557 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:29:45.770543 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756189 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:29:45.770543 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756191 4557 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:29:45.770543 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756194 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:29:45.770543 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756197 4557 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:29:45.770543 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756199 4557 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:29:45.770543 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756202 4557 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:29:45.770543 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756204 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:29:45.770543 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756208 4557 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:29:45.770543 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756212 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:29:45.770543 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756215 4557 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:29:45.771019 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756217 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:29:45.771019 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756220 4557 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:29:45.771019 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756223 4557 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:29:45.771019 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756225 4557 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:29:45.771019 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756228 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:29:45.771019 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756231 4557 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:29:45.771019 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756233 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:29:45.771019 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756236 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:29:45.771019 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756238 4557 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:29:45.771019 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756241 4557 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:29:45.771019 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756243 4557 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:29:45.771019 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756246 4557 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:29:45.771019 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756248 4557 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:29:45.771019 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756251 4557 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:29:45.771019 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756253 4557 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:29:45.771019 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756256 4557 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:29:45.771019 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756259 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:29:45.771019 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756261 4557 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:29:45.771019 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756264 4557 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:29:45.771526 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756266 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:29:45.771526 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756269 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:29:45.771526 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756272 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:29:45.771526 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756275 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:29:45.771526 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756277 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:29:45.771526 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756280 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:29:45.771526 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756283 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:29:45.771526 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756285 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:29:45.771526 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756288 4557 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:29:45.771526 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756291 4557 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:29:45.771526 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756293 4557 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:29:45.771526 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756296 4557 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:29:45.771526 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756298 4557 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:29:45.771526 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756302 4557 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:29:45.771526 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756306 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:29:45.771526 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756310 4557 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:29:45.771526 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756313 4557 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:29:45.771526 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756316 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:29:45.771526 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756319 4557 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:29:45.771983 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756322 4557 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:29:45.771983 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756325 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:29:45.771983 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756327 4557 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:29:45.771983 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756330 4557 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:29:45.771983 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756333 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:29:45.771983 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756335 4557 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:29:45.771983 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756338 4557 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:29:45.771983 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756341 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:29:45.771983 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756343 4557 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:29:45.771983 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756345 4557 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:29:45.771983 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756348 4557 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:29:45.771983 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756351 4557 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:29:45.771983 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756353 4557 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:29:45.771983 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756355 4557 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:29:45.771983 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756358 4557 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:29:45.771983 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756360 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:29:45.771983 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756364 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:29:45.771983 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756366 4557 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:29:45.772428 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.756389 4557 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 00:29:45.772428 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756431 4557 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:29:45.772428 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756435 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:29:45.772428 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756438 4557 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:29:45.772428 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756441 4557 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:29:45.772428 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756444 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:29:45.772428 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756446 4557 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:29:45.772428 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756449 4557 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:29:45.772428 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756452 4557 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:29:45.772428 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756454 4557 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:29:45.772428 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756457 4557 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:29:45.772428 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756459 4557 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:29:45.772428 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756462 4557 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:29:45.772428 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756465 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:29:45.772428 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756467 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:29:45.772428 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756470 4557 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:29:45.772846 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756472 4557 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:29:45.772846 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756475 4557 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:29:45.772846 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756478 4557 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:29:45.772846 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756480 4557 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:29:45.772846 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756483 4557 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:29:45.772846 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756486 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:29:45.772846 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756488 4557 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:29:45.772846 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756492 4557 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:29:45.772846 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756496 4557 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:29:45.772846 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756500 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:29:45.772846 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756504 4557 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:29:45.772846 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756508 4557 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:29:45.772846 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756512 4557 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:29:45.772846 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756516 4557 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:29:45.772846 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756520 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:29:45.772846 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756526 4557 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:29:45.772846 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756530 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:29:45.772846 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756533 4557 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:29:45.772846 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756536 4557 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:29:45.772846 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756540 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:29:45.773352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756542 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:29:45.773352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756545 4557 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:29:45.773352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756548 4557 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:29:45.773352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756550 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:29:45.773352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756553 4557 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:29:45.773352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756556 4557 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:29:45.773352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756558 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:29:45.773352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756561 4557 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:29:45.773352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756564 4557 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:29:45.773352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756566 4557 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:29:45.773352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756569 4557 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:29:45.773352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756572 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:29:45.773352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756574 4557 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:29:45.773352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756577 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:29:45.773352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756579 4557 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:29:45.773352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756582 4557 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:29:45.773352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756584 4557 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:29:45.773352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756587 4557 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:29:45.773352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756589 4557 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:29:45.773352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756592 4557 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:29:45.773850 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756595 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:29:45.773850 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756597 4557 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:29:45.773850 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756600 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:29:45.773850 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756602 4557 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:29:45.773850 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756605 4557 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:29:45.773850 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756608 4557 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:29:45.773850 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756611 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:29:45.773850 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756615 4557 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:29:45.773850 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756619 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:29:45.773850 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756625 4557 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:29:45.773850 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756628 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:29:45.773850 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756631 4557 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:29:45.773850 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756633 4557 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:29:45.773850 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756636 4557 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:29:45.773850 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756638 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:29:45.773850 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756641 4557 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:29:45.773850 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756644 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:29:45.773850 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756646 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:29:45.773850 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756649 4557 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:29:45.774564 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756652 4557 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:29:45.774564 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756654 4557 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:29:45.774564 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756657 4557 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:29:45.774564 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756659 4557 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:29:45.774564 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756662 4557 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:29:45.774564 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756665 4557 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:29:45.774564 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756667 4557 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:29:45.774564 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756670 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:29:45.774564 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756673 4557 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:29:45.774564 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756675 4557 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:29:45.774564 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756678 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:29:45.774564 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756680 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:29:45.774564 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756683 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:29:45.774564 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756685 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:29:45.774564 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756688 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:29:45.774564 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756691 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:29:45.774564 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756694 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:29:45.774564 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756696 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:29:45.774564 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756699 4557 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:29:45.775361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756701 4557 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:29:45.775361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756704 4557 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:29:45.775361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756707 4557 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:29:45.775361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756711 4557 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:29:45.775361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756715 4557 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:29:45.775361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756719 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:29:45.775361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756722 4557 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:29:45.775361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756726 4557 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:29:45.775361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756728 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:29:45.775361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756731 4557 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:29:45.775361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756734 4557 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:29:45.775361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756736 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:29:45.775361 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:45.756739 4557 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:29:45.775361 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.756795 4557 server.go:957] "Client rotation is on, will bootstrap in background" Oct 31 00:29:45.775361 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.757731 4557 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 31 00:29:45.775361 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.757781 4557 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 31 00:29:45.775361 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.757952 4557 server.go:1014] "Starting client certificate rotation" Oct 31 00:29:45.775361 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.758087 4557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 31 00:29:45.776142 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.758139 4557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 00:24:05 +0000 UTC" deadline="2028-08-10 09:43:58.268371126 +0000 UTC" Oct 31 00:29:45.776142 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.758174 4557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15585h14m12.510199105s" Oct 31 00:29:45.776142 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.758389 4557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 31 00:29:45.776142 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.759426 4557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 31 00:29:45.776142 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.760934 4557 log.go:25] "Validated CRI v1 runtime API" Oct 31 00:29:45.776142 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.762651 4557 log.go:25] "Validated CRI v1 image API" Oct 31 00:29:45.776142 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.763347 4557 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 31 00:29:45.776142 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.764944 4557 fs.go:135] Filesystem UUIDs: map[088fd590-46cb-4ee8-898e-fa1bd20c910e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 905224ef-804c-439c-9156-897b1fffa6ee:/dev/nvme0n1p3] Oct 31 00:29:45.776623 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.764965 4557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/05a6fae4f0c2d528763c61e72248343035dbd91b5a4c8d19d5a8017c7d7e4ca4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/05a6fae4f0c2d528763c61e72248343035dbd91b5a4c8d19d5a8017c7d7e4ca4/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0c9d9e26fbf83d27da5653abd677908bef35d8cc75f875673fee15bd56dbf95b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0c9d9e26fbf83d27da5653abd677908bef35d8cc75f875673fee15bd56dbf95b/userdata/shm major:0 minor:216 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2d176be3b8ad8b13b103c4c25f84c98979707788e4bf135eb410d5ed757c923b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2d176be3b8ad8b13b103c4c25f84c98979707788e4bf135eb410d5ed757c923b/userdata/shm major:0 minor:83 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/33acb70d189cfce59ef4ab9d7905426939d52a7b20aeafb5af8b5f4f910383ae/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/33acb70d189cfce59ef4ab9d7905426939d52a7b20aeafb5af8b5f4f910383ae/userdata/shm major:0 minor:202 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3bffdfec1899b046e81a94bd11fd454fdbf030d95f4a0310bf5afa90771e4ca7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3bffdfec1899b046e81a94bd11fd454fdbf030d95f4a0310bf5afa90771e4ca7/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6011bbc3ec404cd597ed4c6dafabfbf6c7be88d089d628a1e9099f24ec54e8d6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6011bbc3ec404cd597ed4c6dafabfbf6c7be88d089d628a1e9099f24ec54e8d6/userdata/shm major:0 minor:220 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6a74b46d566d947ea3c1c76bba79d4d116678b3ccd86afaf6f6ea0552b898cd6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6a74b46d566d947ea3c1c76bba79d4d116678b3ccd86afaf6f6ea0552b898cd6/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6b1c1b90ac87f9ca4ef74f4f2463dddd4aaa82c58ffdc6d8ac97502350b5b598/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6b1c1b90ac87f9ca4ef74f4f2463dddd4aaa82c58ffdc6d8ac97502350b5b598/userdata/shm major:0 minor:230 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/81a0107b1569584cd86d51f80c323dbd711bfe30d92e64bdf7e6010d0e8fbb99/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/81a0107b1569584cd86d51f80c323dbd711bfe30d92e64bdf7e6010d0e8fbb99/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c66d4783dba85c7977a61bb94ff211f46abfabb2eeec19e6363388e5be695100/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c66d4783dba85c7977a61bb94ff211f46abfabb2eeec19e6363388e5be695100/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c8278c6d1f5d07babd0d1eab57ba7174bc0b476c2431eec78143cbc3808c855e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c8278c6d1f5d07babd0d1eab57ba7174bc0b476c2431eec78143cbc3808c855e/userdata/shm major:0 minor:96 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e1ec842d0ebe83c4ebcbd4a5d854be9141398f2cd36e0e866d24af8bf05174f1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e1ec842d0ebe83c4ebcbd4a5d854be9141398f2cd36e0e866d24af8bf05174f1/userdata/shm major:0 minor:92 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e807bc96b27ed8944bebe9f12a13e530aecf4b0aa93cbb1b2f675645bc15be20/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e807bc96b27ed8944bebe9f12a13e530aecf4b0aa93cbb1b2f675645bc15be20/userdata/shm major:0 minor:218 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ec90db55df227da240ad2e4b0c733dadf744b0f3e9406c5b11345c20c65f1f54/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ec90db55df227da240ad2e4b0c733dadf744b0f3e9406c5b11345c20c65f1f54/userdata/shm major:0 minor:233 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f1eee17fff7498d26c950d9bd44b717fc14da4697b84dc174523561642120c08/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f1eee17fff7498d26c950d9bd44b717fc14da4697b84dc174523561642120c08/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f95cec2d18239966c0271e0de042d406263b703f3663251e76de73ba38cd0865/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f95cec2d18239966c0271e0de042d406263b703f3663251e76de73ba38cd0865/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/031b50be-28d6-4dcc-89e4-99e9558738f2/volumes/kubernetes.io~projected/kube-api-access-s87w5:{mountpoint:/var/lib/kubelet/pods/031b50be-28d6-4dcc-89e4-99e9558738f2/volumes/kubernetes.io~projected/kube-api-access-s87w5 major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/031b50be-28d6-4dcc-89e4-99e9558738f2/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/031b50be-28d6-4dcc-89e4-99e9558738f2/volumes/kubernetes.io~secret/signing-key major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7/volumes/kubernetes.io~projected/kube-api-access-txp8g:{mountpoint:/var/lib/kubelet/pods/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7/volumes/kubernetes.io~projected/kube-api-access-txp8g major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/13a9c69b-60c2-4c1d-a77c-5b56b234729c/volumes/kubernetes.io~projected/kube-api-access-xmc22:{mountpoint:/var/lib/kubelet/pods/13a9c69b-60c2-4c1d-a77c-5b56b234729c/volumes/kubernetes.io~projected/kube-api-access-xmc22 major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/177f7e75-1990-4afa-9740-6f3e0665b311/volumes/kubernetes.io~projected/kube-api-access-lv6qc:{mountpoint:/var/lib/kubelet/pods/177f7e75-1990-4afa-9740-6f3e0665b311/volumes/kubernetes.io~projected/kube-api-access-lv6qc major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/33de1dca-4062-4401-9d55-af069d8874f3/volumes/kubernetes.io~projected/kube-api-access-gb75l:{mountpoint:/var/lib/kubelet/pods/33de1dca-4062-4401-9d55-af069d8874f3/volumes/kubernetes.io~projected/kube-api-access-gb75l major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/671b2592-db78-4be6-9a9c-83ade9a48bce/volumes/kubernetes.io~projected/kube-api-access-hrwq7:{mountpoint:/var/lib/kubelet/pods/671b2592-db78-4be6-9a9c-83ade9a48bce/volumes/kubernetes.io~projected/kube-api-access-hrwq7 major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d/volumes/kubernetes.io~empty-dir/tmp major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d/volumes/kubernetes.io~projected/kube-api-access-6lgpc:{mountpoint:/var/lib/kubelet/pods/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d/volumes/kubernetes.io~projected/kube-api-access-6lgpc major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7340ba78-0fa3-4677-95b4-9dada26be5a5/volumes/kubernetes.io~projected/kube-api-access-c78pb:{mountpoint:/var/lib/kubelet/pods/7340ba78-0fa3-4677-95b4-9dada26be5a5/volumes/kubernetes.io~projected/kube-api-access-c78pb major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/758d2e0b-39da-418e-9e35-2c817915ebce/volumes/kubernetes.io~projected/kube-api-access-sfltg:{mountpoint:/var/lib/kubelet/pods/758d2e0b-39da-418e-9e35-2c817915ebce/volumes/kubernetes.io~projected/kube-api-access-sfltg major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e87fd11-4685-4e33-8230-b6b53747c9a9/volumes/kubernetes.io~projected/kube-api-access-pfkv4:{mountpoint:/var/lib/kubelet/pods/7e87fd11-4685-4e33-8230-b6b53747c9a9/volumes/kubernetes.io~projected/kube-api-access-pfkv4 major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8597a843-682b-45d5-9e4a-da5fff7573a1/volumes/kubernetes.io~projected/kube-api-access-qcrwb:{mountpoint:/var/lib/kubelet/pods/8597a843-682b-45d5-9e4a-da5fff7573a1/volumes/kubernetes.io~projected/kube-api-access-qcrwb major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/85b085b5-122b-4fed-9b61-ea83fd294c9f/volumes/kubernetes.io~projected/kube-api-access-lfbxg:{mountpoint:/var/lib/kubelet/pods/85b085b5-122b-4fed-9b61-ea83fd294c9f/volumes/kubernetes.io~projected/kube-api-access-lfbxg major:0 minor:232 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/92956936-d054-482d-a78a-784cf0eeeeb3/volumes/kubernetes.io~projected/kube-api-access-rsgjr:{mountpoint:/var/lib/kubelet/pods/92956936-d054-482d-a78a-784cf0eeeeb3/volumes/kubernetes.io~projected/kube-api-access-rsgjr major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bdd36c3c-acec-474f-b4aa-27ae4490c39b/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/bdd36c3c-acec-474f-b4aa-27ae4490c39b/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f/volumes/kubernetes.io~projected/kube-api-access-8lc56:{mountpoint:/var/lib/kubelet/pods/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f/volumes/kubernetes.io~projected/kube-api-access-8lc56 major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d402f509-6848-43fb-bedd-2d82bfceb0c2/volumes/kubernetes.io~projected/kube-api-access-wxhhb:{mountpoint:/var/lib/kubelet/pods/d402f509-6848-43fb-bedd-2d82bfceb0c2/volumes/kubernetes.io~projected/kube-api-access-wxhhb major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d8e4f707-7f3f-4081-9ad9-df7e33efb927/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/d8e4f707-7f3f-4081-9ad9-df7e33efb927/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f47d176e-65b0-49d3-a77a-f593c25c65fa/volumes/kubernetes.io~projected/kube-api-access-lgmhd:{mountpoint:/var/lib/kubelet/pods/f47d176e-65b0-49d3-a77a-f593c25c65fa/volumes/kubernetes.io~projected/kube-api-access-lgmhd major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f47d176e-65b0-49d3-a77a-f593c25c65fa/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/f47d176e-65b0-49d3-a77a-f593c25c65fa/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/4b7a8ec0c9fd6003083541ec829e7d2b2b3f3d4a9757c9ecfd1daf4a5d9563fb/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/179350f2541a7588265e5518d8803f970c89c9b6c272414b8cd3767718cfae5b/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-105:{mountpoint:/var/lib/containers/storage/overlay/df14bac3a43ecd0d345e2f43fdbe7de7a645824897e9364d742032de084b8d39/merged major:0 minor:105 fsType:overlay blockSize:0} overlay_0-107:{mountpoint:/var/lib/containers/storage/overlay/e85c3d9a5e6e23103fb9e3d8e612d1547359a2578b9aad75aecf501b8df71cb3/merged major:0 minor:107 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/12dfba43e6e69641c43b71cfe626d4382309e6dffc52a2cbae85ca41a276018c/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/84ab6a26ddc3aed39b010cc67b455cdcdebd073a812b2eddcf155c1bf8d37b12/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/008d55449516d8e23895e07f0f0159763c0ceb3b0b1e2035f1ab3b1195be4bd4/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/fec8a49ea5cbde8410d2a95e4a1de3510c8ef81e251f41cc280604884f945e42/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/3e28979aa3c3dbd52d7b1509926aa056e6822ce752f964cbfc34166780a203f1/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/14d029af560a22bb55096c62fff5bb9fcc509b43a6820916ad2f51f4a4720200/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/63d5dc63b4517bfa4b2f1ed79ad78aa1d107dce2651aba7a083443e558cd9261/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-143:{mountpoint:/var/lib/containers/storage/overlay/ee369b27c57e8ebcc2faa270af2f1c94bfb8bed223d71b4b14d2f827a46e4c2b/merged major:0 minor:143 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/9abfc199de4d7932238f2ea0033dbd52db76e0ee22b211a7f7dd610bfe974816/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/f9ddf88dcbf42c7b160cf88e3c0461ebe0bbe99e30d8cf8142f1ed09e0ff7b02/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/e30d94c74dae7e63b9abb85a963386bcb3177aecd96df7c7a09e80955bf56a5c/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/2091c6ad1794cf410ddce132a654fb341b7cff3479c49d2ee5f671820d19c989/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/6c2a05278760d13fea06e9cc135cc15e229c844c14b730655b348005a1a4dcfe/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-174:{mountpoint:/var/lib/containers/storage/overlay/bf1802c985a8194b769fd9414a54e90c0643338844a840d8fb5f91733a56109e/merged major:0 minor:174 fsType:overlay blockSize:0} overlay_0-179:{mountpoint:/var/lib/containers/storage/overlay/8ef5ea118267fcfcba66fcb3cc6611bee66984fdb46f4755623c90ac7ed83d21/merged major:0 minor:179 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/54cdea6c64fc722c505162d0f1b4792deedeaf05a3c3704b81600982e9ef2ac6/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/3972cbefe93f8feb41ee7ea3daf0e0fedaf169ac5e30f1d3a32758450aaa49ca/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-204:{mountpoint:/var/lib/containers/storage/overlay/e8a17e09a06fad4fd9b3f0eeda9c77a8499e1dc6f4e3c36a93744f244049f6dd/merged major:0 minor:204 fsType:overlay blockSize:0} overlay_0-208:{mountpoint:/var/lib/containers/storage/overlay/2a24a36f5625d914d745672339b76a4ccbe45e4f87275951ecf00d1c083fdb45/merged major:0 minor:208 fsType:overlay blockSize:0} overlay_0-222:{mountpoint:/var/lib/containers/storage/overlay/4009c0eac86a2039809c87ed6b9510a72dbdc26203aa88015040f0ae5f55f958/merged major:0 minor:222 fsType:overlay blockSize:0} overlay_0-224:{mountpoint:/var/lib/containers/storage/overlay/9909057fcc7f6579cf2e16f07097f0a4fcaa375d285a7c5885bd38ad6ace963e/merged major:0 minor:224 fsType:overlay blockSize:0} overlay_0-228:{mountpoint:/var/lib/containers/storage/overlay/356eed00bf1a54d9bfcbf3bd6bbebb7d82b4563ed5be3c507451d12e8f2e8345/merged major:0 minor:228 fsType:overlay blockSize:0} overlay_0-235:{mountpoint:/var/lib/containers/storage/overlay/1f154119730c534796d4d64f45272edeb6bd634b5b123247507a1b6d8913f03b/merged major:0 minor:235 fsType:overlay blockSize:0} overlay_0-237:{mountpoint:/var/lib/containers/storage/overlay/c331f550a11a90bcc2f987208f09fb5f85d659d269233b742057454ab60cafa3/merged major:0 minor:237 fsType:overlay blockSize:0} overlay_0-239:{mountpoint:/var/lib/containers/storage/overlay/7a20a795a8c83f5d2b4935513aef1ffe5e904e74d291cf371fc808a76407af9a/merged major:0 minor:239 fsType:overlay blockSize:0} overlay_0-241:{mountpoint:/var/lib/containers/storage/overlay/17212f92fc04bec90c0bf0f5b98c5b0ab45521ad72661eb778c0e91e745e8cd6/merged major:0 minor:241 fsType:overlay blockSize:0} overlay_0-247:{mountpoint:/var/lib/containers/storage/overlay/a2a64e9fef91ea2a5c498fccd63891c13f6b4387713e3e0fd211fe95fd97b62a/merged major:0 minor:247 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/1f4667ed8418bce7ca79a66eab2072a1c29bd8aff997d5e9e70265a691b27bd8/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-259:{mountpoint:/var/lib/containers/storage/overlay/3b080d51480bf9c3c3616ba77be2095fd8eff29e4399b347e8b8bcb9a2fcfe79/merged major:0 minor:259 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/2cb0c3b5ee1531bb49c66c67be79d8b7e8f8847865a2fe2986b1ccdff694b23b/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/a64e282d4184902ccacc89afb7aa8e2d145b2f0e029eb55db49dcc7da5fcd53d/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/5c2848aec14ee260aa855b40e6d8283a0ff9eb899456c30041c59d5b8c254236/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/401149ce8da8cb959a3b6d8b2484d4a1643679254bbed39ae782379b9bcc88a4/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/992cd7e8f7afa67acdcc34ff67a1aacf55b8cb48097e79808e49d4f0706967c5/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/7c4b98a78e2b0c7e1d5b06333f0c97c8d50df3727258cf3e41e31de28b337538/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/939472a79517f51e16a0d3fbf0bfcad8efd8bcaf7d0db0d095f43e090a2106ca/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/4682270fc62c1aee9f0106bc413d7f7f46fe9930315799035236f606cc4f21a1/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/f3f732694222de47675b26375069277629c591f39ec8101773b42b853c7608d1/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-98:{mountpoint:/var/lib/containers/storage/overlay/2d71bc1200520c39e65f41191064800bc0e826b53ccce3e9babc0701208dd381/merged major:0 minor:98 fsType:overlay blockSize:0}] Oct 31 00:29:45.776859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.772759 4557 manager.go:217] Machine: {Timestamp:2026-10-31 00:29:45.772270557 +0000 UTC m=+0.054800902 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098017 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec299f2ba534d82310d7400151fda92d SystemUUID:ec299f2b-a534-d823-10d7-400151fda92d BootID:9a3bc226-f53e-4400-bda6-e916605031c0 Filesystems:[{Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d/volumes/kubernetes.io~projected/kube-api-access-6lgpc DeviceMajor:0 DeviceMinor:62 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/92956936-d054-482d-a78a-784cf0eeeeb3/volumes/kubernetes.io~projected/kube-api-access-rsgjr DeviceMajor:0 DeviceMinor:67 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c66d4783dba85c7977a61bb94ff211f46abfabb2eeec19e6363388e5be695100/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-241 DeviceMajor:0 DeviceMinor:241 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/671b2592-db78-4be6-9a9c-83ade9a48bce/volumes/kubernetes.io~projected/kube-api-access-hrwq7 DeviceMajor:0 DeviceMinor:61 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/031b50be-28d6-4dcc-89e4-99e9558738f2/volumes/kubernetes.io~projected/kube-api-access-s87w5 DeviceMajor:0 DeviceMinor:227 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ec90db55df227da240ad2e4b0c733dadf744b0f3e9406c5b11345c20c65f1f54/userdata/shm DeviceMajor:0 DeviceMinor:233 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-235 DeviceMajor:0 DeviceMinor:235 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-247 DeviceMajor:0 DeviceMinor:247 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/81a0107b1569584cd86d51f80c323dbd711bfe30d92e64bdf7e6010d0e8fbb99/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-143 DeviceMajor:0 DeviceMinor:143 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7340ba78-0fa3-4677-95b4-9dada26be5a5/volumes/kubernetes.io~projected/kube-api-access-c78pb DeviceMajor:0 DeviceMinor:206 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6011bbc3ec404cd597ed4c6dafabfbf6c7be88d089d628a1e9099f24ec54e8d6/userdata/shm DeviceMajor:0 DeviceMinor:220 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/d402f509-6848-43fb-bedd-2d82bfceb0c2/volumes/kubernetes.io~projected/kube-api-access-wxhhb DeviceMajor:0 DeviceMinor:66 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-228 DeviceMajor:0 DeviceMinor:228 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6b1c1b90ac87f9ca4ef74f4f2463dddd4aaa82c58ffdc6d8ac97502350b5b598/userdata/shm DeviceMajor:0 DeviceMinor:230 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/85b085b5-122b-4fed-9b61-ea83fd294c9f/volumes/kubernetes.io~projected/kube-api-access-lfbxg DeviceMajor:0 DeviceMinor:232 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c8278c6d1f5d07babd0d1eab57ba7174bc0b476c2431eec78143cbc3808c855e/userdata/shm DeviceMajor:0 DeviceMinor:96 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-107 DeviceMajor:0 DeviceMinor:107 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f47d176e-65b0-49d3-a77a-f593c25c65fa/volumes/kubernetes.io~projected/kube-api-access-lgmhd DeviceMajor:0 DeviceMinor:201 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f/volumes/kubernetes.io~projected/kube-api-access-8lc56 DeviceMajor:0 DeviceMinor:210 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:56 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:58 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6a74b46d566d947ea3c1c76bba79d4d116678b3ccd86afaf6f6ea0552b898cd6/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bdd36c3c-acec-474f-b4aa-27ae4490c39b/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:207 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2d176be3b8ad8b13b103c4c25f84c98979707788e4bf135eb410d5ed757c923b/userdata/shm DeviceMajor:0 DeviceMinor:83 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-204 DeviceMajor:0 DeviceMinor:204 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0c9d9e26fbf83d27da5653abd677908bef35d8cc75f875673fee15bd56dbf95b/userdata/shm DeviceMajor:0 DeviceMinor:216 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-237 DeviceMajor:0 DeviceMinor:237 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-179 DeviceMajor:0 DeviceMinor:179 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/13a9c69b-60c2-4c1d-a77c-5b56b234729c/volumes/kubernetes.io~projected/kube-api-access-xmc22 DeviceMajor:0 DeviceMinor:197 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-259 DeviceMajor:0 DeviceMinor:259 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f1eee17fff7498d26c950d9bd44b717fc14da4697b84dc174523561642120c08/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7e87fd11-4685-4e33-8230-b6b53747c9a9/volumes/kubernetes.io~projected/kube-api-access-pfkv4 DeviceMajor:0 DeviceMinor:211 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/8597a843-682b-45d5-9e4a-da5fff7573a1/volumes/kubernetes.io~projected/kube-api-access-qcrwb DeviceMajor:0 DeviceMinor:63 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f47d176e-65b0-49d3-a77a-f593c25c65fa/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/031b50be-28d6-4dcc-89e4-99e9558738f2/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:226 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/05a6fae4f0c2d528763c61e72248343035dbd91b5a4c8d19d5a8017c7d7e4ca4/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-105 DeviceMajor:0 DeviceMinor:105 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-208 DeviceMajor:0 DeviceMinor:208 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e807bc96b27ed8944bebe9f12a13e530aecf4b0aa93cbb1b2f675645bc15be20/userdata/shm DeviceMajor:0 DeviceMinor:218 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-224 DeviceMajor:0 DeviceMinor:224 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d8e4f707-7f3f-4081-9ad9-df7e33efb927/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:57 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/758d2e0b-39da-418e-9e35-2c817915ebce/volumes/kubernetes.io~projected/kube-api-access-sfltg DeviceMajor:0 DeviceMinor:59 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7/volumes/kubernetes.io~projected/kube-api-access-txp8g DeviceMajor:0 DeviceMinor:65 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-174 DeviceMajor:0 DeviceMinor:174 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/33de1dca-4062-4401-9d55-af069d8874f3/volumes/kubernetes.io~projected/kube-api-access-gb75l DeviceMajor:0 DeviceMinor:60 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/33acb70d189cfce59ef4ab9d7905426939d52a7b20aeafb5af8b5f4f910383ae/userdata/shm DeviceMajor:0 DeviceMinor:202 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-222 DeviceMajor:0 DeviceMinor:222 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/177f7e75-1990-4afa-9740-6f3e0665b311/volumes/kubernetes.io~projected/kube-api-access-lv6qc DeviceMajor:0 DeviceMinor:64 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f95cec2d18239966c0271e0de042d406263b703f3663251e76de73ba38cd0865/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e1ec842d0ebe83c4ebcbd4a5d854be9141398f2cd36e0e866d24af8bf05174f1/userdata/shm DeviceMajor:0 DeviceMinor:92 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-98 DeviceMajor:0 DeviceMinor:98 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-239 DeviceMajor:0 DeviceMinor:239 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3bffdfec1899b046e81a94bd11fd454fdbf030d95f4a0310bf5afa90771e4ca7/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0c9d9e26fbf83d2 MacAddress:aa:69:02:af:e2:22 Speed:10000 Mtu:8901} {Name:33acb70d189cfce MacAddress:52:2e:64:87:83:ad Speed:10000 Mtu:8901} {Name:6011bbc3ec404cd MacAddress:3e:9b:f2:db:16:00 Speed:10000 Mtu:8901} {Name:6b1c1b90ac87f9c MacAddress:d6:25:b9:8d:38:fc Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:c7:76:b9:69 Speed:0 Mtu:9001} {Name:br-int MacAddress:9e:09:9d:a4:2b:e2 Speed:0 Mtu:8901} {Name:e807bc96b27ed89 MacAddress:de:64:59:58:c0:cf Speed:10000 Mtu:8901} {Name:ec90db55df227da MacAddress:9a:02:94:8a:59:9f Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:c7:76:b9:69 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:56:58:a1:22:6e:26 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:c2:47:5c:c7:57:0b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 31 00:29:45.776859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.773053 4557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 31 00:29:45.776859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.773095 4557 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 31 00:29:45.776859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.773421 4557 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 31 00:29:45.776859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.773441 4557 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-90.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 31 00:29:45.776859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.773559 4557 topology_manager.go:143] "Creating topology manager with none policy" Oct 31 00:29:45.776859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.773566 4557 container_manager_linux.go:311] "Creating device plugin manager" Oct 31 00:29:45.776859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.773577 4557 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 31 00:29:45.776859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.773596 4557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 31 00:29:45.776859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.773681 4557 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 31 00:29:45.776859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.773831 4557 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 31 00:29:45.776859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.773955 4557 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 31 00:29:45.776859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.773992 4557 kubelet.go:493] "Attempting to sync node with API server" Oct 31 00:29:45.776859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.774006 4557 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 31 00:29:45.776859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.774015 4557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 31 00:29:45.776859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.774023 4557 kubelet.go:405] "Adding apiserver pod source" Oct 31 00:29:45.776859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.774031 4557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 31 00:29:45.776859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.774798 4557 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 31 00:29:45.776859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.774810 4557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 31 00:29:45.776859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.775298 4557 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 31 00:29:45.777882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.777249 4557 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 31 00:29:45.777882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.777258 4557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 31 00:29:45.777882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.777362 4557 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 31 00:29:45.777882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.777590 4557 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 31 00:29:45.777882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.777618 4557 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 31 00:29:45.777882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.777718 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 31 00:29:45.777882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.777730 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 31 00:29:45.777882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.777736 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 31 00:29:45.777882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.777742 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 31 00:29:45.777882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.777747 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 31 00:29:45.777882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.777754 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 31 00:29:45.777882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.777764 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 31 00:29:45.777882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.777772 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 31 00:29:45.777882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.777782 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 31 00:29:45.777882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.777788 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 31 00:29:45.777882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.777796 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 31 00:29:45.777882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.777805 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 31 00:29:45.777882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.777832 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 31 00:29:45.777882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.777841 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 31 00:29:45.781098 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.781084 4557 server.go:1263] "Started kubelet" Oct 31 00:29:45.781162 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.781137 4557 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 31 00:29:45.781240 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.781175 4557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 31 00:29:45.781300 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.781261 4557 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 31 00:29:45.781574 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.781556 4557 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 31 00:29:45.781648 ip-10-0-131-90 systemd[1]: Started Kubernetes Kubelet. Oct 31 00:29:45.782792 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.782771 4557 server.go:317] "Adding debug handlers to kubelet server" Oct 31 00:29:45.790262 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.790237 4557 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 31 00:29:45.790354 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.790273 4557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 31 00:29:45.792449 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.790375 4557 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 31 00:29:45.792449 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.790398 4557 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 31 00:29:45.792449 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.790368 4557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 00:24:10 +0000 UTC" deadline="2028-05-17 17:23:14.703814527 +0000 UTC" Oct 31 00:29:45.792449 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:29:45.790396 4557 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-90.ec2.internal\" not found" Oct 31 00:29:45.792449 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.790440 4557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13552h53m28.913380248s" Oct 31 00:29:45.792449 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.790501 4557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 31 00:29:45.792449 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.791587 4557 factory.go:55] Registering systemd factory Oct 31 00:29:45.792449 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.791604 4557 factory.go:223] Registration of the systemd container factory successfully Oct 31 00:29:45.792449 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.791879 4557 factory.go:153] Registering CRI-O factory Oct 31 00:29:45.792449 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.791897 4557 factory.go:223] Registration of the crio container factory successfully Oct 31 00:29:45.792449 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.791957 4557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 31 00:29:45.792449 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.791994 4557 factory.go:103] Registering Raw factory Oct 31 00:29:45.792449 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792014 4557 manager.go:1199] Started watching for new ooms in manager Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792691 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="13a9c69b-60c2-4c1d-a77c-5b56b234729c" volumeName="kubernetes.io/projected/13a9c69b-60c2-4c1d-a77c-5b56b234729c-kube-api-access-xmc22" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792726 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="758d2e0b-39da-418e-9e35-2c817915ebce" volumeName="kubernetes.io/configmap/758d2e0b-39da-418e-9e35-2c817915ebce-serviceca" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792743 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8597a843-682b-45d5-9e4a-da5fff7573a1" volumeName="kubernetes.io/projected/8597a843-682b-45d5-9e4a-da5fff7573a1-kube-api-access-qcrwb" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792759 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="031b50be-28d6-4dcc-89e4-99e9558738f2" volumeName="kubernetes.io/projected/031b50be-28d6-4dcc-89e4-99e9558738f2-kube-api-access-s87w5" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792773 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7" volumeName="kubernetes.io/configmap/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-env-overrides" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792787 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="671e4bc9-b45d-41f0-ab5c-0b40b7742a8d" volumeName="kubernetes.io/empty-dir/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-tuned" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792800 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8597a843-682b-45d5-9e4a-da5fff7573a1" volumeName="kubernetes.io/configmap/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-daemon-config" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792814 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8597a843-682b-45d5-9e4a-da5fff7573a1" volumeName="kubernetes.io/configmap/8597a843-682b-45d5-9e4a-da5fff7573a1-cni-binary-copy" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792831 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f47d176e-65b0-49d3-a77a-f593c25c65fa" volumeName="kubernetes.io/secret/f47d176e-65b0-49d3-a77a-f593c25c65fa-cert" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792840 4557 manager.go:319] Starting recovery of all containers Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792843 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="031b50be-28d6-4dcc-89e4-99e9558738f2" volumeName="kubernetes.io/secret/031b50be-28d6-4dcc-89e4-99e9558738f2-signing-key" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792856 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="177f7e75-1990-4afa-9740-6f3e0665b311" volumeName="kubernetes.io/configmap/177f7e75-1990-4afa-9740-6f3e0665b311-cni-binary-copy" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792874 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33de1dca-4062-4401-9d55-af069d8874f3" volumeName="kubernetes.io/empty-dir/33de1dca-4062-4401-9d55-af069d8874f3-tmp-dir" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792885 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33de1dca-4062-4401-9d55-af069d8874f3" volumeName="kubernetes.io/projected/33de1dca-4062-4401-9d55-af069d8874f3-kube-api-access-gb75l" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792898 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="671b2592-db78-4be6-9a9c-83ade9a48bce" volumeName="kubernetes.io/projected/671b2592-db78-4be6-9a9c-83ade9a48bce-kube-api-access-hrwq7" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792913 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f" volumeName="kubernetes.io/configmap/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-trusted-ca-bundle" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792924 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="671e4bc9-b45d-41f0-ab5c-0b40b7742a8d" volumeName="kubernetes.io/projected/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-kube-api-access-6lgpc" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792935 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bdd36c3c-acec-474f-b4aa-27ae4490c39b" volumeName="kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792948 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d8e4f707-7f3f-4081-9ad9-df7e33efb927" volumeName="kubernetes.io/configmap/d8e4f707-7f3f-4081-9ad9-df7e33efb927-konnectivity-ca" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792961 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="031b50be-28d6-4dcc-89e4-99e9558738f2" volumeName="kubernetes.io/configmap/031b50be-28d6-4dcc-89e4-99e9558738f2-signing-cabundle" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792973 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7" volumeName="kubernetes.io/configmap/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-ovnkube-config" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792984 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="671e4bc9-b45d-41f0-ab5c-0b40b7742a8d" volumeName="kubernetes.io/empty-dir/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-tmp" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.792995 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e87fd11-4685-4e33-8230-b6b53747c9a9" volumeName="kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793008 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="85b085b5-122b-4fed-9b61-ea83fd294c9f" volumeName="kubernetes.io/projected/85b085b5-122b-4fed-9b61-ea83fd294c9f-kube-api-access-lfbxg" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793027 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d8e4f707-7f3f-4081-9ad9-df7e33efb927" volumeName="kubernetes.io/secret/d8e4f707-7f3f-4081-9ad9-df7e33efb927-agent-certs" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793038 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7" volumeName="kubernetes.io/secret/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-ovn-node-metrics-cert" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793051 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="13a9c69b-60c2-4c1d-a77c-5b56b234729c" volumeName="kubernetes.io/configmap/13a9c69b-60c2-4c1d-a77c-5b56b234729c-config-volume" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793064 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="177f7e75-1990-4afa-9740-6f3e0665b311" volumeName="kubernetes.io/configmap/177f7e75-1990-4afa-9740-6f3e0665b311-cni-sysctl-allowlist" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793074 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="177f7e75-1990-4afa-9740-6f3e0665b311" volumeName="kubernetes.io/projected/177f7e75-1990-4afa-9740-6f3e0665b311-kube-api-access-lv6qc" seLinuxMountContext="" Oct 31 00:29:45.793077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793092 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92956936-d054-482d-a78a-784cf0eeeeb3" volumeName="kubernetes.io/configmap/92956936-d054-482d-a78a-784cf0eeeeb3-iptables-alerter-script" seLinuxMountContext="" Oct 31 00:29:45.795748 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793105 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="177f7e75-1990-4afa-9740-6f3e0665b311" volumeName="kubernetes.io/configmap/177f7e75-1990-4afa-9740-6f3e0665b311-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 31 00:29:45.795748 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793117 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7340ba78-0fa3-4677-95b4-9dada26be5a5" volumeName="kubernetes.io/empty-dir/7340ba78-0fa3-4677-95b4-9dada26be5a5-data-volume" seLinuxMountContext="" Oct 31 00:29:45.795748 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793128 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7340ba78-0fa3-4677-95b4-9dada26be5a5" volumeName="kubernetes.io/projected/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-api-access-c78pb" seLinuxMountContext="" Oct 31 00:29:45.795748 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793139 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="758d2e0b-39da-418e-9e35-2c817915ebce" volumeName="kubernetes.io/projected/758d2e0b-39da-418e-9e35-2c817915ebce-kube-api-access-sfltg" seLinuxMountContext="" Oct 31 00:29:45.795748 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793151 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f" volumeName="kubernetes.io/projected/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-kube-api-access-8lc56" seLinuxMountContext="" Oct 31 00:29:45.795748 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793163 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d402f509-6848-43fb-bedd-2d82bfceb0c2" volumeName="kubernetes.io/projected/d402f509-6848-43fb-bedd-2d82bfceb0c2-kube-api-access-wxhhb" seLinuxMountContext="" Oct 31 00:29:45.795748 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793180 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f47d176e-65b0-49d3-a77a-f593c25c65fa" volumeName="kubernetes.io/projected/f47d176e-65b0-49d3-a77a-f593c25c65fa-kube-api-access-lgmhd" seLinuxMountContext="" Oct 31 00:29:45.795748 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793192 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="13a9c69b-60c2-4c1d-a77c-5b56b234729c" volumeName="kubernetes.io/empty-dir/13a9c69b-60c2-4c1d-a77c-5b56b234729c-tmp-dir" seLinuxMountContext="" Oct 31 00:29:45.795748 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793205 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92956936-d054-482d-a78a-784cf0eeeeb3" volumeName="kubernetes.io/projected/92956936-d054-482d-a78a-784cf0eeeeb3-kube-api-access-rsgjr" seLinuxMountContext="" Oct 31 00:29:45.795748 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793216 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f" volumeName="kubernetes.io/configmap/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-service-ca-bundle" seLinuxMountContext="" Oct 31 00:29:45.795748 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793226 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f" volumeName="kubernetes.io/empty-dir/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-archives-path" seLinuxMountContext="" Oct 31 00:29:45.795748 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793240 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7" volumeName="kubernetes.io/configmap/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-ovnkube-script-lib" seLinuxMountContext="" Oct 31 00:29:45.795748 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793257 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7" volumeName="kubernetes.io/projected/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-kube-api-access-txp8g" seLinuxMountContext="" Oct 31 00:29:45.795748 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793268 4557 reconstruct.go:97] "Volume reconstruction finished" Oct 31 00:29:45.795748 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.793276 4557 reconciler.go:29] "Reconciler: start to sync state" Oct 31 00:29:45.814532 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.814494 4557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 31 00:29:45.815958 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.815749 4557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 31 00:29:45.815958 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.815802 4557 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 31 00:29:45.815958 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.815825 4557 kubelet.go:2521] "Starting kubelet main sync loop" Oct 31 00:29:45.815958 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:29:45.815878 4557 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 31 00:29:45.828998 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.828969 4557 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 31 00:29:45.829994 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.829972 4557 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:29:45.830132 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.830114 4557 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:29:45.840668 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.840647 4557 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:29:45.840797 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.840782 4557 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:29:45.843217 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.843176 4557 generic.go:356] "Generic (PLEG): container finished" podID="177f7e75-1990-4afa-9740-6f3e0665b311" containerID="741a0d3cca121dff133bcd9df6b0363e49db25a7e6e4e702dbc4b32973fd4689" exitCode=0 Oct 31 00:29:45.843217 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.843213 4557 generic.go:356] "Generic (PLEG): container finished" podID="177f7e75-1990-4afa-9740-6f3e0665b311" containerID="d8aa19ff90ef3e6cabb65cea20ebf8b49b99ec1f15102e43574f21d232dc65d8" exitCode=0 Oct 31 00:29:45.843217 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.843220 4557 generic.go:356] "Generic (PLEG): container finished" podID="177f7e75-1990-4afa-9740-6f3e0665b311" containerID="5fa8beba5123c541433d0ca8ca0775bcf09d26bca2844ab544337904bf347b9c" exitCode=0 Oct 31 00:29:45.843428 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.843225 4557 generic.go:356] "Generic (PLEG): container finished" podID="177f7e75-1990-4afa-9740-6f3e0665b311" containerID="463e091f120ac813d0fc2a1bd290a51c5b052c2e8891c942bc4a3a6c9a050ad7" exitCode=0 Oct 31 00:29:45.843428 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.843231 4557 generic.go:356] "Generic (PLEG): container finished" podID="177f7e75-1990-4afa-9740-6f3e0665b311" containerID="a3c8200d479ef29de9cac0236f9969dfbe9358d7cb02bc3ffe4abe5475852ace" exitCode=0 Oct 31 00:29:45.843428 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.843238 4557 generic.go:356] "Generic (PLEG): container finished" podID="177f7e75-1990-4afa-9740-6f3e0665b311" containerID="f576202c51bebe9ad9a3224030fa677db6d672a11fda9ad349e50dd8e5fd5581" exitCode=0 Oct 31 00:29:45.849620 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.849596 4557 generic.go:356] "Generic (PLEG): container finished" podID="6a486685e4aa272e6e3121222626b7fe" containerID="a6811314d59e6861462ba47d4eb8c814218027702682b64f84661734c39dca0c" exitCode=0 Oct 31 00:29:45.864535 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.864519 4557 manager.go:324] Recovery completed Oct 31 00:29:45.881857 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.881796 4557 cpu_manager.go:226] "Starting" policy="none" Oct 31 00:29:45.881857 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.881810 4557 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 31 00:29:45.881857 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.881825 4557 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 31 00:29:45.882043 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.881934 4557 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 31 00:29:45.882043 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.881945 4557 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 31 00:29:45.882043 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.881962 4557 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 31 00:29:45.882043 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.881967 4557 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 31 00:29:45.882043 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.881972 4557 policy_none.go:50] "Start" Oct 31 00:29:45.882043 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.881979 4557 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 31 00:29:45.882043 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.881988 4557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 31 00:29:45.893436 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.893421 4557 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 31 00:29:45.893436 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.893437 4557 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 31 00:29:45.893528 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.893443 4557 policy_none.go:44] "Start" Oct 31 00:29:45.897789 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.897763 4557 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 31 00:29:45.901174 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.901162 4557 manager.go:341] "Starting Device Plugin manager" Oct 31 00:29:45.901937 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:29:45.901918 4557 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 31 00:29:45.901937 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.901935 4557 server.go:87] "Starting device plugin registration server" Oct 31 00:29:45.902216 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.902200 4557 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 31 00:29:45.902301 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.902219 4557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 31 00:29:45.902301 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.902288 4557 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 31 00:29:45.902461 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.902427 4557 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 31 00:29:45.902497 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.902477 4557 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 31 00:29:45.902497 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.902485 4557 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 31 00:29:45.902661 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.902569 4557 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T00:29:45.902459848Z","UUID":"1755c332-08ab-4add-9c25-a525f971eec3","Handler":null,"Name":"","Endpoint":""} Oct 31 00:29:45.903847 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:29:45.903824 4557 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 31 00:29:45.903924 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.903851 4557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 31 00:29:45.903924 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.903873 4557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 31 00:29:45.915963 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.915933 4557 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal"] Oct 31 00:29:45.916420 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.916372 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" event={"ID":"6a486685e4aa272e6e3121222626b7fe","Type":"ContainerStarted","Data":"f7982ed336e0cce8478bcfbe7b2b2c4e52b06735e7da6c29ac5d01c4b003c562"} Oct 31 00:29:45.916530 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.916426 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" event={"ID":"6a486685e4aa272e6e3121222626b7fe","Type":"ContainerDied","Data":"a6811314d59e6861462ba47d4eb8c814218027702682b64f84661734c39dca0c"} Oct 31 00:29:45.916530 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.916449 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" event={"ID":"6a486685e4aa272e6e3121222626b7fe","Type":"ContainerStarted","Data":"3bffdfec1899b046e81a94bd11fd454fdbf030d95f4a0310bf5afa90771e4ca7"} Oct 31 00:29:45.916530 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.916461 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal" event={"ID":"a11e2d9565d47e2d9d5101c74a24023b","Type":"ContainerStarted","Data":"14971062c2cce3443caed5a428edbba2c30ba9bf20c0d9d63fdaf59ec5f11e01"} Oct 31 00:29:45.916530 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.916472 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal" event={"ID":"a11e2d9565d47e2d9d5101c74a24023b","Type":"ContainerStarted","Data":"f1eee17fff7498d26c950d9bd44b717fc14da4697b84dc174523561642120c08"} Oct 31 00:29:45.916713 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.916605 4557 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal" Oct 31 00:29:45.916713 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.916643 4557 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" Oct 31 00:29:45.942826 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.942805 4557 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 00:29:45.942909 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:29:45.942846 4557 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-131-90.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal" Oct 31 00:29:45.943063 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:45.943048 4557 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 00:29:45.943100 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:29:45.943086 4557 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" Oct 31 00:29:46.003131 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.003110 4557 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:29:46.005720 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.005703 4557 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasSufficientMemory" Oct 31 00:29:46.005796 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.005732 4557 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasNoDiskPressure" Oct 31 00:29:46.005796 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.005747 4557 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-90.ec2.internal" event="NodeHasSufficientPID" Oct 31 00:29:46.005796 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.005791 4557 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-131-90.ec2.internal" Oct 31 00:29:46.029728 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.029706 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a486685e4aa272e6e3121222626b7fe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal\" (UID: \"6a486685e4aa272e6e3121222626b7fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" Oct 31 00:29:46.029807 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.029730 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a11e2d9565d47e2d9d5101c74a24023b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-90.ec2.internal\" (UID: \"a11e2d9565d47e2d9d5101c74a24023b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal" Oct 31 00:29:46.029807 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.029747 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a486685e4aa272e6e3121222626b7fe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal\" (UID: \"6a486685e4aa272e6e3121222626b7fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" Oct 31 00:29:46.037410 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.037390 4557 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-131-90.ec2.internal" Oct 31 00:29:46.037485 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.037453 4557 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-131-90.ec2.internal" Oct 31 00:29:46.130705 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.130675 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a486685e4aa272e6e3121222626b7fe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal\" (UID: \"6a486685e4aa272e6e3121222626b7fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" Oct 31 00:29:46.130705 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.130703 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a486685e4aa272e6e3121222626b7fe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal\" (UID: \"6a486685e4aa272e6e3121222626b7fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" Oct 31 00:29:46.130870 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.130718 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a11e2d9565d47e2d9d5101c74a24023b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-90.ec2.internal\" (UID: \"a11e2d9565d47e2d9d5101c74a24023b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal" Oct 31 00:29:46.130870 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.130757 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a11e2d9565d47e2d9d5101c74a24023b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-90.ec2.internal\" (UID: \"a11e2d9565d47e2d9d5101c74a24023b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal" Oct 31 00:29:46.130870 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.130792 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a486685e4aa272e6e3121222626b7fe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal\" (UID: \"6a486685e4aa272e6e3121222626b7fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" Oct 31 00:29:46.130870 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.130792 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a486685e4aa272e6e3121222626b7fe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal\" (UID: \"6a486685e4aa272e6e3121222626b7fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" Oct 31 00:29:46.774911 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.774879 4557 apiserver.go:52] "Watching apiserver" Oct 31 00:29:46.826216 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.826190 4557 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 31 00:29:46.826654 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.826634 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal","openshift-dns/node-resolver-kpvff","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal","kube-system/konnectivity-agent-7ttgh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2","openshift-dns/dns-default-xbqw2","kube-system/global-pull-secret-syncer-j7fh7","openshift-ingress-canary/ingress-canary-zd5x6","openshift-multus/multus-additional-cni-plugins-cpmxb","openshift-ovn-kubernetes/ovnkube-node-hc5x9","openshift-insights/insights-runtime-extractor-qf2jx","openshift-multus/network-metrics-daemon-cbb78","openshift-network-diagnostics/network-check-target-72nks","openshift-image-registry/node-ca-cqfvp","openshift-insights/periodic-gathering-wsp74-v7vxc","openshift-multus/multus-tk7rq","openshift-service-ca/service-ca-5fffc97bdf-c45b2","openshift-kube-storage-version-migrator/migrator-66df5d496b-6w8wz","openshift-cluster-node-tuning-operator/tuned-h6n9q","openshift-network-operator/iptables-alerter-rrrwt"] Oct 31 00:29:46.830211 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.830193 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:46.831695 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.831674 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:46.835526 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.835503 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:46.841081 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.841061 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:29:46.841390 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.841359 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 31 00:29:46.841390 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.841381 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 31 00:29:46.841723 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.841393 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 31 00:29:46.841723 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.841395 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 31 00:29:46.841723 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.841412 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 31 00:29:46.841723 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.841454 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 31 00:29:46.841723 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.841616 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 31 00:29:46.841723 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.841661 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 31 00:29:46.841723 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.841669 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 31 00:29:46.841723 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.841676 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 31 00:29:46.841998 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.841760 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 31 00:29:46.842207 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.842187 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 31 00:29:46.842291 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.842208 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dwrd5\"" Oct 31 00:29:46.842291 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.842248 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-s6nvb\"" Oct 31 00:29:46.842291 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.842260 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-59g6b\"" Oct 31 00:29:46.842458 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.842416 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pnxsg\"" Oct 31 00:29:46.842458 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.842421 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 31 00:29:46.842524 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.842462 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j6h9g\"" Oct 31 00:29:46.842524 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.842472 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mhfmv\"" Oct 31 00:29:46.842524 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.842482 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 31 00:29:46.842524 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.842489 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-5lgq7\"" Oct 31 00:29:46.851538 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.851523 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 31 00:29:46.852784 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.852771 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Oct 31 00:29:46.853385 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.853360 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-7zk7c\"" Oct 31 00:29:46.853588 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.853571 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 31 00:29:46.853687 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.853615 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 31 00:29:46.853687 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.853624 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fb5fv\"" Oct 31 00:29:46.853806 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.853792 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 31 00:29:46.853846 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.853795 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hvmr7\"" Oct 31 00:29:46.853846 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.853813 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 31 00:29:46.853945 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.853841 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-d84gp\"" Oct 31 00:29:46.853945 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.853866 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-v9vbh\"" Oct 31 00:29:46.853945 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.853913 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7r7qx\"" Oct 31 00:29:46.853945 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.853926 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9xqcf\"" Oct 31 00:29:46.853945 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.853926 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6qgws\"" Oct 31 00:29:46.854170 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.853951 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 31 00:29:46.854170 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.854011 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-qw5lv\"" Oct 31 00:29:46.854170 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.854058 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fcc5b\"" Oct 31 00:29:46.854170 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.854117 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5whcb\"" Oct 31 00:29:46.855605 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.855588 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kpvff_33de1dca-4062-4401-9d55-af069d8874f3/dns-node-resolver/0.log" Oct 31 00:29:46.862510 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.862495 4557 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal" Oct 31 00:29:46.862614 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.862603 4557 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" Oct 31 00:29:46.867787 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.867771 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 31 00:29:46.868054 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868036 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 31 00:29:46.868137 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868059 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:29:46.868137 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868085 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 31 00:29:46.868137 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868088 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 31 00:29:46.868137 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868110 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 31 00:29:46.868137 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868120 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 31 00:29:46.868137 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868127 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Oct 31 00:29:46.868376 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868114 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 31 00:29:46.868376 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868166 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 31 00:29:46.868376 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868187 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Oct 31 00:29:46.868532 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868458 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Oct 31 00:29:46.868532 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868477 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 31 00:29:46.868532 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868482 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 31 00:29:46.868532 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868518 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 31 00:29:46.868649 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868564 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 31 00:29:46.868649 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868586 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 31 00:29:46.868649 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868608 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 31 00:29:46.868649 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868617 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 31 00:29:46.868786 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868651 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 31 00:29:46.868786 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868657 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 31 00:29:46.868786 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868652 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Oct 31 00:29:46.868786 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868679 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 31 00:29:46.868786 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.868720 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 31 00:29:46.878844 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.878822 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 31 00:29:46.878992 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.878974 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Oct 31 00:29:46.884480 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.884468 4557 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 00:29:46.884528 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:29:46.884504 4557 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-131-90.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-90.ec2.internal" Oct 31 00:29:46.885303 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.885292 4557 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 00:29:46.885339 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:29:46.885316 4557 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-90.ec2.internal" Oct 31 00:29:46.892321 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.892307 4557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 31 00:29:46.935249 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935228 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-log-socket\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.935329 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935252 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.935329 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935272 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-ovnkube-script-lib\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.935329 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935288 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-system-cni-dir\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:46.935449 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935338 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-cni-dir\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:46.935449 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935442 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-var-lib-cni-multus\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:46.935521 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935461 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-sys-fs\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:46.935521 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935507 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-etc-openvswitch\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.935596 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935527 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-ovnkube-script-lib\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.935596 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935533 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-node-log\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.935596 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935574 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-var-lib-kubelet\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:46.935715 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935610 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/177f7e75-1990-4afa-9740-6f3e0665b311-cnibin\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:46.935715 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935655 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/177f7e75-1990-4afa-9740-6f3e0665b311-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:46.935715 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935694 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv6qc\" (UniqueName: \"kubernetes.io/projected/177f7e75-1990-4afa-9740-6f3e0665b311-kube-api-access-lv6qc\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:46.935848 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935727 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7340ba78-0fa3-4677-95b4-9dada26be5a5-data-volume\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:46.935848 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935745 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmc22\" (UniqueName: \"kubernetes.io/projected/13a9c69b-60c2-4c1d-a77c-5b56b234729c-kube-api-access-xmc22\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:46.935848 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935774 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-sysctl-d\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:46.935848 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935830 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7340ba78-0fa3-4677-95b4-9dada26be5a5-data-volume\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:46.936009 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935869 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13a9c69b-60c2-4c1d-a77c-5b56b234729c-metrics-tls\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:46.936009 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935900 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-run-ovn\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.936009 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935931 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c78pb\" (UniqueName: \"kubernetes.io/projected/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-api-access-c78pb\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:46.936009 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935955 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-modprobe-d\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:46.936009 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.935991 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lgpc\" (UniqueName: \"kubernetes.io/projected/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-kube-api-access-6lgpc\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:46.936274 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936039 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-slash\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.936274 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936080 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/758d2e0b-39da-418e-9e35-2c817915ebce-serviceca\") pod \"node-ca-cqfvp\" (UID: \"758d2e0b-39da-418e-9e35-2c817915ebce\") " pod="openshift-image-registry/node-ca-cqfvp" Oct 31 00:29:46.936274 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936105 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/177f7e75-1990-4afa-9740-6f3e0665b311-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:46.936274 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936125 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-systemd\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:46.936274 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936178 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-service-ca-bundle\") pod \"periodic-gathering-wsp74-v7vxc\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:46.936274 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936229 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bdd36c3c-acec-474f-b4aa-27ae4490c39b-kubelet-config\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:46.936526 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936352 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s87w5\" (UniqueName: \"kubernetes.io/projected/031b50be-28d6-4dcc-89e4-99e9558738f2-kube-api-access-s87w5\") pod \"service-ca-5fffc97bdf-c45b2\" (UID: \"031b50be-28d6-4dcc-89e4-99e9558738f2\") " pod="openshift-service-ca/service-ca-5fffc97bdf-c45b2" Oct 31 00:29:46.936526 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936361 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-service-ca-bundle\") pod \"periodic-gathering-wsp74-v7vxc\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:46.936526 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936385 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/758d2e0b-39da-418e-9e35-2c817915ebce-serviceca\") pod \"node-ca-cqfvp\" (UID: \"758d2e0b-39da-418e-9e35-2c817915ebce\") " pod="openshift-image-registry/node-ca-cqfvp" Oct 31 00:29:46.936526 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936394 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/177f7e75-1990-4afa-9740-6f3e0665b311-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:46.936526 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936421 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:46.936526 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936481 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-device-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:46.936764 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936529 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-cni-netd\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.936764 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936579 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-etc-kubernetes\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:46.936764 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936628 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcrwb\" (UniqueName: \"kubernetes.io/projected/8597a843-682b-45d5-9e4a-da5fff7573a1-kube-api-access-qcrwb\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:46.936764 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936695 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-archives-path\") pod \"periodic-gathering-wsp74-v7vxc\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:46.936764 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936760 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lc56\" (UniqueName: \"kubernetes.io/projected/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-kube-api-access-8lc56\") pod \"periodic-gathering-wsp74-v7vxc\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:46.936967 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936814 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-archives-path\") pod \"periodic-gathering-wsp74-v7vxc\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:46.936967 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936865 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/031b50be-28d6-4dcc-89e4-99e9558738f2-signing-cabundle\") pod \"service-ca-5fffc97bdf-c45b2\" (UID: \"031b50be-28d6-4dcc-89e4-99e9558738f2\") " pod="openshift-service-ca/service-ca-5fffc97bdf-c45b2" Oct 31 00:29:46.936967 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936893 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-ovnkube-config\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.936967 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.936911 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-env-overrides\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.937086 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.937064 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-socket-dir-parent\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:46.937115 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.937101 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-var-lib-cni-bin\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:46.937166 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.937151 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-run-multus-certs\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:46.937197 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.937175 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb75l\" (UniqueName: \"kubernetes.io/projected/33de1dca-4062-4401-9d55-af069d8874f3-kube-api-access-gb75l\") pod \"node-resolver-kpvff\" (UID: \"33de1dca-4062-4401-9d55-af069d8874f3\") " pod="openshift-dns/node-resolver-kpvff" Oct 31 00:29:46.937197 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.937191 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f47d176e-65b0-49d3-a77a-f593c25c65fa-cert\") pod \"ingress-canary-zd5x6\" (UID: \"f47d176e-65b0-49d3-a77a-f593c25c65fa\") " pod="openshift-ingress-canary/ingress-canary-zd5x6" Oct 31 00:29:46.937511 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.937491 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f47d176e-65b0-49d3-a77a-f593c25c65fa-cert\") pod \"ingress-canary-zd5x6\" (UID: \"f47d176e-65b0-49d3-a77a-f593c25c65fa\") " pod="openshift-ingress-canary/ingress-canary-zd5x6" Oct 31 00:29:46.937599 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.937520 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/031b50be-28d6-4dcc-89e4-99e9558738f2-signing-cabundle\") pod \"service-ca-5fffc97bdf-c45b2\" (UID: \"031b50be-28d6-4dcc-89e4-99e9558738f2\") " pod="openshift-service-ca/service-ca-5fffc97bdf-c45b2" Oct 31 00:29:46.937599 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.937493 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-env-overrides\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.937599 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.937595 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-ovnkube-config\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.937795 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.937780 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-kubelet\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.937849 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.937821 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-conf-dir\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:46.937903 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.937855 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfbxg\" (UniqueName: \"kubernetes.io/projected/85b085b5-122b-4fed-9b61-ea83fd294c9f-kube-api-access-lfbxg\") pod \"migrator-66df5d496b-6w8wz\" (UID: \"85b085b5-122b-4fed-9b61-ea83fd294c9f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-6w8wz" Oct 31 00:29:46.937903 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.937881 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33de1dca-4062-4401-9d55-af069d8874f3-tmp-dir\") pod \"node-resolver-kpvff\" (UID: \"33de1dca-4062-4401-9d55-af069d8874f3\") " pod="openshift-dns/node-resolver-kpvff" Oct 31 00:29:46.937966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.937922 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92956936-d054-482d-a78a-784cf0eeeeb3-host-slash\") pod \"iptables-alerter-rrrwt\" (UID: \"92956936-d054-482d-a78a-784cf0eeeeb3\") " pod="openshift-network-operator/iptables-alerter-rrrwt" Oct 31 00:29:46.938018 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.937970 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33de1dca-4062-4401-9d55-af069d8874f3-tmp-dir\") pod \"node-resolver-kpvff\" (UID: \"33de1dca-4062-4401-9d55-af069d8874f3\") " pod="openshift-dns/node-resolver-kpvff" Oct 31 00:29:46.938018 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.937997 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxhhb\" (UniqueName: \"kubernetes.io/projected/d402f509-6848-43fb-bedd-2d82bfceb0c2-kube-api-access-wxhhb\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:46.938105 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938052 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.938172 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938158 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/758d2e0b-39da-418e-9e35-2c817915ebce-host\") pod \"node-ca-cqfvp\" (UID: \"758d2e0b-39da-418e-9e35-2c817915ebce\") " pod="openshift-image-registry/node-ca-cqfvp" Oct 31 00:29:46.938210 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938189 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txp8g\" (UniqueName: \"kubernetes.io/projected/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-kube-api-access-txp8g\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.938250 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938224 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfltg\" (UniqueName: \"kubernetes.io/projected/758d2e0b-39da-418e-9e35-2c817915ebce-kube-api-access-sfltg\") pod \"node-ca-cqfvp\" (UID: \"758d2e0b-39da-418e-9e35-2c817915ebce\") " pod="openshift-image-registry/node-ca-cqfvp" Oct 31 00:29:46.938289 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938271 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7340ba78-0fa3-4677-95b4-9dada26be5a5-crio-socket\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:46.938326 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938301 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13a9c69b-60c2-4c1d-a77c-5b56b234729c-tmp-dir\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:46.938380 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938325 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgmhd\" (UniqueName: \"kubernetes.io/projected/f47d176e-65b0-49d3-a77a-f593c25c65fa-kube-api-access-lgmhd\") pod \"ingress-canary-zd5x6\" (UID: \"f47d176e-65b0-49d3-a77a-f593c25c65fa\") " pod="openshift-ingress-canary/ingress-canary-zd5x6" Oct 31 00:29:46.938453 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938395 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/031b50be-28d6-4dcc-89e4-99e9558738f2-signing-key\") pod \"service-ca-5fffc97bdf-c45b2\" (UID: \"031b50be-28d6-4dcc-89e4-99e9558738f2\") " pod="openshift-service-ca/service-ca-5fffc97bdf-c45b2" Oct 31 00:29:46.938453 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938439 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13a9c69b-60c2-4c1d-a77c-5b56b234729c-tmp-dir\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:46.938547 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938485 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d8e4f707-7f3f-4081-9ad9-df7e33efb927-agent-certs\") pod \"konnectivity-agent-7ttgh\" (UID: \"d8e4f707-7f3f-4081-9ad9-df7e33efb927\") " pod="kube-system/konnectivity-agent-7ttgh" Oct 31 00:29:46.938547 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938512 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/177f7e75-1990-4afa-9740-6f3e0665b311-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:46.938547 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938539 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-var-lib-kubelet\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:46.938695 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938583 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/92956936-d054-482d-a78a-784cf0eeeeb3-iptables-alerter-script\") pod \"iptables-alerter-rrrwt\" (UID: \"92956936-d054-482d-a78a-784cf0eeeeb3\") " pod="openshift-network-operator/iptables-alerter-rrrwt" Oct 31 00:29:46.938695 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938608 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-etc-selinux\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:46.938695 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938644 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/031b50be-28d6-4dcc-89e4-99e9558738f2-signing-key\") pod \"service-ca-5fffc97bdf-c45b2\" (UID: \"031b50be-28d6-4dcc-89e4-99e9558738f2\") " pod="openshift-service-ca/service-ca-5fffc97bdf-c45b2" Oct 31 00:29:46.938695 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938648 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-run-k8s-cni-cncf-io\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:46.938830 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938698 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-hostroot\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:46.938830 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938733 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/177f7e75-1990-4afa-9740-6f3e0665b311-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:46.938830 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938745 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d8e4f707-7f3f-4081-9ad9-df7e33efb927-agent-certs\") pod \"konnectivity-agent-7ttgh\" (UID: \"d8e4f707-7f3f-4081-9ad9-df7e33efb927\") " pod="kube-system/konnectivity-agent-7ttgh" Oct 31 00:29:46.938830 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938756 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/177f7e75-1990-4afa-9740-6f3e0665b311-system-cni-dir\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:46.938830 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938778 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs\") pod \"network-metrics-daemon-cbb78\" (UID: \"671b2592-db78-4be6-9a9c-83ade9a48bce\") " pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:46.938830 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938803 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-kubernetes\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:46.938830 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938803 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/92956936-d054-482d-a78a-784cf0eeeeb3-iptables-alerter-script\") pod \"iptables-alerter-rrrwt\" (UID: \"92956936-d054-482d-a78a-784cf0eeeeb3\") " pod="openshift-network-operator/iptables-alerter-rrrwt" Oct 31 00:29:46.938830 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938828 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-run\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:46.939057 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938853 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-trusted-ca-bundle\") pod \"periodic-gathering-wsp74-v7vxc\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:46.939057 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938885 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-registration-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:46.939057 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938966 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-run-netns\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.939057 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.938985 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8597a843-682b-45d5-9e4a-da5fff7573a1-cni-binary-copy\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:46.939057 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939001 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfkv4\" (UniqueName: \"kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4\") pod \"network-check-target-72nks\" (UID: \"7e87fd11-4685-4e33-8230-b6b53747c9a9\") " pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:46.939057 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939040 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:46.939221 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939074 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-sysctl-conf\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:46.939221 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939099 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-sys\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:46.939221 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939127 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsgjr\" (UniqueName: \"kubernetes.io/projected/92956936-d054-482d-a78a-784cf0eeeeb3-kube-api-access-rsgjr\") pod \"iptables-alerter-rrrwt\" (UID: \"92956936-d054-482d-a78a-784cf0eeeeb3\") " pod="openshift-network-operator/iptables-alerter-rrrwt" Oct 31 00:29:46.939221 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939155 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-trusted-ca-bundle\") pod \"periodic-gathering-wsp74-v7vxc\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:46.939221 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939192 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d8e4f707-7f3f-4081-9ad9-df7e33efb927-konnectivity-ca\") pod \"konnectivity-agent-7ttgh\" (UID: \"d8e4f707-7f3f-4081-9ad9-df7e33efb927\") " pod="kube-system/konnectivity-agent-7ttgh" Oct 31 00:29:46.939379 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939220 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-daemon-config\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:46.939379 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939244 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-sysconfig\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:46.939379 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939267 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-tmp\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:46.939379 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939237 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8597a843-682b-45d5-9e4a-da5fff7573a1-cni-binary-copy\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:46.939379 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939323 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-tmp\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:46.939379 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939324 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33de1dca-4062-4401-9d55-af069d8874f3-hosts-file\") pod \"node-resolver-kpvff\" (UID: \"33de1dca-4062-4401-9d55-af069d8874f3\") " pod="openshift-dns/node-resolver-kpvff" Oct 31 00:29:46.939379 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939352 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bdd36c3c-acec-474f-b4aa-27ae4490c39b-dbus\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:46.939379 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939365 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d8e4f707-7f3f-4081-9ad9-df7e33efb927-konnectivity-ca\") pod \"konnectivity-agent-7ttgh\" (UID: \"d8e4f707-7f3f-4081-9ad9-df7e33efb927\") " pod="kube-system/konnectivity-agent-7ttgh" Oct 31 00:29:46.939379 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939380 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-cni-bin\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.939659 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939438 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-daemon-config\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:46.939659 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939443 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-cnibin\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:46.939659 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939476 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-run-netns\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:46.939659 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939500 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/177f7e75-1990-4afa-9740-6f3e0665b311-cni-binary-copy\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:46.939659 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939523 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrwq7\" (UniqueName: \"kubernetes.io/projected/671b2592-db78-4be6-9a9c-83ade9a48bce-kube-api-access-hrwq7\") pod \"network-metrics-daemon-cbb78\" (UID: \"671b2592-db78-4be6-9a9c-83ade9a48bce\") " pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:46.939659 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939564 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/13a9c69b-60c2-4c1d-a77c-5b56b234729c-config-volume\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:46.939659 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939586 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-socket-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:46.939659 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939600 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-lib-modules\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:46.939659 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939615 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-host\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:46.939659 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939625 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/177f7e75-1990-4afa-9740-6f3e0665b311-cni-binary-copy\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:46.939659 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939636 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-tuned\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:46.940057 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939665 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-systemd-units\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.940057 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939682 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-run-systemd\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.940057 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939696 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-run-openvswitch\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.940057 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939737 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-tuned\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:46.940057 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939773 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-ovn-node-metrics-cert\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.940057 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939794 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:46.940057 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939812 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:46.940057 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.939870 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-var-lib-openvswitch\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.940350 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.940064 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-ovn-node-metrics-cert\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.940350 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.940078 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdd36c3c-acec-474f-b4aa-27ae4490c39b-original-pull-secret\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:46.940350 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.940197 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/13a9c69b-60c2-4c1d-a77c-5b56b234729c-config-volume\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:46.956668 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.956643 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s87w5\" (UniqueName: \"kubernetes.io/projected/031b50be-28d6-4dcc-89e4-99e9558738f2-kube-api-access-s87w5\") pod \"service-ca-5fffc97bdf-c45b2\" (UID: \"031b50be-28d6-4dcc-89e4-99e9558738f2\") " pod="openshift-service-ca/service-ca-5fffc97bdf-c45b2" Oct 31 00:29:46.956769 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.956754 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcrwb\" (UniqueName: \"kubernetes.io/projected/8597a843-682b-45d5-9e4a-da5fff7573a1-kube-api-access-qcrwb\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:46.956851 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.956832 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv6qc\" (UniqueName: \"kubernetes.io/projected/177f7e75-1990-4afa-9740-6f3e0665b311-kube-api-access-lv6qc\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:46.957029 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.956997 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lgpc\" (UniqueName: \"kubernetes.io/projected/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-kube-api-access-6lgpc\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:46.957113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.957098 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lc56\" (UniqueName: \"kubernetes.io/projected/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-kube-api-access-8lc56\") pod \"periodic-gathering-wsp74-v7vxc\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:29:46.957475 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.957460 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmc22\" (UniqueName: \"kubernetes.io/projected/13a9c69b-60c2-4c1d-a77c-5b56b234729c-kube-api-access-xmc22\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:46.957936 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.957918 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c78pb\" (UniqueName: \"kubernetes.io/projected/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-api-access-c78pb\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:46.959433 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.958765 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb75l\" (UniqueName: \"kubernetes.io/projected/33de1dca-4062-4401-9d55-af069d8874f3-kube-api-access-gb75l\") pod \"node-resolver-kpvff\" (UID: \"33de1dca-4062-4401-9d55-af069d8874f3\") " pod="openshift-dns/node-resolver-kpvff" Oct 31 00:29:46.959433 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.958779 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txp8g\" (UniqueName: \"kubernetes.io/projected/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-kube-api-access-txp8g\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:46.959433 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.958769 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfbxg\" (UniqueName: \"kubernetes.io/projected/85b085b5-122b-4fed-9b61-ea83fd294c9f-kube-api-access-lfbxg\") pod \"migrator-66df5d496b-6w8wz\" (UID: \"85b085b5-122b-4fed-9b61-ea83fd294c9f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-6w8wz" Oct 31 00:29:46.962695 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.962675 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxhhb\" (UniqueName: \"kubernetes.io/projected/d402f509-6848-43fb-bedd-2d82bfceb0c2-kube-api-access-wxhhb\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:46.962763 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.962680 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrwq7\" (UniqueName: \"kubernetes.io/projected/671b2592-db78-4be6-9a9c-83ade9a48bce-kube-api-access-hrwq7\") pod \"network-metrics-daemon-cbb78\" (UID: \"671b2592-db78-4be6-9a9c-83ade9a48bce\") " pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:46.962808 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.962757 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfltg\" (UniqueName: \"kubernetes.io/projected/758d2e0b-39da-418e-9e35-2c817915ebce-kube-api-access-sfltg\") pod \"node-ca-cqfvp\" (UID: \"758d2e0b-39da-418e-9e35-2c817915ebce\") " pod="openshift-image-registry/node-ca-cqfvp" Oct 31 00:29:46.962864 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.962843 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsgjr\" (UniqueName: \"kubernetes.io/projected/92956936-d054-482d-a78a-784cf0eeeeb3-kube-api-access-rsgjr\") pod \"iptables-alerter-rrrwt\" (UID: \"92956936-d054-482d-a78a-784cf0eeeeb3\") " pod="openshift-network-operator/iptables-alerter-rrrwt" Oct 31 00:29:46.962898 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.962863 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfkv4\" (UniqueName: \"kubernetes.io/projected/7e87fd11-4685-4e33-8230-b6b53747c9a9-kube-api-access-pfkv4\") pod \"network-check-target-72nks\" (UID: \"7e87fd11-4685-4e33-8230-b6b53747c9a9\") " pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:46.962951 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:46.962937 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgmhd\" (UniqueName: \"kubernetes.io/projected/f47d176e-65b0-49d3-a77a-f593c25c65fa-kube-api-access-lgmhd\") pod \"ingress-canary-zd5x6\" (UID: \"f47d176e-65b0-49d3-a77a-f593c25c65fa\") " pod="openshift-ingress-canary/ingress-canary-zd5x6" Oct 31 00:29:47.040130 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040078 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-run-netns\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.040130 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040103 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-socket-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:47.040130 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040117 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-lib-modules\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.040130 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040131 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-host\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.040363 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040146 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-systemd-units\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.040363 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040164 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-run-systemd\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.040363 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040182 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-run-openvswitch\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.040363 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040195 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-socket-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:47.040363 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040202 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:47.040363 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040220 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-run-netns\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.040363 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040232 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-host\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.040363 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040241 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-var-lib-openvswitch\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.040363 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040265 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-log-socket\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.040363 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040273 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-run-systemd\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.040363 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040273 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-lib-modules\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.040363 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:29:47.040290 4557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 31 00:29:47.040363 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040293 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.040363 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040240 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-run-openvswitch\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.040363 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040283 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-var-lib-openvswitch\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.040363 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040300 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-log-socket\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.040363 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040329 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-system-cni-dir\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.040363 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040276 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-systemd-units\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.040363 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040341 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.040363 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:29:47.040359 4557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls podName:7340ba78-0fa3-4677-95b4-9dada26be5a5 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:47.540339364 +0000 UTC m=+1.822869723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qf2jx" (UID: "7340ba78-0fa3-4677-95b4-9dada26be5a5") : secret "insights-runtime-extractor-tls" not found Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040379 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-system-cni-dir\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040424 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-cni-dir\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040447 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-var-lib-cni-multus\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040462 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-sys-fs\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040476 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-etc-openvswitch\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040496 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-node-log\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040520 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-var-lib-kubelet\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040530 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-sys-fs\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040529 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-etc-openvswitch\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040543 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/177f7e75-1990-4afa-9740-6f3e0665b311-cnibin\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040529 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-var-lib-cni-multus\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040559 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-var-lib-kubelet\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040568 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-node-log\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040578 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/177f7e75-1990-4afa-9740-6f3e0665b311-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040583 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/177f7e75-1990-4afa-9740-6f3e0665b311-cnibin\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040593 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-cni-dir\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040609 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-sysctl-d\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040633 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13a9c69b-60c2-4c1d-a77c-5b56b234729c-metrics-tls\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040656 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-run-ovn\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040636 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/177f7e75-1990-4afa-9740-6f3e0665b311-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040679 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-modprobe-d\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040702 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-slash\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040706 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-run-ovn\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040726 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-systemd\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040743 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-slash\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040749 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-modprobe-d\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040750 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-sysctl-d\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040751 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bdd36c3c-acec-474f-b4aa-27ae4490c39b-kubelet-config\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040788 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040799 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bdd36c3c-acec-474f-b4aa-27ae4490c39b-kubelet-config\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040789 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-systemd\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040812 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-device-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040848 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-device-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040854 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-cni-netd\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040878 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-etc-kubernetes\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040826 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040908 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-etc-kubernetes\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040907 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-socket-dir-parent\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040940 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-var-lib-cni-bin\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040946 4557 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040911 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-cni-netd\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040954 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-socket-dir-parent\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040971 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-run-multus-certs\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040987 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-var-lib-cni-bin\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.040954 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-run-multus-certs\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041062 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-kubelet\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041083 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-conf-dir\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041102 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92956936-d054-482d-a78a-784cf0eeeeb3-host-slash\") pod \"iptables-alerter-rrrwt\" (UID: \"92956936-d054-482d-a78a-784cf0eeeeb3\") " pod="openshift-network-operator/iptables-alerter-rrrwt" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041118 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041132 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-kubelet\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.041113 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041133 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/758d2e0b-39da-418e-9e35-2c817915ebce-host\") pod \"node-ca-cqfvp\" (UID: \"758d2e0b-39da-418e-9e35-2c817915ebce\") " pod="openshift-image-registry/node-ca-cqfvp" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041153 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-multus-conf-dir\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041162 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/758d2e0b-39da-418e-9e35-2c817915ebce-host\") pod \"node-ca-cqfvp\" (UID: \"758d2e0b-39da-418e-9e35-2c817915ebce\") " pod="openshift-image-registry/node-ca-cqfvp" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041169 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7340ba78-0fa3-4677-95b4-9dada26be5a5-crio-socket\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041172 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92956936-d054-482d-a78a-784cf0eeeeb3-host-slash\") pod \"iptables-alerter-rrrwt\" (UID: \"92956936-d054-482d-a78a-784cf0eeeeb3\") " pod="openshift-network-operator/iptables-alerter-rrrwt" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041189 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041199 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-var-lib-kubelet\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041226 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7340ba78-0fa3-4677-95b4-9dada26be5a5-crio-socket\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041229 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-etc-selinux\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041241 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-var-lib-kubelet\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041264 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-run-k8s-cni-cncf-io\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041290 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-hostroot\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041295 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-host-run-k8s-cni-cncf-io\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041268 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-etc-selinux\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041313 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/177f7e75-1990-4afa-9740-6f3e0665b311-system-cni-dir\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041333 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-hostroot\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041337 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs\") pod \"network-metrics-daemon-cbb78\" (UID: \"671b2592-db78-4be6-9a9c-83ade9a48bce\") " pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041356 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/177f7e75-1990-4afa-9740-6f3e0665b311-system-cni-dir\") pod \"multus-additional-cni-plugins-cpmxb\" (UID: \"177f7e75-1990-4afa-9740-6f3e0665b311\") " pod="openshift-multus/multus-additional-cni-plugins-cpmxb" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041360 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-kubernetes\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041384 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-run\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:29:47.041422 4557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041427 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-kubernetes\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041434 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-registration-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041454 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-run\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:29:47.041465 4557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs podName:671b2592-db78-4be6-9a9c-83ade9a48bce nodeName:}" failed. No retries permitted until 2026-10-31 00:29:47.5414545 +0000 UTC m=+1.823984861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs") pod "network-metrics-daemon-cbb78" (UID: "671b2592-db78-4be6-9a9c-83ade9a48bce") : secret "metrics-daemon-secret" not found Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041466 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d402f509-6848-43fb-bedd-2d82bfceb0c2-registration-dir\") pod \"aws-ebs-csi-driver-node-8ppf2\" (UID: \"d402f509-6848-43fb-bedd-2d82bfceb0c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ppf2" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041458 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-run-netns\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041494 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-run-netns\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041496 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041529 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-sysctl-conf\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041551 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-sys\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041577 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-sysconfig\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041610 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33de1dca-4062-4401-9d55-af069d8874f3-hosts-file\") pod \"node-resolver-kpvff\" (UID: \"33de1dca-4062-4401-9d55-af069d8874f3\") " pod="openshift-dns/node-resolver-kpvff" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041632 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bdd36c3c-acec-474f-b4aa-27ae4490c39b-dbus\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041635 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-sys\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041651 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-sysctl-conf\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041656 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/671e4bc9-b45d-41f0-ab5c-0b40b7742a8d-etc-sysconfig\") pod \"tuned-h6n9q\" (UID: \"671e4bc9-b45d-41f0-ab5c-0b40b7742a8d\") " pod="openshift-cluster-node-tuning-operator/tuned-h6n9q" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041666 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33de1dca-4062-4401-9d55-af069d8874f3-hosts-file\") pod \"node-resolver-kpvff\" (UID: \"33de1dca-4062-4401-9d55-af069d8874f3\") " pod="openshift-dns/node-resolver-kpvff" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041665 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-cni-bin\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041686 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7-host-cni-bin\") pod \"ovnkube-node-hc5x9\" (UID: \"0663de32-3f4f-4eb1-9bba-e7dc1ddfa7d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041695 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bdd36c3c-acec-474f-b4aa-27ae4490c39b-dbus\") pod \"global-pull-secret-syncer-j7fh7\" (UID: \"bdd36c3c-acec-474f-b4aa-27ae4490c39b\") " pod="kube-system/global-pull-secret-syncer-j7fh7" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041704 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-cnibin\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.042766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.041752 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8597a843-682b-45d5-9e4a-da5fff7573a1-cnibin\") pod \"multus-tk7rq\" (UID: \"8597a843-682b-45d5-9e4a-da5fff7573a1\") " pod="openshift-multus/multus-tk7rq" Oct 31 00:29:47.055038 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.055017 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13a9c69b-60c2-4c1d-a77c-5b56b234729c-metrics-tls\") pod \"dns-default-xbqw2\" (UID: \"13a9c69b-60c2-4c1d-a77c-5b56b234729c\") " pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:47.055165 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.055148 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7340ba78-0fa3-4677-95b4-9dada26be5a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:47.132001 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.131976 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:47.280918 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.280871 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:47.387929 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.387859 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:47.446854 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.446825 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xbqw2"] Oct 31 00:29:47.452808 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:47.452767 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a9c69b_60c2_4c1d_a77c_5b56b234729c.slice/crio-ca8c42f819e5895044e7356d833f69400c3eb13e312c137e1113ba5f1cdd3353 WatchSource:0}: Error finding container ca8c42f819e5895044e7356d833f69400c3eb13e312c137e1113ba5f1cdd3353: Status 404 returned error can't find the container with id ca8c42f819e5895044e7356d833f69400c3eb13e312c137e1113ba5f1cdd3353 Oct 31 00:29:47.455018 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.454997 4557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 31 00:29:47.544724 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.544698 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs\") pod \"network-metrics-daemon-cbb78\" (UID: \"671b2592-db78-4be6-9a9c-83ade9a48bce\") " pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:47.544844 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.544752 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:47.544914 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:29:47.544866 4557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 31 00:29:47.544968 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:29:47.544933 4557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls podName:7340ba78-0fa3-4677-95b4-9dada26be5a5 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:48.544913504 +0000 UTC m=+2.827443838 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qf2jx" (UID: "7340ba78-0fa3-4677-95b4-9dada26be5a5") : secret "insights-runtime-extractor-tls" not found Oct 31 00:29:47.546852 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.546825 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/671b2592-db78-4be6-9a9c-83ade9a48bce-metrics-certs\") pod \"network-metrics-daemon-cbb78\" (UID: \"671b2592-db78-4be6-9a9c-83ade9a48bce\") " pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:47.655104 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.655043 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cqfvp_758d2e0b-39da-418e-9e35-2c817915ebce/node-ca/0.log" Oct 31 00:29:47.713175 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.713147 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:47.731057 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.731037 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbb78" Oct 31 00:29:47.865711 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.865679 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xbqw2" event={"ID":"13a9c69b-60c2-4c1d-a77c-5b56b234729c","Type":"ContainerStarted","Data":"ca8c42f819e5895044e7356d833f69400c3eb13e312c137e1113ba5f1cdd3353"} Oct 31 00:29:47.920422 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:47.920351 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:48.025907 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:48.025852 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:48.045658 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:48.045631 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cbb78"] Oct 31 00:29:48.051050 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:48.051026 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod671b2592_db78_4be6_9a9c_83ade9a48bce.slice/crio-7b610d2644a983dfe0a1a7effbfb007df62d88abf12b0f1e889c2bc627566adf WatchSource:0}: Error finding container 7b610d2644a983dfe0a1a7effbfb007df62d88abf12b0f1e889c2bc627566adf: Status 404 returned error can't find the container with id 7b610d2644a983dfe0a1a7effbfb007df62d88abf12b0f1e889c2bc627566adf Oct 31 00:29:48.135453 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:48.135422 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:48.455079 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:48.455051 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zd5x6_f47d176e-65b0-49d3-a77a-f593c25c65fa/serve-healthcheck-canary/0.log" Oct 31 00:29:48.514690 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:48.514658 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:48.554986 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:48.554960 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:48.557661 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:48.557634 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7340ba78-0fa3-4677-95b4-9dada26be5a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qf2jx\" (UID: \"7340ba78-0fa3-4677-95b4-9dada26be5a5\") " pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:48.636718 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:48.636687 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qf2jx" Oct 31 00:29:48.656671 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:48.656645 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-6w8wz_85b085b5-122b-4fed-9b61-ea83fd294c9f/migrator/0.log" Oct 31 00:29:48.719783 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:48.719691 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:48.775117 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:48.774563 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7ttgh" Oct 31 00:29:48.837074 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:48.836894 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:29:48.873892 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:48.873797 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cbb78" event={"ID":"671b2592-db78-4be6-9a9c-83ade9a48bce","Type":"ContainerStarted","Data":"7b610d2644a983dfe0a1a7effbfb007df62d88abf12b0f1e889c2bc627566adf"} Oct 31 00:29:48.929728 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:48.929647 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:48.947699 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:48.947673 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:48.966128 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:48.966053 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qf2jx"] Oct 31 00:29:48.973302 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:29:48.973273 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7340ba78_0fa3_4677_95b4_9dada26be5a5.slice/crio-042b5f9c27cf81cbab784214d991ed6b97d596fa2f3b35e23259b2208939bb42 WatchSource:0}: Error finding container 042b5f9c27cf81cbab784214d991ed6b97d596fa2f3b35e23259b2208939bb42: Status 404 returned error can't find the container with id 042b5f9c27cf81cbab784214d991ed6b97d596fa2f3b35e23259b2208939bb42 Oct 31 00:29:49.047567 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:49.047541 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:49.313426 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:49.313388 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:49.732266 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:49.732243 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:49.879084 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:49.879050 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qf2jx" event={"ID":"7340ba78-0fa3-4677-95b4-9dada26be5a5","Type":"ContainerStarted","Data":"2b41d106cf82fb9517377b81d702e296fc9fbecacbf006a26ad9f46d45ac94e6"} Oct 31 00:29:49.879473 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:49.879106 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qf2jx" event={"ID":"7340ba78-0fa3-4677-95b4-9dada26be5a5","Type":"ContainerStarted","Data":"4f836ab970a8a2dd4138402660a82491ebc890cddcc32c0c74de9eb0b51b094e"} Oct 31 00:29:49.879473 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:49.879126 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qf2jx" event={"ID":"7340ba78-0fa3-4677-95b4-9dada26be5a5","Type":"ContainerStarted","Data":"042b5f9c27cf81cbab784214d991ed6b97d596fa2f3b35e23259b2208939bb42"} Oct 31 00:29:49.880904 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:49.880879 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xbqw2" event={"ID":"13a9c69b-60c2-4c1d-a77c-5b56b234729c","Type":"ContainerStarted","Data":"8b5e84208e2db95431e12f9ef3654afe1d7d8995a7c5adb89eadc53df0b590a5"} Oct 31 00:29:49.881010 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:49.880927 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xbqw2" event={"ID":"13a9c69b-60c2-4c1d-a77c-5b56b234729c","Type":"ContainerStarted","Data":"f68da7a7e5ced373bd973a23f850b165919a61018d3828294d52e007154fa235"} Oct 31 00:29:49.881070 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:49.881017 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xbqw2" Oct 31 00:29:49.882735 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:49.882718 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cbb78" event={"ID":"671b2592-db78-4be6-9a9c-83ade9a48bce","Type":"ContainerStarted","Data":"5f0acd29edeab33e7184b9458bdf664a067e009695f264a22835a0b2cceeb5c8"} Oct 31 00:29:49.882813 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:49.882750 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cbb78" event={"ID":"671b2592-db78-4be6-9a9c-83ade9a48bce","Type":"ContainerStarted","Data":"ea660e3e229ddd0da756f1e5dd5509d5e02f4fd6d5191fb0c732aa643fcc67ee"} Oct 31 00:29:49.913611 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:49.913590 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:50.117229 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:50.117195 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:50.517568 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:50.517534 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:50.713838 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:50.713803 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:51.312034 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:51.311968 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:51.897870 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:51.897835 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qf2jx" event={"ID":"7340ba78-0fa3-4677-95b4-9dada26be5a5","Type":"ContainerStarted","Data":"3f2719bcecf5d70b6d7c3c0fce277c7c7d7adeecfece2252d701cd6dba472b9b"} Oct 31 00:29:51.914908 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:51.914881 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:51.960743 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:29:51.960711 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:29:52.127698 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:52.127666 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:52.515385 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:52.515353 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:52.740094 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:52.740064 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:53.320299 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:53.320267 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:53.893085 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:53.893047 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:54.001247 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:54.001213 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:54.113486 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:54.113457 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:54.515205 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:54.515172 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:54.717871 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:54.717831 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:55.115515 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:55.115480 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:55.313930 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:55.313889 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:55.892612 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:55.892578 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:29:55.892775 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:55.892749 4557 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 31 00:29:57.997556 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:57.997507 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:59.893706 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:29:59.893632 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xbqw2" Oct 31 00:30:02.940115 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:02.940084 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:03.041216 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:03.041182 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:06.847593 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:06.847559 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hc5x9" Oct 31 00:30:08.792323 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.792294 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-f9fx6"] Oct 31 00:30:08.794335 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.794315 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-f9fx6" Oct 31 00:30:08.819752 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.819729 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gzj9f\"" Oct 31 00:30:08.819848 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.819780 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Oct 31 00:30:08.822001 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.821982 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-f9fx6"] Oct 31 00:30:08.878379 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.878347 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a3e896c7-cd93-4553-9161-44421f92b902-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-f9fx6\" (UID: \"a3e896c7-cd93-4553-9161-44421f92b902\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-f9fx6" Oct 31 00:30:08.885585 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.885564 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7fd6dc794f-2h9wb"] Oct 31 00:30:08.887443 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.887426 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:08.926485 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.926442 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Oct 31 00:30:08.926485 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.926463 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mh94w\"" Oct 31 00:30:08.926701 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.926516 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Oct 31 00:30:08.926701 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.926574 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Oct 31 00:30:08.926701 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.926653 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Oct 31 00:30:08.927582 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.927566 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fd6dc794f-2h9wb"] Oct 31 00:30:08.940459 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.940439 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:08.978846 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.978817 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/763474fc-e7d7-4494-ab00-26b851f669b3-image-registry-private-configuration\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:08.978953 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.978850 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/763474fc-e7d7-4494-ab00-26b851f669b3-registry-tls\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:08.978953 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.978876 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/763474fc-e7d7-4494-ab00-26b851f669b3-ca-trust-extracted\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:08.979020 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.978984 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a3e896c7-cd93-4553-9161-44421f92b902-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-f9fx6\" (UID: \"a3e896c7-cd93-4553-9161-44421f92b902\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-f9fx6" Oct 31 00:30:08.979020 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.979000 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/763474fc-e7d7-4494-ab00-26b851f669b3-registry-certificates\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:08.979020 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.979018 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/763474fc-e7d7-4494-ab00-26b851f669b3-installation-pull-secrets\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:08.979122 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.979110 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6lkj\" (UniqueName: \"kubernetes.io/projected/763474fc-e7d7-4494-ab00-26b851f669b3-kube-api-access-t6lkj\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:08.979156 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.979143 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/763474fc-e7d7-4494-ab00-26b851f669b3-trusted-ca\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:08.979192 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.979166 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/763474fc-e7d7-4494-ab00-26b851f669b3-bound-sa-token\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:08.981194 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:08.981172 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a3e896c7-cd93-4553-9161-44421f92b902-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-f9fx6\" (UID: \"a3e896c7-cd93-4553-9161-44421f92b902\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-f9fx6" Oct 31 00:30:09.070420 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.070308 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:09.079560 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.079537 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/763474fc-e7d7-4494-ab00-26b851f669b3-trusted-ca\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:09.079645 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.079571 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/763474fc-e7d7-4494-ab00-26b851f669b3-bound-sa-token\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:09.079645 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.079592 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/763474fc-e7d7-4494-ab00-26b851f669b3-image-registry-private-configuration\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:09.079743 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.079724 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/763474fc-e7d7-4494-ab00-26b851f669b3-registry-tls\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:09.079784 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.079762 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/763474fc-e7d7-4494-ab00-26b851f669b3-ca-trust-extracted\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:09.079823 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.079807 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/763474fc-e7d7-4494-ab00-26b851f669b3-registry-certificates\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:09.079862 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.079838 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/763474fc-e7d7-4494-ab00-26b851f669b3-installation-pull-secrets\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:09.079923 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.079864 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6lkj\" (UniqueName: \"kubernetes.io/projected/763474fc-e7d7-4494-ab00-26b851f669b3-kube-api-access-t6lkj\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:09.080273 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.080246 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/763474fc-e7d7-4494-ab00-26b851f669b3-ca-trust-extracted\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:09.080754 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.080733 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/763474fc-e7d7-4494-ab00-26b851f669b3-trusted-ca\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:09.080855 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.080775 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/763474fc-e7d7-4494-ab00-26b851f669b3-registry-certificates\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:09.082167 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.082140 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/763474fc-e7d7-4494-ab00-26b851f669b3-registry-tls\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:09.082272 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.082168 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/763474fc-e7d7-4494-ab00-26b851f669b3-image-registry-private-configuration\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:09.082339 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.082299 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/763474fc-e7d7-4494-ab00-26b851f669b3-installation-pull-secrets\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:09.101991 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.101968 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/763474fc-e7d7-4494-ab00-26b851f669b3-bound-sa-token\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:09.102207 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.102189 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6lkj\" (UniqueName: \"kubernetes.io/projected/763474fc-e7d7-4494-ab00-26b851f669b3-kube-api-access-t6lkj\") pod \"image-registry-7fd6dc794f-2h9wb\" (UID: \"763474fc-e7d7-4494-ab00-26b851f669b3\") " pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:09.104974 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.104959 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-f9fx6" Oct 31 00:30:09.196654 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.196624 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:09.270160 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.270131 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:09.395561 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.395505 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-f9fx6"] Oct 31 00:30:09.399947 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:30:09.399923 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3e896c7_cd93_4553_9161_44421f92b902.slice/crio-a73fb6f2945b1d1679aea655db07df55d4044ac63988be512033e163e0b19742 WatchSource:0}: Error finding container a73fb6f2945b1d1679aea655db07df55d4044ac63988be512033e163e0b19742: Status 404 returned error can't find the container with id a73fb6f2945b1d1679aea655db07df55d4044ac63988be512033e163e0b19742 Oct 31 00:30:09.490066 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.490022 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fd6dc794f-2h9wb"] Oct 31 00:30:09.495112 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:30:09.495082 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod763474fc_e7d7_4494_ab00_26b851f669b3.slice/crio-f30403acba1804b6fc30bef473a69abc33df13d3f2797e1d3413d786539d773f WatchSource:0}: Error finding container f30403acba1804b6fc30bef473a69abc33df13d3f2797e1d3413d786539d773f: Status 404 returned error can't find the container with id f30403acba1804b6fc30bef473a69abc33df13d3f2797e1d3413d786539d773f Oct 31 00:30:09.949866 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.949828 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" event={"ID":"763474fc-e7d7-4494-ab00-26b851f669b3","Type":"ContainerStarted","Data":"3ccfb1f01539b3af876d65bfa1a474e08d90a37ce0a06f3f6f28780dfc5a4596"} Oct 31 00:30:09.950326 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.949887 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" event={"ID":"763474fc-e7d7-4494-ab00-26b851f669b3","Type":"ContainerStarted","Data":"f30403acba1804b6fc30bef473a69abc33df13d3f2797e1d3413d786539d773f"} Oct 31 00:30:09.950326 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.949917 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:09.951312 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.951285 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-f9fx6" event={"ID":"a3e896c7-cd93-4553-9161-44421f92b902","Type":"ContainerStarted","Data":"a73fb6f2945b1d1679aea655db07df55d4044ac63988be512033e163e0b19742"} Oct 31 00:30:09.993306 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:09.993259 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" podStartSLOduration=1.993247716 podStartE2EDuration="1.993247716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:30:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:30:09.992614616 +0000 UTC m=+24.275144972" watchObservedRunningTime="2026-10-31 00:30:09.993247716 +0000 UTC m=+24.275778067" Oct 31 00:30:10.955976 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:10.955937 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-f9fx6" event={"ID":"a3e896c7-cd93-4553-9161-44421f92b902","Type":"ContainerStarted","Data":"1378365c25d1c371b95705f1e620ae0530bc752fcd8686cbfaa69b727117fa39"} Oct 31 00:30:10.956381 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:10.956232 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-f9fx6" Oct 31 00:30:10.960744 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:10.960722 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-f9fx6" Oct 31 00:30:10.992459 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:10.992397 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-f9fx6" podStartSLOduration=2.079905098 podStartE2EDuration="2.992385955s" totalImagesPullingTime="912.480857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:30:10.992198348 +0000 UTC m=+25.274728703" watchObservedRunningTime="2026-10-31 00:30:10.992385955 +0000 UTC m=+25.274916307" Oct 31 00:30:11.841395 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:11.841363 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:11.951941 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:11.951909 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:11.975883 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:11.975856 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd"] Oct 31 00:30:11.978549 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:11.978523 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd" Oct 31 00:30:12.002672 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.002652 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Oct 31 00:30:12.002796 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.002683 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Oct 31 00:30:12.002796 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.002700 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 31 00:30:12.002796 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.002746 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 31 00:30:12.002930 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.002860 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 31 00:30:12.002973 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.002960 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fvq6n\"" Oct 31 00:30:12.003802 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.003785 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd"] Oct 31 00:30:12.096568 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.096509 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:12.102566 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.102544 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba1e35d4-03b6-4505-9a2b-4eee6e035c23-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-2nfgd\" (UID: \"ba1e35d4-03b6-4505-9a2b-4eee6e035c23\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd" Oct 31 00:30:12.102686 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.102587 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twbkt\" (UniqueName: \"kubernetes.io/projected/ba1e35d4-03b6-4505-9a2b-4eee6e035c23-kube-api-access-twbkt\") pod \"prometheus-operator-9cd89b74c-2nfgd\" (UID: \"ba1e35d4-03b6-4505-9a2b-4eee6e035c23\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd" Oct 31 00:30:12.102751 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.102703 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba1e35d4-03b6-4505-9a2b-4eee6e035c23-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-2nfgd\" (UID: \"ba1e35d4-03b6-4505-9a2b-4eee6e035c23\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd" Oct 31 00:30:12.102801 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.102748 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ba1e35d4-03b6-4505-9a2b-4eee6e035c23-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-2nfgd\" (UID: \"ba1e35d4-03b6-4505-9a2b-4eee6e035c23\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd" Oct 31 00:30:12.203852 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.203826 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba1e35d4-03b6-4505-9a2b-4eee6e035c23-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-2nfgd\" (UID: \"ba1e35d4-03b6-4505-9a2b-4eee6e035c23\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd" Oct 31 00:30:12.203939 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.203860 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twbkt\" (UniqueName: \"kubernetes.io/projected/ba1e35d4-03b6-4505-9a2b-4eee6e035c23-kube-api-access-twbkt\") pod \"prometheus-operator-9cd89b74c-2nfgd\" (UID: \"ba1e35d4-03b6-4505-9a2b-4eee6e035c23\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd" Oct 31 00:30:12.203939 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.203889 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba1e35d4-03b6-4505-9a2b-4eee6e035c23-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-2nfgd\" (UID: \"ba1e35d4-03b6-4505-9a2b-4eee6e035c23\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd" Oct 31 00:30:12.203939 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.203915 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ba1e35d4-03b6-4505-9a2b-4eee6e035c23-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-2nfgd\" (UID: \"ba1e35d4-03b6-4505-9a2b-4eee6e035c23\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd" Oct 31 00:30:12.204487 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.204469 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba1e35d4-03b6-4505-9a2b-4eee6e035c23-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-2nfgd\" (UID: \"ba1e35d4-03b6-4505-9a2b-4eee6e035c23\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd" Oct 31 00:30:12.206311 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.206293 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba1e35d4-03b6-4505-9a2b-4eee6e035c23-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-2nfgd\" (UID: \"ba1e35d4-03b6-4505-9a2b-4eee6e035c23\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd" Oct 31 00:30:12.206456 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.206440 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ba1e35d4-03b6-4505-9a2b-4eee6e035c23-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-2nfgd\" (UID: \"ba1e35d4-03b6-4505-9a2b-4eee6e035c23\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd" Oct 31 00:30:12.225871 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.225851 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twbkt\" (UniqueName: \"kubernetes.io/projected/ba1e35d4-03b6-4505-9a2b-4eee6e035c23-kube-api-access-twbkt\") pod \"prometheus-operator-9cd89b74c-2nfgd\" (UID: \"ba1e35d4-03b6-4505-9a2b-4eee6e035c23\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd" Oct 31 00:30:12.291153 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.291132 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd" Oct 31 00:30:12.583541 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.583510 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd"] Oct 31 00:30:12.587767 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:30:12.587741 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba1e35d4_03b6_4505_9a2b_4eee6e035c23.slice/crio-b14ba954959f34dd8ef364f7ab16c6acd7738019be73ef3e457f72dd9f992aef WatchSource:0}: Error finding container b14ba954959f34dd8ef364f7ab16c6acd7738019be73ef3e457f72dd9f992aef: Status 404 returned error can't find the container with id b14ba954959f34dd8ef364f7ab16c6acd7738019be73ef3e457f72dd9f992aef Oct 31 00:30:12.967654 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.967569 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd" event={"ID":"ba1e35d4-03b6-4505-9a2b-4eee6e035c23","Type":"ContainerStarted","Data":"b14ba954959f34dd8ef364f7ab16c6acd7738019be73ef3e457f72dd9f992aef"} Oct 31 00:30:12.986194 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:12.986163 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:13.104567 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:13.104533 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:13.971825 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:13.971793 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd" event={"ID":"ba1e35d4-03b6-4505-9a2b-4eee6e035c23","Type":"ContainerStarted","Data":"91fbac0eda87ec8c88f3b3e375ccfbe14477684725da788d8136dff1182f6752"} Oct 31 00:30:13.971984 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:13.971843 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd" event={"ID":"ba1e35d4-03b6-4505-9a2b-4eee6e035c23","Type":"ContainerStarted","Data":"a48628bcb3c13ff69f85db200df951ea48bf58bb739146f59b68cec73aadefc4"} Oct 31 00:30:14.431525 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:14.431446 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:14.545688 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:14.545656 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:16.291648 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.291614 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:16.450726 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.450662 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:16.569245 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.569168 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:16.616932 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.616873 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-2nfgd" podStartSLOduration=4.555707504 podStartE2EDuration="5.616855177s" totalImagesPullingTime="1.061147673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:30:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:30:14.023494611 +0000 UTC m=+28.306024966" watchObservedRunningTime="2026-10-31 00:30:16.616855177 +0000 UTC m=+30.899385532" Oct 31 00:30:16.617474 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.617449 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8b7q7"] Oct 31 00:30:16.647864 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.647843 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.661620 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.661602 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p92bw\"" Oct 31 00:30:16.662320 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.662301 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 31 00:30:16.662480 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.662356 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 31 00:30:16.672310 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.672290 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 31 00:30:16.687670 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.687650 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:16.736234 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.736199 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8671b96-0784-442b-bf11-6c0d2d59268d-metrics-client-ca\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.736347 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.736239 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc7wq\" (UniqueName: \"kubernetes.io/projected/e8671b96-0784-442b-bf11-6c0d2d59268d-kube-api-access-xc7wq\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.736347 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.736272 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8671b96-0784-442b-bf11-6c0d2d59268d-sys\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.736347 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.736319 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8671b96-0784-442b-bf11-6c0d2d59268d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.736530 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.736392 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8671b96-0784-442b-bf11-6c0d2d59268d-node-exporter-wtmp\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.736530 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.736435 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8671b96-0784-442b-bf11-6c0d2d59268d-node-exporter-accelerators-collector-config\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.736530 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.736487 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8671b96-0784-442b-bf11-6c0d2d59268d-node-exporter-tls\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.736530 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.736506 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8671b96-0784-442b-bf11-6c0d2d59268d-node-exporter-textfile\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.736530 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.736522 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8671b96-0784-442b-bf11-6c0d2d59268d-root\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.800993 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.800962 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:16.836980 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.836915 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8671b96-0784-442b-bf11-6c0d2d59268d-metrics-client-ca\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.836980 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.836944 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc7wq\" (UniqueName: \"kubernetes.io/projected/e8671b96-0784-442b-bf11-6c0d2d59268d-kube-api-access-xc7wq\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.836980 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.836974 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8671b96-0784-442b-bf11-6c0d2d59268d-sys\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.837158 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.837026 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8671b96-0784-442b-bf11-6c0d2d59268d-sys\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.837158 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.837053 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8671b96-0784-442b-bf11-6c0d2d59268d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.837158 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.837082 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8671b96-0784-442b-bf11-6c0d2d59268d-node-exporter-wtmp\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.837158 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.837103 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8671b96-0784-442b-bf11-6c0d2d59268d-node-exporter-accelerators-collector-config\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.837158 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.837131 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8671b96-0784-442b-bf11-6c0d2d59268d-node-exporter-tls\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.837365 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.837242 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8671b96-0784-442b-bf11-6c0d2d59268d-node-exporter-wtmp\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.837457 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.837438 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8671b96-0784-442b-bf11-6c0d2d59268d-node-exporter-textfile\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.837534 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.837476 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8671b96-0784-442b-bf11-6c0d2d59268d-root\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.837586 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.837567 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8671b96-0784-442b-bf11-6c0d2d59268d-root\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.837640 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.837604 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8671b96-0784-442b-bf11-6c0d2d59268d-metrics-client-ca\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.837852 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.837827 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8671b96-0784-442b-bf11-6c0d2d59268d-node-exporter-textfile\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.837925 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.837853 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8671b96-0784-442b-bf11-6c0d2d59268d-node-exporter-accelerators-collector-config\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.839616 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.839591 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8671b96-0784-442b-bf11-6c0d2d59268d-node-exporter-tls\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.839616 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.839604 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8671b96-0784-442b-bf11-6c0d2d59268d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.859640 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.859620 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc7wq\" (UniqueName: \"kubernetes.io/projected/e8671b96-0784-442b-bf11-6c0d2d59268d-kube-api-access-xc7wq\") pod \"node-exporter-8b7q7\" (UID: \"e8671b96-0784-442b-bf11-6c0d2d59268d\") " pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:16.914485 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.914458 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:16.997505 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:16.997482 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8b7q7" Oct 31 00:30:17.026592 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:17.026567 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:17.032250 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:30:17.032230 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8671b96_0784_442b_bf11_6c0d2d59268d.slice/crio-eb47a5752e79412c913d25d09ab6b9e48c6218fda3903a8a43e26ce13bfee563 WatchSource:0}: Error finding container eb47a5752e79412c913d25d09ab6b9e48c6218fda3903a8a43e26ce13bfee563: Status 404 returned error can't find the container with id eb47a5752e79412c913d25d09ab6b9e48c6218fda3903a8a43e26ce13bfee563 Oct 31 00:30:17.136662 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:17.136596 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:17.258064 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:17.258036 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:17.364894 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:17.364866 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:17.775447 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:17.775416 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:17.879893 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:17.879856 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:17.993550 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:17.993506 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8b7q7" event={"ID":"e8671b96-0784-442b-bf11-6c0d2d59268d","Type":"ContainerStarted","Data":"eb47a5752e79412c913d25d09ab6b9e48c6218fda3903a8a43e26ce13bfee563"} Oct 31 00:30:18.029901 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:18.029832 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:18.840479 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:18.840455 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-72nks" Oct 31 00:30:18.998474 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:18.998442 4557 generic.go:356] "Generic (PLEG): container finished" podID="e8671b96-0784-442b-bf11-6c0d2d59268d" containerID="733717730cfb199c53a5f206e1849a31e4f309ba13ca10912a27566f00fe0379" exitCode=0 Oct 31 00:30:18.998474 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:18.998476 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8b7q7" event={"ID":"e8671b96-0784-442b-bf11-6c0d2d59268d","Type":"ContainerDied","Data":"733717730cfb199c53a5f206e1849a31e4f309ba13ca10912a27566f00fe0379"} Oct 31 00:30:19.865839 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:19.865794 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:19.972068 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:19.972036 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:20.003882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:20.003852 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8b7q7" event={"ID":"e8671b96-0784-442b-bf11-6c0d2d59268d","Type":"ContainerStarted","Data":"b56e528cb2752bb994af356b6b2f6d2b423717f82de403537bb9e6970f1e1b29"} Oct 31 00:30:20.004012 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:20.003903 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8b7q7" event={"ID":"e8671b96-0784-442b-bf11-6c0d2d59268d","Type":"ContainerStarted","Data":"06ab729cdfa03490f41fc515f6e0d674edaaad4d47283f3477e529f8409098dd"} Oct 31 00:30:20.051860 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:20.051819 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8b7q7" podStartSLOduration=2.620472375 podStartE2EDuration="4.051805842s" totalImagesPullingTime="1.355178498s" totalInitContainerRuntime="76.154969ms" isStatefulPod=true podCreationTimestamp="2026-10-31 00:30:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:30:20.050791135 +0000 UTC m=+34.333321490" watchObservedRunningTime="2026-10-31 00:30:20.051805842 +0000 UTC m=+34.334336233" Oct 31 00:30:20.083189 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:20.083151 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:21.415030 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:21.414993 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:21.623765 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:21.623734 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:21.818020 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:21.817960 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:21.933786 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:21.933747 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:21.965151 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:30:21.965113 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:30:22.067660 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:22.067629 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:22.182727 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:22.182651 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:22.398962 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:22.398933 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:22.504654 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:22.504554 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:22.616889 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:22.616854 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:23.543554 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:23.543517 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:23.679056 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:23.679019 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:23.863907 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:23.863828 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-67c55c5c5d-886vx"] Oct 31 00:30:23.866988 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:23.866967 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:23.890988 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:23.890953 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 31 00:30:23.890988 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:23.890966 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 31 00:30:23.891283 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:23.891015 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 31 00:30:23.891283 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:23.891050 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 31 00:30:23.891283 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:23.891020 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 31 00:30:23.892042 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:23.892019 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67c55c5c5d-886vx"] Oct 31 00:30:23.974240 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:23.974209 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vqrdt\"" Oct 31 00:30:23.974240 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:23.974234 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 31 00:30:23.974484 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:23.974216 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 31 00:30:23.993263 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:23.993227 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-config\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:23.993462 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:23.993283 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-serving-cert\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:23.993462 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:23.993422 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmx9g\" (UniqueName: \"kubernetes.io/projected/c22691cb-e15f-4dbd-817c-9e4972b435d1-kube-api-access-fmx9g\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:23.993462 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:23.993456 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-oauth-config\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:23.993633 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:23.993491 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-oauth-serving-cert\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:23.993689 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:23.993630 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-service-ca\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:23.993726 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:23.993691 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c22691cb-e15f-4dbd-817c-9e4972b435d1-tmp\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:24.094925 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:24.094890 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-service-ca\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:24.094925 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:24.094928 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c22691cb-e15f-4dbd-817c-9e4972b435d1-tmp\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:24.095184 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:24.094968 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-config\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:24.095184 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:24.094993 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-serving-cert\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:24.095184 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:24.095034 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmx9g\" (UniqueName: \"kubernetes.io/projected/c22691cb-e15f-4dbd-817c-9e4972b435d1-kube-api-access-fmx9g\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:24.095184 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:24.095060 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-oauth-config\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:24.095184 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:24.095098 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-oauth-serving-cert\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:24.095599 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:24.095571 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c22691cb-e15f-4dbd-817c-9e4972b435d1-tmp\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:24.095837 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:24.095806 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-config\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:24.095948 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:24.095838 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-service-ca\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:24.095948 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:24.095892 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-oauth-serving-cert\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:24.097673 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:24.097653 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-oauth-config\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:24.097750 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:24.097660 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-serving-cert\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:24.117699 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:24.117634 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmx9g\" (UniqueName: \"kubernetes.io/projected/c22691cb-e15f-4dbd-817c-9e4972b435d1-kube-api-access-fmx9g\") pod \"console-67c55c5c5d-886vx\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:24.178808 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:24.178776 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:24.483071 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:24.483039 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67c55c5c5d-886vx"] Oct 31 00:30:24.487831 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:30:24.487797 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22691cb_e15f_4dbd_817c_9e4972b435d1.slice/crio-ca78fec5a75890200fc6af5eeb2c67b027fbbc5e5594a426c21039a8893032ff WatchSource:0}: Error finding container ca78fec5a75890200fc6af5eeb2c67b027fbbc5e5594a426c21039a8893032ff: Status 404 returned error can't find the container with id ca78fec5a75890200fc6af5eeb2c67b027fbbc5e5594a426c21039a8893032ff Oct 31 00:30:25.020546 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:25.020502 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67c55c5c5d-886vx" event={"ID":"c22691cb-e15f-4dbd-817c-9e4972b435d1","Type":"ContainerStarted","Data":"ca78fec5a75890200fc6af5eeb2c67b027fbbc5e5594a426c21039a8893032ff"} Oct 31 00:30:26.199466 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:26.199179 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:26.309517 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:26.309482 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:27.591742 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:27.591706 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:27.697585 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:27.697468 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:27.808009 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:27.807976 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:27.914060 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:27.914025 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:28.035262 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:28.035224 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67c55c5c5d-886vx" event={"ID":"c22691cb-e15f-4dbd-817c-9e4972b435d1","Type":"ContainerStarted","Data":"387db297dff82f2c2354f447be05a35e4f49643a925eda1c515e259fb8cf901a"} Oct 31 00:30:28.075495 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:28.075441 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-67c55c5c5d-886vx" podStartSLOduration=2.199209508 podStartE2EDuration="5.07542442s" totalImagesPullingTime="2.876214912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:30:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:30:28.074472363 +0000 UTC m=+42.357002717" watchObservedRunningTime="2026-10-31 00:30:28.07542442 +0000 UTC m=+42.357954767" Oct 31 00:30:30.962974 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:30.962940 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7fd6dc794f-2h9wb" Oct 31 00:30:31.159221 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:31.159189 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:31.365135 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:31.365097 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:31.468816 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:31.468780 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:31.813467 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:31.813421 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:32.014896 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:32.014854 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:32.932974 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:32.932935 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:33.038417 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:33.038374 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:33.210937 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:33.210859 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:33.337854 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:33.337823 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:34.179920 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:34.179880 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:34.180313 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:34.179938 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:34.184626 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:34.184603 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:35.061936 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:35.061910 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:30:37.248482 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.248452 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c74b57c8f-gsdst"] Oct 31 00:30:37.250896 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.250874 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.299235 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.299197 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Oct 31 00:30:37.299865 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.299842 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c74b57c8f-gsdst"] Oct 31 00:30:37.403356 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.403320 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kj9f\" (UniqueName: \"kubernetes.io/projected/f1d69b98-1507-4852-9311-7d7a582de098-kube-api-access-9kj9f\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.403356 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.403360 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1d69b98-1507-4852-9311-7d7a582de098-tmp\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.403596 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.403487 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1d69b98-1507-4852-9311-7d7a582de098-console-serving-cert\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.403596 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.403519 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-trusted-ca-bundle\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.403596 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.403585 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1d69b98-1507-4852-9311-7d7a582de098-console-oauth-config\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.403745 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.403610 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-console-config\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.403745 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.403660 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-service-ca\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.403745 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.403740 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-oauth-serving-cert\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.504714 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.504643 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1d69b98-1507-4852-9311-7d7a582de098-console-serving-cert\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.504714 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.504677 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-trusted-ca-bundle\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.504714 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.504707 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1d69b98-1507-4852-9311-7d7a582de098-console-oauth-config\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.504954 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.504740 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-console-config\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.504954 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.504762 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-service-ca\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.504954 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.504790 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-oauth-serving-cert\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.504954 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.504825 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kj9f\" (UniqueName: \"kubernetes.io/projected/f1d69b98-1507-4852-9311-7d7a582de098-kube-api-access-9kj9f\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.504954 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.504865 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1d69b98-1507-4852-9311-7d7a582de098-tmp\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.505301 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.505273 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1d69b98-1507-4852-9311-7d7a582de098-tmp\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.505694 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.505668 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-service-ca\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.505807 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.505704 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-oauth-serving-cert\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.505867 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.505805 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-trusted-ca-bundle\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.506148 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.506126 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-console-config\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.507190 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.507167 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1d69b98-1507-4852-9311-7d7a582de098-console-oauth-config\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.507294 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.507276 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1d69b98-1507-4852-9311-7d7a582de098-console-serving-cert\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.527882 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.527859 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kj9f\" (UniqueName: \"kubernetes.io/projected/f1d69b98-1507-4852-9311-7d7a582de098-kube-api-access-9kj9f\") pod \"console-7c74b57c8f-gsdst\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.560766 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.560738 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:37.858756 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:37.858676 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c74b57c8f-gsdst"] Oct 31 00:30:37.863200 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:30:37.863167 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1d69b98_1507_4852_9311_7d7a582de098.slice/crio-e1b41cdbe750c5d233936b41d6fb3152cd64d9f762794edbf5663c6a49947171 WatchSource:0}: Error finding container e1b41cdbe750c5d233936b41d6fb3152cd64d9f762794edbf5663c6a49947171: Status 404 returned error can't find the container with id e1b41cdbe750c5d233936b41d6fb3152cd64d9f762794edbf5663c6a49947171 Oct 31 00:30:38.071745 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:38.071705 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c74b57c8f-gsdst" event={"ID":"f1d69b98-1507-4852-9311-7d7a582de098","Type":"ContainerStarted","Data":"12aafaaaafd95393455f979bede68afc77f3474cf1bac18a6849db9b5c8c65b6"} Oct 31 00:30:38.071904 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:38.071767 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c74b57c8f-gsdst" event={"ID":"f1d69b98-1507-4852-9311-7d7a582de098","Type":"ContainerStarted","Data":"e1b41cdbe750c5d233936b41d6fb3152cd64d9f762794edbf5663c6a49947171"} Oct 31 00:30:38.114291 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:38.114189 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-7c74b57c8f-gsdst" podStartSLOduration=1.114172237 podStartE2EDuration="1.114172237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:30:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:30:38.113429258 +0000 UTC m=+52.395959612" watchObservedRunningTime="2026-10-31 00:30:38.114172237 +0000 UTC m=+52.396702594" Oct 31 00:30:39.422222 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:39.422187 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:39.528463 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:39.528421 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:47.561862 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:47.561823 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:47.562273 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:47.561903 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:47.566993 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:47.566969 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:47.935980 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:47.935895 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:48.055613 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:48.055583 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:48.107788 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:48.107767 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:30:48.178834 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:48.178810 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67c55c5c5d-886vx"] Oct 31 00:30:51.960219 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:30:51.960185 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:30:53.827800 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:53.827765 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:53.931442 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:53.931399 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:56.489637 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.489591 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:56.548876 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.548845 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-85996d4459-2tw6b"] Oct 31 00:30:56.551701 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.551679 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.581380 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.581343 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85996d4459-2tw6b"] Oct 31 00:30:56.613297 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.613264 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:56.636552 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.636523 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f1cffe3-808c-48cb-9a90-3935986985c9-oauth-serving-cert\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.636664 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.636560 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1cffe3-808c-48cb-9a90-3935986985c9-service-ca\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.636664 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.636591 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f1cffe3-808c-48cb-9a90-3935986985c9-console-oauth-config\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.636732 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.636658 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f1cffe3-808c-48cb-9a90-3935986985c9-tmp\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.636732 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.636695 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f1cffe3-808c-48cb-9a90-3935986985c9-console-config\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.636732 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.636712 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f1cffe3-808c-48cb-9a90-3935986985c9-trusted-ca-bundle\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.636822 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.636741 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f1cffe3-808c-48cb-9a90-3935986985c9-console-serving-cert\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.636822 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.636797 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssmzp\" (UniqueName: \"kubernetes.io/projected/2f1cffe3-808c-48cb-9a90-3935986985c9-kube-api-access-ssmzp\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.737899 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.737863 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f1cffe3-808c-48cb-9a90-3935986985c9-console-oauth-config\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.737899 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.737899 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f1cffe3-808c-48cb-9a90-3935986985c9-tmp\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.738095 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.737932 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f1cffe3-808c-48cb-9a90-3935986985c9-console-config\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.738095 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.737956 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f1cffe3-808c-48cb-9a90-3935986985c9-trusted-ca-bundle\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.738095 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.737996 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f1cffe3-808c-48cb-9a90-3935986985c9-console-serving-cert\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.738095 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.738072 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssmzp\" (UniqueName: \"kubernetes.io/projected/2f1cffe3-808c-48cb-9a90-3935986985c9-kube-api-access-ssmzp\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.738290 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.738145 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f1cffe3-808c-48cb-9a90-3935986985c9-oauth-serving-cert\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.738290 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.738195 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1cffe3-808c-48cb-9a90-3935986985c9-service-ca\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.738392 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.738330 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f1cffe3-808c-48cb-9a90-3935986985c9-tmp\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.738896 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.738869 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f1cffe3-808c-48cb-9a90-3935986985c9-console-config\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.738994 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.738898 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f1cffe3-808c-48cb-9a90-3935986985c9-oauth-serving-cert\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.738994 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.738923 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1cffe3-808c-48cb-9a90-3935986985c9-service-ca\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.738994 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.738929 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f1cffe3-808c-48cb-9a90-3935986985c9-trusted-ca-bundle\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.740645 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.740580 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f1cffe3-808c-48cb-9a90-3935986985c9-console-oauth-config\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.740645 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.740601 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f1cffe3-808c-48cb-9a90-3935986985c9-console-serving-cert\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.762716 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.762697 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssmzp\" (UniqueName: \"kubernetes.io/projected/2f1cffe3-808c-48cb-9a90-3935986985c9-kube-api-access-ssmzp\") pod \"console-85996d4459-2tw6b\" (UID: \"2f1cffe3-808c-48cb-9a90-3935986985c9\") " pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:56.864427 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:56.864395 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:30:57.158986 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:57.158861 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85996d4459-2tw6b"] Oct 31 00:30:57.162845 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:30:57.162816 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f1cffe3_808c_48cb_9a90_3935986985c9.slice/crio-e371cc18492eec4ada59c84f0fcc1cff7a35aea99faec36c5429b63ec13adfaa WatchSource:0}: Error finding container e371cc18492eec4ada59c84f0fcc1cff7a35aea99faec36c5429b63ec13adfaa: Status 404 returned error can't find the container with id e371cc18492eec4ada59c84f0fcc1cff7a35aea99faec36c5429b63ec13adfaa Oct 31 00:30:58.139533 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:58.139499 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85996d4459-2tw6b" event={"ID":"2f1cffe3-808c-48cb-9a90-3935986985c9","Type":"ContainerStarted","Data":"0099908018a5f5de40985713513db19d829c57acb392db944242545a56e3c333"} Oct 31 00:30:58.139952 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:58.139553 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85996d4459-2tw6b" event={"ID":"2f1cffe3-808c-48cb-9a90-3935986985c9","Type":"ContainerStarted","Data":"e371cc18492eec4ada59c84f0fcc1cff7a35aea99faec36c5429b63ec13adfaa"} Oct 31 00:30:58.182032 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:58.181983 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-85996d4459-2tw6b" podStartSLOduration=2.181967279 podStartE2EDuration="2.181967279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:30:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:30:58.181238153 +0000 UTC m=+72.463768535" watchObservedRunningTime="2026-10-31 00:30:58.181967279 +0000 UTC m=+72.464497634" Oct 31 00:30:58.629557 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:58.629526 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-wsp74-v7vxc"] Oct 31 00:30:58.629724 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:58.629709 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-wsp74-v7vxc" podUID="cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f" containerName="insights-gathering" containerID="cri-o://006cafdc7a00d04f0579d07691858e641b5e4d0feb38c5ac911a3a2722288400" gracePeriod=30 Oct 31 00:30:58.875930 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:58.875908 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:30:58.954261 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:58.954177 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-kube-api-access-8lc56\" (UniqueName: \"kubernetes.io/projected/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-kube-api-access-8lc56\") pod \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " Oct 31 00:30:58.954261 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:58.954222 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-service-ca-bundle\") pod \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " Oct 31 00:30:58.954504 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:58.954275 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-archives-path\") pod \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " Oct 31 00:30:58.954504 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:58.954320 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-trusted-ca-bundle\") pod \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\" (UID: \"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f\") " Oct 31 00:30:58.954674 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:58.954646 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-archives-path" pod "cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f" (UID: "cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:30:58.954776 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:58.954678 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-service-ca-bundle" pod "cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f" (UID: "cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:30:58.954776 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:58.954724 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-trusted-ca-bundle" pod "cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f" (UID: "cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:30:58.956224 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:58.956202 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-kube-api-access-8lc56" pod "cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f" (UID: "cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f"). InnerVolumeSpecName "kube-api-access-8lc56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:30:59.055141 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:59.055096 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lc56\" (UniqueName: \"kubernetes.io/projected/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-kube-api-access-8lc56\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:30:59.055141 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:59.055136 4557 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-service-ca-bundle\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:30:59.055141 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:59.055148 4557 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-archives-path\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:30:59.055141 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:59.055157 4557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f-trusted-ca-bundle\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:30:59.143937 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:59.143907 4557 generic.go:356] "Generic (PLEG): container finished" podID="cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f" containerID="006cafdc7a00d04f0579d07691858e641b5e4d0feb38c5ac911a3a2722288400" exitCode=2 Oct 31 00:30:59.144394 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:59.143954 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-wsp74-v7vxc" Oct 31 00:30:59.144394 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:59.143985 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-wsp74-v7vxc" event={"ID":"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f","Type":"ContainerDied","Data":"006cafdc7a00d04f0579d07691858e641b5e4d0feb38c5ac911a3a2722288400"} Oct 31 00:30:59.144394 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:59.144030 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-wsp74-v7vxc" event={"ID":"cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f","Type":"ContainerDied","Data":"e807bc96b27ed8944bebe9f12a13e530aecf4b0aa93cbb1b2f675645bc15be20"} Oct 31 00:30:59.144394 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:59.144050 4557 scope.go:122] "RemoveContainer" containerID="006cafdc7a00d04f0579d07691858e641b5e4d0feb38c5ac911a3a2722288400" Oct 31 00:30:59.153626 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:59.153606 4557 scope.go:122] "RemoveContainer" containerID="006cafdc7a00d04f0579d07691858e641b5e4d0feb38c5ac911a3a2722288400" Oct 31 00:30:59.153897 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:30:59.153878 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"006cafdc7a00d04f0579d07691858e641b5e4d0feb38c5ac911a3a2722288400\": container with ID starting with 006cafdc7a00d04f0579d07691858e641b5e4d0feb38c5ac911a3a2722288400 not found: ID does not exist" containerID="006cafdc7a00d04f0579d07691858e641b5e4d0feb38c5ac911a3a2722288400" Oct 31 00:30:59.153968 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:59.153909 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"006cafdc7a00d04f0579d07691858e641b5e4d0feb38c5ac911a3a2722288400"} err="failed to get container status \"006cafdc7a00d04f0579d07691858e641b5e4d0feb38c5ac911a3a2722288400\": rpc error: code = NotFound desc = could not find container \"006cafdc7a00d04f0579d07691858e641b5e4d0feb38c5ac911a3a2722288400\": container with ID starting with 006cafdc7a00d04f0579d07691858e641b5e4d0feb38c5ac911a3a2722288400 not found: ID does not exist" Oct 31 00:30:59.191216 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:59.191196 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-wsp74-v7vxc"] Oct 31 00:30:59.201793 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:59.201770 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-wsp74-v7vxc"] Oct 31 00:30:59.820861 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:30:59.820831 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f" path="/var/lib/kubelet/pods/cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f/volumes" Oct 31 00:31:01.073456 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:01.073420 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:01.178950 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:01.178919 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:02.029152 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:02.029117 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:02.132318 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:02.132286 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:06.865466 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:06.865435 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:31:06.865901 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:06.865499 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:31:06.870169 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:06.870150 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:31:07.178085 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:07.178010 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85996d4459-2tw6b" Oct 31 00:31:07.249035 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:07.249004 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c74b57c8f-gsdst"] Oct 31 00:31:12.675611 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:12.675578 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:12.779852 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:12.779817 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:13.197777 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.197742 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-67c55c5c5d-886vx" podUID="c22691cb-e15f-4dbd-817c-9e4972b435d1" containerName="console" containerID="cri-o://387db297dff82f2c2354f447be05a35e4f49643a925eda1c515e259fb8cf901a" gracePeriod=15 Oct 31 00:31:13.441792 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.441769 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:31:13.563006 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.562975 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-service-ca\" (UniqueName: \"kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-service-ca\") pod \"c22691cb-e15f-4dbd-817c-9e4972b435d1\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " Oct 31 00:31:13.563167 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.563026 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c22691cb-e15f-4dbd-817c-9e4972b435d1-tmp\" (UniqueName: \"kubernetes.io/empty-dir/c22691cb-e15f-4dbd-817c-9e4972b435d1-tmp\") pod \"c22691cb-e15f-4dbd-817c-9e4972b435d1\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " Oct 31 00:31:13.563167 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.563068 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c22691cb-e15f-4dbd-817c-9e4972b435d1-kube-api-access-fmx9g\" (UniqueName: \"kubernetes.io/projected/c22691cb-e15f-4dbd-817c-9e4972b435d1-kube-api-access-fmx9g\") pod \"c22691cb-e15f-4dbd-817c-9e4972b435d1\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " Oct 31 00:31:13.563167 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.563088 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-config\" (UniqueName: \"kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-config\") pod \"c22691cb-e15f-4dbd-817c-9e4972b435d1\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " Oct 31 00:31:13.563167 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.563106 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-oauth-serving-cert\") pod \"c22691cb-e15f-4dbd-817c-9e4972b435d1\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " Oct 31 00:31:13.563167 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.563131 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-oauth-config\") pod \"c22691cb-e15f-4dbd-817c-9e4972b435d1\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " Oct 31 00:31:13.563167 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.563151 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-serving-cert\") pod \"c22691cb-e15f-4dbd-817c-9e4972b435d1\" (UID: \"c22691cb-e15f-4dbd-817c-9e4972b435d1\") " Oct 31 00:31:13.563632 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.563542 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c22691cb-e15f-4dbd-817c-9e4972b435d1-tmp" pod "c22691cb-e15f-4dbd-817c-9e4972b435d1" (UID: "c22691cb-e15f-4dbd-817c-9e4972b435d1"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:31:13.563632 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.563583 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-service-ca" pod "c22691cb-e15f-4dbd-817c-9e4972b435d1" (UID: "c22691cb-e15f-4dbd-817c-9e4972b435d1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:31:13.563773 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.563666 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-config" pod "c22691cb-e15f-4dbd-817c-9e4972b435d1" (UID: "c22691cb-e15f-4dbd-817c-9e4972b435d1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:31:13.563773 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.563672 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-oauth-serving-cert" pod "c22691cb-e15f-4dbd-817c-9e4972b435d1" (UID: "c22691cb-e15f-4dbd-817c-9e4972b435d1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:31:13.565524 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.565500 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-serving-cert" pod "c22691cb-e15f-4dbd-817c-9e4972b435d1" (UID: "c22691cb-e15f-4dbd-817c-9e4972b435d1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:31:13.565618 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.565528 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-oauth-config" pod "c22691cb-e15f-4dbd-817c-9e4972b435d1" (UID: "c22691cb-e15f-4dbd-817c-9e4972b435d1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:31:13.565618 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.565557 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c22691cb-e15f-4dbd-817c-9e4972b435d1-kube-api-access-fmx9g" pod "c22691cb-e15f-4dbd-817c-9e4972b435d1" (UID: "c22691cb-e15f-4dbd-817c-9e4972b435d1"). InnerVolumeSpecName "kube-api-access-fmx9g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:31:13.664558 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.664531 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmx9g\" (UniqueName: \"kubernetes.io/projected/c22691cb-e15f-4dbd-817c-9e4972b435d1-kube-api-access-fmx9g\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:31:13.664558 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.664553 4557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-config\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:31:13.664690 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.664563 4557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-oauth-serving-cert\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:31:13.664690 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.664572 4557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-oauth-config\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:31:13.664690 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.664582 4557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c22691cb-e15f-4dbd-817c-9e4972b435d1-console-serving-cert\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:31:13.664690 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.664591 4557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c22691cb-e15f-4dbd-817c-9e4972b435d1-service-ca\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:31:13.664690 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:13.664600 4557 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c22691cb-e15f-4dbd-817c-9e4972b435d1-tmp\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:31:14.197842 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:14.197751 4557 generic.go:356] "Generic (PLEG): container finished" podID="c22691cb-e15f-4dbd-817c-9e4972b435d1" containerID="387db297dff82f2c2354f447be05a35e4f49643a925eda1c515e259fb8cf901a" exitCode=0 Oct 31 00:31:14.197842 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:14.197795 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67c55c5c5d-886vx" event={"ID":"c22691cb-e15f-4dbd-817c-9e4972b435d1","Type":"ContainerDied","Data":"387db297dff82f2c2354f447be05a35e4f49643a925eda1c515e259fb8cf901a"} Oct 31 00:31:14.197842 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:14.197811 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67c55c5c5d-886vx" Oct 31 00:31:14.197842 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:14.197840 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67c55c5c5d-886vx" event={"ID":"c22691cb-e15f-4dbd-817c-9e4972b435d1","Type":"ContainerDied","Data":"ca78fec5a75890200fc6af5eeb2c67b027fbbc5e5594a426c21039a8893032ff"} Oct 31 00:31:14.198433 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:14.197863 4557 scope.go:122] "RemoveContainer" containerID="387db297dff82f2c2354f447be05a35e4f49643a925eda1c515e259fb8cf901a" Oct 31 00:31:14.207810 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:14.207790 4557 scope.go:122] "RemoveContainer" containerID="387db297dff82f2c2354f447be05a35e4f49643a925eda1c515e259fb8cf901a" Oct 31 00:31:14.208227 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:31:14.208204 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"387db297dff82f2c2354f447be05a35e4f49643a925eda1c515e259fb8cf901a\": container with ID starting with 387db297dff82f2c2354f447be05a35e4f49643a925eda1c515e259fb8cf901a not found: ID does not exist" containerID="387db297dff82f2c2354f447be05a35e4f49643a925eda1c515e259fb8cf901a" Oct 31 00:31:14.208315 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:14.208237 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"387db297dff82f2c2354f447be05a35e4f49643a925eda1c515e259fb8cf901a"} err="failed to get container status \"387db297dff82f2c2354f447be05a35e4f49643a925eda1c515e259fb8cf901a\": rpc error: code = NotFound desc = could not find container \"387db297dff82f2c2354f447be05a35e4f49643a925eda1c515e259fb8cf901a\": container with ID starting with 387db297dff82f2c2354f447be05a35e4f49643a925eda1c515e259fb8cf901a not found: ID does not exist" Oct 31 00:31:14.243844 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:14.243819 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67c55c5c5d-886vx"] Oct 31 00:31:14.254534 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:14.254511 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67c55c5c5d-886vx"] Oct 31 00:31:15.820395 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:15.820362 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c22691cb-e15f-4dbd-817c-9e4972b435d1" path="/var/lib/kubelet/pods/c22691cb-e15f-4dbd-817c-9e4972b435d1/volumes" Oct 31 00:31:17.943005 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:17.942973 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:18.048659 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:18.048615 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:21.960918 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:31:21.960880 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:31:30.879753 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:30.879715 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:32.267714 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.267660 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-7c74b57c8f-gsdst" podUID="f1d69b98-1507-4852-9311-7d7a582de098" containerName="console" containerID="cri-o://12aafaaaafd95393455f979bede68afc77f3474cf1bac18a6849db9b5c8c65b6" gracePeriod=15 Oct 31 00:31:32.511161 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.511138 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:31:32.592651 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.592585 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-oauth-serving-cert\") pod \"f1d69b98-1507-4852-9311-7d7a582de098\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " Oct 31 00:31:32.592651 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.592626 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-service-ca\") pod \"f1d69b98-1507-4852-9311-7d7a582de098\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " Oct 31 00:31:32.592864 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.592675 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-trusted-ca-bundle\") pod \"f1d69b98-1507-4852-9311-7d7a582de098\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " Oct 31 00:31:32.592864 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.592711 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f1d69b98-1507-4852-9311-7d7a582de098-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1d69b98-1507-4852-9311-7d7a582de098-console-oauth-config\") pod \"f1d69b98-1507-4852-9311-7d7a582de098\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " Oct 31 00:31:32.592864 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.592746 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f1d69b98-1507-4852-9311-7d7a582de098-kube-api-access-9kj9f\" (UniqueName: \"kubernetes.io/projected/f1d69b98-1507-4852-9311-7d7a582de098-kube-api-access-9kj9f\") pod \"f1d69b98-1507-4852-9311-7d7a582de098\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " Oct 31 00:31:32.592864 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.592775 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f1d69b98-1507-4852-9311-7d7a582de098-tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1d69b98-1507-4852-9311-7d7a582de098-tmp\") pod \"f1d69b98-1507-4852-9311-7d7a582de098\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " Oct 31 00:31:32.592864 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.592826 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f1d69b98-1507-4852-9311-7d7a582de098-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1d69b98-1507-4852-9311-7d7a582de098-console-serving-cert\") pod \"f1d69b98-1507-4852-9311-7d7a582de098\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " Oct 31 00:31:32.592864 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.592858 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-console-config\" (UniqueName: \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-console-config\") pod \"f1d69b98-1507-4852-9311-7d7a582de098\" (UID: \"f1d69b98-1507-4852-9311-7d7a582de098\") " Oct 31 00:31:32.593157 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.593042 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-oauth-serving-cert" pod "f1d69b98-1507-4852-9311-7d7a582de098" (UID: "f1d69b98-1507-4852-9311-7d7a582de098"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:31:32.593157 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.593139 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-service-ca" pod "f1d69b98-1507-4852-9311-7d7a582de098" (UID: "f1d69b98-1507-4852-9311-7d7a582de098"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:31:32.593320 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.593277 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-trusted-ca-bundle" pod "f1d69b98-1507-4852-9311-7d7a582de098" (UID: "f1d69b98-1507-4852-9311-7d7a582de098"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:31:32.593458 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.593369 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-console-config" pod "f1d69b98-1507-4852-9311-7d7a582de098" (UID: "f1d69b98-1507-4852-9311-7d7a582de098"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:31:32.593521 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.593447 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1d69b98-1507-4852-9311-7d7a582de098-tmp" pod "f1d69b98-1507-4852-9311-7d7a582de098" (UID: "f1d69b98-1507-4852-9311-7d7a582de098"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:31:32.594909 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.594885 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1d69b98-1507-4852-9311-7d7a582de098-console-oauth-config" pod "f1d69b98-1507-4852-9311-7d7a582de098" (UID: "f1d69b98-1507-4852-9311-7d7a582de098"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:31:32.595414 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.595371 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1d69b98-1507-4852-9311-7d7a582de098-console-serving-cert" pod "f1d69b98-1507-4852-9311-7d7a582de098" (UID: "f1d69b98-1507-4852-9311-7d7a582de098"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:31:32.595484 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.595390 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1d69b98-1507-4852-9311-7d7a582de098-kube-api-access-9kj9f" pod "f1d69b98-1507-4852-9311-7d7a582de098" (UID: "f1d69b98-1507-4852-9311-7d7a582de098"). InnerVolumeSpecName "kube-api-access-9kj9f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:31:32.693919 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.693895 4557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1d69b98-1507-4852-9311-7d7a582de098-console-oauth-config\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:31:32.693919 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.693917 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kj9f\" (UniqueName: \"kubernetes.io/projected/f1d69b98-1507-4852-9311-7d7a582de098-kube-api-access-9kj9f\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:31:32.694066 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.693927 4557 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1d69b98-1507-4852-9311-7d7a582de098-tmp\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:31:32.694066 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.693936 4557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1d69b98-1507-4852-9311-7d7a582de098-console-serving-cert\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:31:32.694066 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.693945 4557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-console-config\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:31:32.694066 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.693954 4557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-oauth-serving-cert\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:31:32.694066 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.693962 4557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-service-ca\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:31:32.694066 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:32.693970 4557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d69b98-1507-4852-9311-7d7a582de098-trusted-ca-bundle\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:31:33.261088 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:33.261053 4557 generic.go:356] "Generic (PLEG): container finished" podID="f1d69b98-1507-4852-9311-7d7a582de098" containerID="12aafaaaafd95393455f979bede68afc77f3474cf1bac18a6849db9b5c8c65b6" exitCode=0 Oct 31 00:31:33.261088 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:33.261090 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c74b57c8f-gsdst" event={"ID":"f1d69b98-1507-4852-9311-7d7a582de098","Type":"ContainerDied","Data":"12aafaaaafd95393455f979bede68afc77f3474cf1bac18a6849db9b5c8c65b6"} Oct 31 00:31:33.261310 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:33.261101 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c74b57c8f-gsdst" Oct 31 00:31:33.261310 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:33.261123 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c74b57c8f-gsdst" event={"ID":"f1d69b98-1507-4852-9311-7d7a582de098","Type":"ContainerDied","Data":"e1b41cdbe750c5d233936b41d6fb3152cd64d9f762794edbf5663c6a49947171"} Oct 31 00:31:33.261310 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:33.261144 4557 scope.go:122] "RemoveContainer" containerID="12aafaaaafd95393455f979bede68afc77f3474cf1bac18a6849db9b5c8c65b6" Oct 31 00:31:33.269875 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:33.269698 4557 scope.go:122] "RemoveContainer" containerID="12aafaaaafd95393455f979bede68afc77f3474cf1bac18a6849db9b5c8c65b6" Oct 31 00:31:33.271984 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:31:33.271960 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12aafaaaafd95393455f979bede68afc77f3474cf1bac18a6849db9b5c8c65b6\": container with ID starting with 12aafaaaafd95393455f979bede68afc77f3474cf1bac18a6849db9b5c8c65b6 not found: ID does not exist" containerID="12aafaaaafd95393455f979bede68afc77f3474cf1bac18a6849db9b5c8c65b6" Oct 31 00:31:33.272075 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:33.271995 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12aafaaaafd95393455f979bede68afc77f3474cf1bac18a6849db9b5c8c65b6"} err="failed to get container status \"12aafaaaafd95393455f979bede68afc77f3474cf1bac18a6849db9b5c8c65b6\": rpc error: code = NotFound desc = could not find container \"12aafaaaafd95393455f979bede68afc77f3474cf1bac18a6849db9b5c8c65b6\": container with ID starting with 12aafaaaafd95393455f979bede68afc77f3474cf1bac18a6849db9b5c8c65b6 not found: ID does not exist" Oct 31 00:31:33.307793 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:33.307772 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c74b57c8f-gsdst"] Oct 31 00:31:33.318518 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:33.318493 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c74b57c8f-gsdst"] Oct 31 00:31:33.333123 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:33.333097 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:33.820967 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:33.820936 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f1d69b98-1507-4852-9311-7d7a582de098" path="/var/lib/kubelet/pods/f1d69b98-1507-4852-9311-7d7a582de098/volumes" Oct 31 00:31:51.961119 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:31:51.961068 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:31:57.900826 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:31:57.900735 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:32:21.960565 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:32:21.960527 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:32:26.073593 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:32:26.073549 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:32:26.182384 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:32:26.182355 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:32:33.465589 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:32:33.465541 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:32:51.959815 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:32:51.959767 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:32:58.845338 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:32:58.845299 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:32:58.952247 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:32:58.952203 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:33:16.696237 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:33:16.696192 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:33:21.960604 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:33:21.960567 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:33:29.128724 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:33:29.128649 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:33:29.239533 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:33:29.239503 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:33:32.043014 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:33:32.042964 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:33:33.585664 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:33:33.585617 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:33:51.960658 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:33:51.960620 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:34:08.237705 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:08.237673 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:11.507262 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:11.507219 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:11.619510 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:11.619462 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:11.726079 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:11.726053 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:21.960257 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:34:21.960217 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:34:22.720748 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:22.720696 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:22.869773 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:22.869742 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:33.715560 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:33.715521 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:34.575365 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:34.575334 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:34.687276 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:34.687249 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:41.410264 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:41.410228 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:42.109305 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.109274 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:42.227906 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.227874 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:42.721684 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.721651 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:42.790055 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.790022 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-86bd856cfb-mj8v2"] Oct 31 00:34:42.790343 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.790324 4557 cpu_manager.go:414] "containerMap: removing container" podUID="cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f" containerName="insights-gathering" Oct 31 00:34:42.790397 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.790345 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f" containerName="insights-gathering" Oct 31 00:34:42.790397 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.790370 4557 cpu_manager.go:414] "containerMap: removing container" podUID="f1d69b98-1507-4852-9311-7d7a582de098" containerName="console" Oct 31 00:34:42.790397 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.790378 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f1d69b98-1507-4852-9311-7d7a582de098" containerName="console" Oct 31 00:34:42.790397 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.790396 4557 cpu_manager.go:414] "containerMap: removing container" podUID="c22691cb-e15f-4dbd-817c-9e4972b435d1" containerName="console" Oct 31 00:34:42.790613 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.790416 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c22691cb-e15f-4dbd-817c-9e4972b435d1" containerName="console" Oct 31 00:34:42.790613 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.790479 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="cdbe3b25-0ac2-4e8d-89cd-0d1a8e6ba69f" containerName="insights-gathering" Oct 31 00:34:42.790613 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.790493 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="f1d69b98-1507-4852-9311-7d7a582de098" containerName="console" Oct 31 00:34:42.790613 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.790502 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="c22691cb-e15f-4dbd-817c-9e4972b435d1" containerName="console" Oct 31 00:34:42.793280 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.793266 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-mj8v2" Oct 31 00:34:42.807380 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.807356 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Oct 31 00:34:42.817499 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.817395 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Oct 31 00:34:42.817642 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.817543 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/1e7f7416-890c-4e0c-a394-ebaf43dadeaa-temp-vol\") pod \"keda-metrics-apiserver-86bd856cfb-mj8v2\" (UID: \"1e7f7416-890c-4e0c-a394-ebaf43dadeaa\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-mj8v2" Oct 31 00:34:42.817724 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.817642 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1e7f7416-890c-4e0c-a394-ebaf43dadeaa-certificates\") pod \"keda-metrics-apiserver-86bd856cfb-mj8v2\" (UID: \"1e7f7416-890c-4e0c-a394-ebaf43dadeaa\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-mj8v2" Oct 31 00:34:42.817724 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.817693 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4pfw\" (UniqueName: \"kubernetes.io/projected/1e7f7416-890c-4e0c-a394-ebaf43dadeaa-kube-api-access-w4pfw\") pod \"keda-metrics-apiserver-86bd856cfb-mj8v2\" (UID: \"1e7f7416-890c-4e0c-a394-ebaf43dadeaa\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-mj8v2" Oct 31 00:34:42.817860 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.817803 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Oct 31 00:34:42.817860 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.817849 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Oct 31 00:34:42.818144 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.817990 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Oct 31 00:34:42.818203 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.818186 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-scv72\"" Oct 31 00:34:42.828769 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.828749 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-86bd856cfb-mj8v2"] Oct 31 00:34:42.835105 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.835085 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:42.918138 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.918116 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/1e7f7416-890c-4e0c-a394-ebaf43dadeaa-temp-vol\") pod \"keda-metrics-apiserver-86bd856cfb-mj8v2\" (UID: \"1e7f7416-890c-4e0c-a394-ebaf43dadeaa\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-mj8v2" Oct 31 00:34:42.918230 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.918145 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1e7f7416-890c-4e0c-a394-ebaf43dadeaa-certificates\") pod \"keda-metrics-apiserver-86bd856cfb-mj8v2\" (UID: \"1e7f7416-890c-4e0c-a394-ebaf43dadeaa\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-mj8v2" Oct 31 00:34:42.918230 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.918162 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4pfw\" (UniqueName: \"kubernetes.io/projected/1e7f7416-890c-4e0c-a394-ebaf43dadeaa-kube-api-access-w4pfw\") pod \"keda-metrics-apiserver-86bd856cfb-mj8v2\" (UID: \"1e7f7416-890c-4e0c-a394-ebaf43dadeaa\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-mj8v2" Oct 31 00:34:42.918573 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.918554 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/1e7f7416-890c-4e0c-a394-ebaf43dadeaa-temp-vol\") pod \"keda-metrics-apiserver-86bd856cfb-mj8v2\" (UID: \"1e7f7416-890c-4e0c-a394-ebaf43dadeaa\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-mj8v2" Oct 31 00:34:42.920549 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.920533 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1e7f7416-890c-4e0c-a394-ebaf43dadeaa-certificates\") pod \"keda-metrics-apiserver-86bd856cfb-mj8v2\" (UID: \"1e7f7416-890c-4e0c-a394-ebaf43dadeaa\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-mj8v2" Oct 31 00:34:42.940320 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:42.940298 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4pfw\" (UniqueName: \"kubernetes.io/projected/1e7f7416-890c-4e0c-a394-ebaf43dadeaa-kube-api-access-w4pfw\") pod \"keda-metrics-apiserver-86bd856cfb-mj8v2\" (UID: \"1e7f7416-890c-4e0c-a394-ebaf43dadeaa\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-mj8v2" Oct 31 00:34:43.092318 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:43.092252 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:43.097780 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:43.097750 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-7b7c985c58-kzldx"] Oct 31 00:34:43.100829 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:43.100814 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-7b7c985c58-kzldx" Oct 31 00:34:43.104714 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:43.104694 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-mj8v2" Oct 31 00:34:43.115625 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:43.115606 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Oct 31 00:34:43.119746 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:43.119724 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/50dd4e56-1e85-4a0b-89d2-0b4558c01c5b-certificates\") pod \"keda-admission-7b7c985c58-kzldx\" (UID: \"50dd4e56-1e85-4a0b-89d2-0b4558c01c5b\") " pod="openshift-keda/keda-admission-7b7c985c58-kzldx" Oct 31 00:34:43.119833 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:43.119761 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nfrp\" (UniqueName: \"kubernetes.io/projected/50dd4e56-1e85-4a0b-89d2-0b4558c01c5b-kube-api-access-4nfrp\") pod \"keda-admission-7b7c985c58-kzldx\" (UID: \"50dd4e56-1e85-4a0b-89d2-0b4558c01c5b\") " pod="openshift-keda/keda-admission-7b7c985c58-kzldx" Oct 31 00:34:43.125285 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:43.125261 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-7b7c985c58-kzldx"] Oct 31 00:34:43.198230 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:43.198202 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:43.221668 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:43.221639 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/50dd4e56-1e85-4a0b-89d2-0b4558c01c5b-certificates\") pod \"keda-admission-7b7c985c58-kzldx\" (UID: \"50dd4e56-1e85-4a0b-89d2-0b4558c01c5b\") " pod="openshift-keda/keda-admission-7b7c985c58-kzldx" Oct 31 00:34:43.221794 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:43.221680 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nfrp\" (UniqueName: \"kubernetes.io/projected/50dd4e56-1e85-4a0b-89d2-0b4558c01c5b-kube-api-access-4nfrp\") pod \"keda-admission-7b7c985c58-kzldx\" (UID: \"50dd4e56-1e85-4a0b-89d2-0b4558c01c5b\") " pod="openshift-keda/keda-admission-7b7c985c58-kzldx" Oct 31 00:34:43.224054 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:43.224034 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/50dd4e56-1e85-4a0b-89d2-0b4558c01c5b-certificates\") pod \"keda-admission-7b7c985c58-kzldx\" (UID: \"50dd4e56-1e85-4a0b-89d2-0b4558c01c5b\") " pod="openshift-keda/keda-admission-7b7c985c58-kzldx" Oct 31 00:34:43.246585 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:43.246552 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nfrp\" (UniqueName: \"kubernetes.io/projected/50dd4e56-1e85-4a0b-89d2-0b4558c01c5b-kube-api-access-4nfrp\") pod \"keda-admission-7b7c985c58-kzldx\" (UID: \"50dd4e56-1e85-4a0b-89d2-0b4558c01c5b\") " pod="openshift-keda/keda-admission-7b7c985c58-kzldx" Oct 31 00:34:43.400278 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:43.400202 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-86bd856cfb-mj8v2"] Oct 31 00:34:43.404673 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:34:43.404645 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e7f7416_890c_4e0c_a394_ebaf43dadeaa.slice/crio-e8f6bd6e85ecbbb7010964aa39b2f12a2eaaf4badd6f5ce1814c1d4a678a225a WatchSource:0}: Error finding container e8f6bd6e85ecbbb7010964aa39b2f12a2eaaf4badd6f5ce1814c1d4a678a225a: Status 404 returned error can't find the container with id e8f6bd6e85ecbbb7010964aa39b2f12a2eaaf4badd6f5ce1814c1d4a678a225a Oct 31 00:34:43.415695 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:43.415675 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-7b7c985c58-kzldx" Oct 31 00:34:43.717645 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:43.717579 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-7b7c985c58-kzldx"] Oct 31 00:34:43.722352 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:34:43.722328 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50dd4e56_1e85_4a0b_89d2_0b4558c01c5b.slice/crio-003e10172cc48e369327d9d4d11935be6ac84796e688818eda8f6c912f10b5a2 WatchSource:0}: Error finding container 003e10172cc48e369327d9d4d11935be6ac84796e688818eda8f6c912f10b5a2: Status 404 returned error can't find the container with id 003e10172cc48e369327d9d4d11935be6ac84796e688818eda8f6c912f10b5a2 Oct 31 00:34:43.850020 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:43.849991 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-7b7c985c58-kzldx" event={"ID":"50dd4e56-1e85-4a0b-89d2-0b4558c01c5b","Type":"ContainerStarted","Data":"003e10172cc48e369327d9d4d11935be6ac84796e688818eda8f6c912f10b5a2"} Oct 31 00:34:43.851095 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:43.851061 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-mj8v2" event={"ID":"1e7f7416-890c-4e0c-a394-ebaf43dadeaa","Type":"ContainerStarted","Data":"e8f6bd6e85ecbbb7010964aa39b2f12a2eaaf4badd6f5ce1814c1d4a678a225a"} Oct 31 00:34:44.026276 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:44.026242 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:44.339460 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:44.339372 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:44.581045 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:44.581010 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:44.712751 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:44.712673 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:46.862831 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:46.862746 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-7b7c985c58-kzldx" event={"ID":"50dd4e56-1e85-4a0b-89d2-0b4558c01c5b","Type":"ContainerStarted","Data":"8db98ad0de217c827edd81f0f22e3be9e0a1baedef38ddd9b34373f5d1e0a0dd"} Oct 31 00:34:46.863234 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:46.862864 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-7b7c985c58-kzldx" Oct 31 00:34:46.864338 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:46.864312 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-mj8v2" event={"ID":"1e7f7416-890c-4e0c-a394-ebaf43dadeaa","Type":"ContainerStarted","Data":"c9c752ce93e6b23aeb73d8187ab27b8eb2fc1dd3423a1f247d1bac9c7b910b56"} Oct 31 00:34:46.864491 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:46.864365 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-mj8v2" Oct 31 00:34:46.901719 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:46.901668 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/keda-admission-7b7c985c58-kzldx" podStartSLOduration=1.330998058 podStartE2EDuration="3.901653832s" totalImagesPullingTime="2.570655774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:34:46.900531656 +0000 UTC m=+301.183062022" watchObservedRunningTime="2026-10-31 00:34:46.901653832 +0000 UTC m=+301.184184186" Oct 31 00:34:46.939271 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:46.939232 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-mj8v2" podStartSLOduration=1.770148861 podStartE2EDuration="4.939220765s" totalImagesPullingTime="3.169071904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:34:46.93865418 +0000 UTC m=+301.221184546" watchObservedRunningTime="2026-10-31 00:34:46.939220765 +0000 UTC m=+301.221751118" Oct 31 00:34:51.963878 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:34:51.963839 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:34:57.873029 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:34:57.872959 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-mj8v2" Oct 31 00:35:07.870925 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:35:07.870893 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-7b7c985c58-kzldx" Oct 31 00:35:21.961112 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:35:21.961073 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:35:33.862733 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:35:33.862692 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:35:34.844956 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:35:34.844919 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:35:34.951641 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:35:34.951608 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:35:51.960831 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:35:51.960797 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:36:09.730058 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:09.730013 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:36:09.837244 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:09.837217 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:36:09.880394 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:09.880365 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-7696d678f8-gng95"] Oct 31 00:36:09.883535 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:09.883518 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-7696d678f8-gng95" Oct 31 00:36:09.912986 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:09.912958 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-7696d678f8-gng95"] Oct 31 00:36:09.923554 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:09.923532 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-wl8m5"] Oct 31 00:36:09.926412 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:09.926380 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-78bb9c6ff8-wl8m5" Oct 31 00:36:09.944617 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:09.944596 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-wl8m5"] Oct 31 00:36:09.949748 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:09.949726 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:36:09.967617 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:09.967592 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Oct 31 00:36:09.967707 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:09.967615 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-4s27j\"" Oct 31 00:36:09.967707 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:09.967656 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-jr5mq\"" Oct 31 00:36:09.967707 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:09.967660 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Oct 31 00:36:09.972931 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:09.972918 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Oct 31 00:36:09.972976 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:09.972943 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Oct 31 00:36:10.043135 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:10.043065 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsxtz\" (UniqueName: \"kubernetes.io/projected/78969fa5-d957-4986-9e75-ee5487f11461-kube-api-access-lsxtz\") pod \"llmisvc-controller-manager-7696d678f8-gng95\" (UID: \"78969fa5-d957-4986-9e75-ee5487f11461\") " pod="kserve/llmisvc-controller-manager-7696d678f8-gng95" Oct 31 00:36:10.043135 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:10.043121 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9cae84be-db5f-4985-b1ad-3a4259edf157-data\") pod \"seaweedfs-78bb9c6ff8-wl8m5\" (UID: \"9cae84be-db5f-4985-b1ad-3a4259edf157\") " pod="kserve/seaweedfs-78bb9c6ff8-wl8m5" Oct 31 00:36:10.043289 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:10.043173 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp929\" (UniqueName: \"kubernetes.io/projected/9cae84be-db5f-4985-b1ad-3a4259edf157-kube-api-access-qp929\") pod \"seaweedfs-78bb9c6ff8-wl8m5\" (UID: \"9cae84be-db5f-4985-b1ad-3a4259edf157\") " pod="kserve/seaweedfs-78bb9c6ff8-wl8m5" Oct 31 00:36:10.043289 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:10.043197 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78969fa5-d957-4986-9e75-ee5487f11461-cert\") pod \"llmisvc-controller-manager-7696d678f8-gng95\" (UID: \"78969fa5-d957-4986-9e75-ee5487f11461\") " pod="kserve/llmisvc-controller-manager-7696d678f8-gng95" Oct 31 00:36:10.059676 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:10.059647 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:36:10.143552 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:10.143520 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsxtz\" (UniqueName: \"kubernetes.io/projected/78969fa5-d957-4986-9e75-ee5487f11461-kube-api-access-lsxtz\") pod \"llmisvc-controller-manager-7696d678f8-gng95\" (UID: \"78969fa5-d957-4986-9e75-ee5487f11461\") " pod="kserve/llmisvc-controller-manager-7696d678f8-gng95" Oct 31 00:36:10.143688 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:10.143584 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9cae84be-db5f-4985-b1ad-3a4259edf157-data\") pod \"seaweedfs-78bb9c6ff8-wl8m5\" (UID: \"9cae84be-db5f-4985-b1ad-3a4259edf157\") " pod="kserve/seaweedfs-78bb9c6ff8-wl8m5" Oct 31 00:36:10.143688 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:10.143604 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp929\" (UniqueName: \"kubernetes.io/projected/9cae84be-db5f-4985-b1ad-3a4259edf157-kube-api-access-qp929\") pod \"seaweedfs-78bb9c6ff8-wl8m5\" (UID: \"9cae84be-db5f-4985-b1ad-3a4259edf157\") " pod="kserve/seaweedfs-78bb9c6ff8-wl8m5" Oct 31 00:36:10.143688 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:10.143621 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78969fa5-d957-4986-9e75-ee5487f11461-cert\") pod \"llmisvc-controller-manager-7696d678f8-gng95\" (UID: \"78969fa5-d957-4986-9e75-ee5487f11461\") " pod="kserve/llmisvc-controller-manager-7696d678f8-gng95" Oct 31 00:36:10.144026 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:10.144003 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9cae84be-db5f-4985-b1ad-3a4259edf157-data\") pod \"seaweedfs-78bb9c6ff8-wl8m5\" (UID: \"9cae84be-db5f-4985-b1ad-3a4259edf157\") " pod="kserve/seaweedfs-78bb9c6ff8-wl8m5" Oct 31 00:36:10.146045 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:10.146027 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78969fa5-d957-4986-9e75-ee5487f11461-cert\") pod \"llmisvc-controller-manager-7696d678f8-gng95\" (UID: \"78969fa5-d957-4986-9e75-ee5487f11461\") " pod="kserve/llmisvc-controller-manager-7696d678f8-gng95" Oct 31 00:36:10.165847 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:10.165829 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp929\" (UniqueName: \"kubernetes.io/projected/9cae84be-db5f-4985-b1ad-3a4259edf157-kube-api-access-qp929\") pod \"seaweedfs-78bb9c6ff8-wl8m5\" (UID: \"9cae84be-db5f-4985-b1ad-3a4259edf157\") " pod="kserve/seaweedfs-78bb9c6ff8-wl8m5" Oct 31 00:36:10.166063 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:10.166042 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsxtz\" (UniqueName: \"kubernetes.io/projected/78969fa5-d957-4986-9e75-ee5487f11461-kube-api-access-lsxtz\") pod \"llmisvc-controller-manager-7696d678f8-gng95\" (UID: \"78969fa5-d957-4986-9e75-ee5487f11461\") " pod="kserve/llmisvc-controller-manager-7696d678f8-gng95" Oct 31 00:36:10.195275 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:10.195252 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-7696d678f8-gng95" Oct 31 00:36:10.237298 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:10.237265 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-78bb9c6ff8-wl8m5" Oct 31 00:36:10.489099 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:10.489064 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-7696d678f8-gng95"] Oct 31 00:36:10.493626 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:36:10.493597 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78969fa5_d957_4986_9e75_ee5487f11461.slice/crio-ea90cb151454593909ee5f104da7d2502a29fb27f3f7ffd174c1a7b683d54efa WatchSource:0}: Error finding container ea90cb151454593909ee5f104da7d2502a29fb27f3f7ffd174c1a7b683d54efa: Status 404 returned error can't find the container with id ea90cb151454593909ee5f104da7d2502a29fb27f3f7ffd174c1a7b683d54efa Oct 31 00:36:10.495012 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:10.494997 4557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 31 00:36:10.533997 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:10.533966 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-wl8m5"] Oct 31 00:36:10.538144 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:36:10.538121 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cae84be_db5f_4985_b1ad_3a4259edf157.slice/crio-f121317cbf18a8b489eb3de6a7a59e0dbb673840ae91f7dc3a6c597298c57da1 WatchSource:0}: Error finding container f121317cbf18a8b489eb3de6a7a59e0dbb673840ae91f7dc3a6c597298c57da1: Status 404 returned error can't find the container with id f121317cbf18a8b489eb3de6a7a59e0dbb673840ae91f7dc3a6c597298c57da1 Oct 31 00:36:11.137982 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:11.137940 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7696d678f8-gng95" event={"ID":"78969fa5-d957-4986-9e75-ee5487f11461","Type":"ContainerStarted","Data":"ea90cb151454593909ee5f104da7d2502a29fb27f3f7ffd174c1a7b683d54efa"} Oct 31 00:36:11.140509 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:11.140454 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-78bb9c6ff8-wl8m5" event={"ID":"9cae84be-db5f-4985-b1ad-3a4259edf157","Type":"ContainerStarted","Data":"f121317cbf18a8b489eb3de6a7a59e0dbb673840ae91f7dc3a6c597298c57da1"} Oct 31 00:36:11.404157 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:11.404064 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:36:11.518345 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:11.518306 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:36:11.623819 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:11.623741 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:36:14.155197 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:14.155101 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7696d678f8-gng95" event={"ID":"78969fa5-d957-4986-9e75-ee5487f11461","Type":"ContainerStarted","Data":"a694e9f708d13ceffb9b6ec31d9f244f5e9245aa465f61048a1fdac70f31cf33"} Oct 31 00:36:14.155618 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:14.155262 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-7696d678f8-gng95" Oct 31 00:36:14.156575 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:14.156546 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-78bb9c6ff8-wl8m5" event={"ID":"9cae84be-db5f-4985-b1ad-3a4259edf157","Type":"ContainerStarted","Data":"b6c7c7da9abb018b331b5bd17011855c1947a925962716295e176a2771b6835a"} Oct 31 00:36:14.156689 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:14.156668 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-78bb9c6ff8-wl8m5" Oct 31 00:36:14.193613 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:14.193561 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-7696d678f8-gng95" podStartSLOduration=2.4397007889999998 podStartE2EDuration="5.193546304s" totalImagesPullingTime="2.753845515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:36:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:36:14.192827087 +0000 UTC m=+388.475357441" watchObservedRunningTime="2026-10-31 00:36:14.193546304 +0000 UTC m=+388.476076712" Oct 31 00:36:14.230199 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:14.230148 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/seaweedfs-78bb9c6ff8-wl8m5" podStartSLOduration=1.898940701 podStartE2EDuration="5.230131425s" totalImagesPullingTime="3.331190724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:36:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:36:14.229472086 +0000 UTC m=+388.512002441" watchObservedRunningTime="2026-10-31 00:36:14.230131425 +0000 UTC m=+388.512661779" Oct 31 00:36:20.163137 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:20.163109 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-78bb9c6ff8-wl8m5" Oct 31 00:36:21.960352 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:36:21.960315 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:36:34.043594 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:34.043518 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:36:45.162694 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:36:45.162661 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-7696d678f8-gng95" Oct 31 00:36:51.961768 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:36:51.961727 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:37:21.960920 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:37:21.960881 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:37:33.575757 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:33.575728 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:37:33.690701 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:33.690669 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-56ddc4c448-wmr55"] Oct 31 00:37:33.691362 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:33.691331 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:37:33.693100 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:33.693078 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-56ddc4c448-wmr55" Oct 31 00:37:33.719526 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:33.718712 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-d9hqg\"" Oct 31 00:37:33.719526 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:33.718950 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Oct 31 00:37:33.719883 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:33.719861 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-56ddc4c448-wmr55"] Oct 31 00:37:33.796319 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:33.796286 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:37:33.841170 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:33.841100 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8682f3f4-1655-4a90-a79d-c9c19a722359-tls-certs\") pod \"model-serving-api-56ddc4c448-wmr55\" (UID: \"8682f3f4-1655-4a90-a79d-c9c19a722359\") " pod="kserve/model-serving-api-56ddc4c448-wmr55" Oct 31 00:37:33.841276 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:33.841180 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhqt8\" (UniqueName: \"kubernetes.io/projected/8682f3f4-1655-4a90-a79d-c9c19a722359-kube-api-access-hhqt8\") pod \"model-serving-api-56ddc4c448-wmr55\" (UID: \"8682f3f4-1655-4a90-a79d-c9c19a722359\") " pod="kserve/model-serving-api-56ddc4c448-wmr55" Oct 31 00:37:33.942393 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:33.942364 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8682f3f4-1655-4a90-a79d-c9c19a722359-tls-certs\") pod \"model-serving-api-56ddc4c448-wmr55\" (UID: \"8682f3f4-1655-4a90-a79d-c9c19a722359\") " pod="kserve/model-serving-api-56ddc4c448-wmr55" Oct 31 00:37:33.942549 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:33.942443 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhqt8\" (UniqueName: \"kubernetes.io/projected/8682f3f4-1655-4a90-a79d-c9c19a722359-kube-api-access-hhqt8\") pod \"model-serving-api-56ddc4c448-wmr55\" (UID: \"8682f3f4-1655-4a90-a79d-c9c19a722359\") " pod="kserve/model-serving-api-56ddc4c448-wmr55" Oct 31 00:37:33.944845 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:33.944823 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8682f3f4-1655-4a90-a79d-c9c19a722359-tls-certs\") pod \"model-serving-api-56ddc4c448-wmr55\" (UID: \"8682f3f4-1655-4a90-a79d-c9c19a722359\") " pod="kserve/model-serving-api-56ddc4c448-wmr55" Oct 31 00:37:33.964634 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:33.964605 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhqt8\" (UniqueName: \"kubernetes.io/projected/8682f3f4-1655-4a90-a79d-c9c19a722359-kube-api-access-hhqt8\") pod \"model-serving-api-56ddc4c448-wmr55\" (UID: \"8682f3f4-1655-4a90-a79d-c9c19a722359\") " pod="kserve/model-serving-api-56ddc4c448-wmr55" Oct 31 00:37:34.004409 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:34.004375 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-56ddc4c448-wmr55" Oct 31 00:37:34.081967 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:34.081941 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:37:34.190956 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:34.190884 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:37:34.297625 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:34.297594 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-56ddc4c448-wmr55"] Oct 31 00:37:34.301655 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:37:34.301627 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8682f3f4_1655_4a90_a79d_c9c19a722359.slice/crio-207fbb1188d6eef769005e470ae1c140f4f7112b4bf3544d9348afdc75580b29 WatchSource:0}: Error finding container 207fbb1188d6eef769005e470ae1c140f4f7112b4bf3544d9348afdc75580b29: Status 404 returned error can't find the container with id 207fbb1188d6eef769005e470ae1c140f4f7112b4bf3544d9348afdc75580b29 Oct 31 00:37:34.417322 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:34.417293 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-56ddc4c448-wmr55" event={"ID":"8682f3f4-1655-4a90-a79d-c9c19a722359","Type":"ContainerStarted","Data":"207fbb1188d6eef769005e470ae1c140f4f7112b4bf3544d9348afdc75580b29"} Oct 31 00:37:36.426681 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:36.426648 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-56ddc4c448-wmr55" event={"ID":"8682f3f4-1655-4a90-a79d-c9c19a722359","Type":"ContainerStarted","Data":"9a8884bfccaacd2979431f9c24e8fef67658b0690966f9c45fe040a4055d690f"} Oct 31 00:37:36.427085 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:36.426774 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-56ddc4c448-wmr55" Oct 31 00:37:36.465531 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:36.465485 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/model-serving-api-56ddc4c448-wmr55" podStartSLOduration=2.152255793 podStartE2EDuration="3.465472813s" totalImagesPullingTime="1.31321702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:37:36.464581805 +0000 UTC m=+470.747112163" watchObservedRunningTime="2026-10-31 00:37:36.465472813 +0000 UTC m=+470.748003181" Oct 31 00:37:37.357841 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:37.357807 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:37:37.462798 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:37.462767 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:37:47.434907 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:37:47.434876 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-56ddc4c448-wmr55" Oct 31 00:37:51.961224 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:37:51.961190 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:38:21.959961 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:38:21.959875 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:38:34.206582 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:38:34.206549 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:38:37.763532 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:38:37.763502 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:38:51.960560 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:38:51.960519 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:39:09.197042 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:09.196994 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:09.309063 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:09.309032 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:21.960438 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:39:21.960387 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:39:25.869884 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:25.869852 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:25.983287 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:25.983255 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:27.504466 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:27.504425 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:27.609606 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:27.609577 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:28.045632 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.045593 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:28.105821 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.105787 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf"] Oct 31 00:39:28.109051 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.109033 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" Oct 31 00:39:28.128463 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.128435 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf"] Oct 31 00:39:28.135419 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.135382 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e1f85522d1\"/\"default-dockercfg-qstms\"" Oct 31 00:39:28.135533 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.135455 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e1f85522d1\"/\"openshift-service-ca.crt\"" Oct 31 00:39:28.135533 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.135456 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e1f85522d1\"/\"success-200-isvc-71dd3-kube-rbac-proxy-sar-config\"" Oct 31 00:39:28.135533 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.135473 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e1f85522d1\"/\"success-200-isvc-71dd3-predictor-serving-cert\"" Oct 31 00:39:28.135533 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.135530 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e1f85522d1\"/\"kube-root-ca.crt\"" Oct 31 00:39:28.178080 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.178039 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:28.211986 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.211955 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/edc8c346-c721-4175-bcd0-c68c7fc857b8-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf\" (UID: \"edc8c346-c721-4175-bcd0-c68c7fc857b8\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" Oct 31 00:39:28.212126 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.211989 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppj7c\" (UniqueName: \"kubernetes.io/projected/edc8c346-c721-4175-bcd0-c68c7fc857b8-kube-api-access-ppj7c\") pod \"success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf\" (UID: \"edc8c346-c721-4175-bcd0-c68c7fc857b8\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" Oct 31 00:39:28.212126 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.212078 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/edc8c346-c721-4175-bcd0-c68c7fc857b8-proxy-tls\") pod \"success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf\" (UID: \"edc8c346-c721-4175-bcd0-c68c7fc857b8\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" Oct 31 00:39:28.312720 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.312641 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/edc8c346-c721-4175-bcd0-c68c7fc857b8-proxy-tls\") pod \"success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf\" (UID: \"edc8c346-c721-4175-bcd0-c68c7fc857b8\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" Oct 31 00:39:28.312720 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.312703 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/edc8c346-c721-4175-bcd0-c68c7fc857b8-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf\" (UID: \"edc8c346-c721-4175-bcd0-c68c7fc857b8\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" Oct 31 00:39:28.312911 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.312817 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppj7c\" (UniqueName: \"kubernetes.io/projected/edc8c346-c721-4175-bcd0-c68c7fc857b8-kube-api-access-ppj7c\") pod \"success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf\" (UID: \"edc8c346-c721-4175-bcd0-c68c7fc857b8\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" Oct 31 00:39:28.313292 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.313269 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/edc8c346-c721-4175-bcd0-c68c7fc857b8-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf\" (UID: \"edc8c346-c721-4175-bcd0-c68c7fc857b8\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" Oct 31 00:39:28.315057 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.315038 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/edc8c346-c721-4175-bcd0-c68c7fc857b8-proxy-tls\") pod \"success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf\" (UID: \"edc8c346-c721-4175-bcd0-c68c7fc857b8\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" Oct 31 00:39:28.335351 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.335328 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppj7c\" (UniqueName: \"kubernetes.io/projected/edc8c346-c721-4175-bcd0-c68c7fc857b8-kube-api-access-ppj7c\") pod \"success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf\" (UID: \"edc8c346-c721-4175-bcd0-c68c7fc857b8\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" Oct 31 00:39:28.423473 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.423443 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" Oct 31 00:39:28.464735 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.464707 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:28.618909 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.618811 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:28.716572 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.716543 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf"] Oct 31 00:39:28.720815 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:39:28.720788 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc8c346_c721_4175_bcd0_c68c7fc857b8.slice/crio-1c71622aa95330dbcc891018162c5890a0f2ea2141c64ddba82abaaaf9a8f446 WatchSource:0}: Error finding container 1c71622aa95330dbcc891018162c5890a0f2ea2141c64ddba82abaaaf9a8f446: Status 404 returned error can't find the container with id 1c71622aa95330dbcc891018162c5890a0f2ea2141c64ddba82abaaaf9a8f446 Oct 31 00:39:28.793893 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.793862 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" event={"ID":"edc8c346-c721-4175-bcd0-c68c7fc857b8","Type":"ContainerStarted","Data":"1c71622aa95330dbcc891018162c5890a0f2ea2141c64ddba82abaaaf9a8f446"} Oct 31 00:39:28.860564 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.860532 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:28.976853 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:28.976824 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:29.537635 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:29.537603 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:29.802213 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:29.802125 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:34.334386 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:34.334346 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:40.846499 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:40.846460 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" event={"ID":"edc8c346-c721-4175-bcd0-c68c7fc857b8","Type":"ContainerStarted","Data":"1ce775d0c06a28b6905a8e65326db068f161707a14bad9d2aeceb8432a623d76"} Oct 31 00:39:41.084872 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:41.084835 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:42.856071 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:42.856039 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" event={"ID":"edc8c346-c721-4175-bcd0-c68c7fc857b8","Type":"ContainerStarted","Data":"ddb8e71bffa51d559ed38f7f287b2a3d71329086fead9c7fff02e46895021b85"} Oct 31 00:39:42.856570 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:42.856098 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" Oct 31 00:39:42.856570 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:42.856143 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" Oct 31 00:39:42.857601 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:42.857576 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" podUID="edc8c346-c721-4175-bcd0-c68c7fc857b8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 31 00:39:42.895632 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:42.895580 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" podStartSLOduration=1.271993658 podStartE2EDuration="14.895568309s" totalImagesPullingTime="13.623574651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:39:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:39:42.894682315 +0000 UTC m=+597.177212668" watchObservedRunningTime="2026-10-31 00:39:42.895568309 +0000 UTC m=+597.178098662" Oct 31 00:39:43.859760 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:43.859716 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" podUID="edc8c346-c721-4175-bcd0-c68c7fc857b8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 31 00:39:48.864606 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:48.864577 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" Oct 31 00:39:48.865123 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:48.865090 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" podUID="edc8c346-c721-4175-bcd0-c68c7fc857b8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 31 00:39:51.959706 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:39:51.959674 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:39:58.865442 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:39:58.865388 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" podUID="edc8c346-c721-4175-bcd0-c68c7fc857b8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 31 00:40:08.865707 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:08.865666 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" podUID="edc8c346-c721-4175-bcd0-c68c7fc857b8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 31 00:40:18.865232 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:18.865187 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" podUID="edc8c346-c721-4175-bcd0-c68c7fc857b8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 31 00:40:21.960978 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:40:21.960945 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:40:28.866376 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:28.866347 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" Oct 31 00:40:34.482599 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:34.482574 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:40:47.801341 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:47.801308 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm"] Oct 31 00:40:47.803375 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:47.803342 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:40:47.803545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:47.803527 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" Oct 31 00:40:47.817224 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:47.817201 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e1f85522d1\"/\"switch-graph-71dd3-serving-cert\"" Oct 31 00:40:47.817327 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:47.817230 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e1f85522d1\"/\"switch-graph-71dd3-kube-rbac-proxy-sar-config\"" Oct 31 00:40:47.828353 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:47.828326 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm"] Oct 31 00:40:47.882103 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:47.882081 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85f6794a-1cf3-4c04-b6cc-ecbb06d3004d-openshift-service-ca-bundle\") pod \"switch-graph-71dd3-7fb97455f5-ln6sm\" (UID: \"85f6794a-1cf3-4c04-b6cc-ecbb06d3004d\") " pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" Oct 31 00:40:47.882223 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:47.882123 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/85f6794a-1cf3-4c04-b6cc-ecbb06d3004d-proxy-tls\") pod \"switch-graph-71dd3-7fb97455f5-ln6sm\" (UID: \"85f6794a-1cf3-4c04-b6cc-ecbb06d3004d\") " pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" Oct 31 00:40:47.927517 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:47.927488 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:40:47.982578 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:47.982551 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85f6794a-1cf3-4c04-b6cc-ecbb06d3004d-openshift-service-ca-bundle\") pod \"switch-graph-71dd3-7fb97455f5-ln6sm\" (UID: \"85f6794a-1cf3-4c04-b6cc-ecbb06d3004d\") " pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" Oct 31 00:40:47.982674 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:47.982607 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/85f6794a-1cf3-4c04-b6cc-ecbb06d3004d-proxy-tls\") pod \"switch-graph-71dd3-7fb97455f5-ln6sm\" (UID: \"85f6794a-1cf3-4c04-b6cc-ecbb06d3004d\") " pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" Oct 31 00:40:47.983112 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:47.983091 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85f6794a-1cf3-4c04-b6cc-ecbb06d3004d-openshift-service-ca-bundle\") pod \"switch-graph-71dd3-7fb97455f5-ln6sm\" (UID: \"85f6794a-1cf3-4c04-b6cc-ecbb06d3004d\") " pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" Oct 31 00:40:47.984933 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:47.984913 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/85f6794a-1cf3-4c04-b6cc-ecbb06d3004d-proxy-tls\") pod \"switch-graph-71dd3-7fb97455f5-ln6sm\" (UID: \"85f6794a-1cf3-4c04-b6cc-ecbb06d3004d\") " pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" Oct 31 00:40:48.113966 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:48.113922 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" Oct 31 00:40:48.403584 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:48.403511 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm"] Oct 31 00:40:48.407705 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:40:48.407676 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f6794a_1cf3_4c04_b6cc_ecbb06d3004d.slice/crio-cb79b03efa3fc1de9e4f0c9e66d8e628b7befe8b0d9cf54a878bbeef2ac192aa WatchSource:0}: Error finding container cb79b03efa3fc1de9e4f0c9e66d8e628b7befe8b0d9cf54a878bbeef2ac192aa: Status 404 returned error can't find the container with id cb79b03efa3fc1de9e4f0c9e66d8e628b7befe8b0d9cf54a878bbeef2ac192aa Oct 31 00:40:49.068660 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:49.068626 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" event={"ID":"85f6794a-1cf3-4c04-b6cc-ecbb06d3004d","Type":"ContainerStarted","Data":"cb79b03efa3fc1de9e4f0c9e66d8e628b7befe8b0d9cf54a878bbeef2ac192aa"} Oct 31 00:40:51.077310 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:51.077277 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" event={"ID":"85f6794a-1cf3-4c04-b6cc-ecbb06d3004d","Type":"ContainerStarted","Data":"b77eb6a56c8b77890997fd1eea6e5083fe5039247bf8b8c6d8a3af86be0a7460"} Oct 31 00:40:51.077781 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:51.077383 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" Oct 31 00:40:51.115879 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:51.115835 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" podStartSLOduration=2.200156165 podStartE2EDuration="4.115823497s" totalImagesPullingTime="1.915667332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:40:51.115113287 +0000 UTC m=+665.397643642" watchObservedRunningTime="2026-10-31 00:40:51.115823497 +0000 UTC m=+665.398353850" Oct 31 00:40:51.959909 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:40:51.959877 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:40:53.580146 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:53.580109 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:40:53.703052 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:53.703021 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:40:57.086742 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:57.086716 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" Oct 31 00:40:59.301613 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:59.301537 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:40:59.356251 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:59.356223 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf"] Oct 31 00:40:59.356601 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:59.356576 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" podUID="edc8c346-c721-4175-bcd0-c68c7fc857b8" containerName="kserve-container" containerID="cri-o://1ce775d0c06a28b6905a8e65326db068f161707a14bad9d2aeceb8432a623d76" gracePeriod=30 Oct 31 00:40:59.356724 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:59.356617 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" podUID="edc8c346-c721-4175-bcd0-c68c7fc857b8" containerName="kube-rbac-proxy" containerID="cri-o://ddb8e71bffa51d559ed38f7f287b2a3d71329086fead9c7fff02e46895021b85" gracePeriod=30 Oct 31 00:40:59.409050 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:40:59.409026 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:41:00.108880 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:00.108844 4557 generic.go:356] "Generic (PLEG): container finished" podID="edc8c346-c721-4175-bcd0-c68c7fc857b8" containerID="ddb8e71bffa51d559ed38f7f287b2a3d71329086fead9c7fff02e46895021b85" exitCode=0 Oct 31 00:41:00.109055 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:00.108923 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" event={"ID":"edc8c346-c721-4175-bcd0-c68c7fc857b8","Type":"ContainerDied","Data":"ddb8e71bffa51d559ed38f7f287b2a3d71329086fead9c7fff02e46895021b85"} Oct 31 00:41:00.915351 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:00.915315 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:41:02.292246 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:02.292224 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" Oct 31 00:41:02.382730 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:02.382678 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/edc8c346-c721-4175-bcd0-c68c7fc857b8-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/edc8c346-c721-4175-bcd0-c68c7fc857b8-kube-rbac-proxy-sar-config\") pod \"edc8c346-c721-4175-bcd0-c68c7fc857b8\" (UID: \"edc8c346-c721-4175-bcd0-c68c7fc857b8\") " Oct 31 00:41:02.382730 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:02.382722 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/edc8c346-c721-4175-bcd0-c68c7fc857b8-kube-api-access-ppj7c\" (UniqueName: \"kubernetes.io/projected/edc8c346-c721-4175-bcd0-c68c7fc857b8-kube-api-access-ppj7c\") pod \"edc8c346-c721-4175-bcd0-c68c7fc857b8\" (UID: \"edc8c346-c721-4175-bcd0-c68c7fc857b8\") " Oct 31 00:41:02.382880 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:02.382741 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/edc8c346-c721-4175-bcd0-c68c7fc857b8-proxy-tls\" (UniqueName: \"kubernetes.io/secret/edc8c346-c721-4175-bcd0-c68c7fc857b8-proxy-tls\") pod \"edc8c346-c721-4175-bcd0-c68c7fc857b8\" (UID: \"edc8c346-c721-4175-bcd0-c68c7fc857b8\") " Oct 31 00:41:02.383030 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:02.382998 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edc8c346-c721-4175-bcd0-c68c7fc857b8-kube-rbac-proxy-sar-config" pod "edc8c346-c721-4175-bcd0-c68c7fc857b8" (UID: "edc8c346-c721-4175-bcd0-c68c7fc857b8"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:41:02.384770 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:02.384752 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edc8c346-c721-4175-bcd0-c68c7fc857b8-kube-api-access-ppj7c" pod "edc8c346-c721-4175-bcd0-c68c7fc857b8" (UID: "edc8c346-c721-4175-bcd0-c68c7fc857b8"). InnerVolumeSpecName "kube-api-access-ppj7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:41:02.384859 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:02.384839 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edc8c346-c721-4175-bcd0-c68c7fc857b8-proxy-tls" pod "edc8c346-c721-4175-bcd0-c68c7fc857b8" (UID: "edc8c346-c721-4175-bcd0-c68c7fc857b8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:41:02.483539 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:02.483503 4557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/edc8c346-c721-4175-bcd0-c68c7fc857b8-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:41:02.483539 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:02.483532 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppj7c\" (UniqueName: \"kubernetes.io/projected/edc8c346-c721-4175-bcd0-c68c7fc857b8-kube-api-access-ppj7c\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:41:02.483539 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:02.483545 4557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/edc8c346-c721-4175-bcd0-c68c7fc857b8-proxy-tls\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:41:03.119844 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:03.119813 4557 generic.go:356] "Generic (PLEG): container finished" podID="edc8c346-c721-4175-bcd0-c68c7fc857b8" containerID="1ce775d0c06a28b6905a8e65326db068f161707a14bad9d2aeceb8432a623d76" exitCode=0 Oct 31 00:41:03.119844 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:03.119850 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" event={"ID":"edc8c346-c721-4175-bcd0-c68c7fc857b8","Type":"ContainerDied","Data":"1ce775d0c06a28b6905a8e65326db068f161707a14bad9d2aeceb8432a623d76"} Oct 31 00:41:03.120039 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:03.119862 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" Oct 31 00:41:03.120039 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:03.119894 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf" event={"ID":"edc8c346-c721-4175-bcd0-c68c7fc857b8","Type":"ContainerDied","Data":"1c71622aa95330dbcc891018162c5890a0f2ea2141c64ddba82abaaaf9a8f446"} Oct 31 00:41:03.120039 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:03.119919 4557 scope.go:122] "RemoveContainer" containerID="ddb8e71bffa51d559ed38f7f287b2a3d71329086fead9c7fff02e46895021b85" Oct 31 00:41:03.127955 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:03.127937 4557 scope.go:122] "RemoveContainer" containerID="1ce775d0c06a28b6905a8e65326db068f161707a14bad9d2aeceb8432a623d76" Oct 31 00:41:03.139831 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:03.139812 4557 scope.go:122] "RemoveContainer" containerID="ddb8e71bffa51d559ed38f7f287b2a3d71329086fead9c7fff02e46895021b85" Oct 31 00:41:03.140098 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:41:03.140078 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddb8e71bffa51d559ed38f7f287b2a3d71329086fead9c7fff02e46895021b85\": container with ID starting with ddb8e71bffa51d559ed38f7f287b2a3d71329086fead9c7fff02e46895021b85 not found: ID does not exist" containerID="ddb8e71bffa51d559ed38f7f287b2a3d71329086fead9c7fff02e46895021b85" Oct 31 00:41:03.140144 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:03.140113 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddb8e71bffa51d559ed38f7f287b2a3d71329086fead9c7fff02e46895021b85"} err="failed to get container status \"ddb8e71bffa51d559ed38f7f287b2a3d71329086fead9c7fff02e46895021b85\": rpc error: code = NotFound desc = could not find container \"ddb8e71bffa51d559ed38f7f287b2a3d71329086fead9c7fff02e46895021b85\": container with ID starting with ddb8e71bffa51d559ed38f7f287b2a3d71329086fead9c7fff02e46895021b85 not found: ID does not exist" Oct 31 00:41:03.140144 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:03.140129 4557 scope.go:122] "RemoveContainer" containerID="1ce775d0c06a28b6905a8e65326db068f161707a14bad9d2aeceb8432a623d76" Oct 31 00:41:03.140380 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:41:03.140360 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ce775d0c06a28b6905a8e65326db068f161707a14bad9d2aeceb8432a623d76\": container with ID starting with 1ce775d0c06a28b6905a8e65326db068f161707a14bad9d2aeceb8432a623d76 not found: ID does not exist" containerID="1ce775d0c06a28b6905a8e65326db068f161707a14bad9d2aeceb8432a623d76" Oct 31 00:41:03.140455 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:03.140386 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ce775d0c06a28b6905a8e65326db068f161707a14bad9d2aeceb8432a623d76"} err="failed to get container status \"1ce775d0c06a28b6905a8e65326db068f161707a14bad9d2aeceb8432a623d76\": rpc error: code = NotFound desc = could not find container \"1ce775d0c06a28b6905a8e65326db068f161707a14bad9d2aeceb8432a623d76\": container with ID starting with 1ce775d0c06a28b6905a8e65326db068f161707a14bad9d2aeceb8432a623d76 not found: ID does not exist" Oct 31 00:41:03.167783 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:03.167762 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf"] Oct 31 00:41:03.178577 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:03.178558 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-71dd3-predictor-7b9588b7fd-xv4qf"] Oct 31 00:41:03.820642 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:03.820612 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="edc8c346-c721-4175-bcd0-c68c7fc857b8" path="/var/lib/kubelet/pods/edc8c346-c721-4175-bcd0-c68c7fc857b8/volumes" Oct 31 00:41:04.574588 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:04.574553 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:41:04.741833 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:04.741805 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:41:04.756604 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:04.756580 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c"] Oct 31 00:41:04.756874 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:04.756859 4557 cpu_manager.go:414] "containerMap: removing container" podUID="edc8c346-c721-4175-bcd0-c68c7fc857b8" containerName="kube-rbac-proxy" Oct 31 00:41:04.756920 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:04.756876 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="edc8c346-c721-4175-bcd0-c68c7fc857b8" containerName="kube-rbac-proxy" Oct 31 00:41:04.756920 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:04.756899 4557 cpu_manager.go:414] "containerMap: removing container" podUID="edc8c346-c721-4175-bcd0-c68c7fc857b8" containerName="kserve-container" Oct 31 00:41:04.756920 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:04.756907 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="edc8c346-c721-4175-bcd0-c68c7fc857b8" containerName="kserve-container" Oct 31 00:41:04.757004 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:04.756974 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="edc8c346-c721-4175-bcd0-c68c7fc857b8" containerName="kube-rbac-proxy" Oct 31 00:41:04.757004 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:04.756985 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="edc8c346-c721-4175-bcd0-c68c7fc857b8" containerName="kserve-container" Oct 31 00:41:04.759893 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:04.759878 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" Oct 31 00:41:04.776358 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:04.776335 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e1f85522d1\"/\"success-200-isvc-e290e-kube-rbac-proxy-sar-config\"" Oct 31 00:41:04.776516 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:04.776503 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e1f85522d1\"/\"success-200-isvc-e290e-predictor-serving-cert\"" Oct 31 00:41:04.787181 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:04.787159 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e1f85522d1\"/\"kube-root-ca.crt\"" Oct 31 00:41:04.788364 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:04.788345 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c"] Oct 31 00:41:04.898946 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:04.898880 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/eeb05652-c244-4180-ba67-1076fd1e834c-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-e290e-predictor-7ff657755d-rqp9c\" (UID: \"eeb05652-c244-4180-ba67-1076fd1e834c\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" Oct 31 00:41:04.898946 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:04.898913 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eeb05652-c244-4180-ba67-1076fd1e834c-proxy-tls\") pod \"success-200-isvc-e290e-predictor-7ff657755d-rqp9c\" (UID: \"eeb05652-c244-4180-ba67-1076fd1e834c\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" Oct 31 00:41:04.898946 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:04.898945 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxtqd\" (UniqueName: \"kubernetes.io/projected/eeb05652-c244-4180-ba67-1076fd1e834c-kube-api-access-wxtqd\") pod \"success-200-isvc-e290e-predictor-7ff657755d-rqp9c\" (UID: \"eeb05652-c244-4180-ba67-1076fd1e834c\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" Oct 31 00:41:04.979133 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:04.979108 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:41:05.000279 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:05.000253 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxtqd\" (UniqueName: \"kubernetes.io/projected/eeb05652-c244-4180-ba67-1076fd1e834c-kube-api-access-wxtqd\") pod \"success-200-isvc-e290e-predictor-7ff657755d-rqp9c\" (UID: \"eeb05652-c244-4180-ba67-1076fd1e834c\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" Oct 31 00:41:05.000348 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:05.000321 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/eeb05652-c244-4180-ba67-1076fd1e834c-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-e290e-predictor-7ff657755d-rqp9c\" (UID: \"eeb05652-c244-4180-ba67-1076fd1e834c\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" Oct 31 00:41:05.000384 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:05.000356 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eeb05652-c244-4180-ba67-1076fd1e834c-proxy-tls\") pod \"success-200-isvc-e290e-predictor-7ff657755d-rqp9c\" (UID: \"eeb05652-c244-4180-ba67-1076fd1e834c\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" Oct 31 00:41:05.000940 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:05.000920 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/eeb05652-c244-4180-ba67-1076fd1e834c-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-e290e-predictor-7ff657755d-rqp9c\" (UID: \"eeb05652-c244-4180-ba67-1076fd1e834c\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" Oct 31 00:41:05.002654 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:05.002636 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eeb05652-c244-4180-ba67-1076fd1e834c-proxy-tls\") pod \"success-200-isvc-e290e-predictor-7ff657755d-rqp9c\" (UID: \"eeb05652-c244-4180-ba67-1076fd1e834c\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" Oct 31 00:41:05.022435 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:05.022398 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxtqd\" (UniqueName: \"kubernetes.io/projected/eeb05652-c244-4180-ba67-1076fd1e834c-kube-api-access-wxtqd\") pod \"success-200-isvc-e290e-predictor-7ff657755d-rqp9c\" (UID: \"eeb05652-c244-4180-ba67-1076fd1e834c\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" Oct 31 00:41:05.071649 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:05.071628 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" Oct 31 00:41:05.129007 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:05.128980 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:41:05.362335 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:05.362295 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c"] Oct 31 00:41:05.366572 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:41:05.366540 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb05652_c244_4180_ba67_1076fd1e834c.slice/crio-92ccded1e90e96480b721cc2d73e2c0459f34235d6b5985999aa72a3ed5ae43a WatchSource:0}: Error finding container 92ccded1e90e96480b721cc2d73e2c0459f34235d6b5985999aa72a3ed5ae43a: Status 404 returned error can't find the container with id 92ccded1e90e96480b721cc2d73e2c0459f34235d6b5985999aa72a3ed5ae43a Oct 31 00:41:06.134665 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:06.134635 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" event={"ID":"eeb05652-c244-4180-ba67-1076fd1e834c","Type":"ContainerStarted","Data":"e82bf46e176c798822fe7dc530e1f8e34e5b33e2b2980bb0fc2c98517f8a0c23"} Oct 31 00:41:06.135068 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:06.134685 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" event={"ID":"eeb05652-c244-4180-ba67-1076fd1e834c","Type":"ContainerStarted","Data":"290682e0e033e5cbc506096dafe0d0863e2040facd2708ab60632bc78366fd57"} Oct 31 00:41:06.135068 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:06.134708 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" event={"ID":"eeb05652-c244-4180-ba67-1076fd1e834c","Type":"ContainerStarted","Data":"92ccded1e90e96480b721cc2d73e2c0459f34235d6b5985999aa72a3ed5ae43a"} Oct 31 00:41:06.135068 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:06.134730 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" Oct 31 00:41:06.135068 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:06.134749 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" Oct 31 00:41:06.136271 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:06.136245 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" podUID="eeb05652-c244-4180-ba67-1076fd1e834c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 31 00:41:06.174961 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:06.174916 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" podStartSLOduration=2.17490488 podStartE2EDuration="2.17490488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:41:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:41:06.174642992 +0000 UTC m=+680.457173347" watchObservedRunningTime="2026-10-31 00:41:06.17490488 +0000 UTC m=+680.457435227" Oct 31 00:41:07.138642 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:07.138602 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" podUID="eeb05652-c244-4180-ba67-1076fd1e834c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 31 00:41:12.143316 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:12.143287 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" Oct 31 00:41:12.143819 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:12.143795 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" podUID="eeb05652-c244-4180-ba67-1076fd1e834c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 31 00:41:21.960387 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:41:21.960345 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:41:22.144151 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:22.144108 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" podUID="eeb05652-c244-4180-ba67-1076fd1e834c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 31 00:41:32.143919 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:32.143877 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" podUID="eeb05652-c244-4180-ba67-1076fd1e834c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 31 00:41:34.592343 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:34.592278 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:41:37.787294 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:37.787261 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg"] Oct 31 00:41:37.788190 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:37.788166 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:41:37.790689 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:37.790674 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" Oct 31 00:41:37.804647 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:37.804629 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-b09a5b3eb3\"/\"model-chainer-serving-cert\"" Oct 31 00:41:37.804773 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:37.804716 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-b09a5b3eb3\"/\"model-chainer-kube-rbac-proxy-sar-config\"" Oct 31 00:41:37.814478 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:37.814457 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-b09a5b3eb3\"/\"default-dockercfg-j65w4\"" Oct 31 00:41:37.815826 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:37.815807 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfc31755-e103-4a63-a72e-97afdd5d7781-openshift-service-ca-bundle\") pod \"model-chainer-6d44dd6cf4-l9bbg\" (UID: \"bfc31755-e103-4a63-a72e-97afdd5d7781\") " pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" Oct 31 00:41:37.815895 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:37.815832 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bfc31755-e103-4a63-a72e-97afdd5d7781-proxy-tls\") pod \"model-chainer-6d44dd6cf4-l9bbg\" (UID: \"bfc31755-e103-4a63-a72e-97afdd5d7781\") " pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" Oct 31 00:41:37.820305 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:37.820287 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg"] Oct 31 00:41:37.904470 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:37.904451 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-b09a5b3eb3\"/\"openshift-service-ca.crt\"" Oct 31 00:41:37.905597 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:37.905575 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:41:37.916701 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:37.916683 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfc31755-e103-4a63-a72e-97afdd5d7781-openshift-service-ca-bundle\") pod \"model-chainer-6d44dd6cf4-l9bbg\" (UID: \"bfc31755-e103-4a63-a72e-97afdd5d7781\") " pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" Oct 31 00:41:37.916783 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:37.916708 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bfc31755-e103-4a63-a72e-97afdd5d7781-proxy-tls\") pod \"model-chainer-6d44dd6cf4-l9bbg\" (UID: \"bfc31755-e103-4a63-a72e-97afdd5d7781\") " pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" Oct 31 00:41:37.917289 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:37.917271 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfc31755-e103-4a63-a72e-97afdd5d7781-openshift-service-ca-bundle\") pod \"model-chainer-6d44dd6cf4-l9bbg\" (UID: \"bfc31755-e103-4a63-a72e-97afdd5d7781\") " pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" Oct 31 00:41:37.918981 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:37.918961 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bfc31755-e103-4a63-a72e-97afdd5d7781-proxy-tls\") pod \"model-chainer-6d44dd6cf4-l9bbg\" (UID: \"bfc31755-e103-4a63-a72e-97afdd5d7781\") " pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" Oct 31 00:41:38.102381 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:38.102331 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" Oct 31 00:41:38.393317 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:38.393246 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg"] Oct 31 00:41:38.397448 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:41:38.397422 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfc31755_e103_4a63_a72e_97afdd5d7781.slice/crio-5502a1cc235465e5c40c35c67c747dc4f3b93aa1123fde2c4a9a9b07bc9a645c WatchSource:0}: Error finding container 5502a1cc235465e5c40c35c67c747dc4f3b93aa1123fde2c4a9a9b07bc9a645c: Status 404 returned error can't find the container with id 5502a1cc235465e5c40c35c67c747dc4f3b93aa1123fde2c4a9a9b07bc9a645c Oct 31 00:41:39.246045 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:39.246010 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" event={"ID":"bfc31755-e103-4a63-a72e-97afdd5d7781","Type":"ContainerStarted","Data":"b80c7efb5ed14e321e6d890be573e8458364b2b16cccb326835ba85228a252d9"} Oct 31 00:41:39.246476 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:39.246059 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" event={"ID":"bfc31755-e103-4a63-a72e-97afdd5d7781","Type":"ContainerStarted","Data":"5502a1cc235465e5c40c35c67c747dc4f3b93aa1123fde2c4a9a9b07bc9a645c"} Oct 31 00:41:39.246476 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:39.246132 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" Oct 31 00:41:39.289888 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:39.287032 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" podStartSLOduration=2.287015677 podStartE2EDuration="2.287015677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:41:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:41:39.284965448 +0000 UTC m=+713.567495804" watchObservedRunningTime="2026-10-31 00:41:39.287015677 +0000 UTC m=+713.569546033" Oct 31 00:41:42.144267 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:42.144228 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" podUID="eeb05652-c244-4180-ba67-1076fd1e834c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 31 00:41:45.254953 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:45.254924 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" Oct 31 00:41:49.972260 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:49.972211 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:41:50.083691 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:50.083659 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:41:50.193285 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:50.193256 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:41:51.959874 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:41:51.959841 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:41:52.144471 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:52.144441 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" Oct 31 00:41:57.308159 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.308128 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:41:57.357281 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.357254 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd"] Oct 31 00:41:57.361972 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.361954 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" Oct 31 00:41:57.376508 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.376488 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-b09a5b3eb3\"/\"kube-root-ca.crt\"" Oct 31 00:41:57.378556 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.378539 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-b09a5b3eb3\"/\"success-200-isvc-8d238-kube-rbac-proxy-sar-config\"" Oct 31 00:41:57.387235 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.387210 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-b09a5b3eb3\"/\"success-200-isvc-8d238-predictor-serving-cert\"" Oct 31 00:41:57.388436 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.388419 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd"] Oct 31 00:41:57.455378 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.455351 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f13d8f1-a5ba-4754-88bd-10188d9594bb-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8d238-predictor-78fc694cc4-vgqsd\" (UID: \"9f13d8f1-a5ba-4754-88bd-10188d9594bb\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" Oct 31 00:41:57.455502 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.455423 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f13d8f1-a5ba-4754-88bd-10188d9594bb-proxy-tls\") pod \"success-200-isvc-8d238-predictor-78fc694cc4-vgqsd\" (UID: \"9f13d8f1-a5ba-4754-88bd-10188d9594bb\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" Oct 31 00:41:57.455545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.455494 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb9mx\" (UniqueName: \"kubernetes.io/projected/9f13d8f1-a5ba-4754-88bd-10188d9594bb-kube-api-access-zb9mx\") pod \"success-200-isvc-8d238-predictor-78fc694cc4-vgqsd\" (UID: \"9f13d8f1-a5ba-4754-88bd-10188d9594bb\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" Oct 31 00:41:57.513972 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.513931 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:41:57.556112 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.556086 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f13d8f1-a5ba-4754-88bd-10188d9594bb-proxy-tls\") pod \"success-200-isvc-8d238-predictor-78fc694cc4-vgqsd\" (UID: \"9f13d8f1-a5ba-4754-88bd-10188d9594bb\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" Oct 31 00:41:57.556201 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.556119 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb9mx\" (UniqueName: \"kubernetes.io/projected/9f13d8f1-a5ba-4754-88bd-10188d9594bb-kube-api-access-zb9mx\") pod \"success-200-isvc-8d238-predictor-78fc694cc4-vgqsd\" (UID: \"9f13d8f1-a5ba-4754-88bd-10188d9594bb\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" Oct 31 00:41:57.556201 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.556173 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f13d8f1-a5ba-4754-88bd-10188d9594bb-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8d238-predictor-78fc694cc4-vgqsd\" (UID: \"9f13d8f1-a5ba-4754-88bd-10188d9594bb\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" Oct 31 00:41:57.556860 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.556841 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f13d8f1-a5ba-4754-88bd-10188d9594bb-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8d238-predictor-78fc694cc4-vgqsd\" (UID: \"9f13d8f1-a5ba-4754-88bd-10188d9594bb\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" Oct 31 00:41:57.558538 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.558493 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f13d8f1-a5ba-4754-88bd-10188d9594bb-proxy-tls\") pod \"success-200-isvc-8d238-predictor-78fc694cc4-vgqsd\" (UID: \"9f13d8f1-a5ba-4754-88bd-10188d9594bb\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" Oct 31 00:41:57.578379 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.578353 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb9mx\" (UniqueName: \"kubernetes.io/projected/9f13d8f1-a5ba-4754-88bd-10188d9594bb-kube-api-access-zb9mx\") pod \"success-200-isvc-8d238-predictor-78fc694cc4-vgqsd\" (UID: \"9f13d8f1-a5ba-4754-88bd-10188d9594bb\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" Oct 31 00:41:57.675758 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.675731 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" Oct 31 00:41:57.687065 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.687036 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:41:57.828971 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.828912 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:41:57.972094 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:57.972056 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd"] Oct 31 00:41:57.976586 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:41:57.976557 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f13d8f1_a5ba_4754_88bd_10188d9594bb.slice/crio-0aadbb6d43f9dc5c48521b812da79050f6e3d30b314b60f66ef87db037d942c8 WatchSource:0}: Error finding container 0aadbb6d43f9dc5c48521b812da79050f6e3d30b314b60f66ef87db037d942c8: Status 404 returned error can't find the container with id 0aadbb6d43f9dc5c48521b812da79050f6e3d30b314b60f66ef87db037d942c8 Oct 31 00:41:58.313117 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:58.313076 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" event={"ID":"9f13d8f1-a5ba-4754-88bd-10188d9594bb","Type":"ContainerStarted","Data":"b69d1f31742392f4112cd53b1261b00c8b3bd89fb438e7094406c19ea8cebd89"} Oct 31 00:41:58.313487 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:58.313143 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" event={"ID":"9f13d8f1-a5ba-4754-88bd-10188d9594bb","Type":"ContainerStarted","Data":"035d07534b20c4da4f17fd202e3229d8e40f216c44e15183647926faa1d6d87a"} Oct 31 00:41:58.313487 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:58.313171 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" event={"ID":"9f13d8f1-a5ba-4754-88bd-10188d9594bb","Type":"ContainerStarted","Data":"0aadbb6d43f9dc5c48521b812da79050f6e3d30b314b60f66ef87db037d942c8"} Oct 31 00:41:58.313487 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:58.313202 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" Oct 31 00:41:58.351868 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:58.351815 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" podStartSLOduration=1.351798445 podStartE2EDuration="1.351798445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:41:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:41:58.351274515 +0000 UTC m=+732.633804861" watchObservedRunningTime="2026-10-31 00:41:58.351798445 +0000 UTC m=+732.634328801" Oct 31 00:41:59.317046 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:59.317011 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" Oct 31 00:41:59.317960 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:41:59.317935 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" podUID="9f13d8f1-a5ba-4754-88bd-10188d9594bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 31 00:42:00.319998 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:00.319955 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" podUID="9f13d8f1-a5ba-4754-88bd-10188d9594bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 31 00:42:04.678248 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:04.678216 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:42:04.680621 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:04.680593 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p"] Oct 31 00:42:04.683658 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:04.683639 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" Oct 31 00:42:04.701509 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:04.701481 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p"] Oct 31 00:42:04.707902 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:04.707883 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e1f85522d1\"/\"switch-graph-e290e-kube-rbac-proxy-sar-config\"" Oct 31 00:42:04.707994 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:04.707951 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e1f85522d1\"/\"switch-graph-e290e-serving-cert\"" Oct 31 00:42:04.709007 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:04.708984 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33884be7-851f-4d74-b0e1-86ea12315049-openshift-service-ca-bundle\") pod \"switch-graph-e290e-5f5cbb5896-kt55p\" (UID: \"33884be7-851f-4d74-b0e1-86ea12315049\") " pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" Oct 31 00:42:04.709103 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:04.709022 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/33884be7-851f-4d74-b0e1-86ea12315049-proxy-tls\") pod \"switch-graph-e290e-5f5cbb5896-kt55p\" (UID: \"33884be7-851f-4d74-b0e1-86ea12315049\") " pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" Oct 31 00:42:04.784174 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:04.784141 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:42:04.810232 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:04.810209 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33884be7-851f-4d74-b0e1-86ea12315049-openshift-service-ca-bundle\") pod \"switch-graph-e290e-5f5cbb5896-kt55p\" (UID: \"33884be7-851f-4d74-b0e1-86ea12315049\") " pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" Oct 31 00:42:04.810303 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:04.810250 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/33884be7-851f-4d74-b0e1-86ea12315049-proxy-tls\") pod \"switch-graph-e290e-5f5cbb5896-kt55p\" (UID: \"33884be7-851f-4d74-b0e1-86ea12315049\") " pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" Oct 31 00:42:04.810824 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:04.810805 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33884be7-851f-4d74-b0e1-86ea12315049-openshift-service-ca-bundle\") pod \"switch-graph-e290e-5f5cbb5896-kt55p\" (UID: \"33884be7-851f-4d74-b0e1-86ea12315049\") " pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" Oct 31 00:42:04.812607 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:04.812589 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/33884be7-851f-4d74-b0e1-86ea12315049-proxy-tls\") pod \"switch-graph-e290e-5f5cbb5896-kt55p\" (UID: \"33884be7-851f-4d74-b0e1-86ea12315049\") " pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" Oct 31 00:42:04.996052 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:04.996025 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" Oct 31 00:42:05.286042 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:05.285958 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p"] Oct 31 00:42:05.290214 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:42:05.290189 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33884be7_851f_4d74_b0e1_86ea12315049.slice/crio-2d080c455d57305b3afbb0a5f686e7026bbd23f2c29e34e7da731fa2b59c36b2 WatchSource:0}: Error finding container 2d080c455d57305b3afbb0a5f686e7026bbd23f2c29e34e7da731fa2b59c36b2: Status 404 returned error can't find the container with id 2d080c455d57305b3afbb0a5f686e7026bbd23f2c29e34e7da731fa2b59c36b2 Oct 31 00:42:05.325032 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:05.325010 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" Oct 31 00:42:05.325431 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:05.325392 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" podUID="9f13d8f1-a5ba-4754-88bd-10188d9594bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 31 00:42:05.337317 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:05.337294 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" event={"ID":"33884be7-851f-4d74-b0e1-86ea12315049","Type":"ContainerStarted","Data":"2d080c455d57305b3afbb0a5f686e7026bbd23f2c29e34e7da731fa2b59c36b2"} Oct 31 00:42:06.342395 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:06.342362 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" event={"ID":"33884be7-851f-4d74-b0e1-86ea12315049","Type":"ContainerStarted","Data":"e3fc36ec345cbf518104276f0e59b5fc1f434c2e026468b0a47b63df21f20764"} Oct 31 00:42:06.342787 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:06.342495 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" Oct 31 00:42:12.351396 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:12.351362 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" Oct 31 00:42:12.393263 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:12.393217 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" podStartSLOduration=8.393204666 podStartE2EDuration="8.393204666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:42:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:42:06.383774122 +0000 UTC m=+740.666304476" watchObservedRunningTime="2026-10-31 00:42:12.393204666 +0000 UTC m=+746.675735012" Oct 31 00:42:15.326125 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:15.326090 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" podUID="9f13d8f1-a5ba-4754-88bd-10188d9594bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 31 00:42:21.960061 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:42:21.960023 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:42:25.325877 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:25.325835 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" podUID="9f13d8f1-a5ba-4754-88bd-10188d9594bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 31 00:42:34.715984 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:34.715912 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:42:35.326124 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:35.326087 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" podUID="9f13d8f1-a5ba-4754-88bd-10188d9594bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 31 00:42:45.326058 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:45.326027 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" Oct 31 00:42:51.960006 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:42:51.959968 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:42:57.405069 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:57.405034 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx"] Oct 31 00:42:57.405730 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:57.405704 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:42:57.408619 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:57.408603 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" Oct 31 00:42:57.425920 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:57.425897 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx"] Oct 31 00:42:57.435249 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:57.435228 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-b09a5b3eb3\"/\"sequence-graph-8d238-serving-cert\"" Oct 31 00:42:57.435385 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:57.435287 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-b09a5b3eb3\"/\"sequence-graph-8d238-kube-rbac-proxy-sar-config\"" Oct 31 00:42:57.499997 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:57.499969 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2fdb9688-33bc-4879-8b12-0e6d1fe721ad-proxy-tls\") pod \"sequence-graph-8d238-85489855c5-xqgfx\" (UID: \"2fdb9688-33bc-4879-8b12-0e6d1fe721ad\") " pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" Oct 31 00:42:57.500109 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:57.500018 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fdb9688-33bc-4879-8b12-0e6d1fe721ad-openshift-service-ca-bundle\") pod \"sequence-graph-8d238-85489855c5-xqgfx\" (UID: \"2fdb9688-33bc-4879-8b12-0e6d1fe721ad\") " pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" Oct 31 00:42:57.568032 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:57.568011 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:42:57.601116 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:57.601090 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2fdb9688-33bc-4879-8b12-0e6d1fe721ad-proxy-tls\") pod \"sequence-graph-8d238-85489855c5-xqgfx\" (UID: \"2fdb9688-33bc-4879-8b12-0e6d1fe721ad\") " pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" Oct 31 00:42:57.601208 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:57.601128 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fdb9688-33bc-4879-8b12-0e6d1fe721ad-openshift-service-ca-bundle\") pod \"sequence-graph-8d238-85489855c5-xqgfx\" (UID: \"2fdb9688-33bc-4879-8b12-0e6d1fe721ad\") " pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" Oct 31 00:42:57.601695 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:57.601666 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fdb9688-33bc-4879-8b12-0e6d1fe721ad-openshift-service-ca-bundle\") pod \"sequence-graph-8d238-85489855c5-xqgfx\" (UID: \"2fdb9688-33bc-4879-8b12-0e6d1fe721ad\") " pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" Oct 31 00:42:57.603544 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:57.603525 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2fdb9688-33bc-4879-8b12-0e6d1fe721ad-proxy-tls\") pod \"sequence-graph-8d238-85489855c5-xqgfx\" (UID: \"2fdb9688-33bc-4879-8b12-0e6d1fe721ad\") " pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" Oct 31 00:42:57.721439 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:57.721398 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" Oct 31 00:42:58.012418 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:58.012338 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx"] Oct 31 00:42:58.016689 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:42:58.016660 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fdb9688_33bc_4879_8b12_0e6d1fe721ad.slice/crio-89640ec19cf57834a72060aab4728ee404272f4d7577f3cbe79422307fd50e15 WatchSource:0}: Error finding container 89640ec19cf57834a72060aab4728ee404272f4d7577f3cbe79422307fd50e15: Status 404 returned error can't find the container with id 89640ec19cf57834a72060aab4728ee404272f4d7577f3cbe79422307fd50e15 Oct 31 00:42:58.535821 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:58.535790 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" event={"ID":"2fdb9688-33bc-4879-8b12-0e6d1fe721ad","Type":"ContainerStarted","Data":"61d962f3e6acf0d277c58f682d3216a450579e74f989150296cb9c484364d34e"} Oct 31 00:42:58.536189 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:58.535843 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" event={"ID":"2fdb9688-33bc-4879-8b12-0e6d1fe721ad","Type":"ContainerStarted","Data":"89640ec19cf57834a72060aab4728ee404272f4d7577f3cbe79422307fd50e15"} Oct 31 00:42:58.536189 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:58.535890 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" Oct 31 00:42:58.573749 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:42:58.573708 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" podStartSLOduration=1.573696378 podStartE2EDuration="1.573696378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:42:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:42:58.572943465 +0000 UTC m=+792.855473820" watchObservedRunningTime="2026-10-31 00:42:58.573696378 +0000 UTC m=+792.856226732" Oct 31 00:43:04.545730 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:43:04.545698 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" Oct 31 00:43:21.960170 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:43:21.960133 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:43:34.845666 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:43:34.845633 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:43:51.960349 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:43:51.960310 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:44:21.960398 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:44:21.960363 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:44:33.791311 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:44:33.791276 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:44:34.944469 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:44:34.944435 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:44:42.475483 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:44:42.475447 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:44:51.960655 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:44:51.960620 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:45:19.914174 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:45:19.914141 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:45:21.959077 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:45:21.959043 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:45:35.106128 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:45:35.106046 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:45:51.960845 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:45:51.960808 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:46:21.960900 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:46:21.960863 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:46:35.214244 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:46:35.214214 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:46:51.960890 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:46:51.960852 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:47:21.960376 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:47:21.960298 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:47:35.342916 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:47:35.342880 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:47:51.960262 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:47:51.960221 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:48:21.960041 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:48:21.960006 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:48:35.462174 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:48:35.462092 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:48:51.960962 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:48:51.960925 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:49:21.960387 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:49:21.960352 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:49:35.583743 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:49:35.583710 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:49:51.960565 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:49:51.960517 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:50:20.281874 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:20.281776 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:50:20.370697 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:20.370666 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c"] Oct 31 00:50:20.370914 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:20.370891 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" podUID="eeb05652-c244-4180-ba67-1076fd1e834c" containerName="kserve-container" containerID="cri-o://290682e0e033e5cbc506096dafe0d0863e2040facd2708ab60632bc78366fd57" gracePeriod=30 Oct 31 00:50:20.370989 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:20.370927 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" podUID="eeb05652-c244-4180-ba67-1076fd1e834c" containerName="kube-rbac-proxy" containerID="cri-o://e82bf46e176c798822fe7dc530e1f8e34e5b33e2b2980bb0fc2c98517f8a0c23" gracePeriod=30 Oct 31 00:50:20.416607 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:20.416572 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:50:21.177726 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:21.177692 4557 generic.go:356] "Generic (PLEG): container finished" podID="eeb05652-c244-4180-ba67-1076fd1e834c" containerID="e82bf46e176c798822fe7dc530e1f8e34e5b33e2b2980bb0fc2c98517f8a0c23" exitCode=0 Oct 31 00:50:21.177912 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:21.177771 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" event={"ID":"eeb05652-c244-4180-ba67-1076fd1e834c","Type":"ContainerDied","Data":"e82bf46e176c798822fe7dc530e1f8e34e5b33e2b2980bb0fc2c98517f8a0c23"} Oct 31 00:50:21.960899 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:50:21.960866 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:50:22.138935 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:22.138899 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" podUID="eeb05652-c244-4180-ba67-1076fd1e834c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.25:8643/healthz\": dial tcp 10.133.0.25:8643: connect: connection refused" Oct 31 00:50:22.144274 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:22.144254 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" podUID="eeb05652-c244-4180-ba67-1076fd1e834c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 31 00:50:23.187128 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:23.187099 4557 generic.go:356] "Generic (PLEG): container finished" podID="eeb05652-c244-4180-ba67-1076fd1e834c" containerID="290682e0e033e5cbc506096dafe0d0863e2040facd2708ab60632bc78366fd57" exitCode=0 Oct 31 00:50:23.187439 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:23.187167 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" event={"ID":"eeb05652-c244-4180-ba67-1076fd1e834c","Type":"ContainerDied","Data":"290682e0e033e5cbc506096dafe0d0863e2040facd2708ab60632bc78366fd57"} Oct 31 00:50:23.306884 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:23.306858 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" Oct 31 00:50:23.377120 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:23.377097 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eeb05652-c244-4180-ba67-1076fd1e834c-kube-api-access-wxtqd\" (UniqueName: \"kubernetes.io/projected/eeb05652-c244-4180-ba67-1076fd1e834c-kube-api-access-wxtqd\") pod \"eeb05652-c244-4180-ba67-1076fd1e834c\" (UID: \"eeb05652-c244-4180-ba67-1076fd1e834c\") " Oct 31 00:50:23.377252 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:23.377143 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eeb05652-c244-4180-ba67-1076fd1e834c-proxy-tls\" (UniqueName: \"kubernetes.io/secret/eeb05652-c244-4180-ba67-1076fd1e834c-proxy-tls\") pod \"eeb05652-c244-4180-ba67-1076fd1e834c\" (UID: \"eeb05652-c244-4180-ba67-1076fd1e834c\") " Oct 31 00:50:23.377252 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:23.377215 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/eeb05652-c244-4180-ba67-1076fd1e834c-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/eeb05652-c244-4180-ba67-1076fd1e834c-kube-rbac-proxy-sar-config\") pod \"eeb05652-c244-4180-ba67-1076fd1e834c\" (UID: \"eeb05652-c244-4180-ba67-1076fd1e834c\") " Oct 31 00:50:23.377610 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:23.377586 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeb05652-c244-4180-ba67-1076fd1e834c-kube-rbac-proxy-sar-config" pod "eeb05652-c244-4180-ba67-1076fd1e834c" (UID: "eeb05652-c244-4180-ba67-1076fd1e834c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:50:23.379103 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:23.379082 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeb05652-c244-4180-ba67-1076fd1e834c-kube-api-access-wxtqd" pod "eeb05652-c244-4180-ba67-1076fd1e834c" (UID: "eeb05652-c244-4180-ba67-1076fd1e834c"). InnerVolumeSpecName "kube-api-access-wxtqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:50:23.379188 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:23.379123 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeb05652-c244-4180-ba67-1076fd1e834c-proxy-tls" pod "eeb05652-c244-4180-ba67-1076fd1e834c" (UID: "eeb05652-c244-4180-ba67-1076fd1e834c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:50:23.478177 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:23.478158 4557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/eeb05652-c244-4180-ba67-1076fd1e834c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:50:23.478177 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:23.478177 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxtqd\" (UniqueName: \"kubernetes.io/projected/eeb05652-c244-4180-ba67-1076fd1e834c-kube-api-access-wxtqd\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:50:23.478294 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:23.478186 4557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eeb05652-c244-4180-ba67-1076fd1e834c-proxy-tls\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:50:24.192584 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:24.192502 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" event={"ID":"eeb05652-c244-4180-ba67-1076fd1e834c","Type":"ContainerDied","Data":"92ccded1e90e96480b721cc2d73e2c0459f34235d6b5985999aa72a3ed5ae43a"} Oct 31 00:50:24.192584 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:24.192539 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c" Oct 31 00:50:24.193246 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:24.192566 4557 scope.go:122] "RemoveContainer" containerID="e82bf46e176c798822fe7dc530e1f8e34e5b33e2b2980bb0fc2c98517f8a0c23" Oct 31 00:50:24.200315 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:24.200300 4557 scope.go:122] "RemoveContainer" containerID="290682e0e033e5cbc506096dafe0d0863e2040facd2708ab60632bc78366fd57" Oct 31 00:50:24.242130 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:24.242108 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c"] Oct 31 00:50:24.252533 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:24.252513 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-e290e-predictor-7ff657755d-rqp9c"] Oct 31 00:50:25.590908 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.590875 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:50:25.740118 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.740090 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s"] Oct 31 00:50:25.740514 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.740499 4557 cpu_manager.go:414] "containerMap: removing container" podUID="eeb05652-c244-4180-ba67-1076fd1e834c" containerName="kserve-container" Oct 31 00:50:25.740576 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.740516 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eeb05652-c244-4180-ba67-1076fd1e834c" containerName="kserve-container" Oct 31 00:50:25.740576 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.740529 4557 cpu_manager.go:414] "containerMap: removing container" podUID="eeb05652-c244-4180-ba67-1076fd1e834c" containerName="kube-rbac-proxy" Oct 31 00:50:25.740576 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.740534 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eeb05652-c244-4180-ba67-1076fd1e834c" containerName="kube-rbac-proxy" Oct 31 00:50:25.740674 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.740582 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="eeb05652-c244-4180-ba67-1076fd1e834c" containerName="kube-rbac-proxy" Oct 31 00:50:25.740674 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.740594 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="eeb05652-c244-4180-ba67-1076fd1e834c" containerName="kserve-container" Oct 31 00:50:25.745052 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.745037 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" Oct 31 00:50:25.765220 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.765202 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:50:25.769370 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.769342 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e1f85522d1\"/\"success-200-isvc-d6609-kube-rbac-proxy-sar-config\"" Oct 31 00:50:25.769493 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.769372 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e1f85522d1\"/\"kube-root-ca.crt\"" Oct 31 00:50:25.769493 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.769387 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e1f85522d1\"/\"success-200-isvc-d6609-predictor-serving-cert\"" Oct 31 00:50:25.770530 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.770513 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s"] Oct 31 00:50:25.794187 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.794165 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2j2j\" (UniqueName: \"kubernetes.io/projected/178bfeaf-bfd9-49b2-81ce-9793080015aa-kube-api-access-b2j2j\") pod \"success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s\" (UID: \"178bfeaf-bfd9-49b2-81ce-9793080015aa\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" Oct 31 00:50:25.794277 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.794198 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/178bfeaf-bfd9-49b2-81ce-9793080015aa-proxy-tls\") pod \"success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s\" (UID: \"178bfeaf-bfd9-49b2-81ce-9793080015aa\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" Oct 31 00:50:25.794277 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.794229 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/178bfeaf-bfd9-49b2-81ce-9793080015aa-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s\" (UID: \"178bfeaf-bfd9-49b2-81ce-9793080015aa\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" Oct 31 00:50:25.826228 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.826202 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eeb05652-c244-4180-ba67-1076fd1e834c" path="/var/lib/kubelet/pods/eeb05652-c244-4180-ba67-1076fd1e834c/volumes" Oct 31 00:50:25.894971 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.894920 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/178bfeaf-bfd9-49b2-81ce-9793080015aa-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s\" (UID: \"178bfeaf-bfd9-49b2-81ce-9793080015aa\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" Oct 31 00:50:25.895071 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.894983 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2j2j\" (UniqueName: \"kubernetes.io/projected/178bfeaf-bfd9-49b2-81ce-9793080015aa-kube-api-access-b2j2j\") pod \"success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s\" (UID: \"178bfeaf-bfd9-49b2-81ce-9793080015aa\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" Oct 31 00:50:25.895071 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.895040 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/178bfeaf-bfd9-49b2-81ce-9793080015aa-proxy-tls\") pod \"success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s\" (UID: \"178bfeaf-bfd9-49b2-81ce-9793080015aa\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" Oct 31 00:50:25.895678 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.895656 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/178bfeaf-bfd9-49b2-81ce-9793080015aa-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s\" (UID: \"178bfeaf-bfd9-49b2-81ce-9793080015aa\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" Oct 31 00:50:25.897342 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.897315 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/178bfeaf-bfd9-49b2-81ce-9793080015aa-proxy-tls\") pod \"success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s\" (UID: \"178bfeaf-bfd9-49b2-81ce-9793080015aa\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" Oct 31 00:50:25.918210 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.918187 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2j2j\" (UniqueName: \"kubernetes.io/projected/178bfeaf-bfd9-49b2-81ce-9793080015aa-kube-api-access-b2j2j\") pod \"success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s\" (UID: \"178bfeaf-bfd9-49b2-81ce-9793080015aa\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" Oct 31 00:50:25.983573 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:25.983541 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:50:26.058702 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:26.058680 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" Oct 31 00:50:26.113138 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:26.113099 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:50:26.352102 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:26.352071 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s"] Oct 31 00:50:26.356603 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:50:26.356576 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod178bfeaf_bfd9_49b2_81ce_9793080015aa.slice/crio-518e5901b005751be85a938f5020916a2a566da5c244b97b3ddf07811c6b5d13 WatchSource:0}: Error finding container 518e5901b005751be85a938f5020916a2a566da5c244b97b3ddf07811c6b5d13: Status 404 returned error can't find the container with id 518e5901b005751be85a938f5020916a2a566da5c244b97b3ddf07811c6b5d13 Oct 31 00:50:27.205552 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:27.205513 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" event={"ID":"178bfeaf-bfd9-49b2-81ce-9793080015aa","Type":"ContainerStarted","Data":"1cdb330cfee8f40ba4b5f4978f498bd2984786a115a86dd75829873d7395549a"} Oct 31 00:50:27.205936 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:27.205572 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" event={"ID":"178bfeaf-bfd9-49b2-81ce-9793080015aa","Type":"ContainerStarted","Data":"3f2512fa16a231c89a7933e744200668037046ee108173457aaefa8f8325a064"} Oct 31 00:50:27.205936 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:27.205593 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" event={"ID":"178bfeaf-bfd9-49b2-81ce-9793080015aa","Type":"ContainerStarted","Data":"518e5901b005751be85a938f5020916a2a566da5c244b97b3ddf07811c6b5d13"} Oct 31 00:50:27.205936 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:27.205633 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" Oct 31 00:50:27.250418 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:27.250365 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" podStartSLOduration=2.250351872 podStartE2EDuration="2.250351872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:50:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:50:27.24896706 +0000 UTC m=+1241.531497412" watchObservedRunningTime="2026-10-31 00:50:27.250351872 +0000 UTC m=+1241.532882225" Oct 31 00:50:28.209793 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:28.209764 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" Oct 31 00:50:28.210895 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:28.210871 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" podUID="178bfeaf-bfd9-49b2-81ce-9793080015aa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 31 00:50:29.213654 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:29.213615 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" podUID="178bfeaf-bfd9-49b2-81ce-9793080015aa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 31 00:50:34.218497 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:34.218468 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" Oct 31 00:50:34.218902 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:34.218877 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" podUID="178bfeaf-bfd9-49b2-81ce-9793080015aa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 31 00:50:35.716831 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:35.716798 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:50:44.219162 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:44.219128 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" podUID="178bfeaf-bfd9-49b2-81ce-9793080015aa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 31 00:50:51.960310 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:50:51.960273 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:50:54.219649 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:50:54.219611 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" podUID="178bfeaf-bfd9-49b2-81ce-9793080015aa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 31 00:51:04.219248 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:04.219206 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" podUID="178bfeaf-bfd9-49b2-81ce-9793080015aa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 31 00:51:13.441617 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:13.441585 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:51:13.492196 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:13.492164 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd"] Oct 31 00:51:13.492454 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:13.492429 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" podUID="9f13d8f1-a5ba-4754-88bd-10188d9594bb" containerName="kserve-container" containerID="cri-o://035d07534b20c4da4f17fd202e3229d8e40f216c44e15183647926faa1d6d87a" gracePeriod=30 Oct 31 00:51:13.492594 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:13.492457 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" podUID="9f13d8f1-a5ba-4754-88bd-10188d9594bb" containerName="kube-rbac-proxy" containerID="cri-o://b69d1f31742392f4112cd53b1261b00c8b3bd89fb438e7094406c19ea8cebd89" gracePeriod=30 Oct 31 00:51:13.560195 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:13.560171 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:51:14.220289 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:14.220263 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" Oct 31 00:51:14.391082 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:14.391048 4557 generic.go:356] "Generic (PLEG): container finished" podID="9f13d8f1-a5ba-4754-88bd-10188d9594bb" containerID="b69d1f31742392f4112cd53b1261b00c8b3bd89fb438e7094406c19ea8cebd89" exitCode=0 Oct 31 00:51:14.391235 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:14.391093 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" event={"ID":"9f13d8f1-a5ba-4754-88bd-10188d9594bb","Type":"ContainerDied","Data":"b69d1f31742392f4112cd53b1261b00c8b3bd89fb438e7094406c19ea8cebd89"} Oct 31 00:51:15.320643 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:15.320607 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" podUID="9f13d8f1-a5ba-4754-88bd-10188d9594bb" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.27:8643/healthz\": dial tcp 10.133.0.27:8643: connect: connection refused" Oct 31 00:51:15.325928 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:15.325905 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" podUID="9f13d8f1-a5ba-4754-88bd-10188d9594bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 31 00:51:16.318248 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.318228 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" Oct 31 00:51:16.399868 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.399841 4557 generic.go:356] "Generic (PLEG): container finished" podID="9f13d8f1-a5ba-4754-88bd-10188d9594bb" containerID="035d07534b20c4da4f17fd202e3229d8e40f216c44e15183647926faa1d6d87a" exitCode=0 Oct 31 00:51:16.400194 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.399881 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" event={"ID":"9f13d8f1-a5ba-4754-88bd-10188d9594bb","Type":"ContainerDied","Data":"035d07534b20c4da4f17fd202e3229d8e40f216c44e15183647926faa1d6d87a"} Oct 31 00:51:16.400194 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.399898 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" Oct 31 00:51:16.400194 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.399924 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd" event={"ID":"9f13d8f1-a5ba-4754-88bd-10188d9594bb","Type":"ContainerDied","Data":"0aadbb6d43f9dc5c48521b812da79050f6e3d30b314b60f66ef87db037d942c8"} Oct 31 00:51:16.400194 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.399950 4557 scope.go:122] "RemoveContainer" containerID="b69d1f31742392f4112cd53b1261b00c8b3bd89fb438e7094406c19ea8cebd89" Oct 31 00:51:16.407279 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.407256 4557 scope.go:122] "RemoveContainer" containerID="035d07534b20c4da4f17fd202e3229d8e40f216c44e15183647926faa1d6d87a" Oct 31 00:51:16.414395 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.414380 4557 scope.go:122] "RemoveContainer" containerID="b69d1f31742392f4112cd53b1261b00c8b3bd89fb438e7094406c19ea8cebd89" Oct 31 00:51:16.414700 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:51:16.414682 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b69d1f31742392f4112cd53b1261b00c8b3bd89fb438e7094406c19ea8cebd89\": container with ID starting with b69d1f31742392f4112cd53b1261b00c8b3bd89fb438e7094406c19ea8cebd89 not found: ID does not exist" containerID="b69d1f31742392f4112cd53b1261b00c8b3bd89fb438e7094406c19ea8cebd89" Oct 31 00:51:16.414752 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.414708 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b69d1f31742392f4112cd53b1261b00c8b3bd89fb438e7094406c19ea8cebd89"} err="failed to get container status \"b69d1f31742392f4112cd53b1261b00c8b3bd89fb438e7094406c19ea8cebd89\": rpc error: code = NotFound desc = could not find container \"b69d1f31742392f4112cd53b1261b00c8b3bd89fb438e7094406c19ea8cebd89\": container with ID starting with b69d1f31742392f4112cd53b1261b00c8b3bd89fb438e7094406c19ea8cebd89 not found: ID does not exist" Oct 31 00:51:16.414752 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.414725 4557 scope.go:122] "RemoveContainer" containerID="035d07534b20c4da4f17fd202e3229d8e40f216c44e15183647926faa1d6d87a" Oct 31 00:51:16.414993 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:51:16.414975 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"035d07534b20c4da4f17fd202e3229d8e40f216c44e15183647926faa1d6d87a\": container with ID starting with 035d07534b20c4da4f17fd202e3229d8e40f216c44e15183647926faa1d6d87a not found: ID does not exist" containerID="035d07534b20c4da4f17fd202e3229d8e40f216c44e15183647926faa1d6d87a" Oct 31 00:51:16.415043 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.414999 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"035d07534b20c4da4f17fd202e3229d8e40f216c44e15183647926faa1d6d87a"} err="failed to get container status \"035d07534b20c4da4f17fd202e3229d8e40f216c44e15183647926faa1d6d87a\": rpc error: code = NotFound desc = could not find container \"035d07534b20c4da4f17fd202e3229d8e40f216c44e15183647926faa1d6d87a\": container with ID starting with 035d07534b20c4da4f17fd202e3229d8e40f216c44e15183647926faa1d6d87a not found: ID does not exist" Oct 31 00:51:16.482256 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.482237 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f13d8f1-a5ba-4754-88bd-10188d9594bb-kube-api-access-zb9mx\" (UniqueName: \"kubernetes.io/projected/9f13d8f1-a5ba-4754-88bd-10188d9594bb-kube-api-access-zb9mx\") pod \"9f13d8f1-a5ba-4754-88bd-10188d9594bb\" (UID: \"9f13d8f1-a5ba-4754-88bd-10188d9594bb\") " Oct 31 00:51:16.482337 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.482291 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9f13d8f1-a5ba-4754-88bd-10188d9594bb-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f13d8f1-a5ba-4754-88bd-10188d9594bb-kube-rbac-proxy-sar-config\") pod \"9f13d8f1-a5ba-4754-88bd-10188d9594bb\" (UID: \"9f13d8f1-a5ba-4754-88bd-10188d9594bb\") " Oct 31 00:51:16.482383 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.482367 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9f13d8f1-a5ba-4754-88bd-10188d9594bb-proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f13d8f1-a5ba-4754-88bd-10188d9594bb-proxy-tls\") pod \"9f13d8f1-a5ba-4754-88bd-10188d9594bb\" (UID: \"9f13d8f1-a5ba-4754-88bd-10188d9594bb\") " Oct 31 00:51:16.482683 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.482662 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f13d8f1-a5ba-4754-88bd-10188d9594bb-kube-rbac-proxy-sar-config" pod "9f13d8f1-a5ba-4754-88bd-10188d9594bb" (UID: "9f13d8f1-a5ba-4754-88bd-10188d9594bb"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:51:16.484203 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.484180 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f13d8f1-a5ba-4754-88bd-10188d9594bb-kube-api-access-zb9mx" pod "9f13d8f1-a5ba-4754-88bd-10188d9594bb" (UID: "9f13d8f1-a5ba-4754-88bd-10188d9594bb"). InnerVolumeSpecName "kube-api-access-zb9mx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:51:16.484315 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.484218 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f13d8f1-a5ba-4754-88bd-10188d9594bb-proxy-tls" pod "9f13d8f1-a5ba-4754-88bd-10188d9594bb" (UID: "9f13d8f1-a5ba-4754-88bd-10188d9594bb"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:51:16.583791 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.583761 4557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f13d8f1-a5ba-4754-88bd-10188d9594bb-proxy-tls\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:51:16.583791 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.583791 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb9mx\" (UniqueName: \"kubernetes.io/projected/9f13d8f1-a5ba-4754-88bd-10188d9594bb-kube-api-access-zb9mx\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:51:16.583791 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.583801 4557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f13d8f1-a5ba-4754-88bd-10188d9594bb-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:51:16.742874 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.742816 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd"] Oct 31 00:51:16.747545 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:16.747524 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-8d238-predictor-78fc694cc4-vgqsd"] Oct 31 00:51:17.821540 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:17.821499 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9f13d8f1-a5ba-4754-88bd-10188d9594bb" path="/var/lib/kubelet/pods/9f13d8f1-a5ba-4754-88bd-10188d9594bb/volumes" Oct 31 00:51:18.802533 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:18.802495 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:51:18.861122 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:18.861093 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb"] Oct 31 00:51:18.861535 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:18.861421 4557 cpu_manager.go:414] "containerMap: removing container" podUID="9f13d8f1-a5ba-4754-88bd-10188d9594bb" containerName="kserve-container" Oct 31 00:51:18.861535 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:18.861432 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9f13d8f1-a5ba-4754-88bd-10188d9594bb" containerName="kserve-container" Oct 31 00:51:18.861535 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:18.861447 4557 cpu_manager.go:414] "containerMap: removing container" podUID="9f13d8f1-a5ba-4754-88bd-10188d9594bb" containerName="kube-rbac-proxy" Oct 31 00:51:18.861535 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:18.861452 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9f13d8f1-a5ba-4754-88bd-10188d9594bb" containerName="kube-rbac-proxy" Oct 31 00:51:18.861535 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:18.861507 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="9f13d8f1-a5ba-4754-88bd-10188d9594bb" containerName="kserve-container" Oct 31 00:51:18.861535 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:18.861516 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="9f13d8f1-a5ba-4754-88bd-10188d9594bb" containerName="kube-rbac-proxy" Oct 31 00:51:18.864255 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:18.864239 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" Oct 31 00:51:18.890776 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:18.890756 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-b09a5b3eb3\"/\"success-200-isvc-32ce2-predictor-serving-cert\"" Oct 31 00:51:18.890884 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:18.890837 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-b09a5b3eb3\"/\"success-200-isvc-32ce2-kube-rbac-proxy-sar-config\"" Oct 31 00:51:18.890884 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:18.890842 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-b09a5b3eb3\"/\"kube-root-ca.crt\"" Oct 31 00:51:18.891938 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:18.891920 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb"] Oct 31 00:51:18.913753 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:18.913728 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:51:18.999068 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:18.999037 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drldp\" (UniqueName: \"kubernetes.io/projected/86a30d13-a008-48d3-90d3-359e51b7df29-kube-api-access-drldp\") pod \"success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb\" (UID: \"86a30d13-a008-48d3-90d3-359e51b7df29\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" Oct 31 00:51:18.999214 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:18.999074 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/86a30d13-a008-48d3-90d3-359e51b7df29-proxy-tls\") pod \"success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb\" (UID: \"86a30d13-a008-48d3-90d3-359e51b7df29\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" Oct 31 00:51:18.999214 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:18.999094 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/86a30d13-a008-48d3-90d3-359e51b7df29-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb\" (UID: \"86a30d13-a008-48d3-90d3-359e51b7df29\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" Oct 31 00:51:19.100492 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:19.100419 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drldp\" (UniqueName: \"kubernetes.io/projected/86a30d13-a008-48d3-90d3-359e51b7df29-kube-api-access-drldp\") pod \"success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb\" (UID: \"86a30d13-a008-48d3-90d3-359e51b7df29\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" Oct 31 00:51:19.100492 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:19.100455 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/86a30d13-a008-48d3-90d3-359e51b7df29-proxy-tls\") pod \"success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb\" (UID: \"86a30d13-a008-48d3-90d3-359e51b7df29\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" Oct 31 00:51:19.100492 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:19.100473 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/86a30d13-a008-48d3-90d3-359e51b7df29-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb\" (UID: \"86a30d13-a008-48d3-90d3-359e51b7df29\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" Oct 31 00:51:19.101065 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:19.101048 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/86a30d13-a008-48d3-90d3-359e51b7df29-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb\" (UID: \"86a30d13-a008-48d3-90d3-359e51b7df29\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" Oct 31 00:51:19.102897 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:19.102878 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/86a30d13-a008-48d3-90d3-359e51b7df29-proxy-tls\") pod \"success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb\" (UID: \"86a30d13-a008-48d3-90d3-359e51b7df29\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" Oct 31 00:51:19.123739 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:19.123711 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drldp\" (UniqueName: \"kubernetes.io/projected/86a30d13-a008-48d3-90d3-359e51b7df29-kube-api-access-drldp\") pod \"success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb\" (UID: \"86a30d13-a008-48d3-90d3-359e51b7df29\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" Oct 31 00:51:19.176717 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:19.176695 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" Oct 31 00:51:19.471765 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:19.471736 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:51:19.478624 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:19.478600 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb"] Oct 31 00:51:19.482336 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:51:19.482311 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86a30d13_a008_48d3_90d3_359e51b7df29.slice/crio-30e9d70113ef3882f013414a9700d9cf755c0ef1caeef8a10f0aa937ef4db423 WatchSource:0}: Error finding container 30e9d70113ef3882f013414a9700d9cf755c0ef1caeef8a10f0aa937ef4db423: Status 404 returned error can't find the container with id 30e9d70113ef3882f013414a9700d9cf755c0ef1caeef8a10f0aa937ef4db423 Oct 31 00:51:19.583195 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:19.583169 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:51:20.418345 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:20.418310 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" event={"ID":"86a30d13-a008-48d3-90d3-359e51b7df29","Type":"ContainerStarted","Data":"f7e2ddb861119ffed6d408ebfc5ebb31aaee2407c266ef05530faf4710a47575"} Oct 31 00:51:20.418753 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:20.418367 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" event={"ID":"86a30d13-a008-48d3-90d3-359e51b7df29","Type":"ContainerStarted","Data":"9b2f69ba9fcffa799fbf54efa9475588e61b8f3d1a0eec45606d9cbae6608998"} Oct 31 00:51:20.418753 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:20.418385 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" event={"ID":"86a30d13-a008-48d3-90d3-359e51b7df29","Type":"ContainerStarted","Data":"30e9d70113ef3882f013414a9700d9cf755c0ef1caeef8a10f0aa937ef4db423"} Oct 31 00:51:20.418753 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:20.418494 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" Oct 31 00:51:20.458338 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:20.458293 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" podStartSLOduration=2.45827276 podStartE2EDuration="2.45827276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:51:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:51:20.45826772 +0000 UTC m=+1294.740798073" watchObservedRunningTime="2026-10-31 00:51:20.45827276 +0000 UTC m=+1294.740803120" Oct 31 00:51:21.422348 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:21.422315 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" Oct 31 00:51:21.423712 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:21.423687 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" podUID="86a30d13-a008-48d3-90d3-359e51b7df29" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 31 00:51:21.960529 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:51:21.960492 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:51:22.425960 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:22.425921 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" podUID="86a30d13-a008-48d3-90d3-359e51b7df29" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 31 00:51:25.788077 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:25.788044 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:51:25.910387 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:25.910358 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:51:27.430056 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:27.430022 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" Oct 31 00:51:27.430505 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:27.430374 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" podUID="86a30d13-a008-48d3-90d3-359e51b7df29" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 31 00:51:35.825940 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:35.825907 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:51:36.725948 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:36.725917 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:51:36.797179 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:36.797151 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s"] Oct 31 00:51:36.797433 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:36.797390 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" podUID="178bfeaf-bfd9-49b2-81ce-9793080015aa" containerName="kserve-container" containerID="cri-o://3f2512fa16a231c89a7933e744200668037046ee108173457aaefa8f8325a064" gracePeriod=30 Oct 31 00:51:36.797942 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:36.797439 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" podUID="178bfeaf-bfd9-49b2-81ce-9793080015aa" containerName="kube-rbac-proxy" containerID="cri-o://1cdb330cfee8f40ba4b5f4978f498bd2984786a115a86dd75829873d7395549a" gracePeriod=30 Oct 31 00:51:36.838431 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:36.838389 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:51:37.430507 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:37.430470 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" podUID="86a30d13-a008-48d3-90d3-359e51b7df29" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 31 00:51:37.485033 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:37.485003 4557 generic.go:356] "Generic (PLEG): container finished" podID="178bfeaf-bfd9-49b2-81ce-9793080015aa" containerID="1cdb330cfee8f40ba4b5f4978f498bd2984786a115a86dd75829873d7395549a" exitCode=0 Oct 31 00:51:37.485186 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:37.485043 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" event={"ID":"178bfeaf-bfd9-49b2-81ce-9793080015aa","Type":"ContainerDied","Data":"1cdb330cfee8f40ba4b5f4978f498bd2984786a115a86dd75829873d7395549a"} Oct 31 00:51:39.214386 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:39.214346 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" podUID="178bfeaf-bfd9-49b2-81ce-9793080015aa" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.30:8643/healthz\": dial tcp 10.133.0.30:8643: connect: connection refused" Oct 31 00:51:40.439615 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.439585 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" Oct 31 00:51:40.455073 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.455045 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/178bfeaf-bfd9-49b2-81ce-9793080015aa-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/178bfeaf-bfd9-49b2-81ce-9793080015aa-kube-rbac-proxy-sar-config\") pod \"178bfeaf-bfd9-49b2-81ce-9793080015aa\" (UID: \"178bfeaf-bfd9-49b2-81ce-9793080015aa\") " Oct 31 00:51:40.455203 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.455111 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/178bfeaf-bfd9-49b2-81ce-9793080015aa-proxy-tls\" (UniqueName: \"kubernetes.io/secret/178bfeaf-bfd9-49b2-81ce-9793080015aa-proxy-tls\") pod \"178bfeaf-bfd9-49b2-81ce-9793080015aa\" (UID: \"178bfeaf-bfd9-49b2-81ce-9793080015aa\") " Oct 31 00:51:40.455203 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.455147 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/178bfeaf-bfd9-49b2-81ce-9793080015aa-kube-api-access-b2j2j\" (UniqueName: \"kubernetes.io/projected/178bfeaf-bfd9-49b2-81ce-9793080015aa-kube-api-access-b2j2j\") pod \"178bfeaf-bfd9-49b2-81ce-9793080015aa\" (UID: \"178bfeaf-bfd9-49b2-81ce-9793080015aa\") " Oct 31 00:51:40.455417 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.455381 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/178bfeaf-bfd9-49b2-81ce-9793080015aa-kube-rbac-proxy-sar-config" pod "178bfeaf-bfd9-49b2-81ce-9793080015aa" (UID: "178bfeaf-bfd9-49b2-81ce-9793080015aa"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:51:40.457114 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.457090 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/178bfeaf-bfd9-49b2-81ce-9793080015aa-kube-api-access-b2j2j" pod "178bfeaf-bfd9-49b2-81ce-9793080015aa" (UID: "178bfeaf-bfd9-49b2-81ce-9793080015aa"). InnerVolumeSpecName "kube-api-access-b2j2j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:51:40.457199 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.457109 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/178bfeaf-bfd9-49b2-81ce-9793080015aa-proxy-tls" pod "178bfeaf-bfd9-49b2-81ce-9793080015aa" (UID: "178bfeaf-bfd9-49b2-81ce-9793080015aa"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:51:40.498633 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.498607 4557 generic.go:356] "Generic (PLEG): container finished" podID="178bfeaf-bfd9-49b2-81ce-9793080015aa" containerID="3f2512fa16a231c89a7933e744200668037046ee108173457aaefa8f8325a064" exitCode=0 Oct 31 00:51:40.498739 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.498670 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" Oct 31 00:51:40.498739 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.498678 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" event={"ID":"178bfeaf-bfd9-49b2-81ce-9793080015aa","Type":"ContainerDied","Data":"3f2512fa16a231c89a7933e744200668037046ee108173457aaefa8f8325a064"} Oct 31 00:51:40.498850 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.498773 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s" event={"ID":"178bfeaf-bfd9-49b2-81ce-9793080015aa","Type":"ContainerDied","Data":"518e5901b005751be85a938f5020916a2a566da5c244b97b3ddf07811c6b5d13"} Oct 31 00:51:40.498850 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.498812 4557 scope.go:122] "RemoveContainer" containerID="1cdb330cfee8f40ba4b5f4978f498bd2984786a115a86dd75829873d7395549a" Oct 31 00:51:40.507281 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.507258 4557 scope.go:122] "RemoveContainer" containerID="3f2512fa16a231c89a7933e744200668037046ee108173457aaefa8f8325a064" Oct 31 00:51:40.513921 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.513904 4557 scope.go:122] "RemoveContainer" containerID="1cdb330cfee8f40ba4b5f4978f498bd2984786a115a86dd75829873d7395549a" Oct 31 00:51:40.514183 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:51:40.514164 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cdb330cfee8f40ba4b5f4978f498bd2984786a115a86dd75829873d7395549a\": container with ID starting with 1cdb330cfee8f40ba4b5f4978f498bd2984786a115a86dd75829873d7395549a not found: ID does not exist" containerID="1cdb330cfee8f40ba4b5f4978f498bd2984786a115a86dd75829873d7395549a" Oct 31 00:51:40.514230 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.514190 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cdb330cfee8f40ba4b5f4978f498bd2984786a115a86dd75829873d7395549a"} err="failed to get container status \"1cdb330cfee8f40ba4b5f4978f498bd2984786a115a86dd75829873d7395549a\": rpc error: code = NotFound desc = could not find container \"1cdb330cfee8f40ba4b5f4978f498bd2984786a115a86dd75829873d7395549a\": container with ID starting with 1cdb330cfee8f40ba4b5f4978f498bd2984786a115a86dd75829873d7395549a not found: ID does not exist" Oct 31 00:51:40.514230 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.514207 4557 scope.go:122] "RemoveContainer" containerID="3f2512fa16a231c89a7933e744200668037046ee108173457aaefa8f8325a064" Oct 31 00:51:40.514449 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:51:40.514428 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f2512fa16a231c89a7933e744200668037046ee108173457aaefa8f8325a064\": container with ID starting with 3f2512fa16a231c89a7933e744200668037046ee108173457aaefa8f8325a064 not found: ID does not exist" containerID="3f2512fa16a231c89a7933e744200668037046ee108173457aaefa8f8325a064" Oct 31 00:51:40.514449 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.514447 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f2512fa16a231c89a7933e744200668037046ee108173457aaefa8f8325a064"} err="failed to get container status \"3f2512fa16a231c89a7933e744200668037046ee108173457aaefa8f8325a064\": rpc error: code = NotFound desc = could not find container \"3f2512fa16a231c89a7933e744200668037046ee108173457aaefa8f8325a064\": container with ID starting with 3f2512fa16a231c89a7933e744200668037046ee108173457aaefa8f8325a064 not found: ID does not exist" Oct 31 00:51:40.545918 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.545898 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s"] Oct 31 00:51:40.550649 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.550631 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-d6609-predictor-66fc4f5cbb-fpp2s"] Oct 31 00:51:40.555901 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.555887 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2j2j\" (UniqueName: \"kubernetes.io/projected/178bfeaf-bfd9-49b2-81ce-9793080015aa-kube-api-access-b2j2j\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:51:40.555971 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.555903 4557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/178bfeaf-bfd9-49b2-81ce-9793080015aa-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:51:40.555971 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:40.555913 4557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/178bfeaf-bfd9-49b2-81ce-9793080015aa-proxy-tls\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:51:41.821305 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:41.821272 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="178bfeaf-bfd9-49b2-81ce-9793080015aa" path="/var/lib/kubelet/pods/178bfeaf-bfd9-49b2-81ce-9793080015aa/volumes" Oct 31 00:51:42.163577 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.163455 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:51:42.225273 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.225244 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h"] Oct 31 00:51:42.225635 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.225620 4557 cpu_manager.go:414] "containerMap: removing container" podUID="178bfeaf-bfd9-49b2-81ce-9793080015aa" containerName="kube-rbac-proxy" Oct 31 00:51:42.225696 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.225640 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="178bfeaf-bfd9-49b2-81ce-9793080015aa" containerName="kube-rbac-proxy" Oct 31 00:51:42.225696 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.225672 4557 cpu_manager.go:414] "containerMap: removing container" podUID="178bfeaf-bfd9-49b2-81ce-9793080015aa" containerName="kserve-container" Oct 31 00:51:42.225696 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.225677 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="178bfeaf-bfd9-49b2-81ce-9793080015aa" containerName="kserve-container" Oct 31 00:51:42.225836 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.225725 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="178bfeaf-bfd9-49b2-81ce-9793080015aa" containerName="kserve-container" Oct 31 00:51:42.225836 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.225737 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="178bfeaf-bfd9-49b2-81ce-9793080015aa" containerName="kube-rbac-proxy" Oct 31 00:51:42.229825 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.229809 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" Oct 31 00:51:42.243995 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.243973 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e1f85522d1\"/\"success-200-isvc-e8b5d-predictor-serving-cert\"" Oct 31 00:51:42.254235 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.254210 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e1f85522d1\"/\"success-200-isvc-e8b5d-kube-rbac-proxy-sar-config\"" Oct 31 00:51:42.254352 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.254310 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e1f85522d1\"/\"kube-root-ca.crt\"" Oct 31 00:51:42.255352 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.255334 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h"] Oct 31 00:51:42.268960 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.268937 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkcsp\" (UniqueName: \"kubernetes.io/projected/0a694468-46eb-4144-b773-13aebaac484b-kube-api-access-bkcsp\") pod \"success-200-isvc-e8b5d-predictor-6cbb775976-xx57h\" (UID: \"0a694468-46eb-4144-b773-13aebaac484b\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" Oct 31 00:51:42.269074 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.269016 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0a694468-46eb-4144-b773-13aebaac484b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-e8b5d-predictor-6cbb775976-xx57h\" (UID: \"0a694468-46eb-4144-b773-13aebaac484b\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" Oct 31 00:51:42.269074 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.269050 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0a694468-46eb-4144-b773-13aebaac484b-proxy-tls\") pod \"success-200-isvc-e8b5d-predictor-6cbb775976-xx57h\" (UID: \"0a694468-46eb-4144-b773-13aebaac484b\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" Oct 31 00:51:42.370336 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.370299 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0a694468-46eb-4144-b773-13aebaac484b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-e8b5d-predictor-6cbb775976-xx57h\" (UID: \"0a694468-46eb-4144-b773-13aebaac484b\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" Oct 31 00:51:42.370460 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.370355 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0a694468-46eb-4144-b773-13aebaac484b-proxy-tls\") pod \"success-200-isvc-e8b5d-predictor-6cbb775976-xx57h\" (UID: \"0a694468-46eb-4144-b773-13aebaac484b\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" Oct 31 00:51:42.370460 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.370439 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkcsp\" (UniqueName: \"kubernetes.io/projected/0a694468-46eb-4144-b773-13aebaac484b-kube-api-access-bkcsp\") pod \"success-200-isvc-e8b5d-predictor-6cbb775976-xx57h\" (UID: \"0a694468-46eb-4144-b773-13aebaac484b\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" Oct 31 00:51:42.370913 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.370894 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0a694468-46eb-4144-b773-13aebaac484b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-e8b5d-predictor-6cbb775976-xx57h\" (UID: \"0a694468-46eb-4144-b773-13aebaac484b\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" Oct 31 00:51:42.372784 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.372762 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0a694468-46eb-4144-b773-13aebaac484b-proxy-tls\") pod \"success-200-isvc-e8b5d-predictor-6cbb775976-xx57h\" (UID: \"0a694468-46eb-4144-b773-13aebaac484b\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" Oct 31 00:51:42.392414 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.392386 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkcsp\" (UniqueName: \"kubernetes.io/projected/0a694468-46eb-4144-b773-13aebaac484b-kube-api-access-bkcsp\") pod \"success-200-isvc-e8b5d-predictor-6cbb775976-xx57h\" (UID: \"0a694468-46eb-4144-b773-13aebaac484b\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" Oct 31 00:51:42.412032 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.412006 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:51:42.543940 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.543911 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" Oct 31 00:51:42.555674 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.555649 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:51:42.737330 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.737300 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:51:42.838761 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:42.838689 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h"] Oct 31 00:51:42.843324 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:51:42.843296 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a694468_46eb_4144_b773_13aebaac484b.slice/crio-8e381dda3a39e183bebc9968638ff3e698fe4595e0f7dd42ed5e7aaecd49b021 WatchSource:0}: Error finding container 8e381dda3a39e183bebc9968638ff3e698fe4595e0f7dd42ed5e7aaecd49b021: Status 404 returned error can't find the container with id 8e381dda3a39e183bebc9968638ff3e698fe4595e0f7dd42ed5e7aaecd49b021 Oct 31 00:51:43.513828 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:43.513790 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" event={"ID":"0a694468-46eb-4144-b773-13aebaac484b","Type":"ContainerStarted","Data":"107c960fadbbe30a4c3878555429d531096bfe2652dec69485125db7ba52edf2"} Oct 31 00:51:43.514001 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:43.513853 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" event={"ID":"0a694468-46eb-4144-b773-13aebaac484b","Type":"ContainerStarted","Data":"ca90d10eee5f0fe8d6260d582e28eb37e4fcc3801f5c9a2378f80dc6890058fc"} Oct 31 00:51:43.514001 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:43.513873 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" event={"ID":"0a694468-46eb-4144-b773-13aebaac484b","Type":"ContainerStarted","Data":"8e381dda3a39e183bebc9968638ff3e698fe4595e0f7dd42ed5e7aaecd49b021"} Oct 31 00:51:43.514001 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:43.513896 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" Oct 31 00:51:43.553960 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:43.553915 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" podStartSLOduration=1.55390009 podStartE2EDuration="1.55390009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:51:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:51:43.552298074 +0000 UTC m=+1317.834828428" watchObservedRunningTime="2026-10-31 00:51:43.55390009 +0000 UTC m=+1317.836430444" Oct 31 00:51:44.517178 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:44.517148 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" Oct 31 00:51:44.518472 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:44.518442 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" podUID="0a694468-46eb-4144-b773-13aebaac484b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 31 00:51:45.527019 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:45.526981 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" podUID="0a694468-46eb-4144-b773-13aebaac484b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 31 00:51:47.332640 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:47.332599 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:51:47.430881 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:47.430843 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" podUID="86a30d13-a008-48d3-90d3-359e51b7df29" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 31 00:51:50.531829 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:50.531795 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" Oct 31 00:51:50.532355 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:50.532325 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" podUID="0a694468-46eb-4144-b773-13aebaac484b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 31 00:51:51.960314 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:51:51.960275 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:51:57.431295 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:51:57.431249 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" podUID="86a30d13-a008-48d3-90d3-359e51b7df29" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 31 00:52:00.532591 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:00.532545 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" podUID="0a694468-46eb-4144-b773-13aebaac484b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 31 00:52:07.431578 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:07.431545 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" Oct 31 00:52:10.532879 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:10.532844 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" podUID="0a694468-46eb-4144-b773-13aebaac484b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 31 00:52:16.087274 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:16.087227 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:18.888527 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:18.888479 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:19.002239 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:19.002207 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:20.532993 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:20.532954 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" podUID="0a694468-46eb-4144-b773-13aebaac484b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 31 00:52:21.961016 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:52:21.960982 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:52:30.124832 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:30.124796 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:30.188055 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:30.188025 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb"] Oct 31 00:52:30.188322 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:30.188292 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" podUID="86a30d13-a008-48d3-90d3-359e51b7df29" containerName="kserve-container" containerID="cri-o://9b2f69ba9fcffa799fbf54efa9475588e61b8f3d1a0eec45606d9cbae6608998" gracePeriod=30 Oct 31 00:52:30.189132 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:30.188699 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" podUID="86a30d13-a008-48d3-90d3-359e51b7df29" containerName="kube-rbac-proxy" containerID="cri-o://f7e2ddb861119ffed6d408ebfc5ebb31aaee2407c266ef05530faf4710a47575" gracePeriod=30 Oct 31 00:52:30.233279 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:30.233256 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:30.533569 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:30.533537 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" Oct 31 00:52:30.707503 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:30.707468 4557 generic.go:356] "Generic (PLEG): container finished" podID="86a30d13-a008-48d3-90d3-359e51b7df29" containerID="f7e2ddb861119ffed6d408ebfc5ebb31aaee2407c266ef05530faf4710a47575" exitCode=0 Oct 31 00:52:30.707653 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:30.707541 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" event={"ID":"86a30d13-a008-48d3-90d3-359e51b7df29","Type":"ContainerDied","Data":"f7e2ddb861119ffed6d408ebfc5ebb31aaee2407c266ef05530faf4710a47575"} Oct 31 00:52:32.426288 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:32.426243 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" podUID="86a30d13-a008-48d3-90d3-359e51b7df29" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.31:8643/healthz\": dial tcp 10.133.0.31:8643: connect: connection refused" Oct 31 00:52:33.229805 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.229784 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" Oct 31 00:52:33.334611 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.334553 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/86a30d13-a008-48d3-90d3-359e51b7df29-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/86a30d13-a008-48d3-90d3-359e51b7df29-kube-rbac-proxy-sar-config\") pod \"86a30d13-a008-48d3-90d3-359e51b7df29\" (UID: \"86a30d13-a008-48d3-90d3-359e51b7df29\") " Oct 31 00:52:33.334611 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.334593 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/86a30d13-a008-48d3-90d3-359e51b7df29-kube-api-access-drldp\" (UniqueName: \"kubernetes.io/projected/86a30d13-a008-48d3-90d3-359e51b7df29-kube-api-access-drldp\") pod \"86a30d13-a008-48d3-90d3-359e51b7df29\" (UID: \"86a30d13-a008-48d3-90d3-359e51b7df29\") " Oct 31 00:52:33.334746 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.334619 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/86a30d13-a008-48d3-90d3-359e51b7df29-proxy-tls\" (UniqueName: \"kubernetes.io/secret/86a30d13-a008-48d3-90d3-359e51b7df29-proxy-tls\") pod \"86a30d13-a008-48d3-90d3-359e51b7df29\" (UID: \"86a30d13-a008-48d3-90d3-359e51b7df29\") " Oct 31 00:52:33.334922 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.334901 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86a30d13-a008-48d3-90d3-359e51b7df29-kube-rbac-proxy-sar-config" pod "86a30d13-a008-48d3-90d3-359e51b7df29" (UID: "86a30d13-a008-48d3-90d3-359e51b7df29"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:52:33.336604 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.336577 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86a30d13-a008-48d3-90d3-359e51b7df29-kube-api-access-drldp" pod "86a30d13-a008-48d3-90d3-359e51b7df29" (UID: "86a30d13-a008-48d3-90d3-359e51b7df29"). InnerVolumeSpecName "kube-api-access-drldp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:52:33.336604 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.336589 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86a30d13-a008-48d3-90d3-359e51b7df29-proxy-tls" pod "86a30d13-a008-48d3-90d3-359e51b7df29" (UID: "86a30d13-a008-48d3-90d3-359e51b7df29"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:52:33.435691 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.435654 4557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/86a30d13-a008-48d3-90d3-359e51b7df29-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:52:33.435691 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.435686 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drldp\" (UniqueName: \"kubernetes.io/projected/86a30d13-a008-48d3-90d3-359e51b7df29-kube-api-access-drldp\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:52:33.435691 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.435695 4557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/86a30d13-a008-48d3-90d3-359e51b7df29-proxy-tls\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 00:52:33.721465 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.721432 4557 generic.go:356] "Generic (PLEG): container finished" podID="86a30d13-a008-48d3-90d3-359e51b7df29" containerID="9b2f69ba9fcffa799fbf54efa9475588e61b8f3d1a0eec45606d9cbae6608998" exitCode=0 Oct 31 00:52:33.721610 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.721507 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" event={"ID":"86a30d13-a008-48d3-90d3-359e51b7df29","Type":"ContainerDied","Data":"9b2f69ba9fcffa799fbf54efa9475588e61b8f3d1a0eec45606d9cbae6608998"} Oct 31 00:52:33.721610 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.721528 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" Oct 31 00:52:33.721610 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.721579 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb" event={"ID":"86a30d13-a008-48d3-90d3-359e51b7df29","Type":"ContainerDied","Data":"30e9d70113ef3882f013414a9700d9cf755c0ef1caeef8a10f0aa937ef4db423"} Oct 31 00:52:33.721610 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.721604 4557 scope.go:122] "RemoveContainer" containerID="f7e2ddb861119ffed6d408ebfc5ebb31aaee2407c266ef05530faf4710a47575" Oct 31 00:52:33.730101 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.730078 4557 scope.go:122] "RemoveContainer" containerID="9b2f69ba9fcffa799fbf54efa9475588e61b8f3d1a0eec45606d9cbae6608998" Oct 31 00:52:33.736944 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.736930 4557 scope.go:122] "RemoveContainer" containerID="f7e2ddb861119ffed6d408ebfc5ebb31aaee2407c266ef05530faf4710a47575" Oct 31 00:52:33.737169 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:52:33.737147 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7e2ddb861119ffed6d408ebfc5ebb31aaee2407c266ef05530faf4710a47575\": container with ID starting with f7e2ddb861119ffed6d408ebfc5ebb31aaee2407c266ef05530faf4710a47575 not found: ID does not exist" containerID="f7e2ddb861119ffed6d408ebfc5ebb31aaee2407c266ef05530faf4710a47575" Oct 31 00:52:33.737210 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.737179 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7e2ddb861119ffed6d408ebfc5ebb31aaee2407c266ef05530faf4710a47575"} err="failed to get container status \"f7e2ddb861119ffed6d408ebfc5ebb31aaee2407c266ef05530faf4710a47575\": rpc error: code = NotFound desc = could not find container \"f7e2ddb861119ffed6d408ebfc5ebb31aaee2407c266ef05530faf4710a47575\": container with ID starting with f7e2ddb861119ffed6d408ebfc5ebb31aaee2407c266ef05530faf4710a47575 not found: ID does not exist" Oct 31 00:52:33.737210 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.737193 4557 scope.go:122] "RemoveContainer" containerID="9b2f69ba9fcffa799fbf54efa9475588e61b8f3d1a0eec45606d9cbae6608998" Oct 31 00:52:33.737450 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:52:33.737432 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b2f69ba9fcffa799fbf54efa9475588e61b8f3d1a0eec45606d9cbae6608998\": container with ID starting with 9b2f69ba9fcffa799fbf54efa9475588e61b8f3d1a0eec45606d9cbae6608998 not found: ID does not exist" containerID="9b2f69ba9fcffa799fbf54efa9475588e61b8f3d1a0eec45606d9cbae6608998" Oct 31 00:52:33.737494 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.737458 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b2f69ba9fcffa799fbf54efa9475588e61b8f3d1a0eec45606d9cbae6608998"} err="failed to get container status \"9b2f69ba9fcffa799fbf54efa9475588e61b8f3d1a0eec45606d9cbae6608998\": rpc error: code = NotFound desc = could not find container \"9b2f69ba9fcffa799fbf54efa9475588e61b8f3d1a0eec45606d9cbae6608998\": container with ID starting with 9b2f69ba9fcffa799fbf54efa9475588e61b8f3d1a0eec45606d9cbae6608998 not found: ID does not exist" Oct 31 00:52:33.769312 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.769290 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb"] Oct 31 00:52:33.779889 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.779865 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-32ce2-predictor-59558f9f8b-4ctjb"] Oct 31 00:52:33.821074 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:33.821043 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="86a30d13-a008-48d3-90d3-359e51b7df29" path="/var/lib/kubelet/pods/86a30d13-a008-48d3-90d3-359e51b7df29/volumes" Oct 31 00:52:35.551205 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.551173 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:35.603292 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.603267 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss"] Oct 31 00:52:35.603674 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.603652 4557 cpu_manager.go:414] "containerMap: removing container" podUID="86a30d13-a008-48d3-90d3-359e51b7df29" containerName="kserve-container" Oct 31 00:52:35.603674 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.603674 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="86a30d13-a008-48d3-90d3-359e51b7df29" containerName="kserve-container" Oct 31 00:52:35.603826 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.603691 4557 cpu_manager.go:414] "containerMap: removing container" podUID="86a30d13-a008-48d3-90d3-359e51b7df29" containerName="kube-rbac-proxy" Oct 31 00:52:35.603826 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.603698 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="86a30d13-a008-48d3-90d3-359e51b7df29" containerName="kube-rbac-proxy" Oct 31 00:52:35.603826 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.603758 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="86a30d13-a008-48d3-90d3-359e51b7df29" containerName="kserve-container" Oct 31 00:52:35.603826 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.603768 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="86a30d13-a008-48d3-90d3-359e51b7df29" containerName="kube-rbac-proxy" Oct 31 00:52:35.606727 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.606710 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" Oct 31 00:52:35.630694 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.630669 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-b09a5b3eb3\"/\"success-200-isvc-1f9f9-kube-rbac-proxy-sar-config\"" Oct 31 00:52:35.630694 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.630685 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-b09a5b3eb3\"/\"kube-root-ca.crt\"" Oct 31 00:52:35.630830 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.630811 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-b09a5b3eb3\"/\"success-200-isvc-1f9f9-predictor-serving-cert\"" Oct 31 00:52:35.632283 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.632265 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss"] Oct 31 00:52:35.660236 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.660219 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:35.752397 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.752372 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-proxy-tls\") pod \"success-200-isvc-1f9f9-predictor-666b69c4b-9gmss\" (UID: \"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" Oct 31 00:52:35.752534 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.752424 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnzm9\" (UniqueName: \"kubernetes.io/projected/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-kube-api-access-dnzm9\") pod \"success-200-isvc-1f9f9-predictor-666b69c4b-9gmss\" (UID: \"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" Oct 31 00:52:35.752534 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.752492 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1f9f9-predictor-666b69c4b-9gmss\" (UID: \"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" Oct 31 00:52:35.853122 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.853053 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-proxy-tls\") pod \"success-200-isvc-1f9f9-predictor-666b69c4b-9gmss\" (UID: \"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" Oct 31 00:52:35.853122 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.853087 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnzm9\" (UniqueName: \"kubernetes.io/projected/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-kube-api-access-dnzm9\") pod \"success-200-isvc-1f9f9-predictor-666b69c4b-9gmss\" (UID: \"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" Oct 31 00:52:35.853122 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.853112 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1f9f9-predictor-666b69c4b-9gmss\" (UID: \"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" Oct 31 00:52:35.853756 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.853735 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1f9f9-predictor-666b69c4b-9gmss\" (UID: \"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" Oct 31 00:52:35.855417 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.855386 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-proxy-tls\") pod \"success-200-isvc-1f9f9-predictor-666b69c4b-9gmss\" (UID: \"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" Oct 31 00:52:35.878224 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.878198 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnzm9\" (UniqueName: \"kubernetes.io/projected/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-kube-api-access-dnzm9\") pod \"success-200-isvc-1f9f9-predictor-666b69c4b-9gmss\" (UID: \"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" Oct 31 00:52:35.920759 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.920733 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" Oct 31 00:52:35.937358 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:35.937317 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:36.045199 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:36.045170 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:36.152737 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:36.152673 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:36.216140 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:36.216111 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss"] Oct 31 00:52:36.220162 ip-10-0-131-90 kubenswrapper[4557]: W1031 00:52:36.220137 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0155e4fb_93e1_4eaa_8b9b_fd9fb12ac79f.slice/crio-0aec0cc1d18f9de39d7f6afe53c5e69be678827fcff7f0b84e65b225963f5861 WatchSource:0}: Error finding container 0aec0cc1d18f9de39d7f6afe53c5e69be678827fcff7f0b84e65b225963f5861: Status 404 returned error can't find the container with id 0aec0cc1d18f9de39d7f6afe53c5e69be678827fcff7f0b84e65b225963f5861 Oct 31 00:52:36.734860 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:36.734825 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" event={"ID":"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f","Type":"ContainerStarted","Data":"c1dc36ca2102195df378a859b0c339b43f4db745f5b2abdb918f3e1d400c0a41"} Oct 31 00:52:36.735225 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:36.734879 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" event={"ID":"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f","Type":"ContainerStarted","Data":"3c3bd38dc41e8a7b97b6eaf993c1f7bd87d1fcb993411da61778c2094614cb11"} Oct 31 00:52:36.735225 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:36.734906 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" event={"ID":"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f","Type":"ContainerStarted","Data":"0aec0cc1d18f9de39d7f6afe53c5e69be678827fcff7f0b84e65b225963f5861"} Oct 31 00:52:36.735225 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:36.734956 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" Oct 31 00:52:36.775254 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:36.775208 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" podStartSLOduration=1.775193494 podStartE2EDuration="1.775193494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:52:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:52:36.774199838 +0000 UTC m=+1371.056730182" watchObservedRunningTime="2026-10-31 00:52:36.775193494 +0000 UTC m=+1371.057723909" Oct 31 00:52:37.738283 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:37.738245 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" Oct 31 00:52:37.739687 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:37.739661 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" podUID="0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 31 00:52:38.742258 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:38.742221 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" podUID="0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 31 00:52:42.288541 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:42.288506 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:42.395292 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:42.395262 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:43.747496 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:43.747468 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" Oct 31 00:52:43.747998 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:43.747971 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" podUID="0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 31 00:52:51.960004 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:52:51.959968 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:52:53.748825 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:52:53.748787 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" podUID="0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 31 00:53:03.748276 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:53:03.748196 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" podUID="0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 31 00:53:13.748674 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:53:13.748626 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" podUID="0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 31 00:53:21.962565 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:53:21.962526 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:53:23.749191 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:53:23.749159 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" Oct 31 00:53:36.756669 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:53:36.756632 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:53:36.864691 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:53:36.864657 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:53:51.961347 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:53:51.961312 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:54:21.959840 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:54:21.959802 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:54:36.202412 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:54:36.202372 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:54:48.216653 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:54:48.216622 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:54:51.960852 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:54:51.960816 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:55:04.915153 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:55:04.915119 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:55:07.276924 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:55:07.276891 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:55:21.960466 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:55:21.960429 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:55:36.329726 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:55:36.329694 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:55:51.960123 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:55:51.960080 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:56:21.960363 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:56:21.960286 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:56:36.435394 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:56:36.435357 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:56:51.960497 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:56:51.960459 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:57:07.761035 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:57:07.761000 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:57:21.962397 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:57:21.962347 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:57:36.562807 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:57:36.562723 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:57:51.960259 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:57:51.960222 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:58:21.960045 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:58:21.960008 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:58:36.689421 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:58:36.689364 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:58:51.960846 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:58:51.960802 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:59:21.961229 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:59:21.961195 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 00:59:36.823775 ip-10-0-131-90 kubenswrapper[4557]: I1031 00:59:36.823732 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 00:59:51.960709 ip-10-0-131-90 kubenswrapper[4557]: E1031 00:59:51.960671 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:00:21.961112 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:00:21.961073 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:00:36.954615 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:00:36.954527 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:00:51.961101 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:00:51.961065 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:00:57.913520 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:00:57.913485 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:00:58.007801 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:00:58.007772 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h"] Oct 31 01:00:58.008023 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:00:58.007995 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" podUID="0a694468-46eb-4144-b773-13aebaac484b" containerName="kserve-container" containerID="cri-o://ca90d10eee5f0fe8d6260d582e28eb37e4fcc3801f5c9a2378f80dc6890058fc" gracePeriod=30 Oct 31 01:00:58.008087 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:00:58.008023 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" podUID="0a694468-46eb-4144-b773-13aebaac484b" containerName="kube-rbac-proxy" containerID="cri-o://107c960fadbbe30a4c3878555429d531096bfe2652dec69485125db7ba52edf2" gracePeriod=30 Oct 31 01:00:58.053096 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:00:58.053071 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:00:58.621604 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:00:58.621567 4557 generic.go:356] "Generic (PLEG): container finished" podID="0a694468-46eb-4144-b773-13aebaac484b" containerID="107c960fadbbe30a4c3878555429d531096bfe2652dec69485125db7ba52edf2" exitCode=0 Oct 31 01:00:58.621775 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:00:58.621624 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" event={"ID":"0a694468-46eb-4144-b773-13aebaac484b","Type":"ContainerDied","Data":"107c960fadbbe30a4c3878555429d531096bfe2652dec69485125db7ba52edf2"} Oct 31 01:01:00.527620 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:00.527579 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" podUID="0a694468-46eb-4144-b773-13aebaac484b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.32:8643/healthz\": dial tcp 10.133.0.32:8643: connect: connection refused" Oct 31 01:01:00.532911 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:00.532889 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" podUID="0a694468-46eb-4144-b773-13aebaac484b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 31 01:01:00.844543 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:00.844519 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" Oct 31 01:01:00.929140 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:00.929119 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0a694468-46eb-4144-b773-13aebaac484b-kube-api-access-bkcsp\" (UniqueName: \"kubernetes.io/projected/0a694468-46eb-4144-b773-13aebaac484b-kube-api-access-bkcsp\") pod \"0a694468-46eb-4144-b773-13aebaac484b\" (UID: \"0a694468-46eb-4144-b773-13aebaac484b\") " Oct 31 01:01:00.929288 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:00.929154 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0a694468-46eb-4144-b773-13aebaac484b-proxy-tls\" (UniqueName: \"kubernetes.io/secret/0a694468-46eb-4144-b773-13aebaac484b-proxy-tls\") pod \"0a694468-46eb-4144-b773-13aebaac484b\" (UID: \"0a694468-46eb-4144-b773-13aebaac484b\") " Oct 31 01:01:00.929288 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:00.929198 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0a694468-46eb-4144-b773-13aebaac484b-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0a694468-46eb-4144-b773-13aebaac484b-kube-rbac-proxy-sar-config\") pod \"0a694468-46eb-4144-b773-13aebaac484b\" (UID: \"0a694468-46eb-4144-b773-13aebaac484b\") " Oct 31 01:01:00.929628 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:00.929595 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a694468-46eb-4144-b773-13aebaac484b-kube-rbac-proxy-sar-config" pod "0a694468-46eb-4144-b773-13aebaac484b" (UID: "0a694468-46eb-4144-b773-13aebaac484b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:01:00.931216 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:00.931194 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a694468-46eb-4144-b773-13aebaac484b-proxy-tls" pod "0a694468-46eb-4144-b773-13aebaac484b" (UID: "0a694468-46eb-4144-b773-13aebaac484b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:01:00.931310 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:00.931239 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a694468-46eb-4144-b773-13aebaac484b-kube-api-access-bkcsp" pod "0a694468-46eb-4144-b773-13aebaac484b" (UID: "0a694468-46eb-4144-b773-13aebaac484b"). InnerVolumeSpecName "kube-api-access-bkcsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:01:01.029853 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:01.029829 4557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0a694468-46eb-4144-b773-13aebaac484b-proxy-tls\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:01:01.029853 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:01.029851 4557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0a694468-46eb-4144-b773-13aebaac484b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:01:01.029983 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:01.029860 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkcsp\" (UniqueName: \"kubernetes.io/projected/0a694468-46eb-4144-b773-13aebaac484b-kube-api-access-bkcsp\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:01:01.633053 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:01.633018 4557 generic.go:356] "Generic (PLEG): container finished" podID="0a694468-46eb-4144-b773-13aebaac484b" containerID="ca90d10eee5f0fe8d6260d582e28eb37e4fcc3801f5c9a2378f80dc6890058fc" exitCode=0 Oct 31 01:01:01.633487 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:01.633063 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" Oct 31 01:01:01.633487 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:01.633100 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" event={"ID":"0a694468-46eb-4144-b773-13aebaac484b","Type":"ContainerDied","Data":"ca90d10eee5f0fe8d6260d582e28eb37e4fcc3801f5c9a2378f80dc6890058fc"} Oct 31 01:01:01.633487 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:01.633158 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h" event={"ID":"0a694468-46eb-4144-b773-13aebaac484b","Type":"ContainerDied","Data":"8e381dda3a39e183bebc9968638ff3e698fe4595e0f7dd42ed5e7aaecd49b021"} Oct 31 01:01:01.633487 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:01.633187 4557 scope.go:122] "RemoveContainer" containerID="107c960fadbbe30a4c3878555429d531096bfe2652dec69485125db7ba52edf2" Oct 31 01:01:01.644334 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:01.642563 4557 scope.go:122] "RemoveContainer" containerID="ca90d10eee5f0fe8d6260d582e28eb37e4fcc3801f5c9a2378f80dc6890058fc" Oct 31 01:01:01.651053 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:01.651034 4557 scope.go:122] "RemoveContainer" containerID="107c960fadbbe30a4c3878555429d531096bfe2652dec69485125db7ba52edf2" Oct 31 01:01:01.651317 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:01:01.651297 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"107c960fadbbe30a4c3878555429d531096bfe2652dec69485125db7ba52edf2\": container with ID starting with 107c960fadbbe30a4c3878555429d531096bfe2652dec69485125db7ba52edf2 not found: ID does not exist" containerID="107c960fadbbe30a4c3878555429d531096bfe2652dec69485125db7ba52edf2" Oct 31 01:01:01.651394 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:01.651324 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"107c960fadbbe30a4c3878555429d531096bfe2652dec69485125db7ba52edf2"} err="failed to get container status \"107c960fadbbe30a4c3878555429d531096bfe2652dec69485125db7ba52edf2\": rpc error: code = NotFound desc = could not find container \"107c960fadbbe30a4c3878555429d531096bfe2652dec69485125db7ba52edf2\": container with ID starting with 107c960fadbbe30a4c3878555429d531096bfe2652dec69485125db7ba52edf2 not found: ID does not exist" Oct 31 01:01:01.651394 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:01.651341 4557 scope.go:122] "RemoveContainer" containerID="ca90d10eee5f0fe8d6260d582e28eb37e4fcc3801f5c9a2378f80dc6890058fc" Oct 31 01:01:01.651594 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:01:01.651578 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca90d10eee5f0fe8d6260d582e28eb37e4fcc3801f5c9a2378f80dc6890058fc\": container with ID starting with ca90d10eee5f0fe8d6260d582e28eb37e4fcc3801f5c9a2378f80dc6890058fc not found: ID does not exist" containerID="ca90d10eee5f0fe8d6260d582e28eb37e4fcc3801f5c9a2378f80dc6890058fc" Oct 31 01:01:01.651635 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:01.651599 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca90d10eee5f0fe8d6260d582e28eb37e4fcc3801f5c9a2378f80dc6890058fc"} err="failed to get container status \"ca90d10eee5f0fe8d6260d582e28eb37e4fcc3801f5c9a2378f80dc6890058fc\": rpc error: code = NotFound desc = could not find container \"ca90d10eee5f0fe8d6260d582e28eb37e4fcc3801f5c9a2378f80dc6890058fc\": container with ID starting with ca90d10eee5f0fe8d6260d582e28eb37e4fcc3801f5c9a2378f80dc6890058fc not found: ID does not exist" Oct 31 01:01:01.684585 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:01.684558 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h"] Oct 31 01:01:01.695208 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:01.695184 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-e8b5d-predictor-6cbb775976-xx57h"] Oct 31 01:01:01.821044 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:01.821019 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0a694468-46eb-4144-b773-13aebaac484b" path="/var/lib/kubelet/pods/0a694468-46eb-4144-b773-13aebaac484b/volumes" Oct 31 01:01:03.254425 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.254372 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:01:03.408699 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.408671 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl"] Oct 31 01:01:03.409046 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.409032 4557 cpu_manager.go:414] "containerMap: removing container" podUID="0a694468-46eb-4144-b773-13aebaac484b" containerName="kube-rbac-proxy" Oct 31 01:01:03.409100 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.409047 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0a694468-46eb-4144-b773-13aebaac484b" containerName="kube-rbac-proxy" Oct 31 01:01:03.409100 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.409077 4557 cpu_manager.go:414] "containerMap: removing container" podUID="0a694468-46eb-4144-b773-13aebaac484b" containerName="kserve-container" Oct 31 01:01:03.409100 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.409082 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0a694468-46eb-4144-b773-13aebaac484b" containerName="kserve-container" Oct 31 01:01:03.409202 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.409131 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="0a694468-46eb-4144-b773-13aebaac484b" containerName="kube-rbac-proxy" Oct 31 01:01:03.409202 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.409143 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="0a694468-46eb-4144-b773-13aebaac484b" containerName="kserve-container" Oct 31 01:01:03.413457 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.413438 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" Oct 31 01:01:03.429053 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.429036 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e1f85522d1\"/\"success-200-isvc-39fbc-kube-rbac-proxy-sar-config\"" Oct 31 01:01:03.431228 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.431211 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e1f85522d1\"/\"kube-root-ca.crt\"" Oct 31 01:01:03.440856 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.440824 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl"] Oct 31 01:01:03.441703 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.441688 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e1f85522d1\"/\"success-200-isvc-39fbc-predictor-serving-cert\"" Oct 31 01:01:03.482545 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.482513 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:01:03.549074 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.549020 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d67f4c54-c2cd-478a-b29d-5356fe389f5b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-39fbc-predictor-6ddf7665c4-797kl\" (UID: \"d67f4c54-c2cd-478a-b29d-5356fe389f5b\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" Oct 31 01:01:03.549074 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.549048 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxj2g\" (UniqueName: \"kubernetes.io/projected/d67f4c54-c2cd-478a-b29d-5356fe389f5b-kube-api-access-kxj2g\") pod \"success-200-isvc-39fbc-predictor-6ddf7665c4-797kl\" (UID: \"d67f4c54-c2cd-478a-b29d-5356fe389f5b\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" Oct 31 01:01:03.549226 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.549084 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d67f4c54-c2cd-478a-b29d-5356fe389f5b-proxy-tls\") pod \"success-200-isvc-39fbc-predictor-6ddf7665c4-797kl\" (UID: \"d67f4c54-c2cd-478a-b29d-5356fe389f5b\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" Oct 31 01:01:03.650311 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.650274 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d67f4c54-c2cd-478a-b29d-5356fe389f5b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-39fbc-predictor-6ddf7665c4-797kl\" (UID: \"d67f4c54-c2cd-478a-b29d-5356fe389f5b\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" Oct 31 01:01:03.650311 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.650311 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxj2g\" (UniqueName: \"kubernetes.io/projected/d67f4c54-c2cd-478a-b29d-5356fe389f5b-kube-api-access-kxj2g\") pod \"success-200-isvc-39fbc-predictor-6ddf7665c4-797kl\" (UID: \"d67f4c54-c2cd-478a-b29d-5356fe389f5b\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" Oct 31 01:01:03.650601 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.650453 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d67f4c54-c2cd-478a-b29d-5356fe389f5b-proxy-tls\") pod \"success-200-isvc-39fbc-predictor-6ddf7665c4-797kl\" (UID: \"d67f4c54-c2cd-478a-b29d-5356fe389f5b\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" Oct 31 01:01:03.651189 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.651163 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d67f4c54-c2cd-478a-b29d-5356fe389f5b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-39fbc-predictor-6ddf7665c4-797kl\" (UID: \"d67f4c54-c2cd-478a-b29d-5356fe389f5b\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" Oct 31 01:01:03.651310 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.651250 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:01:03.652933 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.652908 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d67f4c54-c2cd-478a-b29d-5356fe389f5b-proxy-tls\") pod \"success-200-isvc-39fbc-predictor-6ddf7665c4-797kl\" (UID: \"d67f4c54-c2cd-478a-b29d-5356fe389f5b\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" Oct 31 01:01:03.672685 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.672666 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxj2g\" (UniqueName: \"kubernetes.io/projected/d67f4c54-c2cd-478a-b29d-5356fe389f5b-kube-api-access-kxj2g\") pod \"success-200-isvc-39fbc-predictor-6ddf7665c4-797kl\" (UID: \"d67f4c54-c2cd-478a-b29d-5356fe389f5b\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" Oct 31 01:01:03.728127 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.728105 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" Oct 31 01:01:03.769720 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:03.769692 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:01:04.027190 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:04.027158 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl"] Oct 31 01:01:04.032602 ip-10-0-131-90 kubenswrapper[4557]: W1031 01:01:04.032572 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67f4c54_c2cd_478a_b29d_5356fe389f5b.slice/crio-713692f4038984a315b08c001f583800c7e8e2897d95f06b05b46d30122127c3 WatchSource:0}: Error finding container 713692f4038984a315b08c001f583800c7e8e2897d95f06b05b46d30122127c3: Status 404 returned error can't find the container with id 713692f4038984a315b08c001f583800c7e8e2897d95f06b05b46d30122127c3 Oct 31 01:01:04.648912 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:04.648877 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" event={"ID":"d67f4c54-c2cd-478a-b29d-5356fe389f5b","Type":"ContainerStarted","Data":"0315b00ea9da2393d2c0c563ed751411ed6b1ee448246f7d753abaf8f39de76d"} Oct 31 01:01:04.649377 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:04.648930 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" event={"ID":"d67f4c54-c2cd-478a-b29d-5356fe389f5b","Type":"ContainerStarted","Data":"d4a14476da36fcef78c8945ecd7d025fb5e688c9aea9a8d667824f22298ed238"} Oct 31 01:01:04.649377 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:04.648951 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" event={"ID":"d67f4c54-c2cd-478a-b29d-5356fe389f5b","Type":"ContainerStarted","Data":"713692f4038984a315b08c001f583800c7e8e2897d95f06b05b46d30122127c3"} Oct 31 01:01:04.649377 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:04.648987 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" Oct 31 01:01:04.689317 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:04.689273 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" podStartSLOduration=1.689260493 podStartE2EDuration="1.689260493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:01:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:01:04.687749078 +0000 UTC m=+1878.970279446" watchObservedRunningTime="2026-10-31 01:01:04.689260493 +0000 UTC m=+1878.971790848" Oct 31 01:01:05.653358 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:05.653320 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" Oct 31 01:01:05.654731 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:05.654702 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" podUID="d67f4c54-c2cd-478a-b29d-5356fe389f5b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 31 01:01:06.657563 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:06.657525 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" podUID="d67f4c54-c2cd-478a-b29d-5356fe389f5b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 31 01:01:11.662446 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:11.662397 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" Oct 31 01:01:11.662911 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:11.662844 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" podUID="d67f4c54-c2cd-478a-b29d-5356fe389f5b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 31 01:01:21.663167 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:21.663130 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" podUID="d67f4c54-c2cd-478a-b29d-5356fe389f5b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 31 01:01:21.960890 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:01:21.960791 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:01:31.663647 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:31.663607 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" podUID="d67f4c54-c2cd-478a-b29d-5356fe389f5b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 31 01:01:37.064637 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:37.064597 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:01:41.663096 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:41.663055 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" podUID="d67f4c54-c2cd-478a-b29d-5356fe389f5b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 31 01:01:51.292933 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:51.292899 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:01:51.342742 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:51.342705 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss"] Oct 31 01:01:51.343068 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:51.343011 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" podUID="0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" containerName="kserve-container" containerID="cri-o://3c3bd38dc41e8a7b97b6eaf993c1f7bd87d1fcb993411da61778c2094614cb11" gracePeriod=30 Oct 31 01:01:51.343223 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:51.343050 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" podUID="0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" containerName="kube-rbac-proxy" containerID="cri-o://c1dc36ca2102195df378a859b0c339b43f4db745f5b2abdb918f3e1d400c0a41" gracePeriod=30 Oct 31 01:01:51.403027 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:51.402998 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:01:51.663646 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:51.663563 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" Oct 31 01:01:51.840010 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:51.839978 4557 generic.go:356] "Generic (PLEG): container finished" podID="0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" containerID="c1dc36ca2102195df378a859b0c339b43f4db745f5b2abdb918f3e1d400c0a41" exitCode=0 Oct 31 01:01:51.840170 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:51.840048 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" event={"ID":"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f","Type":"ContainerDied","Data":"c1dc36ca2102195df378a859b0c339b43f4db745f5b2abdb918f3e1d400c0a41"} Oct 31 01:01:51.960462 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:01:51.960368 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:01:53.743232 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:53.743194 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" podUID="0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.33:8643/healthz\": dial tcp 10.133.0.33:8643: connect: connection refused" Oct 31 01:01:53.748573 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:53.748549 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" podUID="0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 31 01:01:54.286902 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.286874 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" Oct 31 01:01:54.413280 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.413210 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-kube-rbac-proxy-sar-config\") pod \"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f\" (UID: \"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f\") " Oct 31 01:01:54.413280 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.413253 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-proxy-tls\" (UniqueName: \"kubernetes.io/secret/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-proxy-tls\") pod \"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f\" (UID: \"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f\") " Oct 31 01:01:54.413280 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.413273 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-kube-api-access-dnzm9\" (UniqueName: \"kubernetes.io/projected/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-kube-api-access-dnzm9\") pod \"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f\" (UID: \"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f\") " Oct 31 01:01:54.413610 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.413586 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-kube-rbac-proxy-sar-config" pod "0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" (UID: "0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:01:54.415331 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.415299 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-proxy-tls" pod "0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" (UID: "0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:01:54.415451 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.415350 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-kube-api-access-dnzm9" pod "0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" (UID: "0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f"). InnerVolumeSpecName "kube-api-access-dnzm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:01:54.513934 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.513900 4557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:01:54.513934 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.513932 4557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-proxy-tls\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:01:54.514071 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.513947 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnzm9\" (UniqueName: \"kubernetes.io/projected/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f-kube-api-access-dnzm9\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:01:54.852158 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.852126 4557 generic.go:356] "Generic (PLEG): container finished" podID="0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" containerID="3c3bd38dc41e8a7b97b6eaf993c1f7bd87d1fcb993411da61778c2094614cb11" exitCode=0 Oct 31 01:01:54.852579 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.852163 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" event={"ID":"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f","Type":"ContainerDied","Data":"3c3bd38dc41e8a7b97b6eaf993c1f7bd87d1fcb993411da61778c2094614cb11"} Oct 31 01:01:54.852579 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.852226 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" event={"ID":"0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f","Type":"ContainerDied","Data":"0aec0cc1d18f9de39d7f6afe53c5e69be678827fcff7f0b84e65b225963f5861"} Oct 31 01:01:54.852579 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.852252 4557 scope.go:122] "RemoveContainer" containerID="c1dc36ca2102195df378a859b0c339b43f4db745f5b2abdb918f3e1d400c0a41" Oct 31 01:01:54.852579 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.852175 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss" Oct 31 01:01:54.862674 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.862639 4557 scope.go:122] "RemoveContainer" containerID="3c3bd38dc41e8a7b97b6eaf993c1f7bd87d1fcb993411da61778c2094614cb11" Oct 31 01:01:54.869917 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.869900 4557 scope.go:122] "RemoveContainer" containerID="c1dc36ca2102195df378a859b0c339b43f4db745f5b2abdb918f3e1d400c0a41" Oct 31 01:01:54.870145 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:01:54.870129 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1dc36ca2102195df378a859b0c339b43f4db745f5b2abdb918f3e1d400c0a41\": container with ID starting with c1dc36ca2102195df378a859b0c339b43f4db745f5b2abdb918f3e1d400c0a41 not found: ID does not exist" containerID="c1dc36ca2102195df378a859b0c339b43f4db745f5b2abdb918f3e1d400c0a41" Oct 31 01:01:54.870183 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.870155 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1dc36ca2102195df378a859b0c339b43f4db745f5b2abdb918f3e1d400c0a41"} err="failed to get container status \"c1dc36ca2102195df378a859b0c339b43f4db745f5b2abdb918f3e1d400c0a41\": rpc error: code = NotFound desc = could not find container \"c1dc36ca2102195df378a859b0c339b43f4db745f5b2abdb918f3e1d400c0a41\": container with ID starting with c1dc36ca2102195df378a859b0c339b43f4db745f5b2abdb918f3e1d400c0a41 not found: ID does not exist" Oct 31 01:01:54.870183 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.870174 4557 scope.go:122] "RemoveContainer" containerID="3c3bd38dc41e8a7b97b6eaf993c1f7bd87d1fcb993411da61778c2094614cb11" Oct 31 01:01:54.870439 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:01:54.870398 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c3bd38dc41e8a7b97b6eaf993c1f7bd87d1fcb993411da61778c2094614cb11\": container with ID starting with 3c3bd38dc41e8a7b97b6eaf993c1f7bd87d1fcb993411da61778c2094614cb11 not found: ID does not exist" containerID="3c3bd38dc41e8a7b97b6eaf993c1f7bd87d1fcb993411da61778c2094614cb11" Oct 31 01:01:54.870541 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.870445 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c3bd38dc41e8a7b97b6eaf993c1f7bd87d1fcb993411da61778c2094614cb11"} err="failed to get container status \"3c3bd38dc41e8a7b97b6eaf993c1f7bd87d1fcb993411da61778c2094614cb11\": rpc error: code = NotFound desc = could not find container \"3c3bd38dc41e8a7b97b6eaf993c1f7bd87d1fcb993411da61778c2094614cb11\": container with ID starting with 3c3bd38dc41e8a7b97b6eaf993c1f7bd87d1fcb993411da61778c2094614cb11 not found: ID does not exist" Oct 31 01:01:54.899309 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.899291 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss"] Oct 31 01:01:54.909911 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:54.909893 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-1f9f9-predictor-666b69c4b-9gmss"] Oct 31 01:01:55.822579 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:55.822541 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" path="/var/lib/kubelet/pods/0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f/volumes" Oct 31 01:01:56.712272 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.712239 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:01:56.765021 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.764987 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq"] Oct 31 01:01:56.765434 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.765398 4557 cpu_manager.go:414] "containerMap: removing container" podUID="0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" containerName="kube-rbac-proxy" Oct 31 01:01:56.765520 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.765437 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" containerName="kube-rbac-proxy" Oct 31 01:01:56.765520 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.765463 4557 cpu_manager.go:414] "containerMap: removing container" podUID="0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" containerName="kserve-container" Oct 31 01:01:56.765520 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.765471 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" containerName="kserve-container" Oct 31 01:01:56.765680 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.765557 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" containerName="kserve-container" Oct 31 01:01:56.765680 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.765574 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="0155e4fb-93e1-4eaa-8b9b-fd9fb12ac79f" containerName="kube-rbac-proxy" Oct 31 01:01:56.770052 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.770030 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" Oct 31 01:01:56.783758 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.783733 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-b09a5b3eb3\"/\"success-200-isvc-2ff2d-kube-rbac-proxy-sar-config\"" Oct 31 01:01:56.794167 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.794137 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-b09a5b3eb3\"/\"kube-root-ca.crt\"" Oct 31 01:01:56.794167 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.794159 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-b09a5b3eb3\"/\"success-200-isvc-2ff2d-predictor-serving-cert\"" Oct 31 01:01:56.796126 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.796108 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq"] Oct 31 01:01:56.819892 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.819870 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:01:56.831927 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.831905 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-proxy-tls\") pod \"success-200-isvc-2ff2d-predictor-d74b87588-6vcvq\" (UID: \"dc2d4cc5-7bd9-4a70-9434-a3c46be68788\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" Oct 31 01:01:56.831988 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.831950 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2ff2d-predictor-d74b87588-6vcvq\" (UID: \"dc2d4cc5-7bd9-4a70-9434-a3c46be68788\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" Oct 31 01:01:56.832049 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.832034 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw99d\" (UniqueName: \"kubernetes.io/projected/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-kube-api-access-nw99d\") pod \"success-200-isvc-2ff2d-predictor-d74b87588-6vcvq\" (UID: \"dc2d4cc5-7bd9-4a70-9434-a3c46be68788\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" Oct 31 01:01:56.932616 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.932588 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw99d\" (UniqueName: \"kubernetes.io/projected/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-kube-api-access-nw99d\") pod \"success-200-isvc-2ff2d-predictor-d74b87588-6vcvq\" (UID: \"dc2d4cc5-7bd9-4a70-9434-a3c46be68788\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" Oct 31 01:01:56.932727 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.932631 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-proxy-tls\") pod \"success-200-isvc-2ff2d-predictor-d74b87588-6vcvq\" (UID: \"dc2d4cc5-7bd9-4a70-9434-a3c46be68788\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" Oct 31 01:01:56.932727 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.932675 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2ff2d-predictor-d74b87588-6vcvq\" (UID: \"dc2d4cc5-7bd9-4a70-9434-a3c46be68788\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" Oct 31 01:01:56.933367 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.933348 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2ff2d-predictor-d74b87588-6vcvq\" (UID: \"dc2d4cc5-7bd9-4a70-9434-a3c46be68788\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" Oct 31 01:01:56.935115 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.935095 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-proxy-tls\") pod \"success-200-isvc-2ff2d-predictor-d74b87588-6vcvq\" (UID: \"dc2d4cc5-7bd9-4a70-9434-a3c46be68788\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" Oct 31 01:01:56.954762 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:56.954737 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw99d\" (UniqueName: \"kubernetes.io/projected/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-kube-api-access-nw99d\") pod \"success-200-isvc-2ff2d-predictor-d74b87588-6vcvq\" (UID: \"dc2d4cc5-7bd9-4a70-9434-a3c46be68788\") " pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" Oct 31 01:01:57.084697 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:57.084669 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" Oct 31 01:01:57.097398 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:57.097372 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:01:57.225203 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:57.225175 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:01:57.379796 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:57.379726 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq"] Oct 31 01:01:57.384375 ip-10-0-131-90 kubenswrapper[4557]: W1031 01:01:57.384340 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc2d4cc5_7bd9_4a70_9434_a3c46be68788.slice/crio-e144270691ef19c8f78e235962dae3cc2a31748f4db7e20116e8a1516d5f70f9 WatchSource:0}: Error finding container e144270691ef19c8f78e235962dae3cc2a31748f4db7e20116e8a1516d5f70f9: Status 404 returned error can't find the container with id e144270691ef19c8f78e235962dae3cc2a31748f4db7e20116e8a1516d5f70f9 Oct 31 01:01:57.865679 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:57.865645 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" event={"ID":"dc2d4cc5-7bd9-4a70-9434-a3c46be68788","Type":"ContainerStarted","Data":"3c73f9f84b710a4372c9b453ac02c1c4734a2fd12623e2b33b5463c92c585fdf"} Oct 31 01:01:57.866075 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:57.865713 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" Oct 31 01:01:57.866075 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:57.865735 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" event={"ID":"dc2d4cc5-7bd9-4a70-9434-a3c46be68788","Type":"ContainerStarted","Data":"042331c8ab8c36b334cbd45fd40a35a350b40575f901322b0cce434f278f602c"} Oct 31 01:01:57.866075 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:57.865754 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" event={"ID":"dc2d4cc5-7bd9-4a70-9434-a3c46be68788","Type":"ContainerStarted","Data":"e144270691ef19c8f78e235962dae3cc2a31748f4db7e20116e8a1516d5f70f9"} Oct 31 01:01:57.903884 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:57.903831 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" podStartSLOduration=1.90381931 podStartE2EDuration="1.90381931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:01:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:01:57.903649023 +0000 UTC m=+1932.186179378" watchObservedRunningTime="2026-10-31 01:01:57.90381931 +0000 UTC m=+1932.186349666" Oct 31 01:01:58.869344 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:58.869311 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" Oct 31 01:01:58.870659 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:58.870627 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" podUID="dc2d4cc5-7bd9-4a70-9434-a3c46be68788" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused" Oct 31 01:01:59.873463 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:01:59.873430 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" podUID="dc2d4cc5-7bd9-4a70-9434-a3c46be68788" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused" Oct 31 01:02:03.490921 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:03.490888 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:02:03.660964 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:03.660932 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:02:04.877615 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:04.877588 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" Oct 31 01:02:04.878068 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:04.878040 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" podUID="dc2d4cc5-7bd9-4a70-9434-a3c46be68788" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused" Oct 31 01:02:14.867641 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:14.867608 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:02:14.877973 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:14.877944 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" podUID="dc2d4cc5-7bd9-4a70-9434-a3c46be68788" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused" Oct 31 01:02:14.915012 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:14.914983 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl"] Oct 31 01:02:14.915272 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:14.915245 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" podUID="d67f4c54-c2cd-478a-b29d-5356fe389f5b" containerName="kserve-container" containerID="cri-o://d4a14476da36fcef78c8945ecd7d025fb5e688c9aea9a8d667824f22298ed238" gracePeriod=30 Oct 31 01:02:14.915354 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:14.915297 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" podUID="d67f4c54-c2cd-478a-b29d-5356fe389f5b" containerName="kube-rbac-proxy" containerID="cri-o://0315b00ea9da2393d2c0c563ed751411ed6b1ee448246f7d753abaf8f39de76d" gracePeriod=30 Oct 31 01:02:14.979252 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:14.979225 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:02:15.932521 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:15.932491 4557 generic.go:356] "Generic (PLEG): container finished" podID="d67f4c54-c2cd-478a-b29d-5356fe389f5b" containerID="0315b00ea9da2393d2c0c563ed751411ed6b1ee448246f7d753abaf8f39de76d" exitCode=0 Oct 31 01:02:15.932893 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:15.932558 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" event={"ID":"d67f4c54-c2cd-478a-b29d-5356fe389f5b","Type":"ContainerDied","Data":"0315b00ea9da2393d2c0c563ed751411ed6b1ee448246f7d753abaf8f39de76d"} Oct 31 01:02:16.658444 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:16.658364 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" podUID="d67f4c54-c2cd-478a-b29d-5356fe389f5b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.34:8643/healthz\": dial tcp 10.133.0.34:8643: connect: connection refused" Oct 31 01:02:18.259697 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.259674 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" Oct 31 01:02:18.403675 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.403606 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d67f4c54-c2cd-478a-b29d-5356fe389f5b-proxy-tls\" (UniqueName: \"kubernetes.io/secret/d67f4c54-c2cd-478a-b29d-5356fe389f5b-proxy-tls\") pod \"d67f4c54-c2cd-478a-b29d-5356fe389f5b\" (UID: \"d67f4c54-c2cd-478a-b29d-5356fe389f5b\") " Oct 31 01:02:18.403675 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.403647 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d67f4c54-c2cd-478a-b29d-5356fe389f5b-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d67f4c54-c2cd-478a-b29d-5356fe389f5b-kube-rbac-proxy-sar-config\") pod \"d67f4c54-c2cd-478a-b29d-5356fe389f5b\" (UID: \"d67f4c54-c2cd-478a-b29d-5356fe389f5b\") " Oct 31 01:02:18.403892 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.403705 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d67f4c54-c2cd-478a-b29d-5356fe389f5b-kube-api-access-kxj2g\" (UniqueName: \"kubernetes.io/projected/d67f4c54-c2cd-478a-b29d-5356fe389f5b-kube-api-access-kxj2g\") pod \"d67f4c54-c2cd-478a-b29d-5356fe389f5b\" (UID: \"d67f4c54-c2cd-478a-b29d-5356fe389f5b\") " Oct 31 01:02:18.404070 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.404043 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d67f4c54-c2cd-478a-b29d-5356fe389f5b-kube-rbac-proxy-sar-config" pod "d67f4c54-c2cd-478a-b29d-5356fe389f5b" (UID: "d67f4c54-c2cd-478a-b29d-5356fe389f5b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:02:18.405727 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.405705 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d67f4c54-c2cd-478a-b29d-5356fe389f5b-proxy-tls" pod "d67f4c54-c2cd-478a-b29d-5356fe389f5b" (UID: "d67f4c54-c2cd-478a-b29d-5356fe389f5b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:02:18.405975 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.405954 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d67f4c54-c2cd-478a-b29d-5356fe389f5b-kube-api-access-kxj2g" pod "d67f4c54-c2cd-478a-b29d-5356fe389f5b" (UID: "d67f4c54-c2cd-478a-b29d-5356fe389f5b"). InnerVolumeSpecName "kube-api-access-kxj2g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:02:18.504255 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.504226 4557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d67f4c54-c2cd-478a-b29d-5356fe389f5b-proxy-tls\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:02:18.504255 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.504250 4557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d67f4c54-c2cd-478a-b29d-5356fe389f5b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:02:18.504255 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.504260 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxj2g\" (UniqueName: \"kubernetes.io/projected/d67f4c54-c2cd-478a-b29d-5356fe389f5b-kube-api-access-kxj2g\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:02:18.945166 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.945126 4557 generic.go:356] "Generic (PLEG): container finished" podID="d67f4c54-c2cd-478a-b29d-5356fe389f5b" containerID="d4a14476da36fcef78c8945ecd7d025fb5e688c9aea9a8d667824f22298ed238" exitCode=0 Oct 31 01:02:18.945308 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.945169 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" Oct 31 01:02:18.945308 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.945198 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" event={"ID":"d67f4c54-c2cd-478a-b29d-5356fe389f5b","Type":"ContainerDied","Data":"d4a14476da36fcef78c8945ecd7d025fb5e688c9aea9a8d667824f22298ed238"} Oct 31 01:02:18.945308 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.945253 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl" event={"ID":"d67f4c54-c2cd-478a-b29d-5356fe389f5b","Type":"ContainerDied","Data":"713692f4038984a315b08c001f583800c7e8e2897d95f06b05b46d30122127c3"} Oct 31 01:02:18.945308 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.945277 4557 scope.go:122] "RemoveContainer" containerID="0315b00ea9da2393d2c0c563ed751411ed6b1ee448246f7d753abaf8f39de76d" Oct 31 01:02:18.953978 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.953963 4557 scope.go:122] "RemoveContainer" containerID="d4a14476da36fcef78c8945ecd7d025fb5e688c9aea9a8d667824f22298ed238" Oct 31 01:02:18.961189 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.961171 4557 scope.go:122] "RemoveContainer" containerID="0315b00ea9da2393d2c0c563ed751411ed6b1ee448246f7d753abaf8f39de76d" Oct 31 01:02:18.961475 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:02:18.961453 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0315b00ea9da2393d2c0c563ed751411ed6b1ee448246f7d753abaf8f39de76d\": container with ID starting with 0315b00ea9da2393d2c0c563ed751411ed6b1ee448246f7d753abaf8f39de76d not found: ID does not exist" containerID="0315b00ea9da2393d2c0c563ed751411ed6b1ee448246f7d753abaf8f39de76d" Oct 31 01:02:18.961551 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.961488 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0315b00ea9da2393d2c0c563ed751411ed6b1ee448246f7d753abaf8f39de76d"} err="failed to get container status \"0315b00ea9da2393d2c0c563ed751411ed6b1ee448246f7d753abaf8f39de76d\": rpc error: code = NotFound desc = could not find container \"0315b00ea9da2393d2c0c563ed751411ed6b1ee448246f7d753abaf8f39de76d\": container with ID starting with 0315b00ea9da2393d2c0c563ed751411ed6b1ee448246f7d753abaf8f39de76d not found: ID does not exist" Oct 31 01:02:18.961551 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.961509 4557 scope.go:122] "RemoveContainer" containerID="d4a14476da36fcef78c8945ecd7d025fb5e688c9aea9a8d667824f22298ed238" Oct 31 01:02:18.961776 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:02:18.961759 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4a14476da36fcef78c8945ecd7d025fb5e688c9aea9a8d667824f22298ed238\": container with ID starting with d4a14476da36fcef78c8945ecd7d025fb5e688c9aea9a8d667824f22298ed238 not found: ID does not exist" containerID="d4a14476da36fcef78c8945ecd7d025fb5e688c9aea9a8d667824f22298ed238" Oct 31 01:02:18.961815 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.961782 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4a14476da36fcef78c8945ecd7d025fb5e688c9aea9a8d667824f22298ed238"} err="failed to get container status \"d4a14476da36fcef78c8945ecd7d025fb5e688c9aea9a8d667824f22298ed238\": rpc error: code = NotFound desc = could not find container \"d4a14476da36fcef78c8945ecd7d025fb5e688c9aea9a8d667824f22298ed238\": container with ID starting with d4a14476da36fcef78c8945ecd7d025fb5e688c9aea9a8d667824f22298ed238 not found: ID does not exist" Oct 31 01:02:18.994316 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:18.994291 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl"] Oct 31 01:02:19.009775 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:19.009751 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-39fbc-predictor-6ddf7665c4-797kl"] Oct 31 01:02:19.821097 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:19.821064 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d67f4c54-c2cd-478a-b29d-5356fe389f5b" path="/var/lib/kubelet/pods/d67f4c54-c2cd-478a-b29d-5356fe389f5b/volumes" Oct 31 01:02:20.226531 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.226500 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:02:20.281150 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.281119 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x"] Oct 31 01:02:20.281472 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.281459 4557 cpu_manager.go:414] "containerMap: removing container" podUID="d67f4c54-c2cd-478a-b29d-5356fe389f5b" containerName="kube-rbac-proxy" Oct 31 01:02:20.281530 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.281473 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d67f4c54-c2cd-478a-b29d-5356fe389f5b" containerName="kube-rbac-proxy" Oct 31 01:02:20.281530 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.281492 4557 cpu_manager.go:414] "containerMap: removing container" podUID="d67f4c54-c2cd-478a-b29d-5356fe389f5b" containerName="kserve-container" Oct 31 01:02:20.281530 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.281498 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d67f4c54-c2cd-478a-b29d-5356fe389f5b" containerName="kserve-container" Oct 31 01:02:20.281672 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.281558 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="d67f4c54-c2cd-478a-b29d-5356fe389f5b" containerName="kube-rbac-proxy" Oct 31 01:02:20.281672 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.281568 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="d67f4c54-c2cd-478a-b29d-5356fe389f5b" containerName="kserve-container" Oct 31 01:02:20.285978 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.285961 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" Oct 31 01:02:20.299680 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.299651 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e1f85522d1\"/\"success-200-isvc-3fc47-predictor-serving-cert\"" Oct 31 01:02:20.309967 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.309945 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e1f85522d1\"/\"success-200-isvc-3fc47-kube-rbac-proxy-sar-config\"" Oct 31 01:02:20.309967 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.309954 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e1f85522d1\"/\"kube-root-ca.crt\"" Oct 31 01:02:20.311262 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.311239 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x"] Oct 31 01:02:20.417984 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.417954 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9be77934-fefa-4407-9369-3bf4536a27e1-proxy-tls\") pod \"success-200-isvc-3fc47-predictor-69686b55fd-2kw8x\" (UID: \"9be77934-fefa-4407-9369-3bf4536a27e1\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" Oct 31 01:02:20.418170 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.417998 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh7mt\" (UniqueName: \"kubernetes.io/projected/9be77934-fefa-4407-9369-3bf4536a27e1-kube-api-access-rh7mt\") pod \"success-200-isvc-3fc47-predictor-69686b55fd-2kw8x\" (UID: \"9be77934-fefa-4407-9369-3bf4536a27e1\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" Oct 31 01:02:20.418170 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.418149 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9be77934-fefa-4407-9369-3bf4536a27e1-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-3fc47-predictor-69686b55fd-2kw8x\" (UID: \"9be77934-fefa-4407-9369-3bf4536a27e1\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" Oct 31 01:02:20.519322 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.519249 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9be77934-fefa-4407-9369-3bf4536a27e1-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-3fc47-predictor-69686b55fd-2kw8x\" (UID: \"9be77934-fefa-4407-9369-3bf4536a27e1\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" Oct 31 01:02:20.519322 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.519303 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9be77934-fefa-4407-9369-3bf4536a27e1-proxy-tls\") pod \"success-200-isvc-3fc47-predictor-69686b55fd-2kw8x\" (UID: \"9be77934-fefa-4407-9369-3bf4536a27e1\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" Oct 31 01:02:20.519521 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.519338 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh7mt\" (UniqueName: \"kubernetes.io/projected/9be77934-fefa-4407-9369-3bf4536a27e1-kube-api-access-rh7mt\") pod \"success-200-isvc-3fc47-predictor-69686b55fd-2kw8x\" (UID: \"9be77934-fefa-4407-9369-3bf4536a27e1\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" Oct 31 01:02:20.519521 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:02:20.519490 4557 secret.go:189] Couldn't get secret e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-serving-cert: secret "success-200-isvc-3fc47-predictor-serving-cert" not found Oct 31 01:02:20.519600 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:02:20.519549 4557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9be77934-fefa-4407-9369-3bf4536a27e1-proxy-tls podName:9be77934-fefa-4407-9369-3bf4536a27e1 nodeName:}" failed. No retries permitted until 2026-10-31 01:02:21.019533592 +0000 UTC m=+1955.302063925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/9be77934-fefa-4407-9369-3bf4536a27e1-proxy-tls") pod "success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" (UID: "9be77934-fefa-4407-9369-3bf4536a27e1") : secret "success-200-isvc-3fc47-predictor-serving-cert" not found Oct 31 01:02:20.519967 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.519946 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9be77934-fefa-4407-9369-3bf4536a27e1-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-3fc47-predictor-69686b55fd-2kw8x\" (UID: \"9be77934-fefa-4407-9369-3bf4536a27e1\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" Oct 31 01:02:20.543744 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.543717 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh7mt\" (UniqueName: \"kubernetes.io/projected/9be77934-fefa-4407-9369-3bf4536a27e1-kube-api-access-rh7mt\") pod \"success-200-isvc-3fc47-predictor-69686b55fd-2kw8x\" (UID: \"9be77934-fefa-4407-9369-3bf4536a27e1\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" Oct 31 01:02:20.626683 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.626650 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:02:20.739482 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:20.739455 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:02:21.023534 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:21.023504 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9be77934-fefa-4407-9369-3bf4536a27e1-proxy-tls\") pod \"success-200-isvc-3fc47-predictor-69686b55fd-2kw8x\" (UID: \"9be77934-fefa-4407-9369-3bf4536a27e1\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" Oct 31 01:02:21.025932 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:21.025907 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9be77934-fefa-4407-9369-3bf4536a27e1-proxy-tls\") pod \"success-200-isvc-3fc47-predictor-69686b55fd-2kw8x\" (UID: \"9be77934-fefa-4407-9369-3bf4536a27e1\") " pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" Oct 31 01:02:21.199846 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:21.199817 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" Oct 31 01:02:21.499056 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:21.499021 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x"] Oct 31 01:02:21.503098 ip-10-0-131-90 kubenswrapper[4557]: W1031 01:02:21.503068 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9be77934_fefa_4407_9369_3bf4536a27e1.slice/crio-72de1f00c932c3453a0aa0eff99d96dcfd055137ca2fbd9790c65fb0b79f1ea0 WatchSource:0}: Error finding container 72de1f00c932c3453a0aa0eff99d96dcfd055137ca2fbd9790c65fb0b79f1ea0: Status 404 returned error can't find the container with id 72de1f00c932c3453a0aa0eff99d96dcfd055137ca2fbd9790c65fb0b79f1ea0 Oct 31 01:02:21.959633 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:21.959544 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" event={"ID":"9be77934-fefa-4407-9369-3bf4536a27e1","Type":"ContainerStarted","Data":"5a0bc7a991f23b23de96c1df1615e2a204ff05a4a781d6d8813617900677a64d"} Oct 31 01:02:21.959633 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:21.959608 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" event={"ID":"9be77934-fefa-4407-9369-3bf4536a27e1","Type":"ContainerStarted","Data":"b51b55865a469627b90d7169f6c1a8c7d0f0cff495ca8a652da4c02d53ea2848"} Oct 31 01:02:21.959633 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:21.959630 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" event={"ID":"9be77934-fefa-4407-9369-3bf4536a27e1","Type":"ContainerStarted","Data":"72de1f00c932c3453a0aa0eff99d96dcfd055137ca2fbd9790c65fb0b79f1ea0"} Oct 31 01:02:21.959902 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:21.959661 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" Oct 31 01:02:21.961504 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:02:21.961477 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:02:22.000569 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:22.000527 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" podStartSLOduration=2.000514859 podStartE2EDuration="2.000514859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:02:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:02:21.998995308 +0000 UTC m=+1956.281525663" watchObservedRunningTime="2026-10-31 01:02:22.000514859 +0000 UTC m=+1956.283045225" Oct 31 01:02:22.963663 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:22.963633 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" Oct 31 01:02:22.965265 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:22.965243 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" podUID="9be77934-fefa-4407-9369-3bf4536a27e1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused" Oct 31 01:02:23.967673 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:23.967635 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" podUID="9be77934-fefa-4407-9369-3bf4536a27e1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused" Oct 31 01:02:24.878114 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:24.878071 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" podUID="dc2d4cc5-7bd9-4a70-9434-a3c46be68788" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused" Oct 31 01:02:28.972207 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:28.972179 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" Oct 31 01:02:28.972733 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:28.972655 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" podUID="9be77934-fefa-4407-9369-3bf4536a27e1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused" Oct 31 01:02:34.878292 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:34.878255 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" podUID="dc2d4cc5-7bd9-4a70-9434-a3c46be68788" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused" Oct 31 01:02:37.189024 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:37.188992 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:02:38.972913 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:38.972872 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" podUID="9be77934-fefa-4407-9369-3bf4536a27e1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused" Oct 31 01:02:44.878937 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:44.878896 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" podUID="dc2d4cc5-7bd9-4a70-9434-a3c46be68788" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused" Oct 31 01:02:48.973293 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:48.973257 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" podUID="9be77934-fefa-4407-9369-3bf4536a27e1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused" Oct 31 01:02:51.960701 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:02:51.960660 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:02:53.695344 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:53.695303 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:02:54.879209 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:54.879183 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" Oct 31 01:02:58.972623 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:02:58.972581 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" podUID="9be77934-fefa-4407-9369-3bf4536a27e1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused" Oct 31 01:03:06.912920 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:03:06.912890 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:03:07.307312 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:03:07.307271 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:03:08.972937 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:03:08.972904 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" podUID="9be77934-fefa-4407-9369-3bf4536a27e1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused" Oct 31 01:03:18.973576 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:03:18.973545 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" Oct 31 01:03:21.961525 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:03:21.961489 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:03:30.431079 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:03:30.431000 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:03:30.576675 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:03:30.576636 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:03:37.319607 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:03:37.319569 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:03:51.961245 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:03:51.961189 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:04:21.961173 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:04:21.961132 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:04:37.456319 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:04:37.456283 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:04:51.961501 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:04:51.961461 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:05:21.961959 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:05:21.961881 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:05:37.592005 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:05:37.591967 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:05:51.961921 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:05:51.961876 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:06:21.961800 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:06:21.961760 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:06:37.707454 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:06:37.707314 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:06:51.960943 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:06:51.960906 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:07:03.818881 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:07:03.818836 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:07:03.946024 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:07:03.945973 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:07:21.961365 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:07:21.961321 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:07:34.826483 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:07:34.826448 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:07:37.836215 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:07:37.836183 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:07:51.961813 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:07:51.961772 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:08:21.961265 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:08:21.961179 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:08:37.960691 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:08:37.960658 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:08:51.961275 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:08:51.961241 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:09:21.960879 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:09:21.960841 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:09:38.087477 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:09:38.087440 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:09:51.961676 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:09:51.961636 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:10:10.215363 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:10:10.215328 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:10:21.961732 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:10:21.961695 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:10:38.234917 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:10:38.234883 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:10:51.961315 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:10:51.961278 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:11:21.961364 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:11:21.961285 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:11:38.347701 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:38.347669 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:11:45.997777 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:45.997742 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:11:46.068060 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:46.068028 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x"] Oct 31 01:11:46.068278 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:46.068232 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" podUID="9be77934-fefa-4407-9369-3bf4536a27e1" containerName="kserve-container" containerID="cri-o://b51b55865a469627b90d7169f6c1a8c7d0f0cff495ca8a652da4c02d53ea2848" gracePeriod=30 Oct 31 01:11:46.068278 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:46.068267 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" podUID="9be77934-fefa-4407-9369-3bf4536a27e1" containerName="kube-rbac-proxy" containerID="cri-o://5a0bc7a991f23b23de96c1df1615e2a204ff05a4a781d6d8813617900677a64d" gracePeriod=30 Oct 31 01:11:46.812827 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:46.812794 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:11:47.139957 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:47.139877 4557 generic.go:356] "Generic (PLEG): container finished" podID="9be77934-fefa-4407-9369-3bf4536a27e1" containerID="5a0bc7a991f23b23de96c1df1615e2a204ff05a4a781d6d8813617900677a64d" exitCode=0 Oct 31 01:11:47.139957 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:47.139921 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" event={"ID":"9be77934-fefa-4407-9369-3bf4536a27e1","Type":"ContainerDied","Data":"5a0bc7a991f23b23de96c1df1615e2a204ff05a4a781d6d8813617900677a64d"} Oct 31 01:11:48.968270 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:48.968230 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" podUID="9be77934-fefa-4407-9369-3bf4536a27e1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.36:8643/healthz\": dial tcp 10.133.0.36:8643: connect: connection refused" Oct 31 01:11:48.973589 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:48.973560 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" podUID="9be77934-fefa-4407-9369-3bf4536a27e1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused" Oct 31 01:11:49.150481 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:49.150453 4557 generic.go:356] "Generic (PLEG): container finished" podID="9be77934-fefa-4407-9369-3bf4536a27e1" containerID="b51b55865a469627b90d7169f6c1a8c7d0f0cff495ca8a652da4c02d53ea2848" exitCode=0 Oct 31 01:11:49.150612 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:49.150531 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" event={"ID":"9be77934-fefa-4407-9369-3bf4536a27e1","Type":"ContainerDied","Data":"b51b55865a469627b90d7169f6c1a8c7d0f0cff495ca8a652da4c02d53ea2848"} Oct 31 01:11:49.216184 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:49.216164 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" Oct 31 01:11:49.253960 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:49.253939 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9be77934-fefa-4407-9369-3bf4536a27e1-kube-api-access-rh7mt\" (UniqueName: \"kubernetes.io/projected/9be77934-fefa-4407-9369-3bf4536a27e1-kube-api-access-rh7mt\") pod \"9be77934-fefa-4407-9369-3bf4536a27e1\" (UID: \"9be77934-fefa-4407-9369-3bf4536a27e1\") " Oct 31 01:11:49.254090 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:49.253974 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9be77934-fefa-4407-9369-3bf4536a27e1-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9be77934-fefa-4407-9369-3bf4536a27e1-kube-rbac-proxy-sar-config\") pod \"9be77934-fefa-4407-9369-3bf4536a27e1\" (UID: \"9be77934-fefa-4407-9369-3bf4536a27e1\") " Oct 31 01:11:49.254090 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:49.254057 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9be77934-fefa-4407-9369-3bf4536a27e1-proxy-tls\" (UniqueName: \"kubernetes.io/secret/9be77934-fefa-4407-9369-3bf4536a27e1-proxy-tls\") pod \"9be77934-fefa-4407-9369-3bf4536a27e1\" (UID: \"9be77934-fefa-4407-9369-3bf4536a27e1\") " Oct 31 01:11:49.254396 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:49.254370 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9be77934-fefa-4407-9369-3bf4536a27e1-kube-rbac-proxy-sar-config" pod "9be77934-fefa-4407-9369-3bf4536a27e1" (UID: "9be77934-fefa-4407-9369-3bf4536a27e1"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:11:49.256336 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:49.256308 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9be77934-fefa-4407-9369-3bf4536a27e1-kube-api-access-rh7mt" pod "9be77934-fefa-4407-9369-3bf4536a27e1" (UID: "9be77934-fefa-4407-9369-3bf4536a27e1"). InnerVolumeSpecName "kube-api-access-rh7mt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:11:49.256485 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:49.256465 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9be77934-fefa-4407-9369-3bf4536a27e1-proxy-tls" pod "9be77934-fefa-4407-9369-3bf4536a27e1" (UID: "9be77934-fefa-4407-9369-3bf4536a27e1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:11:49.354895 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:49.354867 4557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9be77934-fefa-4407-9369-3bf4536a27e1-proxy-tls\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:11:49.354895 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:49.354889 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rh7mt\" (UniqueName: \"kubernetes.io/projected/9be77934-fefa-4407-9369-3bf4536a27e1-kube-api-access-rh7mt\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:11:49.354895 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:49.354899 4557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9be77934-fefa-4407-9369-3bf4536a27e1-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:11:50.156440 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:50.156343 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" event={"ID":"9be77934-fefa-4407-9369-3bf4536a27e1","Type":"ContainerDied","Data":"72de1f00c932c3453a0aa0eff99d96dcfd055137ca2fbd9790c65fb0b79f1ea0"} Oct 31 01:11:50.156440 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:50.156371 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x" Oct 31 01:11:50.156440 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:50.156430 4557 scope.go:122] "RemoveContainer" containerID="5a0bc7a991f23b23de96c1df1615e2a204ff05a4a781d6d8813617900677a64d" Oct 31 01:11:50.164460 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:50.164440 4557 scope.go:122] "RemoveContainer" containerID="b51b55865a469627b90d7169f6c1a8c7d0f0cff495ca8a652da4c02d53ea2848" Oct 31 01:11:50.204013 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:50.203977 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x"] Oct 31 01:11:50.214605 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:50.214579 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-e1f85522d1/success-200-isvc-3fc47-predictor-69686b55fd-2kw8x"] Oct 31 01:11:50.808029 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:50.808000 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:11:51.823700 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:51.822782 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9be77934-fefa-4407-9369-3bf4536a27e1" path="/var/lib/kubelet/pods/9be77934-fefa-4407-9369-3bf4536a27e1/volumes" Oct 31 01:11:51.960821 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:11:51.960782 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:11:55.179713 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:55.179681 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:11:55.801643 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:55.801613 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm"] Oct 31 01:11:55.801854 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:55.801810 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" podUID="85f6794a-1cf3-4c04-b6cc-ecbb06d3004d" containerName="switch-graph-71dd3" containerID="cri-o://b77eb6a56c8b77890997fd1eea6e5083fe5039247bf8b8c6d8a3af86be0a7460" gracePeriod=30 Oct 31 01:11:55.812146 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:55.812121 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p"] Oct 31 01:11:55.812349 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:55.812314 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" podUID="33884be7-851f-4d74-b0e1-86ea12315049" containerName="switch-graph-e290e" containerID="cri-o://e3fc36ec345cbf518104276f0e59b5fc1f434c2e026468b0a47b63df21f20764" gracePeriod=30 Oct 31 01:11:55.888175 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:55.888142 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:11:57.085303 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:57.085261 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" podUID="85f6794a-1cf3-4c04-b6cc-ecbb06d3004d" containerName="switch-graph-71dd3" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:11:57.350152 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:11:57.350071 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" podUID="33884be7-851f-4d74-b0e1-86ea12315049" containerName="switch-graph-e290e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:12:02.085973 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:02.085934 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" podUID="85f6794a-1cf3-4c04-b6cc-ecbb06d3004d" containerName="switch-graph-71dd3" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:12:02.349710 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:02.349630 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" podUID="33884be7-851f-4d74-b0e1-86ea12315049" containerName="switch-graph-e290e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:12:07.085155 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:07.085116 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" podUID="85f6794a-1cf3-4c04-b6cc-ecbb06d3004d" containerName="switch-graph-71dd3" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:12:07.085552 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:07.085235 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" Oct 31 01:12:07.350451 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:07.350352 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" podUID="33884be7-851f-4d74-b0e1-86ea12315049" containerName="switch-graph-e290e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:12:07.350594 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:07.350477 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" Oct 31 01:12:12.085043 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:12.085003 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" podUID="85f6794a-1cf3-4c04-b6cc-ecbb06d3004d" containerName="switch-graph-71dd3" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:12:12.350000 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:12.349924 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" podUID="33884be7-851f-4d74-b0e1-86ea12315049" containerName="switch-graph-e290e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:12:17.085586 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:17.085551 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" podUID="85f6794a-1cf3-4c04-b6cc-ecbb06d3004d" containerName="switch-graph-71dd3" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:12:17.349910 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:17.349821 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" podUID="33884be7-851f-4d74-b0e1-86ea12315049" containerName="switch-graph-e290e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:12:21.961196 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:12:21.961158 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:12:22.085232 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:22.085202 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" podUID="85f6794a-1cf3-4c04-b6cc-ecbb06d3004d" containerName="switch-graph-71dd3" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:12:22.349309 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:22.349275 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" podUID="33884be7-851f-4d74-b0e1-86ea12315049" containerName="switch-graph-e290e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:12:25.976319 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:25.976295 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" Oct 31 01:12:25.978869 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:25.978849 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" Oct 31 01:12:26.127390 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.127311 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/33884be7-851f-4d74-b0e1-86ea12315049-proxy-tls\" (UniqueName: \"kubernetes.io/secret/33884be7-851f-4d74-b0e1-86ea12315049-proxy-tls\") pod \"33884be7-851f-4d74-b0e1-86ea12315049\" (UID: \"33884be7-851f-4d74-b0e1-86ea12315049\") " Oct 31 01:12:26.127390 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.127379 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/85f6794a-1cf3-4c04-b6cc-ecbb06d3004d-openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85f6794a-1cf3-4c04-b6cc-ecbb06d3004d-openshift-service-ca-bundle\") pod \"85f6794a-1cf3-4c04-b6cc-ecbb06d3004d\" (UID: \"85f6794a-1cf3-4c04-b6cc-ecbb06d3004d\") " Oct 31 01:12:26.127621 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.127450 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/85f6794a-1cf3-4c04-b6cc-ecbb06d3004d-proxy-tls\" (UniqueName: \"kubernetes.io/secret/85f6794a-1cf3-4c04-b6cc-ecbb06d3004d-proxy-tls\") pod \"85f6794a-1cf3-4c04-b6cc-ecbb06d3004d\" (UID: \"85f6794a-1cf3-4c04-b6cc-ecbb06d3004d\") " Oct 31 01:12:26.127621 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.127471 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/33884be7-851f-4d74-b0e1-86ea12315049-openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33884be7-851f-4d74-b0e1-86ea12315049-openshift-service-ca-bundle\") pod \"33884be7-851f-4d74-b0e1-86ea12315049\" (UID: \"33884be7-851f-4d74-b0e1-86ea12315049\") " Oct 31 01:12:26.127796 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.127772 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85f6794a-1cf3-4c04-b6cc-ecbb06d3004d-openshift-service-ca-bundle" pod "85f6794a-1cf3-4c04-b6cc-ecbb06d3004d" (UID: "85f6794a-1cf3-4c04-b6cc-ecbb06d3004d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:12:26.127848 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.127818 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33884be7-851f-4d74-b0e1-86ea12315049-openshift-service-ca-bundle" pod "33884be7-851f-4d74-b0e1-86ea12315049" (UID: "33884be7-851f-4d74-b0e1-86ea12315049"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:12:26.129341 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.129321 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33884be7-851f-4d74-b0e1-86ea12315049-proxy-tls" pod "33884be7-851f-4d74-b0e1-86ea12315049" (UID: "33884be7-851f-4d74-b0e1-86ea12315049"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:12:26.129458 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.129371 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85f6794a-1cf3-4c04-b6cc-ecbb06d3004d-proxy-tls" pod "85f6794a-1cf3-4c04-b6cc-ecbb06d3004d" (UID: "85f6794a-1cf3-4c04-b6cc-ecbb06d3004d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:12:26.228517 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.228490 4557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/33884be7-851f-4d74-b0e1-86ea12315049-proxy-tls\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:12:26.228517 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.228513 4557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85f6794a-1cf3-4c04-b6cc-ecbb06d3004d-openshift-service-ca-bundle\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:12:26.228517 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.228521 4557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/85f6794a-1cf3-4c04-b6cc-ecbb06d3004d-proxy-tls\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:12:26.228679 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.228531 4557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33884be7-851f-4d74-b0e1-86ea12315049-openshift-service-ca-bundle\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:12:26.290122 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.290096 4557 generic.go:356] "Generic (PLEG): container finished" podID="33884be7-851f-4d74-b0e1-86ea12315049" containerID="e3fc36ec345cbf518104276f0e59b5fc1f434c2e026468b0a47b63df21f20764" exitCode=137 Oct 31 01:12:26.290223 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.290138 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" Oct 31 01:12:26.290223 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.290188 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" event={"ID":"33884be7-851f-4d74-b0e1-86ea12315049","Type":"ContainerDied","Data":"e3fc36ec345cbf518104276f0e59b5fc1f434c2e026468b0a47b63df21f20764"} Oct 31 01:12:26.290314 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.290247 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p" event={"ID":"33884be7-851f-4d74-b0e1-86ea12315049","Type":"ContainerDied","Data":"2d080c455d57305b3afbb0a5f686e7026bbd23f2c29e34e7da731fa2b59c36b2"} Oct 31 01:12:26.290314 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.290275 4557 scope.go:122] "RemoveContainer" containerID="e3fc36ec345cbf518104276f0e59b5fc1f434c2e026468b0a47b63df21f20764" Oct 31 01:12:26.291393 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.291373 4557 generic.go:356] "Generic (PLEG): container finished" podID="85f6794a-1cf3-4c04-b6cc-ecbb06d3004d" containerID="b77eb6a56c8b77890997fd1eea6e5083fe5039247bf8b8c6d8a3af86be0a7460" exitCode=137 Oct 31 01:12:26.291500 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.291432 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" Oct 31 01:12:26.291500 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.291446 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" event={"ID":"85f6794a-1cf3-4c04-b6cc-ecbb06d3004d","Type":"ContainerDied","Data":"b77eb6a56c8b77890997fd1eea6e5083fe5039247bf8b8c6d8a3af86be0a7460"} Oct 31 01:12:26.291500 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.291487 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm" event={"ID":"85f6794a-1cf3-4c04-b6cc-ecbb06d3004d","Type":"ContainerDied","Data":"cb79b03efa3fc1de9e4f0c9e66d8e628b7befe8b0d9cf54a878bbeef2ac192aa"} Oct 31 01:12:26.299081 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.299061 4557 scope.go:122] "RemoveContainer" containerID="e3fc36ec345cbf518104276f0e59b5fc1f434c2e026468b0a47b63df21f20764" Oct 31 01:12:26.299363 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:12:26.299340 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3fc36ec345cbf518104276f0e59b5fc1f434c2e026468b0a47b63df21f20764\": container with ID starting with e3fc36ec345cbf518104276f0e59b5fc1f434c2e026468b0a47b63df21f20764 not found: ID does not exist" containerID="e3fc36ec345cbf518104276f0e59b5fc1f434c2e026468b0a47b63df21f20764" Oct 31 01:12:26.299452 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.299375 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3fc36ec345cbf518104276f0e59b5fc1f434c2e026468b0a47b63df21f20764"} err="failed to get container status \"e3fc36ec345cbf518104276f0e59b5fc1f434c2e026468b0a47b63df21f20764\": rpc error: code = NotFound desc = could not find container \"e3fc36ec345cbf518104276f0e59b5fc1f434c2e026468b0a47b63df21f20764\": container with ID starting with e3fc36ec345cbf518104276f0e59b5fc1f434c2e026468b0a47b63df21f20764 not found: ID does not exist" Oct 31 01:12:26.299452 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.299423 4557 scope.go:122] "RemoveContainer" containerID="b77eb6a56c8b77890997fd1eea6e5083fe5039247bf8b8c6d8a3af86be0a7460" Oct 31 01:12:26.306996 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.306974 4557 scope.go:122] "RemoveContainer" containerID="b77eb6a56c8b77890997fd1eea6e5083fe5039247bf8b8c6d8a3af86be0a7460" Oct 31 01:12:26.307240 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:12:26.307223 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b77eb6a56c8b77890997fd1eea6e5083fe5039247bf8b8c6d8a3af86be0a7460\": container with ID starting with b77eb6a56c8b77890997fd1eea6e5083fe5039247bf8b8c6d8a3af86be0a7460 not found: ID does not exist" containerID="b77eb6a56c8b77890997fd1eea6e5083fe5039247bf8b8c6d8a3af86be0a7460" Oct 31 01:12:26.307302 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.307246 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b77eb6a56c8b77890997fd1eea6e5083fe5039247bf8b8c6d8a3af86be0a7460"} err="failed to get container status \"b77eb6a56c8b77890997fd1eea6e5083fe5039247bf8b8c6d8a3af86be0a7460\": rpc error: code = NotFound desc = could not find container \"b77eb6a56c8b77890997fd1eea6e5083fe5039247bf8b8c6d8a3af86be0a7460\": container with ID starting with b77eb6a56c8b77890997fd1eea6e5083fe5039247bf8b8c6d8a3af86be0a7460 not found: ID does not exist" Oct 31 01:12:26.337086 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.337065 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm"] Oct 31 01:12:26.344431 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.344399 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-e1f85522d1/switch-graph-71dd3-7fb97455f5-ln6sm"] Oct 31 01:12:26.375590 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.375573 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p"] Oct 31 01:12:26.379941 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:26.379900 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-e1f85522d1/switch-graph-e290e-5f5cbb5896-kt55p"] Oct 31 01:12:27.821543 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:27.821467 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="33884be7-851f-4d74-b0e1-86ea12315049" path="/var/lib/kubelet/pods/33884be7-851f-4d74-b0e1-86ea12315049/volumes" Oct 31 01:12:27.821925 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:27.821814 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="85f6794a-1cf3-4c04-b6cc-ecbb06d3004d" path="/var/lib/kubelet/pods/85f6794a-1cf3-4c04-b6cc-ecbb06d3004d/volumes" Oct 31 01:12:34.459630 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:34.459594 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:12:34.565027 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:34.564983 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:12:35.341855 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:35.341822 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:12:38.464830 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:38.464799 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:12:40.995760 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:40.995722 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:12:41.101026 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:12:41.100989 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:12:51.961146 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:12:51.961106 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:13:21.962349 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:13:21.962313 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:13:38.595611 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:13:38.595565 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:13:51.961522 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:13:51.961482 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:14:21.962107 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:14:21.962026 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:14:38.719666 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:14:38.719619 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:14:51.961605 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:14:51.961565 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:15:21.961213 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:15:21.961168 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:15:38.851979 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:15:38.851883 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:15:51.960931 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:15:51.960893 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:16:21.961687 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:16:21.961650 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:16:38.966946 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:16:38.966906 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:16:51.961063 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:16:51.961025 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:17:09.303735 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:17:09.303647 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:17:21.961744 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:17:21.961702 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:17:39.079447 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:17:39.079392 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:17:51.961426 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:17:51.961376 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:18:21.961555 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:18:21.961518 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:18:39.228749 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:18:39.228662 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:18:51.960791 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:18:51.960752 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:19:21.961884 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:19:21.961848 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:19:27.652958 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:27.652926 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:19:27.718050 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:27.718010 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq"] Oct 31 01:19:27.718444 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:27.718397 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" podUID="dc2d4cc5-7bd9-4a70-9434-a3c46be68788" containerName="kserve-container" containerID="cri-o://042331c8ab8c36b334cbd45fd40a35a350b40575f901322b0cce434f278f602c" gracePeriod=30 Oct 31 01:19:27.721526 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:27.718677 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" podUID="dc2d4cc5-7bd9-4a70-9434-a3c46be68788" containerName="kube-rbac-proxy" containerID="cri-o://3c73f9f84b710a4372c9b453ac02c1c4734a2fd12623e2b33b5463c92c585fdf" gracePeriod=30 Oct 31 01:19:27.760797 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:27.760767 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:19:28.760670 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:28.760634 4557 generic.go:356] "Generic (PLEG): container finished" podID="dc2d4cc5-7bd9-4a70-9434-a3c46be68788" containerID="3c73f9f84b710a4372c9b453ac02c1c4734a2fd12623e2b33b5463c92c585fdf" exitCode=0 Oct 31 01:19:28.761102 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:28.760710 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" event={"ID":"dc2d4cc5-7bd9-4a70-9434-a3c46be68788","Type":"ContainerDied","Data":"3c73f9f84b710a4372c9b453ac02c1c4734a2fd12623e2b33b5463c92c585fdf"} Oct 31 01:19:29.873869 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:29.873827 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" podUID="dc2d4cc5-7bd9-4a70-9434-a3c46be68788" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.35:8643/healthz\": dial tcp 10.133.0.35:8643: connect: connection refused" Oct 31 01:19:30.247448 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:30.247419 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:19:31.158613 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.158586 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" Oct 31 01:19:31.238371 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.238332 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-kube-rbac-proxy-sar-config\") pod \"dc2d4cc5-7bd9-4a70-9434-a3c46be68788\" (UID: \"dc2d4cc5-7bd9-4a70-9434-a3c46be68788\") " Oct 31 01:19:31.238589 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.238434 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-kube-api-access-nw99d\" (UniqueName: \"kubernetes.io/projected/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-kube-api-access-nw99d\") pod \"dc2d4cc5-7bd9-4a70-9434-a3c46be68788\" (UID: \"dc2d4cc5-7bd9-4a70-9434-a3c46be68788\") " Oct 31 01:19:31.238589 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.238461 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-proxy-tls\" (UniqueName: \"kubernetes.io/secret/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-proxy-tls\") pod \"dc2d4cc5-7bd9-4a70-9434-a3c46be68788\" (UID: \"dc2d4cc5-7bd9-4a70-9434-a3c46be68788\") " Oct 31 01:19:31.238765 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.238728 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-kube-rbac-proxy-sar-config" pod "dc2d4cc5-7bd9-4a70-9434-a3c46be68788" (UID: "dc2d4cc5-7bd9-4a70-9434-a3c46be68788"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:19:31.240519 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.240495 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-kube-api-access-nw99d" pod "dc2d4cc5-7bd9-4a70-9434-a3c46be68788" (UID: "dc2d4cc5-7bd9-4a70-9434-a3c46be68788"). InnerVolumeSpecName "kube-api-access-nw99d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:19:31.240636 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.240613 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-proxy-tls" pod "dc2d4cc5-7bd9-4a70-9434-a3c46be68788" (UID: "dc2d4cc5-7bd9-4a70-9434-a3c46be68788"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:19:31.339067 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.339030 4557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:19:31.339067 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.339061 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nw99d\" (UniqueName: \"kubernetes.io/projected/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-kube-api-access-nw99d\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:19:31.339067 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.339073 4557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dc2d4cc5-7bd9-4a70-9434-a3c46be68788-proxy-tls\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:19:31.772958 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.772918 4557 generic.go:356] "Generic (PLEG): container finished" podID="dc2d4cc5-7bd9-4a70-9434-a3c46be68788" containerID="042331c8ab8c36b334cbd45fd40a35a350b40575f901322b0cce434f278f602c" exitCode=0 Oct 31 01:19:31.773164 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.772982 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" Oct 31 01:19:31.773164 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.772994 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" event={"ID":"dc2d4cc5-7bd9-4a70-9434-a3c46be68788","Type":"ContainerDied","Data":"042331c8ab8c36b334cbd45fd40a35a350b40575f901322b0cce434f278f602c"} Oct 31 01:19:31.773164 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.773048 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq" event={"ID":"dc2d4cc5-7bd9-4a70-9434-a3c46be68788","Type":"ContainerDied","Data":"e144270691ef19c8f78e235962dae3cc2a31748f4db7e20116e8a1516d5f70f9"} Oct 31 01:19:31.773164 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.773074 4557 scope.go:122] "RemoveContainer" containerID="3c73f9f84b710a4372c9b453ac02c1c4734a2fd12623e2b33b5463c92c585fdf" Oct 31 01:19:31.781263 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.781243 4557 scope.go:122] "RemoveContainer" containerID="042331c8ab8c36b334cbd45fd40a35a350b40575f901322b0cce434f278f602c" Oct 31 01:19:31.788598 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.788576 4557 scope.go:122] "RemoveContainer" containerID="3c73f9f84b710a4372c9b453ac02c1c4734a2fd12623e2b33b5463c92c585fdf" Oct 31 01:19:31.788908 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:19:31.788889 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c73f9f84b710a4372c9b453ac02c1c4734a2fd12623e2b33b5463c92c585fdf\": container with ID starting with 3c73f9f84b710a4372c9b453ac02c1c4734a2fd12623e2b33b5463c92c585fdf not found: ID does not exist" containerID="3c73f9f84b710a4372c9b453ac02c1c4734a2fd12623e2b33b5463c92c585fdf" Oct 31 01:19:31.788984 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.788922 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c73f9f84b710a4372c9b453ac02c1c4734a2fd12623e2b33b5463c92c585fdf"} err="failed to get container status \"3c73f9f84b710a4372c9b453ac02c1c4734a2fd12623e2b33b5463c92c585fdf\": rpc error: code = NotFound desc = could not find container \"3c73f9f84b710a4372c9b453ac02c1c4734a2fd12623e2b33b5463c92c585fdf\": container with ID starting with 3c73f9f84b710a4372c9b453ac02c1c4734a2fd12623e2b33b5463c92c585fdf not found: ID does not exist" Oct 31 01:19:31.788984 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.788945 4557 scope.go:122] "RemoveContainer" containerID="042331c8ab8c36b334cbd45fd40a35a350b40575f901322b0cce434f278f602c" Oct 31 01:19:31.789185 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:19:31.789165 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"042331c8ab8c36b334cbd45fd40a35a350b40575f901322b0cce434f278f602c\": container with ID starting with 042331c8ab8c36b334cbd45fd40a35a350b40575f901322b0cce434f278f602c not found: ID does not exist" containerID="042331c8ab8c36b334cbd45fd40a35a350b40575f901322b0cce434f278f602c" Oct 31 01:19:31.789231 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.789193 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"042331c8ab8c36b334cbd45fd40a35a350b40575f901322b0cce434f278f602c"} err="failed to get container status \"042331c8ab8c36b334cbd45fd40a35a350b40575f901322b0cce434f278f602c\": rpc error: code = NotFound desc = could not find container \"042331c8ab8c36b334cbd45fd40a35a350b40575f901322b0cce434f278f602c\": container with ID starting with 042331c8ab8c36b334cbd45fd40a35a350b40575f901322b0cce434f278f602c not found: ID does not exist" Oct 31 01:19:31.822074 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.822043 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq"] Oct 31 01:19:31.831440 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:31.831393 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-b09a5b3eb3/success-200-isvc-2ff2d-predictor-d74b87588-6vcvq"] Oct 31 01:19:32.476463 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:32.476426 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:19:33.820780 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:33.820745 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dc2d4cc5-7bd9-4a70-9434-a3c46be68788" path="/var/lib/kubelet/pods/dc2d4cc5-7bd9-4a70-9434-a3c46be68788/volumes" Oct 31 01:19:34.654315 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:34.654280 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:19:34.772344 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:34.772307 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:19:37.423770 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:37.423730 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg"] Oct 31 01:19:37.424279 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:37.424029 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" podUID="bfc31755-e103-4a63-a72e-97afdd5d7781" containerName="model-chainer" containerID="cri-o://b80c7efb5ed14e321e6d890be573e8458364b2b16cccb326835ba85228a252d9" gracePeriod=30 Oct 31 01:19:37.448541 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:37.448500 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx"] Oct 31 01:19:37.448732 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:37.448711 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" podUID="2fdb9688-33bc-4879-8b12-0e6d1fe721ad" containerName="sequence-graph-8d238" containerID="cri-o://61d962f3e6acf0d277c58f682d3216a450579e74f989150296cb9c484364d34e" gracePeriod=30 Oct 31 01:19:37.537460 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:37.537425 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:19:39.353687 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:39.353655 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:19:39.544789 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:39.544751 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" podUID="2fdb9688-33bc-4879-8b12-0e6d1fe721ad" containerName="sequence-graph-8d238" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:19:40.254284 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:40.254249 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" podUID="bfc31755-e103-4a63-a72e-97afdd5d7781" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:19:44.544283 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:44.544237 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" podUID="2fdb9688-33bc-4879-8b12-0e6d1fe721ad" containerName="sequence-graph-8d238" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:19:45.254280 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:45.254243 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" podUID="bfc31755-e103-4a63-a72e-97afdd5d7781" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:19:49.544849 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:49.544806 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" podUID="2fdb9688-33bc-4879-8b12-0e6d1fe721ad" containerName="sequence-graph-8d238" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:19:49.545346 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:49.544945 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" Oct 31 01:19:50.253806 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:50.253763 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" podUID="bfc31755-e103-4a63-a72e-97afdd5d7781" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:19:50.253996 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:50.253896 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" Oct 31 01:19:51.962887 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:19:51.962848 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:19:54.545450 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:54.545391 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" podUID="2fdb9688-33bc-4879-8b12-0e6d1fe721ad" containerName="sequence-graph-8d238" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:19:55.254077 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:55.254030 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" podUID="bfc31755-e103-4a63-a72e-97afdd5d7781" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:19:55.613127 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:55.613018 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-b09a5b3eb3_model-chainer-6d44dd6cf4-l9bbg_bfc31755-e103-4a63-a72e-97afdd5d7781/model-chainer/0.log" Oct 31 01:19:55.981683 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:55.981657 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-b09a5b3eb3_sequence-graph-8d238-85489855c5-xqgfx_2fdb9688-33bc-4879-8b12-0e6d1fe721ad/sequence-graph-8d238/0.log" Oct 31 01:19:57.370690 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:57.370658 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-b09a5b3eb3_model-chainer-6d44dd6cf4-l9bbg_bfc31755-e103-4a63-a72e-97afdd5d7781/model-chainer/0.log" Oct 31 01:19:57.572599 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:57.572570 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-b09a5b3eb3_sequence-graph-8d238-85489855c5-xqgfx_2fdb9688-33bc-4879-8b12-0e6d1fe721ad/sequence-graph-8d238/0.log" Oct 31 01:19:58.883594 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:58.883565 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-b09a5b3eb3_model-chainer-6d44dd6cf4-l9bbg_bfc31755-e103-4a63-a72e-97afdd5d7781/model-chainer/0.log" Oct 31 01:19:59.085727 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:59.085694 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-b09a5b3eb3_sequence-graph-8d238-85489855c5-xqgfx_2fdb9688-33bc-4879-8b12-0e6d1fe721ad/sequence-graph-8d238/0.log" Oct 31 01:19:59.545174 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:19:59.545132 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" podUID="2fdb9688-33bc-4879-8b12-0e6d1fe721ad" containerName="sequence-graph-8d238" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:20:00.253529 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:00.253484 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" podUID="bfc31755-e103-4a63-a72e-97afdd5d7781" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:20:00.427317 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:00.427286 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-b09a5b3eb3_model-chainer-6d44dd6cf4-l9bbg_bfc31755-e103-4a63-a72e-97afdd5d7781/model-chainer/0.log" Oct 31 01:20:00.634632 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:00.634548 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-b09a5b3eb3_sequence-graph-8d238-85489855c5-xqgfx_2fdb9688-33bc-4879-8b12-0e6d1fe721ad/sequence-graph-8d238/0.log" Oct 31 01:20:01.998158 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:01.998131 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-b09a5b3eb3_model-chainer-6d44dd6cf4-l9bbg_bfc31755-e103-4a63-a72e-97afdd5d7781/model-chainer/0.log" Oct 31 01:20:02.203131 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:02.203098 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-b09a5b3eb3_sequence-graph-8d238-85489855c5-xqgfx_2fdb9688-33bc-4879-8b12-0e6d1fe721ad/sequence-graph-8d238/0.log" Oct 31 01:20:03.567211 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:03.567184 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-b09a5b3eb3_model-chainer-6d44dd6cf4-l9bbg_bfc31755-e103-4a63-a72e-97afdd5d7781/model-chainer/0.log" Oct 31 01:20:03.775194 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:03.775160 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-b09a5b3eb3_sequence-graph-8d238-85489855c5-xqgfx_2fdb9688-33bc-4879-8b12-0e6d1fe721ad/sequence-graph-8d238/0.log" Oct 31 01:20:04.544869 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:04.544835 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" podUID="2fdb9688-33bc-4879-8b12-0e6d1fe721ad" containerName="sequence-graph-8d238" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:20:05.087383 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:05.087340 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-b09a5b3eb3_model-chainer-6d44dd6cf4-l9bbg_bfc31755-e103-4a63-a72e-97afdd5d7781/model-chainer/0.log" Oct 31 01:20:05.254007 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:05.253967 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" podUID="bfc31755-e103-4a63-a72e-97afdd5d7781" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:20:05.281679 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:05.281652 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-b09a5b3eb3_sequence-graph-8d238-85489855c5-xqgfx_2fdb9688-33bc-4879-8b12-0e6d1fe721ad/sequence-graph-8d238/0.log" Oct 31 01:20:06.575823 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:06.575787 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-b09a5b3eb3_model-chainer-6d44dd6cf4-l9bbg_bfc31755-e103-4a63-a72e-97afdd5d7781/model-chainer/0.log" Oct 31 01:20:06.767791 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:06.767760 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-b09a5b3eb3_sequence-graph-8d238-85489855c5-xqgfx_2fdb9688-33bc-4879-8b12-0e6d1fe721ad/sequence-graph-8d238/0.log" Oct 31 01:20:07.619363 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:07.619338 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" Oct 31 01:20:07.720647 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:07.720621 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2fdb9688-33bc-4879-8b12-0e6d1fe721ad-openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fdb9688-33bc-4879-8b12-0e6d1fe721ad-openshift-service-ca-bundle\") pod \"2fdb9688-33bc-4879-8b12-0e6d1fe721ad\" (UID: \"2fdb9688-33bc-4879-8b12-0e6d1fe721ad\") " Oct 31 01:20:07.720835 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:07.720819 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2fdb9688-33bc-4879-8b12-0e6d1fe721ad-proxy-tls\" (UniqueName: \"kubernetes.io/secret/2fdb9688-33bc-4879-8b12-0e6d1fe721ad-proxy-tls\") pod \"2fdb9688-33bc-4879-8b12-0e6d1fe721ad\" (UID: \"2fdb9688-33bc-4879-8b12-0e6d1fe721ad\") " Oct 31 01:20:07.721000 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:07.720974 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fdb9688-33bc-4879-8b12-0e6d1fe721ad-openshift-service-ca-bundle" pod "2fdb9688-33bc-4879-8b12-0e6d1fe721ad" (UID: "2fdb9688-33bc-4879-8b12-0e6d1fe721ad"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:20:07.722825 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:07.722806 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fdb9688-33bc-4879-8b12-0e6d1fe721ad-proxy-tls" pod "2fdb9688-33bc-4879-8b12-0e6d1fe721ad" (UID: "2fdb9688-33bc-4879-8b12-0e6d1fe721ad"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:20:07.821515 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:07.821477 4557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2fdb9688-33bc-4879-8b12-0e6d1fe721ad-proxy-tls\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:20:07.821515 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:07.821503 4557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fdb9688-33bc-4879-8b12-0e6d1fe721ad-openshift-service-ca-bundle\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:20:07.904057 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:07.904017 4557 generic.go:356] "Generic (PLEG): container finished" podID="2fdb9688-33bc-4879-8b12-0e6d1fe721ad" containerID="61d962f3e6acf0d277c58f682d3216a450579e74f989150296cb9c484364d34e" exitCode=0 Oct 31 01:20:07.904203 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:07.904081 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" Oct 31 01:20:07.904203 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:07.904101 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" event={"ID":"2fdb9688-33bc-4879-8b12-0e6d1fe721ad","Type":"ContainerDied","Data":"61d962f3e6acf0d277c58f682d3216a450579e74f989150296cb9c484364d34e"} Oct 31 01:20:07.904203 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:07.904181 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx" event={"ID":"2fdb9688-33bc-4879-8b12-0e6d1fe721ad","Type":"ContainerDied","Data":"89640ec19cf57834a72060aab4728ee404272f4d7577f3cbe79422307fd50e15"} Oct 31 01:20:07.904356 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:07.904205 4557 scope.go:122] "RemoveContainer" containerID="61d962f3e6acf0d277c58f682d3216a450579e74f989150296cb9c484364d34e" Oct 31 01:20:07.905755 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:07.905730 4557 generic.go:356] "Generic (PLEG): container finished" podID="bfc31755-e103-4a63-a72e-97afdd5d7781" containerID="b80c7efb5ed14e321e6d890be573e8458364b2b16cccb326835ba85228a252d9" exitCode=0 Oct 31 01:20:07.905861 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:07.905783 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" event={"ID":"bfc31755-e103-4a63-a72e-97afdd5d7781","Type":"ContainerDied","Data":"b80c7efb5ed14e321e6d890be573e8458364b2b16cccb326835ba85228a252d9"} Oct 31 01:20:07.911912 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:07.911894 4557 scope.go:122] "RemoveContainer" containerID="61d962f3e6acf0d277c58f682d3216a450579e74f989150296cb9c484364d34e" Oct 31 01:20:07.912182 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:20:07.912157 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61d962f3e6acf0d277c58f682d3216a450579e74f989150296cb9c484364d34e\": container with ID starting with 61d962f3e6acf0d277c58f682d3216a450579e74f989150296cb9c484364d34e not found: ID does not exist" containerID="61d962f3e6acf0d277c58f682d3216a450579e74f989150296cb9c484364d34e" Oct 31 01:20:07.912240 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:07.912188 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d962f3e6acf0d277c58f682d3216a450579e74f989150296cb9c484364d34e"} err="failed to get container status \"61d962f3e6acf0d277c58f682d3216a450579e74f989150296cb9c484364d34e\": rpc error: code = NotFound desc = could not find container \"61d962f3e6acf0d277c58f682d3216a450579e74f989150296cb9c484364d34e\": container with ID starting with 61d962f3e6acf0d277c58f682d3216a450579e74f989150296cb9c484364d34e not found: ID does not exist" Oct 31 01:20:07.950964 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:07.950943 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx"] Oct 31 01:20:07.957702 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:07.957681 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-b09a5b3eb3/sequence-graph-8d238-85489855c5-xqgfx"] Oct 31 01:20:08.052106 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:08.052083 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" Oct 31 01:20:08.065706 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:08.065672 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-b09a5b3eb3_model-chainer-6d44dd6cf4-l9bbg_bfc31755-e103-4a63-a72e-97afdd5d7781/model-chainer/0.log" Oct 31 01:20:08.224275 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:08.224243 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bfc31755-e103-4a63-a72e-97afdd5d7781-openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfc31755-e103-4a63-a72e-97afdd5d7781-openshift-service-ca-bundle\") pod \"bfc31755-e103-4a63-a72e-97afdd5d7781\" (UID: \"bfc31755-e103-4a63-a72e-97afdd5d7781\") " Oct 31 01:20:08.224275 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:08.224278 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bfc31755-e103-4a63-a72e-97afdd5d7781-proxy-tls\" (UniqueName: \"kubernetes.io/secret/bfc31755-e103-4a63-a72e-97afdd5d7781-proxy-tls\") pod \"bfc31755-e103-4a63-a72e-97afdd5d7781\" (UID: \"bfc31755-e103-4a63-a72e-97afdd5d7781\") " Oct 31 01:20:08.224679 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:08.224651 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfc31755-e103-4a63-a72e-97afdd5d7781-openshift-service-ca-bundle" pod "bfc31755-e103-4a63-a72e-97afdd5d7781" (UID: "bfc31755-e103-4a63-a72e-97afdd5d7781"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:20:08.226297 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:08.226280 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfc31755-e103-4a63-a72e-97afdd5d7781-proxy-tls" pod "bfc31755-e103-4a63-a72e-97afdd5d7781" (UID: "bfc31755-e103-4a63-a72e-97afdd5d7781"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:20:08.324803 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:08.324731 4557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfc31755-e103-4a63-a72e-97afdd5d7781-openshift-service-ca-bundle\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:20:08.324803 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:08.324756 4557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bfc31755-e103-4a63-a72e-97afdd5d7781-proxy-tls\") on node \"ip-10-0-131-90.ec2.internal\" DevicePath \"\"" Oct 31 01:20:08.911536 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:08.911510 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" Oct 31 01:20:08.911939 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:08.911509 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg" event={"ID":"bfc31755-e103-4a63-a72e-97afdd5d7781","Type":"ContainerDied","Data":"5502a1cc235465e5c40c35c67c747dc4f3b93aa1123fde2c4a9a9b07bc9a645c"} Oct 31 01:20:08.911939 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:08.911636 4557 scope.go:122] "RemoveContainer" containerID="b80c7efb5ed14e321e6d890be573e8458364b2b16cccb326835ba85228a252d9" Oct 31 01:20:08.958279 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:08.958254 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg"] Oct 31 01:20:08.963037 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:08.963015 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-b09a5b3eb3/model-chainer-6d44dd6cf4-l9bbg"] Oct 31 01:20:09.821182 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:09.821147 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2fdb9688-33bc-4879-8b12-0e6d1fe721ad" path="/var/lib/kubelet/pods/2fdb9688-33bc-4879-8b12-0e6d1fe721ad/volumes" Oct 31 01:20:09.821571 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:09.821556 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bfc31755-e103-4a63-a72e-97afdd5d7781" path="/var/lib/kubelet/pods/bfc31755-e103-4a63-a72e-97afdd5d7781/volumes" Oct 31 01:20:15.456330 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:15.456297 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:20:15.570891 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:15.570862 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:20:16.343813 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:16.343778 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:20:21.878159 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:21.878125 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:20:21.960646 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:20:21.960611 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:20:21.982804 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:21.982779 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:20:38.846277 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:38.846244 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:20:39.146741 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:39.146647 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:20:39.258445 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:39.258387 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:20:39.475060 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:39.475026 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:20:43.694331 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:43.694296 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j7fh7_bdd36c3c-acec-474f-b4aa-27ae4490c39b/global-pull-secret-syncer/0.log" Oct 31 01:20:44.210248 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:44.210219 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" Oct 31 01:20:44.713802 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:44.713770 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-90.ec2.internal_a11e2d9565d47e2d9d5101c74a24023b/haproxy/0.log" Oct 31 01:20:44.748828 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:44.748758 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:20:44.857571 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:44.857536 4557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ttgh_d8e4f707-7f3f-4081-9ad9-df7e33efb927/konnectivity-agent/0.log" limit=1024 Oct 31 01:20:51.792596 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:51.792551 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8b7q7_e8671b96-0784-442b-bf11-6c0d2d59268d/node-exporter/0.log" Oct 31 01:20:51.916051 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:51.915997 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8b7q7_e8671b96-0784-442b-bf11-6c0d2d59268d/kube-rbac-proxy/0.log" Oct 31 01:20:51.961153 ip-10-0-131-90 kubenswrapper[4557]: E1031 01:20:51.961125 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qf2jx" containerName="extractor" Oct 31 01:20:52.040173 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.040150 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8b7q7_e8671b96-0784-442b-bf11-6c0d2d59268d/init-textfile/0.log" Oct 31 01:20:52.664060 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664024 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2"] Oct 31 01:20:52.664311 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664299 4557 cpu_manager.go:414] "containerMap: removing container" podUID="9be77934-fefa-4407-9369-3bf4536a27e1" containerName="kserve-container" Oct 31 01:20:52.664363 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664312 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9be77934-fefa-4407-9369-3bf4536a27e1" containerName="kserve-container" Oct 31 01:20:52.664363 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664334 4557 cpu_manager.go:414] "containerMap: removing container" podUID="dc2d4cc5-7bd9-4a70-9434-a3c46be68788" containerName="kserve-container" Oct 31 01:20:52.664363 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664341 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dc2d4cc5-7bd9-4a70-9434-a3c46be68788" containerName="kserve-container" Oct 31 01:20:52.664363 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664358 4557 cpu_manager.go:414] "containerMap: removing container" podUID="33884be7-851f-4d74-b0e1-86ea12315049" containerName="switch-graph-e290e" Oct 31 01:20:52.664508 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664366 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="33884be7-851f-4d74-b0e1-86ea12315049" containerName="switch-graph-e290e" Oct 31 01:20:52.664508 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664375 4557 cpu_manager.go:414] "containerMap: removing container" podUID="2fdb9688-33bc-4879-8b12-0e6d1fe721ad" containerName="sequence-graph-8d238" Oct 31 01:20:52.664508 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664383 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2fdb9688-33bc-4879-8b12-0e6d1fe721ad" containerName="sequence-graph-8d238" Oct 31 01:20:52.664508 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664399 4557 cpu_manager.go:414] "containerMap: removing container" podUID="dc2d4cc5-7bd9-4a70-9434-a3c46be68788" containerName="kube-rbac-proxy" Oct 31 01:20:52.664508 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664420 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dc2d4cc5-7bd9-4a70-9434-a3c46be68788" containerName="kube-rbac-proxy" Oct 31 01:20:52.664508 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664430 4557 cpu_manager.go:414] "containerMap: removing container" podUID="9be77934-fefa-4407-9369-3bf4536a27e1" containerName="kube-rbac-proxy" Oct 31 01:20:52.664508 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664437 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9be77934-fefa-4407-9369-3bf4536a27e1" containerName="kube-rbac-proxy" Oct 31 01:20:52.664508 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664449 4557 cpu_manager.go:414] "containerMap: removing container" podUID="85f6794a-1cf3-4c04-b6cc-ecbb06d3004d" containerName="switch-graph-71dd3" Oct 31 01:20:52.664508 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664455 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="85f6794a-1cf3-4c04-b6cc-ecbb06d3004d" containerName="switch-graph-71dd3" Oct 31 01:20:52.664508 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664463 4557 cpu_manager.go:414] "containerMap: removing container" podUID="bfc31755-e103-4a63-a72e-97afdd5d7781" containerName="model-chainer" Oct 31 01:20:52.664508 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664470 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bfc31755-e103-4a63-a72e-97afdd5d7781" containerName="model-chainer" Oct 31 01:20:52.664811 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664551 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="dc2d4cc5-7bd9-4a70-9434-a3c46be68788" containerName="kserve-container" Oct 31 01:20:52.664811 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664565 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="33884be7-851f-4d74-b0e1-86ea12315049" containerName="switch-graph-e290e" Oct 31 01:20:52.664811 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664573 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="2fdb9688-33bc-4879-8b12-0e6d1fe721ad" containerName="sequence-graph-8d238" Oct 31 01:20:52.664811 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664584 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="dc2d4cc5-7bd9-4a70-9434-a3c46be68788" containerName="kube-rbac-proxy" Oct 31 01:20:52.664811 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664592 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="9be77934-fefa-4407-9369-3bf4536a27e1" containerName="kube-rbac-proxy" Oct 31 01:20:52.664811 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664600 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="85f6794a-1cf3-4c04-b6cc-ecbb06d3004d" containerName="switch-graph-71dd3" Oct 31 01:20:52.664811 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664609 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="bfc31755-e103-4a63-a72e-97afdd5d7781" containerName="model-chainer" Oct 31 01:20:52.664811 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.664619 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="9be77934-fefa-4407-9369-3bf4536a27e1" containerName="kserve-container" Oct 31 01:20:52.667358 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.667341 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" Oct 31 01:20:52.681036 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.681014 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dxkrx\"/\"openshift-service-ca.crt\"" Oct 31 01:20:52.691303 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.691284 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dxkrx\"/\"kube-root-ca.crt\"" Oct 31 01:20:52.691474 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.691457 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dxkrx\"/\"default-dockercfg-5r9ss\"" Oct 31 01:20:52.692960 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.692938 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2"] Oct 31 01:20:52.736586 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.736553 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9814162a-c093-437b-8fd2-40dcc6e834a0-lib-modules\") pod \"perf-node-gather-daemonset-w4tl2\" (UID: \"9814162a-c093-437b-8fd2-40dcc6e834a0\") " pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" Oct 31 01:20:52.736729 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.736593 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9814162a-c093-437b-8fd2-40dcc6e834a0-proc\") pod \"perf-node-gather-daemonset-w4tl2\" (UID: \"9814162a-c093-437b-8fd2-40dcc6e834a0\") " pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" Oct 31 01:20:52.736729 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.736676 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9814162a-c093-437b-8fd2-40dcc6e834a0-sys\") pod \"perf-node-gather-daemonset-w4tl2\" (UID: \"9814162a-c093-437b-8fd2-40dcc6e834a0\") " pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" Oct 31 01:20:52.736729 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.736699 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9814162a-c093-437b-8fd2-40dcc6e834a0-podres\") pod \"perf-node-gather-daemonset-w4tl2\" (UID: \"9814162a-c093-437b-8fd2-40dcc6e834a0\") " pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" Oct 31 01:20:52.736729 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.736716 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6tpk\" (UniqueName: \"kubernetes.io/projected/9814162a-c093-437b-8fd2-40dcc6e834a0-kube-api-access-l6tpk\") pod \"perf-node-gather-daemonset-w4tl2\" (UID: \"9814162a-c093-437b-8fd2-40dcc6e834a0\") " pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" Oct 31 01:20:52.837717 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.837684 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9814162a-c093-437b-8fd2-40dcc6e834a0-lib-modules\") pod \"perf-node-gather-daemonset-w4tl2\" (UID: \"9814162a-c093-437b-8fd2-40dcc6e834a0\") " pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" Oct 31 01:20:52.838154 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.837725 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9814162a-c093-437b-8fd2-40dcc6e834a0-proc\") pod \"perf-node-gather-daemonset-w4tl2\" (UID: \"9814162a-c093-437b-8fd2-40dcc6e834a0\") " pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" Oct 31 01:20:52.838154 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.837758 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9814162a-c093-437b-8fd2-40dcc6e834a0-sys\") pod \"perf-node-gather-daemonset-w4tl2\" (UID: \"9814162a-c093-437b-8fd2-40dcc6e834a0\") " pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" Oct 31 01:20:52.838154 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.837778 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9814162a-c093-437b-8fd2-40dcc6e834a0-podres\") pod \"perf-node-gather-daemonset-w4tl2\" (UID: \"9814162a-c093-437b-8fd2-40dcc6e834a0\") " pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" Oct 31 01:20:52.838154 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.837806 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6tpk\" (UniqueName: \"kubernetes.io/projected/9814162a-c093-437b-8fd2-40dcc6e834a0-kube-api-access-l6tpk\") pod \"perf-node-gather-daemonset-w4tl2\" (UID: \"9814162a-c093-437b-8fd2-40dcc6e834a0\") " pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" Oct 31 01:20:52.838154 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.837818 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9814162a-c093-437b-8fd2-40dcc6e834a0-lib-modules\") pod \"perf-node-gather-daemonset-w4tl2\" (UID: \"9814162a-c093-437b-8fd2-40dcc6e834a0\") " pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" Oct 31 01:20:52.838154 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.837859 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9814162a-c093-437b-8fd2-40dcc6e834a0-sys\") pod \"perf-node-gather-daemonset-w4tl2\" (UID: \"9814162a-c093-437b-8fd2-40dcc6e834a0\") " pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" Oct 31 01:20:52.838154 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.837879 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9814162a-c093-437b-8fd2-40dcc6e834a0-podres\") pod \"perf-node-gather-daemonset-w4tl2\" (UID: \"9814162a-c093-437b-8fd2-40dcc6e834a0\") " pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" Oct 31 01:20:52.838154 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.837886 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9814162a-c093-437b-8fd2-40dcc6e834a0-proc\") pod \"perf-node-gather-daemonset-w4tl2\" (UID: \"9814162a-c093-437b-8fd2-40dcc6e834a0\") " pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" Oct 31 01:20:52.860864 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.860835 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6tpk\" (UniqueName: \"kubernetes.io/projected/9814162a-c093-437b-8fd2-40dcc6e834a0-kube-api-access-l6tpk\") pod \"perf-node-gather-daemonset-w4tl2\" (UID: \"9814162a-c093-437b-8fd2-40dcc6e834a0\") " pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" Oct 31 01:20:52.978911 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:52.978891 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" Oct 31 01:20:53.271227 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:53.271145 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2"] Oct 31 01:20:53.276010 ip-10-0-131-90 kubenswrapper[4557]: W1031 01:20:53.275980 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9814162a_c093_437b_8fd2_40dcc6e834a0.slice/crio-3c73af36c7ec7b140a9033520eb6da6e3510f83839650c38abee1843b65ec9ea WatchSource:0}: Error finding container 3c73af36c7ec7b140a9033520eb6da6e3510f83839650c38abee1843b65ec9ea: Status 404 returned error can't find the container with id 3c73af36c7ec7b140a9033520eb6da6e3510f83839650c38abee1843b65ec9ea Oct 31 01:20:54.056514 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:54.056476 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" event={"ID":"9814162a-c093-437b-8fd2-40dcc6e834a0","Type":"ContainerStarted","Data":"941493e048a9943069f50cff4dd02d3de658e23b1a47bdd9eaafb0a39fcf18bd"} Oct 31 01:20:54.056985 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:54.056560 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" event={"ID":"9814162a-c093-437b-8fd2-40dcc6e834a0","Type":"ContainerStarted","Data":"3c73af36c7ec7b140a9033520eb6da6e3510f83839650c38abee1843b65ec9ea"} Oct 31 01:20:54.056985 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:54.056609 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" Oct 31 01:20:54.094765 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:54.094718 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" podStartSLOduration=2.094706311 podStartE2EDuration="2.094706311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 01:20:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:20:54.093990981 +0000 UTC m=+3068.376521335" watchObservedRunningTime="2026-10-31 01:20:54.094706311 +0000 UTC m=+3068.377236665" Oct 31 01:20:54.297346 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:54.297316 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-2nfgd_ba1e35d4-03b6-4505-9a2b-4eee6e035c23/prometheus-operator/0.log" Oct 31 01:20:54.419765 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:54.419698 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-2nfgd_ba1e35d4-03b6-4505-9a2b-4eee6e035c23/kube-rbac-proxy/0.log" Oct 31 01:20:54.549088 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:54.549059 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-f9fx6_a3e896c7-cd93-4553-9161-44421f92b902/prometheus-operator-admission-webhook/0.log" Oct 31 01:20:59.058237 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:20:59.058210 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85996d4459-2tw6b_2f1cffe3-808c-48cb-9a90-3935986985c9/console/0.log" Oct 31 01:21:00.069712 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:21:00.069684 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dxkrx/perf-node-gather-daemonset-w4tl2" Oct 31 01:21:02.897544 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:21:02.897514 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xbqw2_13a9c69b-60c2-4c1d-a77c-5b56b234729c/dns/0.log" Oct 31 01:21:03.030188 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:21:03.030162 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xbqw2_13a9c69b-60c2-4c1d-a77c-5b56b234729c/kube-rbac-proxy/0.log" Oct 31 01:21:03.428862 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:21:03.428833 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kpvff_33de1dca-4062-4401-9d55-af069d8874f3/dns-node-resolver/0.log" Oct 31 01:21:04.559893 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:21:04.559862 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7fd6dc794f-2h9wb_763474fc-e7d7-4494-ab00-26b851f669b3/registry/0.log" Oct 31 01:21:04.824921 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:21:04.824844 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cqfvp_758d2e0b-39da-418e-9e35-2c817915ebce/node-ca/0.log" Oct 31 01:21:07.904787 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:21:07.904756 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zd5x6_f47d176e-65b0-49d3-a77a-f593c25c65fa/serve-healthcheck-canary/0.log" Oct 31 01:21:09.764976 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:21:09.764948 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qf2jx_7340ba78-0fa3-4677-95b4-9dada26be5a5/kube-rbac-proxy/0.log" Oct 31 01:21:09.888233 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:21:09.888210 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qf2jx_7340ba78-0fa3-4677-95b4-9dada26be5a5/exporter/0.log" Oct 31 01:21:10.022464 ip-10-0-131-90 kubenswrapper[4557]: I1031 01:21:10.022375 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qf2jx_7340ba78-0fa3-4677-95b4-9dada26be5a5/extractor/0.log"