Oct 31 00:26:49.496504 ip-10-0-134-145 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Oct 31 00:26:49.496514 ip-10-0-134-145 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Oct 31 00:26:49.496521 ip-10-0-134-145 systemd[1]: kubelet.service: Failed with result 'resources'. Oct 31 00:26:49.496772 ip-10-0-134-145 systemd[1]: Failed to start Kubernetes Kubelet. Oct 31 00:26:59.733397 ip-10-0-134-145 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Oct 31 00:26:59.733413 ip-10-0-134-145 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f25e8f8bda204e77982ccd407af6bd39 -- Oct 31 00:28:58.673747 ip-10-0-134-145 systemd[1]: Starting Kubernetes Kubelet... Oct 31 00:28:59.132011 ip-10-0-134-145 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 00:28:59.132011 ip-10-0-134-145 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 31 00:28:59.132011 ip-10-0-134-145 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 00:28:59.132011 ip-10-0-134-145 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 00:28:59.137174 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137076 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:28:59.137174 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137168 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:28:59.137174 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137174 2574 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:28:59.137174 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137177 2574 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:28:59.137174 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137181 2574 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:28:59.137491 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137186 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:28:59.137491 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137190 2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:28:59.137491 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137193 2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:28:59.137491 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137197 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:28:59.137491 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137201 2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:28:59.137491 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137204 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:28:59.137491 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137209 2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:28:59.137491 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137213 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:28:59.137491 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137217 2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:28:59.137491 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137220 2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:28:59.137491 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137224 2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:28:59.137491 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137228 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:28:59.137491 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137232 2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:28:59.137491 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137236 2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:28:59.137491 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137240 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:28:59.137491 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137245 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:28:59.137491 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137248 2574 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:28:59.137491 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137252 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:28:59.137491 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137257 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:28:59.138247 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137261 2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:28:59.138247 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137265 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:28:59.138247 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137269 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:28:59.138247 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137272 2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:28:59.138247 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137276 2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:28:59.138247 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137280 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:28:59.138247 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137284 2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:28:59.138247 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137288 2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:28:59.138247 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137312 2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:28:59.138247 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137317 2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:28:59.138247 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137322 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:28:59.138247 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137326 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:28:59.138247 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137330 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:28:59.138247 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137336 2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:28:59.138247 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137340 2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:28:59.138247 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137345 2574 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:28:59.138247 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137350 2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:28:59.138247 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137354 2574 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:28:59.138247 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137358 2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:28:59.138796 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137362 2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:28:59.138796 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137366 2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:28:59.138796 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137370 2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:28:59.138796 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137375 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:28:59.138796 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137379 2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:28:59.138796 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137383 2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:28:59.138796 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137387 2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:28:59.138796 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137391 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:28:59.138796 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137396 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:28:59.138796 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137400 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:28:59.138796 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137404 2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:28:59.138796 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137409 2574 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:28:59.138796 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137413 2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:28:59.138796 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137438 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:28:59.138796 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137443 2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:28:59.138796 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137447 2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:28:59.138796 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137451 2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:28:59.138796 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137455 2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:28:59.138796 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137459 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:28:59.138796 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137464 2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:28:59.139329 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137468 2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:28:59.139329 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137472 2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:28:59.139329 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137476 2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:28:59.139329 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137481 2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:28:59.139329 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137485 2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:28:59.139329 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137489 2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:28:59.139329 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137493 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:28:59.139329 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137497 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:28:59.139329 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137502 2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:28:59.139329 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137508 2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:28:59.139329 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137514 2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:28:59.139329 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137518 2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:28:59.139329 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137523 2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:28:59.139329 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137528 2574 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:28:59.139329 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137532 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:28:59.139329 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137537 2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:28:59.139329 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137541 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:28:59.139329 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137545 2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:28:59.139329 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137550 2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:28:59.140149 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137553 2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:28:59.140149 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137570 2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:28:59.140149 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137575 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:28:59.140149 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137580 2574 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:28:59.140149 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137584 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:28:59.140149 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137588 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:28:59.140149 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137592 2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:28:59.140149 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137596 2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:28:59.140149 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137601 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:28:59.140149 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137605 2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:28:59.140149 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137610 2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:28:59.140149 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137614 2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:28:59.140149 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137618 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:28:59.140149 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137623 2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:28:59.140149 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137627 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:28:59.140149 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137634 2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:28:59.140149 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137641 2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:28:59.140149 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137645 2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:28:59.140149 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137650 2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:28:59.140947 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137655 2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:28:59.140947 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137671 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:28:59.140947 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137677 2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:28:59.140947 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137682 2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:28:59.140947 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.137686 2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:28:59.140947 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139864 2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:28:59.140947 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139876 2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:28:59.140947 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139881 2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:28:59.140947 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139886 2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:28:59.140947 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139890 2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:28:59.140947 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139894 2574 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:28:59.140947 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139899 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:28:59.140947 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139903 2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:28:59.140947 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139907 2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:28:59.140947 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139911 2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:28:59.140947 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139918 2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:28:59.140947 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139922 2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:28:59.140947 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139927 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:28:59.140947 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139931 2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:28:59.140947 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139936 2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:28:59.141821 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139940 2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:28:59.141821 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139945 2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:28:59.141821 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139949 2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:28:59.141821 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139953 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:28:59.141821 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139957 2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:28:59.141821 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139963 2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:28:59.141821 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139967 2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:28:59.141821 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139971 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:28:59.141821 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139976 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:28:59.141821 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139980 2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:28:59.141821 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139984 2574 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:28:59.141821 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139988 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:28:59.141821 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139993 2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:28:59.141821 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.139997 2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:28:59.141821 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140002 2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:28:59.141821 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140006 2574 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:28:59.141821 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140010 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:28:59.141821 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140015 2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:28:59.141821 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140019 2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:28:59.141821 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140023 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:28:59.142721 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140027 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:28:59.142721 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140031 2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:28:59.142721 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140035 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:28:59.142721 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140039 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:28:59.142721 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140044 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:28:59.142721 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140048 2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:28:59.142721 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140052 2574 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:28:59.142721 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140056 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:28:59.142721 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140062 2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:28:59.142721 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140066 2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:28:59.142721 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140070 2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:28:59.142721 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140074 2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:28:59.142721 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140078 2574 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:28:59.142721 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140083 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:28:59.142721 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140087 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:28:59.142721 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140091 2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:28:59.142721 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140095 2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:28:59.142721 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140100 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:28:59.142721 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140104 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:28:59.142721 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140108 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:28:59.143610 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140112 2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:28:59.143610 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140116 2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:28:59.143610 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140121 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:28:59.143610 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140125 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:28:59.143610 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140130 2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:28:59.143610 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140134 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:28:59.143610 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140138 2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:28:59.143610 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140142 2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:28:59.143610 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140147 2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:28:59.143610 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140151 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:28:59.143610 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140154 2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:28:59.143610 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140158 2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:28:59.143610 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140162 2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:28:59.143610 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140166 2574 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:28:59.143610 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140171 2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:28:59.143610 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140175 2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:28:59.143610 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140180 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:28:59.143610 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140184 2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:28:59.143610 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140189 2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:28:59.144366 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140193 2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:28:59.144366 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140197 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:28:59.144366 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140202 2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:28:59.144366 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140206 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:28:59.144366 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140210 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:28:59.144366 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140214 2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:28:59.144366 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140218 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:28:59.144366 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140223 2574 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:28:59.144366 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140227 2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:28:59.144366 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140231 2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:28:59.144366 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140235 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:28:59.144366 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140240 2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:28:59.144366 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140248 2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:28:59.144366 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140254 2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:28:59.144366 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140259 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:28:59.144366 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140265 2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:28:59.144366 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140269 2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:28:59.144366 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140274 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:28:59.144366 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140279 2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:28:59.145029 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140283 2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:28:59.145029 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140288 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:28:59.145029 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140292 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:28:59.145029 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140299 2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:28:59.145029 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140305 2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:28:59.145029 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140310 2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:28:59.145029 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140314 2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:28:59.145029 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140320 2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:28:59.145029 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140324 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:28:59.145029 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140328 2574 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:28:59.145029 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140333 2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:28:59.145029 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140337 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:28:59.145029 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.140341 2574 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:28:59.145029 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141233 2574 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:28:59.145029 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141242 2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:28:59.145029 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141248 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:28:59.145029 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141252 2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:28:59.145029 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141257 2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:28:59.145029 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141261 2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:28:59.145734 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141265 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:28:59.145734 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141270 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:28:59.145734 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141274 2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:28:59.145734 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141278 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:28:59.145734 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141283 2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:28:59.145734 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141287 2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:28:59.145734 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141292 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:28:59.145734 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141296 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:28:59.145734 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141301 2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:28:59.145734 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141305 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:28:59.145734 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141310 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:28:59.145734 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141314 2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:28:59.145734 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141319 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:28:59.145734 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141323 2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:28:59.145734 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141328 2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:28:59.145734 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141331 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:28:59.145734 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141336 2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:28:59.145734 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141340 2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:28:59.145734 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141345 2574 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:28:59.146222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141349 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:28:59.146222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141353 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:28:59.146222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141358 2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:28:59.146222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141362 2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:28:59.146222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141365 2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:28:59.146222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141369 2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:28:59.146222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141374 2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:28:59.146222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141379 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:28:59.146222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141383 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:28:59.146222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141387 2574 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:28:59.146222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141392 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:28:59.146222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141397 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:28:59.146222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141401 2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:28:59.146222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141405 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:28:59.146222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141409 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:28:59.146222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141413 2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:28:59.146222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141436 2574 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:28:59.146222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141441 2574 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:28:59.146222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141445 2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:28:59.146222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141450 2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:28:59.146747 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141454 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:28:59.146747 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141459 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:28:59.146747 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141463 2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:28:59.146747 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141467 2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:28:59.146747 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141472 2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:28:59.146747 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141480 2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:28:59.146747 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141486 2574 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:28:59.146747 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141491 2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:28:59.146747 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141498 2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:28:59.146747 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141505 2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:28:59.146747 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141509 2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:28:59.146747 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141514 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:28:59.146747 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141519 2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:28:59.146747 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141523 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:28:59.146747 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141527 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:28:59.146747 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141531 2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:28:59.146747 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141535 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:28:59.146747 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141540 2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:28:59.146747 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141544 2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:28:59.147260 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141548 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:28:59.147260 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141552 2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:28:59.147260 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141557 2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:28:59.147260 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141561 2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:28:59.147260 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141567 2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:28:59.147260 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141571 2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:28:59.147260 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141575 2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:28:59.147260 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141579 2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:28:59.147260 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141584 2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:28:59.147260 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141588 2574 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:28:59.147260 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141593 2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:28:59.147260 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141597 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:28:59.147260 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141601 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:28:59.147260 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141605 2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:28:59.147260 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141610 2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:28:59.147260 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141614 2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:28:59.147260 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141618 2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:28:59.147260 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141622 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:28:59.147260 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141626 2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:28:59.147781 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141631 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:28:59.147781 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141635 2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:28:59.147781 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141639 2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:28:59.147781 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141643 2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:28:59.147781 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141647 2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:28:59.147781 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141651 2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:28:59.147781 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141656 2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:28:59.147781 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141659 2574 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:28:59.147781 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141663 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:28:59.147781 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141668 2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:28:59.147781 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141672 2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:28:59.147781 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141676 2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:28:59.147781 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141680 2574 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:28:59.147781 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141685 2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:28:59.147781 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141689 2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:28:59.147781 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141693 2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:28:59.147781 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141698 2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:28:59.147781 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141704 2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:28:59.147781 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141709 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:28:59.147781 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141713 2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141717 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141721 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.141725 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141858 2574 flags.go:64] FLAG: --address="0.0.0.0" Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141870 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141879 2574 flags.go:64] FLAG: --anonymous-auth="true" Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141886 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141893 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141898 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141909 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141916 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141921 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141926 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141932 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141937 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141942 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141947 2574 flags.go:64] FLAG: --cgroup-root="" Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141951 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141956 2574 flags.go:64] FLAG: --client-ca-file="" Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141960 2574 flags.go:64] FLAG: --cloud-provider="external" Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141965 2574 flags.go:64] FLAG: --cluster-dns="[]" Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141973 2574 flags.go:64] FLAG: --cluster-domain="" Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141977 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 31 00:28:59.148250 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141982 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141988 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.141993 2574 flags.go:64] FLAG: --container-log-max-files="5" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142008 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142012 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142018 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142023 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142028 2574 flags.go:64] FLAG: --contention-profiling="false" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142034 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142038 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142044 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142048 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142055 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142060 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142065 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142069 2574 flags.go:64] FLAG: --enable-load-reader="false" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142074 2574 flags.go:64] FLAG: --enable-server="true" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142079 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142088 2574 flags.go:64] FLAG: --event-burst="100" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142094 2574 flags.go:64] FLAG: --event-qps="50" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142098 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142103 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142107 2574 flags.go:64] FLAG: --eviction-hard="" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142115 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 31 00:28:59.148824 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142120 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142125 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142129 2574 flags.go:64] FLAG: --eviction-soft="" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142134 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142139 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142143 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142148 2574 flags.go:64] FLAG: --experimental-mounter-path="" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142153 2574 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142157 2574 flags.go:64] FLAG: --fail-swap-on="true" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142162 2574 flags.go:64] FLAG: --feature-gates="" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142169 2574 flags.go:64] FLAG: --file-check-frequency="20s" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142176 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142181 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142186 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142190 2574 flags.go:64] FLAG: --healthz-port="10248" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142196 2574 flags.go:64] FLAG: --help="false" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142201 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142207 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142212 2574 flags.go:64] FLAG: --http-check-frequency="20s" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142216 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142222 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142227 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142231 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 31 00:28:59.149403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142236 2574 flags.go:64] FLAG: --image-service-endpoint="" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142241 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142245 2574 flags.go:64] FLAG: --kube-api-burst="100" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142252 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142257 2574 flags.go:64] FLAG: --kube-api-qps="50" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142262 2574 flags.go:64] FLAG: --kube-reserved="" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142266 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142270 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142275 2574 flags.go:64] FLAG: --kubelet-cgroups="" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142280 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142284 2574 flags.go:64] FLAG: --lock-file="" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142289 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142293 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142298 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142307 2574 flags.go:64] FLAG: --log-json-split-stream="false" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142311 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142316 2574 flags.go:64] FLAG: --log-text-split-stream="false" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142321 2574 flags.go:64] FLAG: --logging-format="text" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142325 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142331 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142338 2574 flags.go:64] FLAG: --manifest-url="" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142342 2574 flags.go:64] FLAG: --manifest-url-header="" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142349 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142354 2574 flags.go:64] FLAG: --max-open-files="1000000" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142360 2574 flags.go:64] FLAG: --max-pods="110" Oct 31 00:28:59.150027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142365 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142369 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142375 2574 flags.go:64] FLAG: --memory-manager-policy="None" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142380 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142385 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142389 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142394 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142406 2574 flags.go:64] FLAG: --node-status-max-images="50" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142411 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142436 2574 flags.go:64] FLAG: --oom-score-adj="-999" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142443 2574 flags.go:64] FLAG: --pod-cidr="" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142448 2574 flags.go:64] FLAG: --pod-manifest-path="" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142452 2574 flags.go:64] FLAG: --pod-max-pids="-1" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142457 2574 flags.go:64] FLAG: --pods-per-core="0" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142462 2574 flags.go:64] FLAG: --port="10250" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142466 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142471 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-04b3e2fdf19e92dbe" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142476 2574 flags.go:64] FLAG: --qos-reserved="" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142480 2574 flags.go:64] FLAG: --read-only-port="10255" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142486 2574 flags.go:64] FLAG: --register-node="true" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142490 2574 flags.go:64] FLAG: --register-with-taints="" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142497 2574 flags.go:64] FLAG: --registry-burst="10" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142501 2574 flags.go:64] FLAG: --registry-qps="5" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142506 2574 flags.go:64] FLAG: --reserved-cpus="" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142510 2574 flags.go:64] FLAG: --reserved-memory="" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142516 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 31 00:28:59.150676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142521 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142527 2574 flags.go:64] FLAG: --rotate-certificates="false" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142532 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142537 2574 flags.go:64] FLAG: --runonce="false" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142541 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142547 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142552 2574 flags.go:64] FLAG: --seccomp-default="false" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142557 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142562 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142569 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142574 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142579 2574 flags.go:64] FLAG: --storage-driver-password="root" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142583 2574 flags.go:64] FLAG: --storage-driver-secure="false" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142588 2574 flags.go:64] FLAG: --storage-driver-table="stats" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142592 2574 flags.go:64] FLAG: --storage-driver-user="root" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142596 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142603 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142608 2574 flags.go:64] FLAG: --system-cgroups="" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142613 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142621 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142626 2574 flags.go:64] FLAG: --tls-cert-file="" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142630 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142642 2574 flags.go:64] FLAG: --tls-min-version="" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142647 2574 flags.go:64] FLAG: --tls-private-key-file="" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142651 2574 flags.go:64] FLAG: --topology-manager-policy="none" Oct 31 00:28:59.151337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142656 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 31 00:28:59.151956 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142661 2574 flags.go:64] FLAG: --topology-manager-scope="container" Oct 31 00:28:59.151956 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142666 2574 flags.go:64] FLAG: --v="2" Oct 31 00:28:59.151956 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142673 2574 flags.go:64] FLAG: --version="false" Oct 31 00:28:59.151956 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142679 2574 flags.go:64] FLAG: --vmodule="" Oct 31 00:28:59.151956 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142685 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 31 00:28:59.151956 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.142691 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 31 00:28:59.151956 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.142943 2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:28:59.151956 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.142954 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:28:59.151956 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.142961 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:28:59.151956 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.142966 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:28:59.151956 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.142972 2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:28:59.151956 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.142977 2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:28:59.151956 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.142982 2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:28:59.151956 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.142986 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:28:59.151956 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.142991 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:28:59.151956 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.142995 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:28:59.151956 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143001 2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:28:59.151956 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143005 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:28:59.151956 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143010 2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:28:59.151956 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143014 2574 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:28:59.152448 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143018 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:28:59.152448 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143022 2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:28:59.152448 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143028 2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:28:59.152448 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143034 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:28:59.152448 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143039 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:28:59.152448 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143043 2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:28:59.152448 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143048 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:28:59.152448 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143052 2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:28:59.152448 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143056 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:28:59.152448 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143060 2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:28:59.152448 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143064 2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:28:59.152448 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143069 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:28:59.152448 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143073 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:28:59.152448 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143077 2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:28:59.152448 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143081 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:28:59.152448 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143086 2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:28:59.152448 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143090 2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:28:59.152448 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143094 2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:28:59.152448 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143098 2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:28:59.152448 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143103 2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:28:59.152929 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143108 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:28:59.152929 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143112 2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:28:59.152929 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143116 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:28:59.152929 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143120 2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:28:59.152929 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143124 2574 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:28:59.152929 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143129 2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:28:59.152929 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143133 2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:28:59.152929 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143137 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:28:59.152929 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143141 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:28:59.152929 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143146 2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:28:59.152929 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143150 2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:28:59.152929 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143154 2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:28:59.152929 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143159 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:28:59.152929 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143163 2574 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:28:59.152929 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143169 2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:28:59.152929 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143174 2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:28:59.152929 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143178 2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:28:59.152929 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143183 2574 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:28:59.152929 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143187 2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:28:59.152929 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143191 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:28:59.153395 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143195 2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:28:59.153395 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143199 2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:28:59.153395 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143203 2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:28:59.153395 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143208 2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:28:59.153395 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143212 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:28:59.153395 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143216 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:28:59.153395 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143220 2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:28:59.153395 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143224 2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:28:59.153395 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143228 2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:28:59.153395 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143232 2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:28:59.153395 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143236 2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:28:59.153395 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143243 2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:28:59.153395 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143247 2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:28:59.153395 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143251 2574 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:28:59.153395 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143256 2574 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:28:59.153395 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143260 2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:28:59.153395 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143264 2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:28:59.153395 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143287 2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:28:59.153395 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143295 2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:28:59.153395 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143300 2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:28:59.153887 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143305 2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:28:59.153887 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143310 2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:28:59.153887 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143315 2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:28:59.153887 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143319 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:28:59.153887 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143323 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:28:59.153887 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143327 2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:28:59.153887 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143333 2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:28:59.153887 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143337 2574 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:28:59.153887 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143342 2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:28:59.153887 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143346 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:28:59.153887 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143351 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:28:59.153887 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143355 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:28:59.153887 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143359 2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:28:59.153887 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143363 2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:28:59.153887 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143368 2574 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:28:59.153887 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143371 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:28:59.153887 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143375 2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:28:59.153887 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143380 2574 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:28:59.153887 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143384 2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:28:59.154324 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143391 2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:28:59.154324 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143397 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:28:59.154324 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143401 2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:28:59.154324 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143405 2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:28:59.154324 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143411 2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:28:59.154324 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143434 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:28:59.154324 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143440 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:28:59.154324 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143444 2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:28:59.154324 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143448 2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:28:59.154324 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143453 2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:28:59.154324 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143457 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:28:59.154324 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143461 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:28:59.154324 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143466 2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:28:59.154324 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.143520 2574 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 00:28:59.154324 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143595 2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:28:59.154696 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143602 2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:28:59.154696 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143608 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:28:59.154696 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143612 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:28:59.154696 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143616 2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:28:59.154696 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143620 2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:28:59.154696 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143625 2574 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:28:59.154696 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143629 2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:28:59.154696 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143633 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:28:59.154696 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143637 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:28:59.154696 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143641 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:28:59.154696 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143646 2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:28:59.154696 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143650 2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:28:59.154696 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143655 2574 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:28:59.154696 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143659 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:28:59.154696 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143663 2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:28:59.154696 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143667 2574 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:28:59.154696 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143671 2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:28:59.154696 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143678 2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:28:59.154696 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143685 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:28:59.155135 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143690 2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:28:59.155135 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143695 2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:28:59.155135 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143702 2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:28:59.155135 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143707 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:28:59.155135 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143712 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:28:59.155135 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143716 2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:28:59.155135 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143720 2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:28:59.155135 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143725 2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:28:59.155135 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143729 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:28:59.155135 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143733 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:28:59.155135 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143737 2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:28:59.155135 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143742 2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:28:59.155135 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143746 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:28:59.155135 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143750 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:28:59.155135 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143755 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:28:59.155135 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143763 2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:28:59.155135 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143769 2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:28:59.155135 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143774 2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:28:59.155135 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143779 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:28:59.156031 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143784 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:28:59.156031 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143788 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:28:59.156031 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143792 2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:28:59.156031 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143796 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:28:59.156031 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143800 2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:28:59.156031 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143804 2574 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:28:59.156031 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143808 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:28:59.156031 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143812 2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:28:59.156031 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143817 2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:28:59.156031 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143821 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:28:59.156031 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143825 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:28:59.156031 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143829 2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:28:59.156031 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143833 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:28:59.156031 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143837 2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:28:59.156031 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143841 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:28:59.156031 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143846 2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:28:59.156031 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143851 2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:28:59.156031 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143855 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:28:59.156031 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143859 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:28:59.156595 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143863 2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:28:59.156595 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143867 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:28:59.156595 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143871 2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:28:59.156595 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143875 2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:28:59.156595 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143879 2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:28:59.156595 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143883 2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:28:59.156595 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143888 2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:28:59.156595 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143891 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:28:59.156595 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143896 2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:28:59.156595 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143900 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:28:59.156595 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143905 2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:28:59.156595 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143910 2574 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:28:59.156595 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143914 2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:28:59.156595 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143918 2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:28:59.156595 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143922 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:28:59.156595 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143926 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:28:59.156595 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143930 2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:28:59.156595 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143934 2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:28:59.156595 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143938 2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:28:59.156595 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143942 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:28:59.157104 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143946 2574 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:28:59.157104 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143951 2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:28:59.157104 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143955 2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:28:59.157104 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143959 2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:28:59.157104 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143964 2574 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:28:59.157104 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143968 2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:28:59.157104 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143972 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:28:59.157104 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143976 2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:28:59.157104 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143982 2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:28:59.157104 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143986 2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:28:59.157104 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143991 2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:28:59.157104 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143995 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:28:59.157104 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.143999 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:28:59.157104 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.144003 2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:28:59.157104 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.144007 2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:28:59.157104 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.144011 2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:28:59.157104 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.144015 2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:28:59.157104 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.144019 2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:28:59.157104 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.144024 2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:28:59.157104 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.144028 2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:28:59.157605 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.144032 2574 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:28:59.157605 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.144036 2574 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:28:59.157605 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.144040 2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:28:59.157605 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.144045 2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:28:59.157605 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.144055 2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:28:59.157605 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.144059 2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:28:59.157605 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.144063 2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:28:59.157605 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.144067 2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:28:59.157605 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.152208 2574 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 31 00:28:59.157605 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.152228 2574 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 31 00:28:59.157605 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.152242 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 31 00:28:59.157605 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.152247 2574 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 31 00:28:59.157605 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152308 2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:28:59.157605 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152314 2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:28:59.157605 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152319 2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:28:59.157605 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152322 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:28:59.157605 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152325 2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:28:59.157605 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152329 2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:28:59.157605 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152331 2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:28:59.158054 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152334 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:28:59.158054 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152336 2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:28:59.158054 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152339 2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:28:59.158054 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152341 2574 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:28:59.158054 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152344 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:28:59.158054 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152346 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:28:59.158054 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152349 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:28:59.158054 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152352 2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:28:59.158054 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152354 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:28:59.158054 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152357 2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:28:59.158054 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152359 2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:28:59.158054 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152362 2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:28:59.158054 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152365 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:28:59.158054 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152367 2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:28:59.158054 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152370 2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:28:59.158054 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152372 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:28:59.158054 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152375 2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:28:59.158054 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152377 2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:28:59.158054 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152380 2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:28:59.158522 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152382 2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:28:59.158522 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152385 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:28:59.158522 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152388 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:28:59.158522 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152397 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:28:59.158522 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152400 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:28:59.158522 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152402 2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:28:59.158522 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152405 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:28:59.158522 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152407 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:28:59.158522 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152409 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:28:59.158522 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152412 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:28:59.158522 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152430 2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:28:59.158522 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152434 2574 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:28:59.158522 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152437 2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:28:59.158522 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152440 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:28:59.158522 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152442 2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:28:59.158522 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152445 2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:28:59.158522 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152447 2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:28:59.158522 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152450 2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:28:59.158522 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152452 2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:28:59.158522 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152455 2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:28:59.158992 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152457 2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:28:59.158992 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152461 2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:28:59.158992 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152463 2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:28:59.158992 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152466 2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:28:59.158992 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152468 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:28:59.158992 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152471 2574 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:28:59.158992 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152473 2574 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:28:59.158992 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152476 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:28:59.158992 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152478 2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:28:59.158992 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152480 2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:28:59.158992 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152483 2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:28:59.158992 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152486 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:28:59.158992 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152488 2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:28:59.158992 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152491 2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:28:59.158992 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152494 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:28:59.158992 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152497 2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:28:59.158992 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152507 2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:28:59.158992 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152510 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:28:59.158992 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152513 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:28:59.158992 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152515 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:28:59.159479 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152517 2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:28:59.159479 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152520 2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:28:59.159479 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152522 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:28:59.159479 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152525 2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:28:59.159479 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152527 2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:28:59.159479 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152529 2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:28:59.159479 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152533 2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:28:59.159479 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152537 2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:28:59.159479 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152540 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:28:59.159479 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152542 2574 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:28:59.159479 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152545 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:28:59.159479 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152547 2574 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:28:59.159479 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152550 2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:28:59.159479 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152552 2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:28:59.159479 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152555 2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:28:59.159479 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152557 2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:28:59.159479 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152559 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:28:59.159479 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152562 2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:28:59.159479 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152565 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:28:59.159919 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152567 2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:28:59.159919 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152570 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:28:59.159919 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152573 2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:28:59.159919 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152575 2574 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:28:59.159919 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152578 2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:28:59.159919 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152580 2574 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:28:59.159919 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152582 2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:28:59.159919 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152585 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:28:59.159919 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152587 2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:28:59.159919 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152590 2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:28:59.159919 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152598 2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:28:59.159919 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152601 2574 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:28:59.159919 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152603 2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:28:59.159919 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152606 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:28:59.159919 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152608 2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:28:59.159919 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152610 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:28:59.159919 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152613 2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:28:59.159919 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152615 2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:28:59.159919 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152618 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:28:59.159919 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152620 2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:28:59.160373 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152622 2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:28:59.160373 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.152651 2574 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 00:28:59.160373 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152839 2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:28:59.160373 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152843 2574 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:28:59.160373 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152846 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:28:59.160373 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152848 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:28:59.160373 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152851 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:28:59.160373 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152853 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:28:59.160373 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152856 2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:28:59.160373 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152858 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:28:59.160373 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152861 2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:28:59.160373 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152863 2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:28:59.160373 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152866 2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:28:59.160373 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152868 2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:28:59.160373 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152871 2574 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:28:59.160373 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152873 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:28:59.160780 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152876 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:28:59.160780 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152878 2574 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:28:59.160780 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152881 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:28:59.160780 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152884 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:28:59.160780 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152886 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:28:59.160780 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152888 2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:28:59.160780 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152891 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:28:59.160780 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152899 2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:28:59.160780 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152902 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:28:59.160780 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152904 2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:28:59.160780 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152907 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:28:59.160780 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152909 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:28:59.160780 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152912 2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:28:59.160780 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152914 2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:28:59.160780 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152917 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:28:59.160780 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152919 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:28:59.160780 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152921 2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:28:59.160780 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152924 2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:28:59.160780 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152926 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:28:59.161224 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152929 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:28:59.161224 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152932 2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:28:59.161224 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152934 2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:28:59.161224 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152937 2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:28:59.161224 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152939 2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:28:59.161224 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152942 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:28:59.161224 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152944 2574 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:28:59.161224 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152946 2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:28:59.161224 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152949 2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:28:59.161224 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152952 2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:28:59.161224 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152954 2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:28:59.161224 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152957 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:28:59.161224 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152959 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:28:59.161224 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152962 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:28:59.161224 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152964 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:28:59.161224 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152967 2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:28:59.161224 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152969 2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:28:59.161224 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152972 2574 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:28:59.161224 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152974 2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:28:59.161224 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152977 2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:28:59.161714 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152979 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:28:59.161714 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152987 2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:28:59.161714 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152990 2574 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:28:59.161714 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152992 2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:28:59.161714 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152995 2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:28:59.161714 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152997 2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:28:59.161714 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.152999 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:28:59.161714 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153003 2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:28:59.161714 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153006 2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:28:59.161714 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153009 2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:28:59.161714 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153011 2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:28:59.161714 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153014 2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:28:59.161714 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153016 2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:28:59.161714 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153018 2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:28:59.161714 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153021 2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:28:59.161714 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153023 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:28:59.161714 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153026 2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:28:59.161714 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153028 2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:28:59.161714 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153030 2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:28:59.162159 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153033 2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:28:59.162159 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153035 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:28:59.162159 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153038 2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:28:59.162159 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153040 2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:28:59.162159 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153050 2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:28:59.162159 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153052 2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:28:59.162159 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153055 2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:28:59.162159 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153057 2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:28:59.162159 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153060 2574 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:28:59.162159 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153062 2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:28:59.162159 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153065 2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:28:59.162159 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153067 2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:28:59.162159 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153069 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:28:59.162159 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153072 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:28:59.162159 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153074 2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:28:59.162159 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153082 2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:28:59.162159 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153085 2574 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:28:59.162159 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153087 2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:28:59.162159 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153090 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:28:59.162681 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153092 2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:28:59.162681 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153095 2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:28:59.162681 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153097 2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:28:59.162681 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153100 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:28:59.162681 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153102 2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:28:59.162681 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153105 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:28:59.162681 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153108 2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:28:59.162681 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153112 2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:28:59.162681 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153115 2574 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:28:59.162681 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153118 2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:28:59.162681 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153121 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:28:59.162681 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153124 2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:28:59.162681 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153126 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:28:59.162681 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153128 2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:28:59.162681 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153131 2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:28:59.162681 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.153155 2574 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 00:28:59.163055 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153193 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:28:59.163055 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153196 2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:28:59.163055 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153199 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:28:59.163055 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153201 2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:28:59.163055 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153204 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:28:59.163055 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153206 2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:28:59.163055 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153209 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:28:59.163055 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153211 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:28:59.163055 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153213 2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:28:59.163055 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153216 2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:28:59.163055 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153218 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:28:59.163055 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153220 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:28:59.163055 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153223 2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:28:59.163055 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153230 2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:28:59.163055 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153233 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:28:59.163055 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153236 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:28:59.163055 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153238 2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:28:59.163055 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153241 2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:28:59.163055 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153243 2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:28:59.163545 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153245 2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:28:59.163545 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153248 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:28:59.163545 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153250 2574 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:28:59.163545 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153253 2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:28:59.163545 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153255 2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:28:59.163545 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153257 2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:28:59.163545 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153260 2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:28:59.163545 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153263 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:28:59.163545 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153265 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:28:59.163545 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153268 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:28:59.163545 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153272 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:28:59.163545 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153275 2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:28:59.163545 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153277 2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:28:59.163545 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153280 2574 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:28:59.163545 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153282 2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:28:59.163545 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153285 2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:28:59.163545 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153287 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:28:59.163545 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153289 2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:28:59.163545 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153292 2574 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:28:59.163545 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153294 2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:28:59.164233 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153297 2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:28:59.164233 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153299 2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:28:59.164233 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153301 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:28:59.164233 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153305 2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:28:59.164233 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153309 2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:28:59.164233 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153312 2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:28:59.164233 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153314 2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:28:59.164233 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153323 2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:28:59.164233 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153325 2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:28:59.164233 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153328 2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:28:59.164233 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153330 2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:28:59.164233 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153332 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:28:59.164233 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153335 2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:28:59.164233 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153337 2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:28:59.164233 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153340 2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:28:59.164233 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153342 2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:28:59.164233 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153345 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:28:59.164233 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153347 2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:28:59.164233 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153349 2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:28:59.164980 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153352 2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:28:59.164980 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153354 2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:28:59.164980 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153356 2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:28:59.164980 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153360 2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:28:59.164980 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153362 2574 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:28:59.164980 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153366 2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:28:59.164980 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153369 2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:28:59.164980 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153371 2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:28:59.164980 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153374 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:28:59.164980 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153376 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:28:59.164980 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153379 2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:28:59.164980 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153381 2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:28:59.164980 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153383 2574 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:28:59.164980 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153386 2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:28:59.164980 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153388 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:28:59.164980 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153391 2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:28:59.164980 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153394 2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:28:59.164980 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153396 2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:28:59.164980 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153399 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:28:59.164980 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153402 2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:28:59.165758 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153404 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:28:59.165758 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153414 2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:28:59.165758 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153434 2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:28:59.165758 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153437 2574 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:28:59.165758 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153440 2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:28:59.165758 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153444 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:28:59.165758 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153446 2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:28:59.165758 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153449 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:28:59.165758 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153451 2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:28:59.165758 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153453 2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:28:59.165758 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153456 2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:28:59.165758 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153458 2574 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:28:59.165758 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153461 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:28:59.165758 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153463 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:28:59.165758 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153466 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:28:59.165758 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153470 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:28:59.165758 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153472 2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:28:59.165758 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153476 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:28:59.165758 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153479 2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:28:59.166240 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153481 2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:28:59.166240 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153483 2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:28:59.166240 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153486 2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:28:59.166240 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153489 2574 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:28:59.166240 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153491 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:28:59.166240 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153494 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:28:59.166240 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153496 2574 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:28:59.166240 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153498 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:28:59.166240 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:28:59.153502 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:28:59.166240 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.153573 2574 server.go:957] "Client rotation is on, will bootstrap in background" Oct 31 00:28:59.166240 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.155341 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 31 00:28:59.166240 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.156450 2574 server.go:1014] "Starting client certificate rotation" Oct 31 00:28:59.166240 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.156560 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 31 00:28:59.166240 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.157335 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 31 00:28:59.166240 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.159621 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 31 00:28:59.166240 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.161606 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 31 00:28:59.174076 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.174057 2574 log.go:25] "Validated CRI v1 runtime API" Oct 31 00:28:59.177901 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.177874 2574 log.go:25] "Validated CRI v1 image API" Oct 31 00:28:59.178812 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.178788 2574 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 31 00:28:59.181403 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.181376 2574 fs.go:135] Filesystem UUIDs: map[2310dd9f-6ca9-4deb-81d5-c6f19f2809d5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b6667d17-927a-48fb-bee2-f2bad2f7ab2b:/dev/nvme0n1p3] Oct 31 00:28:59.181467 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.181404 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 31 00:28:59.187884 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.187765 2574 manager.go:217] Machine: {Timestamp:2026-10-31 00:28:59.186254632 +0000 UTC m=+0.381167320 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3059572 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cb5b74a354a2d1e30975530338a79 SystemUUID:ec2cb5b7-4a35-4a2d-1e30-975530338a79 BootID:f25e8f8b-da20-4e77-982c-cd407af6bd39 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c8:46:d9:9f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c8:46:d9:9f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:a9:bc:49:37:39 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 31 00:28:59.187884 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.187877 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 31 00:28:59.188007 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.187965 2574 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 31 00:28:59.191151 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.191136 2574 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 31 00:28:59.191602 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.191571 2574 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 31 00:28:59.191749 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.191607 2574 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-145.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 31 00:28:59.192480 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.192470 2574 topology_manager.go:143] "Creating topology manager with none policy" Oct 31 00:28:59.192509 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.192482 2574 container_manager_linux.go:311] "Creating device plugin manager" Oct 31 00:28:59.192509 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.192493 2574 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 31 00:28:59.192509 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.192503 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 31 00:28:59.193795 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.193785 2574 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 31 00:28:59.198667 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.198655 2574 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 31 00:28:59.198799 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.198790 2574 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 31 00:28:59.198836 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.198821 2574 kubelet.go:493] "Attempting to sync node with API server" Oct 31 00:28:59.198836 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.198832 2574 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 31 00:28:59.198885 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.198841 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 31 00:28:59.198885 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.198851 2574 kubelet.go:405] "Adding apiserver pod source" Oct 31 00:28:59.198885 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.198860 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 31 00:28:59.199222 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.199200 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 31 00:28:59.201766 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.201744 2574 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 31 00:28:59.209044 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.209028 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 31 00:28:59.209962 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.209921 2574 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 31 00:28:59.210028 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.209982 2574 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 31 00:28:59.210163 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.210153 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 31 00:28:59.210209 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.210171 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 31 00:28:59.210209 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.210177 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 31 00:28:59.210209 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.210183 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 31 00:28:59.210209 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.210191 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 31 00:28:59.210209 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.210199 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 31 00:28:59.210379 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.210361 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nnb57" Oct 31 00:28:59.210904 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.210892 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 31 00:28:59.210935 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.210906 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 31 00:28:59.210935 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.210914 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 31 00:28:59.210935 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.210925 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 31 00:28:59.210935 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.210934 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 31 00:28:59.211066 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.210944 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 31 00:28:59.212859 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.212846 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 31 00:28:59.212893 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.212865 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 31 00:28:59.218538 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.218507 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nnb57" Oct 31 00:28:59.222092 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.222074 2574 server.go:1263] "Started kubelet" Oct 31 00:28:59.222318 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.222277 2574 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 31 00:28:59.222609 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.222588 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-145.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 31 00:28:59.223486 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:28:59.222840 2574 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Oct 31 00:28:59.223486 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.222263 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 31 00:28:59.223486 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.222974 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 31 00:28:59.223146 ip-10-0-134-145 systemd[1]: Started Kubernetes Kubelet. Oct 31 00:28:59.224187 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.224170 2574 server.go:317] "Adding debug handlers to kubelet server" Oct 31 00:28:59.224331 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.224316 2574 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 31 00:28:59.225516 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:28:59.225409 2574 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-145.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Oct 31 00:28:59.228200 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:28:59.226951 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-145.us-east-2.compute.internal.18e375bedc313866 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-145.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-145.us-east-2.compute.internal,},FirstTimestamp:2026-10-31 00:28:59.22203863 +0000 UTC m=+0.416951302,LastTimestamp:2026-10-31 00:28:59.22203863 +0000 UTC m=+0.416951302,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-145.us-east-2.compute.internal,}" Oct 31 00:28:59.229817 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:28:59.229798 2574 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 31 00:28:59.231827 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.231810 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 31 00:28:59.232508 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.232492 2574 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 31 00:28:59.232655 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:28:59.232634 2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-145.us-east-2.compute.internal\" not found" Oct 31 00:28:59.233242 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.233225 2574 factory.go:55] Registering systemd factory Oct 31 00:28:59.233320 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.233263 2574 factory.go:223] Registration of the systemd container factory successfully Oct 31 00:28:59.233379 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.233342 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 31 00:28:59.233518 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.233483 2574 factory.go:153] Registering CRI-O factory Oct 31 00:28:59.233518 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.233519 2574 factory.go:223] Registration of the crio container factory successfully Oct 31 00:28:59.233621 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.233538 2574 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 31 00:28:59.233669 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.233632 2574 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 31 00:28:59.233669 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.233580 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 31 00:28:59.233669 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.233658 2574 factory.go:103] Registering Raw factory Oct 31 00:28:59.233669 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.233670 2574 manager.go:1199] Started watching for new ooms in manager Oct 31 00:28:59.233837 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.233747 2574 reconstruct.go:97] "Volume reconstruction finished" Oct 31 00:28:59.233837 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.233755 2574 reconciler.go:29] "Reconciler: start to sync state" Oct 31 00:28:59.234740 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.234715 2574 manager.go:319] Starting recovery of all containers Oct 31 00:28:59.244276 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.244253 2574 manager.go:324] Recovery completed Oct 31 00:28:59.249051 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.249032 2574 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:28:59.249135 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.249123 2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:28:59.251104 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.251082 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 31 00:28:59.251217 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.251121 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 31 00:28:59.251217 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.251139 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 31 00:28:59.251315 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:28:59.251250 2574 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-145.us-east-2.compute.internal\" not found" node="ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:28:59.251956 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.251940 2574 cpu_manager.go:226] "Starting" policy="none" Oct 31 00:28:59.251956 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.251955 2574 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 31 00:28:59.252093 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.251976 2574 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 31 00:28:59.252325 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.252287 2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:28:59.253289 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.253270 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 31 00:28:59.253367 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.253304 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 31 00:28:59.253367 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.253319 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 31 00:28:59.254149 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.254137 2574 policy_none.go:50] "Start" Oct 31 00:28:59.254189 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.254154 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 31 00:28:59.254189 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.254166 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 31 00:28:59.256141 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.256123 2574 policy_none.go:44] "Start" Oct 31 00:28:59.313840 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.299060 2574 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 31 00:28:59.313840 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.303277 2574 manager.go:341] "Starting Device Plugin manager" Oct 31 00:28:59.313840 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:28:59.304018 2574 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 31 00:28:59.313840 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.304036 2574 server.go:87] "Starting device plugin registration server" Oct 31 00:28:59.313840 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.304273 2574 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 31 00:28:59.313840 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.304284 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 31 00:28:59.313840 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.304387 2574 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 31 00:28:59.313840 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.304488 2574 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 31 00:28:59.313840 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.304496 2574 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 31 00:28:59.313840 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:28:59.305068 2574 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 31 00:28:59.313840 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:28:59.305121 2574 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-145.us-east-2.compute.internal\" not found" Oct 31 00:28:59.313840 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.309478 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 31 00:28:59.313840 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.311044 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 31 00:28:59.313840 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.311064 2574 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 31 00:28:59.313840 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.311086 2574 kubelet.go:2521] "Starting kubelet main sync loop" Oct 31 00:28:59.313840 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:28:59.311115 2574 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Oct 31 00:28:59.316278 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.315101 2574 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:28:59.404695 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.404620 2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:28:59.405696 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.405677 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 31 00:28:59.405793 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.405707 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 31 00:28:59.405793 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.405717 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 31 00:28:59.405793 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.405745 2574 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:28:59.411330 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.411311 2574 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal"] Oct 31 00:28:59.411390 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.411368 2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:28:59.412207 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.412192 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 31 00:28:59.412264 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.412220 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 31 00:28:59.412264 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.412230 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 31 00:28:59.414516 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.414503 2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:28:59.414683 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.414666 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:28:59.414750 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.414708 2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:28:59.414863 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.414847 2574 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:28:59.414921 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:28:59.414875 2574 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-145.us-east-2.compute.internal\": node \"ip-10-0-134-145.us-east-2.compute.internal\" not found" Oct 31 00:28:59.415455 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.415437 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 31 00:28:59.415455 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.415453 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 31 00:28:59.415574 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.415482 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 31 00:28:59.415574 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.415495 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 31 00:28:59.415574 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.415482 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 31 00:28:59.415574 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.415566 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 31 00:28:59.417751 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.417735 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:28:59.417810 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.417789 2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:28:59.418458 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.418441 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 31 00:28:59.418543 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.418466 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 31 00:28:59.418543 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.418478 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 31 00:28:59.434542 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.434518 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5bf9502ef5bfb3cbf20de88306bbc22-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal\" (UID: \"a5bf9502ef5bfb3cbf20de88306bbc22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:28:59.434641 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.434543 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5bf9502ef5bfb3cbf20de88306bbc22-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal\" (UID: \"a5bf9502ef5bfb3cbf20de88306bbc22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:28:59.434641 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.434561 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e99a684e1e1866230a776f45fdda194d-config\") pod \"kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal\" (UID: \"e99a684e1e1866230a776f45fdda194d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:28:59.439744 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:28:59.439727 2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-145.us-east-2.compute.internal\" not found" Oct 31 00:28:59.446250 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:28:59.446233 2574 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-145.us-east-2.compute.internal\" not found" node="ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:28:59.448743 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:28:59.448726 2574 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-145.us-east-2.compute.internal\" not found" node="ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:28:59.535387 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.535361 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5bf9502ef5bfb3cbf20de88306bbc22-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal\" (UID: \"a5bf9502ef5bfb3cbf20de88306bbc22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:28:59.535512 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.535391 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e99a684e1e1866230a776f45fdda194d-config\") pod \"kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal\" (UID: \"e99a684e1e1866230a776f45fdda194d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:28:59.535512 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.535409 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5bf9502ef5bfb3cbf20de88306bbc22-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal\" (UID: \"a5bf9502ef5bfb3cbf20de88306bbc22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:28:59.535512 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.535497 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5bf9502ef5bfb3cbf20de88306bbc22-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal\" (UID: \"a5bf9502ef5bfb3cbf20de88306bbc22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:28:59.535512 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.535500 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5bf9502ef5bfb3cbf20de88306bbc22-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal\" (UID: \"a5bf9502ef5bfb3cbf20de88306bbc22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:28:59.535651 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.535500 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e99a684e1e1866230a776f45fdda194d-config\") pod \"kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal\" (UID: \"e99a684e1e1866230a776f45fdda194d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:28:59.540466 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:28:59.540450 2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-145.us-east-2.compute.internal\" not found" Oct 31 00:28:59.641451 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:28:59.641388 2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-145.us-east-2.compute.internal\" not found" Oct 31 00:28:59.742283 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:28:59.742222 2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-145.us-east-2.compute.internal\" not found" Oct 31 00:28:59.751431 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.751385 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:28:59.754556 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:28:59.754541 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:28:59.843297 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:28:59.843263 2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-145.us-east-2.compute.internal\" not found" Oct 31 00:28:59.943803 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:28:59.943764 2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-145.us-east-2.compute.internal\" not found" Oct 31 00:29:00.044384 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:00.044311 2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-145.us-east-2.compute.internal\" not found" Oct 31 00:29:00.144798 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:00.144771 2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-145.us-east-2.compute.internal\" not found" Oct 31 00:29:00.156987 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:00.156960 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 31 00:29:00.157144 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:00.157124 2574 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 31 00:29:00.157205 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:00.157159 2574 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 31 00:29:00.215035 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:00.215004 2574 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:29:00.226186 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:00.226136 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 00:23:59 +0000 UTC" deadline="2028-06-20 23:51:33.221969356 +0000 UTC" Oct 31 00:29:00.226186 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:00.226182 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14375h22m32.995789995s" Oct 31 00:29:00.245371 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:00.245318 2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-145.us-east-2.compute.internal\" not found" Oct 31 00:29:00.345835 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:00.345807 2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-145.us-east-2.compute.internal\" not found" Oct 31 00:29:00.443760 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:29:00.443729 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5bf9502ef5bfb3cbf20de88306bbc22.slice/crio-d1e36958212cc3bad9df53ee73c7031515b019514965236038d6a8c82f4d7c1a WatchSource:0}: Error finding container d1e36958212cc3bad9df53ee73c7031515b019514965236038d6a8c82f4d7c1a: Status 404 returned error can't find the container with id d1e36958212cc3bad9df53ee73c7031515b019514965236038d6a8c82f4d7c1a Oct 31 00:29:00.444078 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:29:00.444054 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode99a684e1e1866230a776f45fdda194d.slice/crio-d773daf30ca65ca8b21f34273166026dc5a909a3df68e0f7b9caaed52d1c8a97 WatchSource:0}: Error finding container d773daf30ca65ca8b21f34273166026dc5a909a3df68e0f7b9caaed52d1c8a97: Status 404 returned error can't find the container with id d773daf30ca65ca8b21f34273166026dc5a909a3df68e0f7b9caaed52d1c8a97 Oct 31 00:29:00.446213 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:00.446193 2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-145.us-east-2.compute.internal\" not found" Oct 31 00:29:00.450507 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:00.450491 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 31 00:29:00.546790 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:00.546761 2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-145.us-east-2.compute.internal\" not found" Oct 31 00:29:00.589068 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:00.589012 2574 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:29:00.633068 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:00.633044 2574 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:29:00.645994 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:00.645973 2574 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 00:29:00.647093 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:00.647080 2574 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:29:00.653745 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:00.653724 2574 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 00:29:00.969461 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:00.969366 2574 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:29:01.199523 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.199491 2574 apiserver.go:52] "Watching apiserver" Oct 31 00:29:01.214405 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.214372 2574 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 31 00:29:01.214851 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.214827 2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-6rt5w","kube-system/konnectivity-agent-ch4wj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg","openshift-dns/node-resolver-g7phc","openshift-multus/multus-additional-cni-plugins-qsxkm","openshift-cluster-node-tuning-operator/tuned-csst9","openshift-image-registry/node-ca-5nw7t","openshift-multus/network-metrics-daemon-bl5rh","openshift-network-diagnostics/network-check-target-hnzfm","openshift-network-operator/iptables-alerter-csk4z","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal","openshift-multus/multus-h2bhb","openshift-ovn-kubernetes/ovnkube-node-d9vvz","kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal"] Oct 31 00:29:01.217886 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.217862 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-csk4z" Oct 31 00:29:01.219974 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.219926 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.224841 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.224814 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.227640 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.227621 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g7phc" Oct 31 00:29:01.233027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.233000 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:01.233131 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:01.233092 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:01.233372 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.233351 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 31 00:29:01.235754 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.235732 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.240904 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.240283 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 31 00:29:01.240904 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.240385 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:29:01.240904 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.240485 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 31 00:29:01.240904 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.240607 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 31 00:29:01.240904 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.240651 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 31 00:29:01.240904 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.240653 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pnvd5\"" Oct 31 00:29:01.240904 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.240731 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 31 00:29:01.240904 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.240785 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 31 00:29:01.240904 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.240825 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 31 00:29:01.240904 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.240879 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 31 00:29:01.241575 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.240914 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:01.241575 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:01.240980 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzfm" podUID="4d754c0a-9f48-439b-8673-6ba91b6408ff" Oct 31 00:29:01.241575 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.241563 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rn9j5\"" Oct 31 00:29:01.241761 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.241670 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 31 00:29:01.241869 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.241852 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-l9cjs\"" Oct 31 00:29:01.243903 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.243182 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.245282 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.245243 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-system-cni-dir\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.245282 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.245276 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-multus-conf-dir\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.245451 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.245304 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.245451 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.245329 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs\") pod \"network-metrics-daemon-bl5rh\" (UID: \"1720ac40-f3e0-44e3-b2f2-06db389fb9b7\") " pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:01.245451 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.245365 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/447b2177-70e2-46dd-a082-6c750a49db1c-etc-tuned\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.245451 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.245392 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3af97b1-99a9-4fab-97b4-ac62b870de03-host-slash\") pod \"iptables-alerter-csk4z\" (UID: \"e3af97b1-99a9-4fab-97b4-ac62b870de03\") " pod="openshift-network-operator/iptables-alerter-csk4z" Oct 31 00:29:01.245451 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.245417 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db01ba46-985b-4967-a668-73e1eb99189b-cni-binary-copy\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.245791 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.245487 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1b304f2-676a-4a6f-bdac-8805188c415f-tmp-dir\") pod \"node-resolver-g7phc\" (UID: \"a1b304f2-676a-4a6f-bdac-8805188c415f\") " pod="openshift-dns/node-resolver-g7phc" Oct 31 00:29:01.245791 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.245519 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n87x\" (UniqueName: \"kubernetes.io/projected/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-kube-api-access-4n87x\") pod \"network-metrics-daemon-bl5rh\" (UID: \"1720ac40-f3e0-44e3-b2f2-06db389fb9b7\") " pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:01.246332 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.246308 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-kubernetes\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.246462 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.246351 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-sysctl-conf\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.246462 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.246385 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-run\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.246462 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.245913 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ch4wj" Oct 31 00:29:01.246462 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.246431 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-hostroot\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.246788 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.246487 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-registration-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.246788 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.246557 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-lib-modules\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.246788 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.246584 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-host\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.246788 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.246631 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3af97b1-99a9-4fab-97b4-ac62b870de03-iptables-alerter-script\") pod \"iptables-alerter-csk4z\" (UID: \"e3af97b1-99a9-4fab-97b4-ac62b870de03\") " pod="openshift-network-operator/iptables-alerter-csk4z" Oct 31 00:29:01.246788 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.246659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-run-k8s-cni-cncf-io\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.246788 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.246683 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-var-lib-kubelet\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.246788 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.246727 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-cnibin\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.246788 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.246755 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-multus-socket-dir-parent\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.246788 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.246781 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-var-lib-kubelet\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.247213 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.246806 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-device-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.247213 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.246830 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-etc-selinux\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.247213 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.246893 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzdpn\" (UniqueName: \"kubernetes.io/projected/a2ba2a3b-57ee-4515-a194-cb86198d246b-kube-api-access-lzdpn\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.247213 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.246918 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-run-multus-certs\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.247213 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.246943 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-etc-kubernetes\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.247213 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.246982 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2l4j\" (UniqueName: \"kubernetes.io/projected/db01ba46-985b-4967-a668-73e1eb99189b-kube-api-access-g2l4j\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.247213 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.247028 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a1b304f2-676a-4a6f-bdac-8805188c415f-hosts-file\") pod \"node-resolver-g7phc\" (UID: \"a1b304f2-676a-4a6f-bdac-8805188c415f\") " pod="openshift-dns/node-resolver-g7phc" Oct 31 00:29:01.247213 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.247056 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-modprobe-d\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.247213 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.247085 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-multus-cni-dir\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.247213 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.247113 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-run-netns\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.247213 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.247135 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/db01ba46-985b-4967-a668-73e1eb99189b-multus-daemon-config\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.247213 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.247158 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-socket-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.247213 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.247175 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z56w9\" (UniqueName: \"kubernetes.io/projected/a1b304f2-676a-4a6f-bdac-8805188c415f-kube-api-access-z56w9\") pod \"node-resolver-g7phc\" (UID: \"a1b304f2-676a-4a6f-bdac-8805188c415f\") " pod="openshift-dns/node-resolver-g7phc" Oct 31 00:29:01.247213 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.247191 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-sysconfig\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.247213 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.247216 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-systemd\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.247841 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.247315 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/447b2177-70e2-46dd-a082-6c750a49db1c-tmp\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.247841 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.247339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gqct\" (UniqueName: \"kubernetes.io/projected/e3af97b1-99a9-4fab-97b4-ac62b870de03-kube-api-access-4gqct\") pod \"iptables-alerter-csk4z\" (UID: \"e3af97b1-99a9-4fab-97b4-ac62b870de03\") " pod="openshift-network-operator/iptables-alerter-csk4z" Oct 31 00:29:01.247841 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.247355 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-var-lib-cni-bin\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.247841 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.247378 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-var-lib-cni-multus\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.247841 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.247395 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-sys-fs\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.247841 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.247410 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-sysctl-d\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.247841 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.247427 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-sys\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.247841 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.247451 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmkhp\" (UniqueName: \"kubernetes.io/projected/447b2177-70e2-46dd-a082-6c750a49db1c-kube-api-access-xmkhp\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.248522 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.248501 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.251732 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.251596 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:01.251732 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:01.251676 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:01.254092 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.254068 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5nw7t" Oct 31 00:29:01.269093 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.269064 2574 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 31 00:29:01.276859 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.276832 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-smcwp" Oct 31 00:29:01.282695 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.282663 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-smcwp" Oct 31 00:29:01.319857 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.319790 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal" event={"ID":"e99a684e1e1866230a776f45fdda194d","Type":"ContainerStarted","Data":"d773daf30ca65ca8b21f34273166026dc5a909a3df68e0f7b9caaed52d1c8a97"} Oct 31 00:29:01.321216 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.321190 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" event={"ID":"a5bf9502ef5bfb3cbf20de88306bbc22","Type":"ContainerStarted","Data":"d1e36958212cc3bad9df53ee73c7031515b019514965236038d6a8c82f4d7c1a"} Oct 31 00:29:01.334958 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.334931 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 31 00:29:01.340887 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.340796 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vxzr5\"" Oct 31 00:29:01.340887 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.340811 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 31 00:29:01.340887 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.340821 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pl6tx\"" Oct 31 00:29:01.340887 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.340805 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-72tmz\"" Oct 31 00:29:01.340887 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.340804 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 31 00:29:01.340887 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.340833 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-9nqcj\"" Oct 31 00:29:01.340887 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.340855 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jhx4l\"" Oct 31 00:29:01.342251 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.342232 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4cbmj\"" Oct 31 00:29:01.342356 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.342342 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 31 00:29:01.342423 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.342358 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:29:01.342423 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.342400 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 31 00:29:01.342423 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.342413 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 31 00:29:01.342610 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.342504 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 31 00:29:01.342610 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.342553 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 31 00:29:01.342712 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.342614 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 31 00:29:01.342712 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.342678 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 31 00:29:01.342817 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.342749 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 31 00:29:01.342817 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.342807 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 31 00:29:01.342923 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.342894 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 31 00:29:01.342980 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.342941 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 31 00:29:01.343080 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.343058 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 31 00:29:01.343301 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.343287 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 31 00:29:01.343666 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.343646 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 31 00:29:01.347716 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.347694 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-multus-socket-dir-parent\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.347818 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.347728 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-var-lib-kubelet\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.347818 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.347761 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-node-log\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.347902 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.347833 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4defb35-52f2-46fc-a314-affe5a217a84-host\") pod \"node-ca-5nw7t\" (UID: \"a4defb35-52f2-46fc-a314-affe5a217a84\") " pod="openshift-image-registry/node-ca-5nw7t" Oct 31 00:29:01.347902 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.347879 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-etc-kubernetes\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.347979 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.347908 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2l4j\" (UniqueName: \"kubernetes.io/projected/db01ba46-985b-4967-a668-73e1eb99189b-kube-api-access-g2l4j\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.347979 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.347906 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-multus-socket-dir-parent\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.347979 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.347957 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-kubelet\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.347979 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.347968 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-etc-kubernetes\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.348109 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.347992 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-cni-netd\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.348109 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348020 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3c5e8eb-fd22-42ee-a203-7c3077f48084-konnectivity-ca\") pod \"konnectivity-agent-ch4wj\" (UID: \"c3c5e8eb-fd22-42ee-a203-7c3077f48084\") " pod="kube-system/konnectivity-agent-ch4wj" Oct 31 00:29:01.348109 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348046 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5vvg\" (UniqueName: \"kubernetes.io/projected/a4defb35-52f2-46fc-a314-affe5a217a84-kube-api-access-v5vvg\") pod \"node-ca-5nw7t\" (UID: \"a4defb35-52f2-46fc-a314-affe5a217a84\") " pod="openshift-image-registry/node-ca-5nw7t" Oct 31 00:29:01.348109 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348073 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87931c70-7b7c-4910-89ce-f84136d7a852-system-cni-dir\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.348109 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348102 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-multus-cni-dir\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.348295 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348128 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/db01ba46-985b-4967-a668-73e1eb99189b-multus-daemon-config\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.348295 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348155 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-socket-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.348295 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348181 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z56w9\" (UniqueName: \"kubernetes.io/projected/a1b304f2-676a-4a6f-bdac-8805188c415f-kube-api-access-z56w9\") pod \"node-resolver-g7phc\" (UID: \"a1b304f2-676a-4a6f-bdac-8805188c415f\") " pod="openshift-dns/node-resolver-g7phc" Oct 31 00:29:01.348295 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348205 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-sysconfig\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.348295 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-systemd\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.348295 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348239 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-var-lib-kubelet\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.348295 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348255 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gqct\" (UniqueName: \"kubernetes.io/projected/e3af97b1-99a9-4fab-97b4-ac62b870de03-kube-api-access-4gqct\") pod \"iptables-alerter-csk4z\" (UID: \"e3af97b1-99a9-4fab-97b4-ac62b870de03\") " pod="openshift-network-operator/iptables-alerter-csk4z" Oct 31 00:29:01.348295 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348291 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-var-lib-cni-bin\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.348595 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348492 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-var-lib-cni-multus\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.348595 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348519 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-sys\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.348595 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348538 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-slash\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.348595 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348573 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-run-netns\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.348730 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348598 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-ovn-node-metrics-cert\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.348730 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348624 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-ovnkube-script-lib\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.348730 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348642 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-system-cni-dir\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.348730 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs\") pod \"network-metrics-daemon-bl5rh\" (UID: \"1720ac40-f3e0-44e3-b2f2-06db389fb9b7\") " pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:01.348730 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348675 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-run-systemd\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.348886 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348754 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/87931c70-7b7c-4910-89ce-f84136d7a852-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.348886 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348779 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-kubelet-config\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:01.348886 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348808 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-lib-modules\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.348886 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348833 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-etc-openvswitch\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.348886 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348857 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3af97b1-99a9-4fab-97b4-ac62b870de03-host-slash\") pod \"iptables-alerter-csk4z\" (UID: \"e3af97b1-99a9-4fab-97b4-ac62b870de03\") " pod="openshift-network-operator/iptables-alerter-csk4z" Oct 31 00:29:01.348886 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348873 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db01ba46-985b-4967-a668-73e1eb99189b-cni-binary-copy\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.349083 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348877 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/db01ba46-985b-4967-a668-73e1eb99189b-multus-daemon-config\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.349083 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349011 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-multus-cni-dir\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.349083 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349040 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-var-lib-cni-bin\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.349083 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349071 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-var-lib-cni-multus\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.349239 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349099 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-sys\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.349239 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349132 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-system-cni-dir\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.349239 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.348891 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n87x\" (UniqueName: \"kubernetes.io/projected/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-kube-api-access-4n87x\") pod \"network-metrics-daemon-bl5rh\" (UID: \"1720ac40-f3e0-44e3-b2f2-06db389fb9b7\") " pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:01.349239 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349206 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-socket-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.349411 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:01.349300 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:01.349411 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349326 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3af97b1-99a9-4fab-97b4-ac62b870de03-host-slash\") pod \"iptables-alerter-csk4z\" (UID: \"e3af97b1-99a9-4fab-97b4-ac62b870de03\") " pod="openshift-network-operator/iptables-alerter-csk4z" Oct 31 00:29:01.349411 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:01.349362 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs podName:1720ac40-f3e0-44e3-b2f2-06db389fb9b7 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:01.849341846 +0000 UTC m=+3.044254524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs") pod "network-metrics-daemon-bl5rh" (UID: "1720ac40-f3e0-44e3-b2f2-06db389fb9b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:01.349630 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349484 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-lib-modules\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.349630 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349536 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-log-socket\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.349630 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349592 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-sysconfig\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.349630 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349596 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-hostroot\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.349837 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349633 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-host\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.349837 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349635 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-hostroot\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.349837 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349672 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3c5e8eb-fd22-42ee-a203-7c3077f48084-agent-certs\") pod \"konnectivity-agent-ch4wj\" (UID: \"c3c5e8eb-fd22-42ee-a203-7c3077f48084\") " pod="kube-system/konnectivity-agent-ch4wj" Oct 31 00:29:01.349837 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349696 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-systemd\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.349837 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349702 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-run-k8s-cni-cncf-io\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.349837 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349759 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-run-k8s-cni-cncf-io\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.349837 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349792 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-var-lib-kubelet\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.349837 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349821 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-systemd-units\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.350243 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349866 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db01ba46-985b-4967-a668-73e1eb99189b-cni-binary-copy\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.350243 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349883 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/87931c70-7b7c-4910-89ce-f84136d7a852-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.350243 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349937 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-host\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.350243 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349963 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-var-lib-kubelet\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.350243 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349971 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:01.350243 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.349995 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-device-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.350243 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350023 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-etc-selinux\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.350243 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350040 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-device-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.350243 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350065 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzdpn\" (UniqueName: \"kubernetes.io/projected/a2ba2a3b-57ee-4515-a194-cb86198d246b-kube-api-access-lzdpn\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.350243 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350083 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4defb35-52f2-46fc-a314-affe5a217a84-serviceca\") pod \"node-ca-5nw7t\" (UID: \"a4defb35-52f2-46fc-a314-affe5a217a84\") " pod="openshift-image-registry/node-ca-5nw7t" Oct 31 00:29:01.350243 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350119 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87931c70-7b7c-4910-89ce-f84136d7a852-cni-binary-copy\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.350243 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350146 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-dbus\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:01.350243 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350180 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-run-multus-certs\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.350243 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350206 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-etc-selinux\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.350243 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a1b304f2-676a-4a6f-bdac-8805188c415f-hosts-file\") pod \"node-resolver-g7phc\" (UID: \"a1b304f2-676a-4a6f-bdac-8805188c415f\") " pod="openshift-dns/node-resolver-g7phc" Oct 31 00:29:01.350243 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350248 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-modprobe-d\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.351035 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350265 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b47dq\" (UniqueName: \"kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq\") pod \"network-check-target-hnzfm\" (UID: \"4d754c0a-9f48-439b-8673-6ba91b6408ff\") " pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:01.351035 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350285 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.351035 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350340 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5fmn\" (UniqueName: \"kubernetes.io/projected/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-kube-api-access-m5fmn\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.351035 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350360 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-run-netns\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.351035 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350383 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/447b2177-70e2-46dd-a082-6c750a49db1c-tmp\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.351035 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350410 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmkhp\" (UniqueName: \"kubernetes.io/projected/447b2177-70e2-46dd-a082-6c750a49db1c-kube-api-access-xmkhp\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.351035 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350439 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-run-openvswitch\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.351035 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350463 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-ovnkube-config\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.351035 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350470 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-run-multus-certs\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.351035 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350480 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-sys-fs\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.351035 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350552 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-sysctl-d\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.351035 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350583 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.351035 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350621 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87931c70-7b7c-4910-89ce-f84136d7a852-cnibin\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.351035 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350653 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-multus-conf-dir\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.351035 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350680 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.351035 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350714 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/447b2177-70e2-46dd-a082-6c750a49db1c-etc-tuned\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.351035 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350739 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-run-ovn\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.351757 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350764 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87931c70-7b7c-4910-89ce-f84136d7a852-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.351757 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2cv8\" (UniqueName: \"kubernetes.io/projected/87931c70-7b7c-4910-89ce-f84136d7a852-kube-api-access-n2cv8\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.351757 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350803 2574 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 31 00:29:01.351757 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350819 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-var-lib-openvswitch\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.351757 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350844 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-sys-fs\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.351757 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350850 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1b304f2-676a-4a6f-bdac-8805188c415f-tmp-dir\") pod \"node-resolver-g7phc\" (UID: \"a1b304f2-676a-4a6f-bdac-8805188c415f\") " pod="openshift-dns/node-resolver-g7phc" Oct 31 00:29:01.351757 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350885 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-kubernetes\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.351757 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350896 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a1b304f2-676a-4a6f-bdac-8805188c415f-hosts-file\") pod \"node-resolver-g7phc\" (UID: \"a1b304f2-676a-4a6f-bdac-8805188c415f\") " pod="openshift-dns/node-resolver-g7phc" Oct 31 00:29:01.351757 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.350912 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-sysctl-conf\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.351757 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.351077 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-modprobe-d\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.351757 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.351119 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-run\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.351757 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.351149 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-registration-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.351757 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.351180 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-env-overrides\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.351757 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.351209 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3af97b1-99a9-4fab-97b4-ac62b870de03-iptables-alerter-script\") pod \"iptables-alerter-csk4z\" (UID: \"e3af97b1-99a9-4fab-97b4-ac62b870de03\") " pod="openshift-network-operator/iptables-alerter-csk4z" Oct 31 00:29:01.351757 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.351242 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-cni-bin\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.351757 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.351275 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-cnibin\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.351757 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.351360 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-cnibin\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.351757 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.351385 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-multus-conf-dir\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.352581 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.351417 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.352581 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.351244 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-sysctl-conf\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.352581 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.351678 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-run\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.352581 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.351680 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1b304f2-676a-4a6f-bdac-8805188c415f-tmp-dir\") pod \"node-resolver-g7phc\" (UID: \"a1b304f2-676a-4a6f-bdac-8805188c415f\") " pod="openshift-dns/node-resolver-g7phc" Oct 31 00:29:01.352581 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.351719 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-run-netns\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.352581 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.351733 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-kubernetes\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.352581 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.351781 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-registration-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.352581 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.351792 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-sysctl-d\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.352581 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.352261 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3af97b1-99a9-4fab-97b4-ac62b870de03-iptables-alerter-script\") pod \"iptables-alerter-csk4z\" (UID: \"e3af97b1-99a9-4fab-97b4-ac62b870de03\") " pod="openshift-network-operator/iptables-alerter-csk4z" Oct 31 00:29:01.355049 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.355027 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/447b2177-70e2-46dd-a082-6c750a49db1c-tmp\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.355119 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.355086 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/447b2177-70e2-46dd-a082-6c750a49db1c-etc-tuned\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.357655 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.357633 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gqct\" (UniqueName: \"kubernetes.io/projected/e3af97b1-99a9-4fab-97b4-ac62b870de03-kube-api-access-4gqct\") pod \"iptables-alerter-csk4z\" (UID: \"e3af97b1-99a9-4fab-97b4-ac62b870de03\") " pod="openshift-network-operator/iptables-alerter-csk4z" Oct 31 00:29:01.358352 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.358323 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2l4j\" (UniqueName: \"kubernetes.io/projected/db01ba46-985b-4967-a668-73e1eb99189b-kube-api-access-g2l4j\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.359728 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.359328 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z56w9\" (UniqueName: \"kubernetes.io/projected/a1b304f2-676a-4a6f-bdac-8805188c415f-kube-api-access-z56w9\") pod \"node-resolver-g7phc\" (UID: \"a1b304f2-676a-4a6f-bdac-8805188c415f\") " pod="openshift-dns/node-resolver-g7phc" Oct 31 00:29:01.359728 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.359666 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmkhp\" (UniqueName: \"kubernetes.io/projected/447b2177-70e2-46dd-a082-6c750a49db1c-kube-api-access-xmkhp\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.361206 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.361180 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n87x\" (UniqueName: \"kubernetes.io/projected/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-kube-api-access-4n87x\") pod \"network-metrics-daemon-bl5rh\" (UID: \"1720ac40-f3e0-44e3-b2f2-06db389fb9b7\") " pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:01.361747 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.361727 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzdpn\" (UniqueName: \"kubernetes.io/projected/a2ba2a3b-57ee-4515-a194-cb86198d246b-kube-api-access-lzdpn\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.403876 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.403845 2574 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:29:01.451666 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.451628 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87931c70-7b7c-4910-89ce-f84136d7a852-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.451854 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.451673 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2cv8\" (UniqueName: \"kubernetes.io/projected/87931c70-7b7c-4910-89ce-f84136d7a852-kube-api-access-n2cv8\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.451854 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.451704 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-var-lib-openvswitch\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.451854 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.451733 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-env-overrides\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.451854 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.451757 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-cni-bin\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.451854 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.451784 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-node-log\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.451854 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.451807 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4defb35-52f2-46fc-a314-affe5a217a84-host\") pod \"node-ca-5nw7t\" (UID: \"a4defb35-52f2-46fc-a314-affe5a217a84\") " pod="openshift-image-registry/node-ca-5nw7t" Oct 31 00:29:01.451854 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.451834 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-kubelet\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.451854 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.451856 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-cni-netd\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.452272 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.451865 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87931c70-7b7c-4910-89ce-f84136d7a852-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.452272 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.451882 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3c5e8eb-fd22-42ee-a203-7c3077f48084-konnectivity-ca\") pod \"konnectivity-agent-ch4wj\" (UID: \"c3c5e8eb-fd22-42ee-a203-7c3077f48084\") " pod="kube-system/konnectivity-agent-ch4wj" Oct 31 00:29:01.452272 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.451907 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5vvg\" (UniqueName: \"kubernetes.io/projected/a4defb35-52f2-46fc-a314-affe5a217a84-kube-api-access-v5vvg\") pod \"node-ca-5nw7t\" (UID: \"a4defb35-52f2-46fc-a314-affe5a217a84\") " pod="openshift-image-registry/node-ca-5nw7t" Oct 31 00:29:01.452272 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.451929 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-var-lib-openvswitch\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.452272 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.451932 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87931c70-7b7c-4910-89ce-f84136d7a852-system-cni-dir\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.452272 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.451970 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87931c70-7b7c-4910-89ce-f84136d7a852-system-cni-dir\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.452272 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.451974 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-slash\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.452272 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452010 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4defb35-52f2-46fc-a314-affe5a217a84-host\") pod \"node-ca-5nw7t\" (UID: \"a4defb35-52f2-46fc-a314-affe5a217a84\") " pod="openshift-image-registry/node-ca-5nw7t" Oct 31 00:29:01.452272 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452021 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-run-netns\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.452272 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452048 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-ovn-node-metrics-cert\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.452272 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452056 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-cni-bin\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.452272 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452080 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-cni-netd\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.452272 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452081 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-ovnkube-script-lib\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.452272 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452113 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-slash\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.452272 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452135 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-run-systemd\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.452272 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452151 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-run-netns\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.452272 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452161 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/87931c70-7b7c-4910-89ce-f84136d7a852-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.453138 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452189 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-kubelet-config\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:01.453138 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452215 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-etc-openvswitch\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.453138 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452241 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-log-socket\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.453138 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452269 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3c5e8eb-fd22-42ee-a203-7c3077f48084-agent-certs\") pod \"konnectivity-agent-ch4wj\" (UID: \"c3c5e8eb-fd22-42ee-a203-7c3077f48084\") " pod="kube-system/konnectivity-agent-ch4wj" Oct 31 00:29:01.453138 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452294 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-systemd-units\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.453138 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452317 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/87931c70-7b7c-4910-89ce-f84136d7a852-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.453138 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452343 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:01.453138 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452389 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4defb35-52f2-46fc-a314-affe5a217a84-serviceca\") pod \"node-ca-5nw7t\" (UID: \"a4defb35-52f2-46fc-a314-affe5a217a84\") " pod="openshift-image-registry/node-ca-5nw7t" Oct 31 00:29:01.453138 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452413 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87931c70-7b7c-4910-89ce-f84136d7a852-cni-binary-copy\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.453138 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452435 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-dbus\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:01.453138 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452463 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b47dq\" (UniqueName: \"kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq\") pod \"network-check-target-hnzfm\" (UID: \"4d754c0a-9f48-439b-8673-6ba91b6408ff\") " pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:01.453138 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452491 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.453138 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452536 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5fmn\" (UniqueName: \"kubernetes.io/projected/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-kube-api-access-m5fmn\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.453138 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452563 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-run-openvswitch\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.453138 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452608 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-run-openvswitch\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.453138 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452623 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-env-overrides\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.453138 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452648 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-systemd-units\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.454017 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:01.452718 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:01.454017 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:01.452826 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret podName:3b3c9cfb-2fd5-4a88-a938-77f38dd28969 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:01.952805415 +0000 UTC m=+3.147718092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret") pod "global-pull-secret-syncer-6rt5w" (UID: "3b3c9cfb-2fd5-4a88-a938-77f38dd28969") : object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:01.454017 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452962 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-run-systemd\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.454017 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.453210 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-ovnkube-script-lib\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.454017 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.453283 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4defb35-52f2-46fc-a314-affe5a217a84-serviceca\") pod \"node-ca-5nw7t\" (UID: \"a4defb35-52f2-46fc-a314-affe5a217a84\") " pod="openshift-image-registry/node-ca-5nw7t" Oct 31 00:29:01.454017 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.453476 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3c5e8eb-fd22-42ee-a203-7c3077f48084-konnectivity-ca\") pod \"konnectivity-agent-ch4wj\" (UID: \"c3c5e8eb-fd22-42ee-a203-7c3077f48084\") " pod="kube-system/konnectivity-agent-ch4wj" Oct 31 00:29:01.454017 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.453549 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-node-log\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.454017 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.453823 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.454017 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.453855 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87931c70-7b7c-4910-89ce-f84136d7a852-cni-binary-copy\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.454017 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.453856 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/87931c70-7b7c-4910-89ce-f84136d7a852-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.454017 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.453896 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-dbus\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:01.454017 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.452049 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-kubelet\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.454615 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.454064 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-kubelet-config\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:01.454615 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.454131 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-etc-openvswitch\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.454615 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.454159 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-log-socket\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.454615 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.454293 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-ovnkube-config\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.454615 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.454329 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.454615 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.454366 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87931c70-7b7c-4910-89ce-f84136d7a852-cnibin\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.454615 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.454396 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-run-ovn\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.454615 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.454481 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-run-ovn\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.454615 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.454479 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/87931c70-7b7c-4910-89ce-f84136d7a852-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.454615 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.454543 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87931c70-7b7c-4910-89ce-f84136d7a852-cnibin\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.454615 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.454542 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.455048 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.454954 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-ovnkube-config\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.456336 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.456309 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3c5e8eb-fd22-42ee-a203-7c3077f48084-agent-certs\") pod \"konnectivity-agent-ch4wj\" (UID: \"c3c5e8eb-fd22-42ee-a203-7c3077f48084\") " pod="kube-system/konnectivity-agent-ch4wj" Oct 31 00:29:01.458844 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.458817 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-ovn-node-metrics-cert\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.461139 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.461117 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2cv8\" (UniqueName: \"kubernetes.io/projected/87931c70-7b7c-4910-89ce-f84136d7a852-kube-api-access-n2cv8\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.462681 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:01.462660 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 00:29:01.462785 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:01.462687 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 00:29:01.462785 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:01.462701 2574 projected.go:196] Error preparing data for projected volume kube-api-access-b47dq for pod openshift-network-diagnostics/network-check-target-hnzfm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:01.462785 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:01.462766 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq podName:4d754c0a-9f48-439b-8673-6ba91b6408ff nodeName:}" failed. No retries permitted until 2026-10-31 00:29:01.962748254 +0000 UTC m=+3.157660929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b47dq" (UniqueName: "kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq") pod "network-check-target-hnzfm" (UID: "4d754c0a-9f48-439b-8673-6ba91b6408ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:01.466305 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.466276 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5vvg\" (UniqueName: \"kubernetes.io/projected/a4defb35-52f2-46fc-a314-affe5a217a84-kube-api-access-v5vvg\") pod \"node-ca-5nw7t\" (UID: \"a4defb35-52f2-46fc-a314-affe5a217a84\") " pod="openshift-image-registry/node-ca-5nw7t" Oct 31 00:29:01.466760 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.466713 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5fmn\" (UniqueName: \"kubernetes.io/projected/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-kube-api-access-m5fmn\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.538451 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.538333 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-csk4z" Oct 31 00:29:01.547899 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.547872 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h2bhb" Oct 31 00:29:01.548769 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:29:01.548734 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3af97b1_99a9_4fab_97b4_ac62b870de03.slice/crio-e0ac25b6b8cddc86816b0d94c71cff163eee470b42bc94d08d7a0d7a770fbfea WatchSource:0}: Error finding container e0ac25b6b8cddc86816b0d94c71cff163eee470b42bc94d08d7a0d7a770fbfea: Status 404 returned error can't find the container with id e0ac25b6b8cddc86816b0d94c71cff163eee470b42bc94d08d7a0d7a770fbfea Oct 31 00:29:01.563050 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.563021 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:29:01.565642 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.565616 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g7phc" Oct 31 00:29:01.574611 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.574586 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:29:01.575343 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:29:01.575316 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ba2a3b_57ee_4515_a194_cb86198d246b.slice/crio-2f812f411c8a0981f16f3bdb1950ba4c4813e7e1ae5ac75cfdfdd5bb748bfb22 WatchSource:0}: Error finding container 2f812f411c8a0981f16f3bdb1950ba4c4813e7e1ae5ac75cfdfdd5bb748bfb22: Status 404 returned error can't find the container with id 2f812f411c8a0981f16f3bdb1950ba4c4813e7e1ae5ac75cfdfdd5bb748bfb22 Oct 31 00:29:01.577859 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:29:01.577837 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b304f2_676a_4a6f_bdac_8805188c415f.slice/crio-f2fbc74ff263f96e2afe196affb0ca7bbf793a53d8fd1202b97d80d72fe8d33c WatchSource:0}: Error finding container f2fbc74ff263f96e2afe196affb0ca7bbf793a53d8fd1202b97d80d72fe8d33c: Status 404 returned error can't find the container with id f2fbc74ff263f96e2afe196affb0ca7bbf793a53d8fd1202b97d80d72fe8d33c Oct 31 00:29:01.585071 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:29:01.585041 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod447b2177_70e2_46dd_a082_6c750a49db1c.slice/crio-27d0478b1fa50de916041015f8a70235524ad5ff7cd4654a5d72762063f5c39f WatchSource:0}: Error finding container 27d0478b1fa50de916041015f8a70235524ad5ff7cd4654a5d72762063f5c39f: Status 404 returned error can't find the container with id 27d0478b1fa50de916041015f8a70235524ad5ff7cd4654a5d72762063f5c39f Oct 31 00:29:01.604096 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.604065 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ch4wj" Oct 31 00:29:01.608633 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.608414 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:01.617192 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:29:01.616835 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c5e8eb_fd22_42ee_a203_7c3077f48084.slice/crio-9179eca04f12367813068df1b2967a42644a337501de4361c09f8c76339c0d04 WatchSource:0}: Error finding container 9179eca04f12367813068df1b2967a42644a337501de4361c09f8c76339c0d04: Status 404 returned error can't find the container with id 9179eca04f12367813068df1b2967a42644a337501de4361c09f8c76339c0d04 Oct 31 00:29:01.624287 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.624111 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5nw7t" Oct 31 00:29:01.624590 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:29:01.624561 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a2cb6c_83e1_41e4_a2a8_11ec1a00b4c3.slice/crio-e4199e3568a18e2466f585dcb837ed13581f40db130f2aefdf14ce9f04eeb4bb WatchSource:0}: Error finding container e4199e3568a18e2466f585dcb837ed13581f40db130f2aefdf14ce9f04eeb4bb: Status 404 returned error can't find the container with id e4199e3568a18e2466f585dcb837ed13581f40db130f2aefdf14ce9f04eeb4bb Oct 31 00:29:01.631640 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.631452 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:29:01.635543 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:29:01.635491 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4defb35_52f2_46fc_a314_affe5a217a84.slice/crio-95d6391c36609eb5973f7d0d4104a7818b2ce219be6a653170cf2027d252310b WatchSource:0}: Error finding container 95d6391c36609eb5973f7d0d4104a7818b2ce219be6a653170cf2027d252310b: Status 404 returned error can't find the container with id 95d6391c36609eb5973f7d0d4104a7818b2ce219be6a653170cf2027d252310b Oct 31 00:29:01.641712 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:29:01.641608 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87931c70_7b7c_4910_89ce_f84136d7a852.slice/crio-ca9e27fce2156c2dc5929bcd4fbd1b84f6124e2126f0b1e825dd3a44dd3dee92 WatchSource:0}: Error finding container ca9e27fce2156c2dc5929bcd4fbd1b84f6124e2126f0b1e825dd3a44dd3dee92: Status 404 returned error can't find the container with id ca9e27fce2156c2dc5929bcd4fbd1b84f6124e2126f0b1e825dd3a44dd3dee92 Oct 31 00:29:01.859019 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.858925 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs\") pod \"network-metrics-daemon-bl5rh\" (UID: \"1720ac40-f3e0-44e3-b2f2-06db389fb9b7\") " pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:01.859189 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:01.859089 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:01.859189 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:01.859156 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs podName:1720ac40-f3e0-44e3-b2f2-06db389fb9b7 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:02.859140956 +0000 UTC m=+4.054053626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs") pod "network-metrics-daemon-bl5rh" (UID: "1720ac40-f3e0-44e3-b2f2-06db389fb9b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:01.959911 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:01.959269 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:01.959911 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:01.959509 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:01.959911 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:01.959570 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret podName:3b3c9cfb-2fd5-4a88-a938-77f38dd28969 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:02.959554056 +0000 UTC m=+4.154466729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret") pod "global-pull-secret-syncer-6rt5w" (UID: "3b3c9cfb-2fd5-4a88-a938-77f38dd28969") : object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:02.060220 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:02.060169 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b47dq\" (UniqueName: \"kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq\") pod \"network-check-target-hnzfm\" (UID: \"4d754c0a-9f48-439b-8673-6ba91b6408ff\") " pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:02.060399 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:02.060371 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 00:29:02.060399 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:02.060395 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 00:29:02.060529 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:02.060411 2574 projected.go:196] Error preparing data for projected volume kube-api-access-b47dq for pod openshift-network-diagnostics/network-check-target-hnzfm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:02.060529 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:02.060493 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq podName:4d754c0a-9f48-439b-8673-6ba91b6408ff nodeName:}" failed. No retries permitted until 2026-10-31 00:29:03.060476162 +0000 UTC m=+4.255388841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b47dq" (UniqueName: "kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq") pod "network-check-target-hnzfm" (UID: "4d754c0a-9f48-439b-8673-6ba91b6408ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:02.286129 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:02.285957 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 00:24:01 +0000 UTC" deadline="2028-06-28 10:49:10.185130492 +0000 UTC" Oct 31 00:29:02.286129 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:02.286023 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14554h20m7.899111707s" Oct 31 00:29:02.335822 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:02.335703 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsxkm" event={"ID":"87931c70-7b7c-4910-89ce-f84136d7a852","Type":"ContainerStarted","Data":"ca9e27fce2156c2dc5929bcd4fbd1b84f6124e2126f0b1e825dd3a44dd3dee92"} Oct 31 00:29:02.346595 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:02.346553 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5nw7t" event={"ID":"a4defb35-52f2-46fc-a314-affe5a217a84","Type":"ContainerStarted","Data":"95d6391c36609eb5973f7d0d4104a7818b2ce219be6a653170cf2027d252310b"} Oct 31 00:29:02.359364 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:02.359325 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ch4wj" event={"ID":"c3c5e8eb-fd22-42ee-a203-7c3077f48084","Type":"ContainerStarted","Data":"9179eca04f12367813068df1b2967a42644a337501de4361c09f8c76339c0d04"} Oct 31 00:29:02.367754 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:02.367658 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g7phc" event={"ID":"a1b304f2-676a-4a6f-bdac-8805188c415f","Type":"ContainerStarted","Data":"f2fbc74ff263f96e2afe196affb0ca7bbf793a53d8fd1202b97d80d72fe8d33c"} Oct 31 00:29:02.384672 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:02.384556 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" event={"ID":"a2ba2a3b-57ee-4515-a194-cb86198d246b","Type":"ContainerStarted","Data":"2f812f411c8a0981f16f3bdb1950ba4c4813e7e1ae5ac75cfdfdd5bb748bfb22"} Oct 31 00:29:02.389754 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:02.389715 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h2bhb" event={"ID":"db01ba46-985b-4967-a668-73e1eb99189b","Type":"ContainerStarted","Data":"105f81a407ed8ae4dcf3b52f848d31c53b4d44302ec7509c825a6cadf6b8e392"} Oct 31 00:29:02.397483 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:02.397318 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" event={"ID":"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3","Type":"ContainerStarted","Data":"e4199e3568a18e2466f585dcb837ed13581f40db130f2aefdf14ce9f04eeb4bb"} Oct 31 00:29:02.405199 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:02.405123 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-csst9" event={"ID":"447b2177-70e2-46dd-a082-6c750a49db1c","Type":"ContainerStarted","Data":"27d0478b1fa50de916041015f8a70235524ad5ff7cd4654a5d72762063f5c39f"} Oct 31 00:29:02.412132 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:02.412054 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-csk4z" event={"ID":"e3af97b1-99a9-4fab-97b4-ac62b870de03","Type":"ContainerStarted","Data":"e0ac25b6b8cddc86816b0d94c71cff163eee470b42bc94d08d7a0d7a770fbfea"} Oct 31 00:29:02.869318 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:02.868601 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs\") pod \"network-metrics-daemon-bl5rh\" (UID: \"1720ac40-f3e0-44e3-b2f2-06db389fb9b7\") " pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:02.869318 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:02.868762 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:02.869318 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:02.868829 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs podName:1720ac40-f3e0-44e3-b2f2-06db389fb9b7 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:04.868810485 +0000 UTC m=+6.063723160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs") pod "network-metrics-daemon-bl5rh" (UID: "1720ac40-f3e0-44e3-b2f2-06db389fb9b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:02.969932 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:02.969147 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:02.969932 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:02.969351 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:02.969932 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:02.969418 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret podName:3b3c9cfb-2fd5-4a88-a938-77f38dd28969 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:04.969397204 +0000 UTC m=+6.164309879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret") pod "global-pull-secret-syncer-6rt5w" (UID: "3b3c9cfb-2fd5-4a88-a938-77f38dd28969") : object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:03.070525 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:03.069770 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b47dq\" (UniqueName: \"kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq\") pod \"network-check-target-hnzfm\" (UID: \"4d754c0a-9f48-439b-8673-6ba91b6408ff\") " pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:03.070525 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:03.070011 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 00:29:03.070525 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:03.070034 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 00:29:03.070525 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:03.070048 2574 projected.go:196] Error preparing data for projected volume kube-api-access-b47dq for pod openshift-network-diagnostics/network-check-target-hnzfm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:03.070525 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:03.070112 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq podName:4d754c0a-9f48-439b-8673-6ba91b6408ff nodeName:}" failed. No retries permitted until 2026-10-31 00:29:05.070092679 +0000 UTC m=+6.265005340 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b47dq" (UniqueName: "kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq") pod "network-check-target-hnzfm" (UID: "4d754c0a-9f48-439b-8673-6ba91b6408ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:03.287323 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:03.287193 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 00:24:01 +0000 UTC" deadline="2028-05-31 00:28:08.507821369 +0000 UTC" Oct 31 00:29:03.287323 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:03.287240 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13871h59m5.220586849s" Oct 31 00:29:03.314510 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:03.314463 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:03.314748 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:03.314632 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:03.315165 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:03.315110 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:03.315396 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:03.315221 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:03.315396 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:03.315291 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:03.315637 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:03.315400 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzfm" podUID="4d754c0a-9f48-439b-8673-6ba91b6408ff" Oct 31 00:29:03.435031 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:03.434990 2574 generic.go:356] "Generic (PLEG): container finished" podID="a5bf9502ef5bfb3cbf20de88306bbc22" containerID="da2b4a203f237bd1a0519397b56804930c980774c9cbbf01a98b6b572b7a7065" exitCode=0 Oct 31 00:29:03.435201 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:03.435156 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" event={"ID":"a5bf9502ef5bfb3cbf20de88306bbc22","Type":"ContainerDied","Data":"da2b4a203f237bd1a0519397b56804930c980774c9cbbf01a98b6b572b7a7065"} Oct 31 00:29:03.452872 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:03.452829 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal" event={"ID":"e99a684e1e1866230a776f45fdda194d","Type":"ContainerStarted","Data":"22864bcb875f5fbd90f9d2180ec1e6598b1d9ed7b74a94318e5b6a05878296f3"} Oct 31 00:29:04.499399 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:04.494557 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" event={"ID":"a5bf9502ef5bfb3cbf20de88306bbc22","Type":"ContainerStarted","Data":"3613a151416ed84b556defc289c5829c5a424700d7ac32ffa06bf126398c5491"} Oct 31 00:29:04.518441 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:04.518359 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal" podStartSLOduration=3.518337144 podStartE2EDuration="3.518337144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:29:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:03.469404477 +0000 UTC m=+4.664317156" watchObservedRunningTime="2026-10-31 00:29:04.518337144 +0000 UTC m=+5.713249828" Oct 31 00:29:04.888405 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:04.887645 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs\") pod \"network-metrics-daemon-bl5rh\" (UID: \"1720ac40-f3e0-44e3-b2f2-06db389fb9b7\") " pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:04.888405 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:04.887925 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:04.888405 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:04.887995 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs podName:1720ac40-f3e0-44e3-b2f2-06db389fb9b7 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:08.887972029 +0000 UTC m=+10.082884704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs") pod "network-metrics-daemon-bl5rh" (UID: "1720ac40-f3e0-44e3-b2f2-06db389fb9b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:04.989013 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:04.988972 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:04.989174 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:04.989155 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:04.989246 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:04.989233 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret podName:3b3c9cfb-2fd5-4a88-a938-77f38dd28969 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:08.989213873 +0000 UTC m=+10.184126554 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret") pod "global-pull-secret-syncer-6rt5w" (UID: "3b3c9cfb-2fd5-4a88-a938-77f38dd28969") : object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:05.090653 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:05.089902 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b47dq\" (UniqueName: \"kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq\") pod \"network-check-target-hnzfm\" (UID: \"4d754c0a-9f48-439b-8673-6ba91b6408ff\") " pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:05.090653 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:05.090084 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 00:29:05.090653 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:05.090108 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 00:29:05.090653 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:05.090124 2574 projected.go:196] Error preparing data for projected volume kube-api-access-b47dq for pod openshift-network-diagnostics/network-check-target-hnzfm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:05.090653 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:05.090191 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq podName:4d754c0a-9f48-439b-8673-6ba91b6408ff nodeName:}" failed. No retries permitted until 2026-10-31 00:29:09.090171116 +0000 UTC m=+10.285083794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b47dq" (UniqueName: "kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq") pod "network-check-target-hnzfm" (UID: "4d754c0a-9f48-439b-8673-6ba91b6408ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:05.315241 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:05.314296 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:05.315241 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:05.314464 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:05.315241 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:05.314913 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:05.315241 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:05.315030 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:05.315241 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:05.315095 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:05.315241 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:05.315177 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzfm" podUID="4d754c0a-9f48-439b-8673-6ba91b6408ff" Oct 31 00:29:05.503874 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:05.503373 2574 generic.go:356] "Generic (PLEG): container finished" podID="87931c70-7b7c-4910-89ce-f84136d7a852" containerID="cede29c40dcb0eb381767fee61e5b790ab9d946e76e6bcef85362ed281bde163" exitCode=0 Oct 31 00:29:05.503874 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:05.503571 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsxkm" event={"ID":"87931c70-7b7c-4910-89ce-f84136d7a852","Type":"ContainerDied","Data":"cede29c40dcb0eb381767fee61e5b790ab9d946e76e6bcef85362ed281bde163"} Oct 31 00:29:05.528538 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:05.528309 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" podStartSLOduration=4.528283886 podStartE2EDuration="4.528283886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:29:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:04.519263877 +0000 UTC m=+5.714176561" watchObservedRunningTime="2026-10-31 00:29:05.528283886 +0000 UTC m=+6.723196570" Oct 31 00:29:07.312454 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:07.311909 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:07.312454 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:07.311932 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:07.312454 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:07.312077 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:07.312454 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:07.312141 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:07.312454 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:07.312240 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzfm" podUID="4d754c0a-9f48-439b-8673-6ba91b6408ff" Oct 31 00:29:07.312454 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:07.312344 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:07.515786 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:07.515019 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5nw7t" event={"ID":"a4defb35-52f2-46fc-a314-affe5a217a84","Type":"ContainerStarted","Data":"bb403ad5c0b4e256449ffa98f1c2a13bf07f2108a88cbea1568488a1344fe8ee"} Oct 31 00:29:07.520984 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:07.520440 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ch4wj" event={"ID":"c3c5e8eb-fd22-42ee-a203-7c3077f48084","Type":"ContainerStarted","Data":"5638683e562d75b2c3840f4529b2abedcb901194c9d49fbdcba522444dc9a709"} Oct 31 00:29:07.546281 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:07.545177 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5nw7t" podStartSLOduration=1.945582785 podStartE2EDuration="7.545157391s" totalImagesPullingTime="5.599574606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:07.530798242 +0000 UTC m=+8.725710922" watchObservedRunningTime="2026-10-31 00:29:07.545157391 +0000 UTC m=+8.740070071" Oct 31 00:29:08.399731 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:08.399682 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ch4wj" Oct 31 00:29:08.526241 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:08.526007 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" event={"ID":"a2ba2a3b-57ee-4515-a194-cb86198d246b","Type":"ContainerStarted","Data":"ab0d157269a92ae27c395865533e8c50abcc1a5e43dc0c034b253ac43832597d"} Oct 31 00:29:08.922842 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:08.922170 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs\") pod \"network-metrics-daemon-bl5rh\" (UID: \"1720ac40-f3e0-44e3-b2f2-06db389fb9b7\") " pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:08.922842 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:08.922365 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:08.922842 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:08.922448 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs podName:1720ac40-f3e0-44e3-b2f2-06db389fb9b7 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:16.922411333 +0000 UTC m=+18.117324013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs") pod "network-metrics-daemon-bl5rh" (UID: "1720ac40-f3e0-44e3-b2f2-06db389fb9b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:09.023302 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:09.023230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:09.023497 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:09.023478 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:09.023646 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:09.023617 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret podName:3b3c9cfb-2fd5-4a88-a938-77f38dd28969 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:17.023597899 +0000 UTC m=+18.218510574 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret") pod "global-pull-secret-syncer-6rt5w" (UID: "3b3c9cfb-2fd5-4a88-a938-77f38dd28969") : object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:09.124602 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:09.124569 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b47dq\" (UniqueName: \"kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq\") pod \"network-check-target-hnzfm\" (UID: \"4d754c0a-9f48-439b-8673-6ba91b6408ff\") " pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:09.124767 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:09.124741 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 00:29:09.124767 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:09.124763 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 00:29:09.124887 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:09.124777 2574 projected.go:196] Error preparing data for projected volume kube-api-access-b47dq for pod openshift-network-diagnostics/network-check-target-hnzfm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:09.124887 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:09.124834 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq podName:4d754c0a-9f48-439b-8673-6ba91b6408ff nodeName:}" failed. No retries permitted until 2026-10-31 00:29:17.124815337 +0000 UTC m=+18.319728000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b47dq" (UniqueName: "kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq") pod "network-check-target-hnzfm" (UID: "4d754c0a-9f48-439b-8673-6ba91b6408ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:09.228266 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:09.228237 2574 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 31 00:29:09.309634 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:09.309552 2574 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T00:29:09.228263086Z","UUID":"821f641c-d3b4-4828-9c21-2590b8f790ee","Handler":null,"Name":"","Endpoint":""} Oct 31 00:29:09.313229 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:09.313202 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:09.313371 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:09.313323 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzfm" podUID="4d754c0a-9f48-439b-8673-6ba91b6408ff" Oct 31 00:29:09.313736 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:09.313717 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:09.313852 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:09.313797 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:09.313924 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:09.313881 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:09.313978 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:09.313949 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:09.314090 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:09.314071 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 31 00:29:09.314144 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:09.314100 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 31 00:29:09.535804 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:09.535729 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" event={"ID":"a2ba2a3b-57ee-4515-a194-cb86198d246b","Type":"ContainerStarted","Data":"fddf0019b7f3705de952366153bbaaf4b50605260885c09f573699c6dfbd5a1b"} Oct 31 00:29:10.106080 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:10.106039 2574 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ch4wj" Oct 31 00:29:10.106845 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:10.106826 2574 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ch4wj" Oct 31 00:29:10.121412 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:10.121351 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ch4wj" podStartSLOduration=6.4412637759999996 podStartE2EDuration="11.121339105s" totalImagesPullingTime="4.680075329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:07.546155992 +0000 UTC m=+8.741068672" watchObservedRunningTime="2026-10-31 00:29:10.121339105 +0000 UTC m=+11.316251795" Oct 31 00:29:10.541486 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:10.541224 2574 generic.go:356] "Generic (PLEG): container finished" podID="87931c70-7b7c-4910-89ce-f84136d7a852" containerID="b4c725bc8e2052608f6fc3ddd5cf3c1b62cd888f1580da1bbed1e77997c4fe0f" exitCode=0 Oct 31 00:29:10.541935 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:10.541310 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsxkm" event={"ID":"87931c70-7b7c-4910-89ce-f84136d7a852","Type":"ContainerDied","Data":"b4c725bc8e2052608f6fc3ddd5cf3c1b62cd888f1580da1bbed1e77997c4fe0f"} Oct 31 00:29:10.543843 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:10.543818 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g7phc" event={"ID":"a1b304f2-676a-4a6f-bdac-8805188c415f","Type":"ContainerStarted","Data":"67d9d7b0df02adddff27094e6a957e3d415c7ffd3020fba43fa36a30087ebd6c"} Oct 31 00:29:10.546162 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:10.546056 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h2bhb" event={"ID":"db01ba46-985b-4967-a668-73e1eb99189b","Type":"ContainerStarted","Data":"ea4880581868ca89a4170354163ba8e89d3f799b8c3e9476c44a00d270b47c4c"} Oct 31 00:29:10.546947 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:10.546920 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ch4wj" Oct 31 00:29:10.588521 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:10.588480 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-g7phc" podStartSLOduration=2.925145685 podStartE2EDuration="11.588467303s" totalImagesPullingTime="8.663321618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:10.588187374 +0000 UTC m=+11.783100053" watchObservedRunningTime="2026-10-31 00:29:10.588467303 +0000 UTC m=+11.783379982" Oct 31 00:29:10.604543 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:10.604491 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-h2bhb" podStartSLOduration=3.584575761 podStartE2EDuration="11.604409488s" totalImagesPullingTime="8.019833727s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:10.603764749 +0000 UTC m=+11.798677431" watchObservedRunningTime="2026-10-31 00:29:10.604409488 +0000 UTC m=+11.799322168" Oct 31 00:29:11.312581 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:11.312545 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:11.312745 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:11.312674 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:11.313005 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:11.312986 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:11.313105 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:11.313087 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzfm" podUID="4d754c0a-9f48-439b-8673-6ba91b6408ff" Oct 31 00:29:11.313168 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:11.313148 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:11.313267 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:11.313234 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:11.550872 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:11.550833 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" event={"ID":"a2ba2a3b-57ee-4515-a194-cb86198d246b","Type":"ContainerStarted","Data":"0836b95898c99539e211f8cdae31a1b2b65df6c5d3500298193d99657012c953"} Oct 31 00:29:11.568062 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:11.568005 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" podStartSLOduration=4.109136074 podStartE2EDuration="12.567986662s" totalImagesPullingTime="8.458850588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:28:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:11.567956458 +0000 UTC m=+12.762869136" watchObservedRunningTime="2026-10-31 00:29:11.567986662 +0000 UTC m=+12.762899343" Oct 31 00:29:12.554244 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:12.554202 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-csst9" event={"ID":"447b2177-70e2-46dd-a082-6c750a49db1c","Type":"ContainerStarted","Data":"ebc95d387e93e8a04d31f2595fe5dbe35ce1e2b07d2bad83dc455d2628fc46e2"} Oct 31 00:29:12.556048 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:12.556012 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-csk4z" event={"ID":"e3af97b1-99a9-4fab-97b4-ac62b870de03","Type":"ContainerStarted","Data":"8cdd5c17b83a9e9942a7fb96d33a5b96ebc36d500848694962b9682bd8bd8d9a"} Oct 31 00:29:12.558264 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:12.558235 2574 generic.go:356] "Generic (PLEG): container finished" podID="87931c70-7b7c-4910-89ce-f84136d7a852" containerID="b436188e93a8296435430ad5d8ea351fdfeaaa7679be6597b1b11523de2806b0" exitCode=0 Oct 31 00:29:12.558371 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:12.558323 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsxkm" event={"ID":"87931c70-7b7c-4910-89ce-f84136d7a852","Type":"ContainerDied","Data":"b436188e93a8296435430ad5d8ea351fdfeaaa7679be6597b1b11523de2806b0"} Oct 31 00:29:12.571392 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:12.571343 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-csst9" podStartSLOduration=2.758611099 podStartE2EDuration="13.571329289s" totalImagesPullingTime="10.81271819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:12.571090663 +0000 UTC m=+13.766003341" watchObservedRunningTime="2026-10-31 00:29:12.571329289 +0000 UTC m=+13.766241967" Oct 31 00:29:12.585481 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:12.585408 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-csk4z" podStartSLOduration=5.077283782 podStartE2EDuration="13.585395559s" totalImagesPullingTime="8.508111777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:12.585024039 +0000 UTC m=+13.779936718" watchObservedRunningTime="2026-10-31 00:29:12.585395559 +0000 UTC m=+13.780308233" Oct 31 00:29:13.312114 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:13.312078 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:13.312114 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:13.312098 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:13.312368 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:13.312207 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:13.312368 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:13.312257 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:13.312368 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:13.312352 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzfm" podUID="4d754c0a-9f48-439b-8673-6ba91b6408ff" Oct 31 00:29:13.312543 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:13.312408 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:14.565497 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:14.565242 2574 generic.go:356] "Generic (PLEG): container finished" podID="87931c70-7b7c-4910-89ce-f84136d7a852" containerID="321f52b11f70c28c18391db7adddd7a333a4f89ab5cef80bb5dd68057ce90830" exitCode=0 Oct 31 00:29:14.565497 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:14.565447 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsxkm" event={"ID":"87931c70-7b7c-4910-89ce-f84136d7a852","Type":"ContainerDied","Data":"321f52b11f70c28c18391db7adddd7a333a4f89ab5cef80bb5dd68057ce90830"} Oct 31 00:29:15.281972 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:15.281928 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:15.311748 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:15.311712 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:15.311748 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:15.311740 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:15.311748 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:15.311756 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:15.311993 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:15.311863 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzfm" podUID="4d754c0a-9f48-439b-8673-6ba91b6408ff" Oct 31 00:29:15.312279 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:15.312246 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:15.312371 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:15.312335 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:15.508842 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:15.508774 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:16.870789 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:16.870559 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:16.986356 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:16.986323 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs\") pod \"network-metrics-daemon-bl5rh\" (UID: \"1720ac40-f3e0-44e3-b2f2-06db389fb9b7\") " pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:16.986560 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:16.986535 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:16.986635 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:16.986625 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs podName:1720ac40-f3e0-44e3-b2f2-06db389fb9b7 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:32.986602996 +0000 UTC m=+34.181515673 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs") pod "network-metrics-daemon-bl5rh" (UID: "1720ac40-f3e0-44e3-b2f2-06db389fb9b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:17.087569 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:17.087481 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:17.087696 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:17.087621 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:17.087696 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:17.087679 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret podName:3b3c9cfb-2fd5-4a88-a938-77f38dd28969 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:33.087664051 +0000 UTC m=+34.282576732 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret") pod "global-pull-secret-syncer-6rt5w" (UID: "3b3c9cfb-2fd5-4a88-a938-77f38dd28969") : object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:17.187980 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:17.187937 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b47dq\" (UniqueName: \"kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq\") pod \"network-check-target-hnzfm\" (UID: \"4d754c0a-9f48-439b-8673-6ba91b6408ff\") " pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:17.188208 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:17.188103 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 00:29:17.188208 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:17.188123 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 00:29:17.188208 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:17.188134 2574 projected.go:196] Error preparing data for projected volume kube-api-access-b47dq for pod openshift-network-diagnostics/network-check-target-hnzfm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:17.188208 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:17.188196 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq podName:4d754c0a-9f48-439b-8673-6ba91b6408ff nodeName:}" failed. No retries permitted until 2026-10-31 00:29:33.188178863 +0000 UTC m=+34.383091534 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b47dq" (UniqueName: "kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq") pod "network-check-target-hnzfm" (UID: "4d754c0a-9f48-439b-8673-6ba91b6408ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:17.311863 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:17.311821 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:17.311863 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:17.311858 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:17.312070 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:17.311821 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:17.312070 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:17.311939 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:17.312070 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:17.312018 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:17.312175 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:17.312077 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzfm" podUID="4d754c0a-9f48-439b-8673-6ba91b6408ff" Oct 31 00:29:17.575679 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:17.575650 2574 generic.go:356] "Generic (PLEG): container finished" podID="87931c70-7b7c-4910-89ce-f84136d7a852" containerID="74b59817a92e916c94770d829aac1df807ede77aa24563ebeb73f8c509e50806" exitCode=0 Oct 31 00:29:17.575855 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:17.575738 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsxkm" event={"ID":"87931c70-7b7c-4910-89ce-f84136d7a852","Type":"ContainerDied","Data":"74b59817a92e916c94770d829aac1df807ede77aa24563ebeb73f8c509e50806"} Oct 31 00:29:17.578838 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:17.578821 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9vvz_c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/ovn-acl-logging/0.log" Oct 31 00:29:17.579207 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:17.579186 2574 generic.go:356] "Generic (PLEG): container finished" podID="c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3" containerID="d3e40fce623e9ecd45ea44fe4efafdec09044e0c7b4515dc55ed45fb31b082e8" exitCode=1 Oct 31 00:29:17.579288 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:17.579225 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" event={"ID":"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3","Type":"ContainerStarted","Data":"72841c03b669eb11fa15e4aa07bcf2865c4c8d4ca11fd5f2b0a1d67502e63f1b"} Oct 31 00:29:17.579288 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:17.579281 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" event={"ID":"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3","Type":"ContainerStarted","Data":"b169dc48acd6cc397d099f5c4c567070982fc777f6ba1f6d4baac7e5c33ce6b7"} Oct 31 00:29:17.579361 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:17.579312 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" event={"ID":"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3","Type":"ContainerStarted","Data":"27def1654e0feb503b5d6f0db28e14a8d6fd0a88df9e1efb4b3a48c85f6d111f"} Oct 31 00:29:17.579361 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:17.579338 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" event={"ID":"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3","Type":"ContainerStarted","Data":"e4e0381bf5fa2bd4f591b1bacd59233fb91ae652fbf44afac84545cf40e78d61"} Oct 31 00:29:17.579437 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:17.579364 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" event={"ID":"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3","Type":"ContainerDied","Data":"d3e40fce623e9ecd45ea44fe4efafdec09044e0c7b4515dc55ed45fb31b082e8"} Oct 31 00:29:17.579437 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:17.579390 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" event={"ID":"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3","Type":"ContainerStarted","Data":"1b2dae4a2ed294cd597deaa5a24287be3a50adc7def7233a8788be4eac8b2d29"} Oct 31 00:29:18.234947 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:18.234906 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:18.404560 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:18.404517 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:18.584472 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:18.584407 2574 generic.go:356] "Generic (PLEG): container finished" podID="87931c70-7b7c-4910-89ce-f84136d7a852" containerID="06de7caf076d2aa54833211cdf82f073b58b5a2817cf41382d1b187dbd1c58e4" exitCode=0 Oct 31 00:29:18.584616 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:18.584497 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsxkm" event={"ID":"87931c70-7b7c-4910-89ce-f84136d7a852","Type":"ContainerDied","Data":"06de7caf076d2aa54833211cdf82f073b58b5a2817cf41382d1b187dbd1c58e4"} Oct 31 00:29:18.785156 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:18.785129 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:18.958581 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:18.958504 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:19.312342 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:19.312314 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:19.312852 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:19.312493 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:19.312852 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:19.312566 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:19.312852 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:19.312516 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:19.312852 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:19.312636 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:19.312852 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:19.312701 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzfm" podUID="4d754c0a-9f48-439b-8673-6ba91b6408ff" Oct 31 00:29:19.591843 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:19.591767 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9vvz_c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/ovn-acl-logging/0.log" Oct 31 00:29:19.592174 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:19.592148 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" event={"ID":"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3","Type":"ContainerStarted","Data":"6fcaec8a90646fead18f3cb9e01203c5386490ff10d5552a9d0ad3892abe1c95"} Oct 31 00:29:19.595205 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:19.595175 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsxkm" event={"ID":"87931c70-7b7c-4910-89ce-f84136d7a852","Type":"ContainerStarted","Data":"883613c1767f9da0799da6afa8c3228e5889449702d877657e85eb9d23fa8905"} Oct 31 00:29:19.616138 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:19.616084 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qsxkm" podStartSLOduration=7.573343405 podStartE2EDuration="19.616071848s" totalImagesPullingTime="12.042728443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:29:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:19.615803632 +0000 UTC m=+20.810716323" watchObservedRunningTime="2026-10-31 00:29:19.616071848 +0000 UTC m=+20.810984524" Oct 31 00:29:21.312027 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:21.311991 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:21.312782 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:21.312047 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:21.312782 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:21.312046 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:21.312782 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:21.312126 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzfm" podUID="4d754c0a-9f48-439b-8673-6ba91b6408ff" Oct 31 00:29:21.312782 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:21.312179 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:21.312782 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:21.312278 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:21.421970 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:21.421712 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:21.593734 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:21.593701 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:21.601574 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:21.601544 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9vvz_c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/ovn-acl-logging/0.log" Oct 31 00:29:21.601874 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:21.601853 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" event={"ID":"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3","Type":"ContainerStarted","Data":"f6d4ec01d86a3f58fdc0aadebc33e726c1ac1599428999c0e7310fa6cda2cdcb"} Oct 31 00:29:21.602133 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:21.602105 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:21.602198 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:21.602188 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:21.602263 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:21.602248 2574 scope.go:122] "RemoveContainer" containerID="d3e40fce623e9ecd45ea44fe4efafdec09044e0c7b4515dc55ed45fb31b082e8" Oct 31 00:29:21.619007 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:21.618984 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:21.845515 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:21.845482 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:22.322075 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:22.322036 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:22.497245 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:22.497216 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:22.608444 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:22.608355 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9vvz_c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/ovn-acl-logging/0.log" Oct 31 00:29:22.608761 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:22.608737 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" event={"ID":"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3","Type":"ContainerStarted","Data":"4ef9181f7192a484d80b8b778dd1a177a5f9415980323b4bdf23906d5045abdf"} Oct 31 00:29:22.609088 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:22.609071 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:22.627073 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:22.627046 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:22.635782 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:22.635734 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" podStartSLOduration=8.715171032 podStartE2EDuration="23.635716731s" totalImagesPullingTime="14.920545699s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:22.634443991 +0000 UTC m=+23.829356673" watchObservedRunningTime="2026-10-31 00:29:22.635716731 +0000 UTC m=+23.830629412" Oct 31 00:29:22.973044 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:22.972973 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hnzfm"] Oct 31 00:29:22.973199 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:22.973101 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:22.973246 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:22.973213 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzfm" podUID="4d754c0a-9f48-439b-8673-6ba91b6408ff" Oct 31 00:29:22.977173 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:22.977149 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6rt5w"] Oct 31 00:29:22.977302 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:22.977266 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:22.977394 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:22.977376 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:22.977670 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:22.977642 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bl5rh"] Oct 31 00:29:22.977750 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:22.977737 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:22.977834 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:22.977820 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:23.602818 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:23.602778 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:24.036597 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:24.036565 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:24.219085 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:24.219054 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:24.312160 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:24.312078 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:24.312310 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:24.312196 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:24.312310 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:24.312259 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:24.312377 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:24.312358 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:24.426352 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:24.426321 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:24.605377 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:24.605305 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:24.628310 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:24.628279 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g7phc_a1b304f2-676a-4a6f-bdac-8805188c415f/dns-node-resolver/0.log" Oct 31 00:29:24.786370 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:24.786334 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:24.960670 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:24.960584 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:25.312022 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:25.311976 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:25.312195 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:25.312093 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzfm" podUID="4d754c0a-9f48-439b-8673-6ba91b6408ff" Oct 31 00:29:25.627784 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:25.627761 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5nw7t_a4defb35-52f2-46fc-a314-affe5a217a84/node-ca/0.log" Oct 31 00:29:25.680720 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:25.680692 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:25.873981 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:25.873930 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:26.049672 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:26.049641 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:26.227714 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:26.227608 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:26.311897 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:26.311871 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:26.311897 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:26.311896 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:26.312067 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:26.311967 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:26.312067 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:26.312028 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:26.403879 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:26.403853 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:26.574558 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:26.574531 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:26.996025 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:26.995957 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:27.311698 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:27.311669 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:27.311868 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:27.311774 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzfm" podUID="4d754c0a-9f48-439b-8673-6ba91b6408ff" Oct 31 00:29:27.670302 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:27.670227 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:27.882278 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:27.882249 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:28.075920 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:28.075875 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:28.276236 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:28.276195 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:28.312289 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:28.312262 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:28.312454 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:28.312298 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:28.312550 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:28.312532 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:28.312684 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:28.312662 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:28.509201 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:28.509126 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:28.694189 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:28.694156 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:28.869271 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:28.869242 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:29.041999 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:29.041970 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:29.215488 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:29.215412 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:29.312905 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:29.312868 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:29.313074 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:29.312969 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzfm" podUID="4d754c0a-9f48-439b-8673-6ba91b6408ff" Oct 31 00:29:29.388108 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:29.387943 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:29.565899 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:29.565871 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:29.740480 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:29.740448 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:29.928941 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:29.928872 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:30.107222 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:30.107196 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:30.277425 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:30.277400 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:30.311590 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:30.311563 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:30.311712 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:30.311667 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:30.311712 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:30.311693 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:30.311817 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:30.311742 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:30.473844 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:30.473817 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:30.663749 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:30.663675 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:30.836834 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:30.836801 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:31.311561 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:31.311536 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:31.311934 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:31.311637 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzfm" podUID="4d754c0a-9f48-439b-8673-6ba91b6408ff" Oct 31 00:29:31.414193 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:31.414164 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:31.604990 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:31.604897 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:31.775810 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:31.775766 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:31.943106 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:31.942980 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:32.116063 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:32.116030 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:32.291855 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:32.291799 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:32.311970 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:32.311936 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:32.311970 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:32.311967 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:32.312390 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:32.312051 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:32.312390 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:32.312188 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:32.477144 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:32.477080 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:32.998815 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:32.998723 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs\") pod \"network-metrics-daemon-bl5rh\" (UID: \"1720ac40-f3e0-44e3-b2f2-06db389fb9b7\") " pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:32.998967 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:32.998893 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:32.999019 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:32.998973 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs podName:1720ac40-f3e0-44e3-b2f2-06db389fb9b7 nodeName:}" failed. No retries permitted until 2026-10-31 00:30:04.998952708 +0000 UTC m=+66.193865382 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs") pod "network-metrics-daemon-bl5rh" (UID: "1720ac40-f3e0-44e3-b2f2-06db389fb9b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:29:33.099942 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:33.099902 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:33.100107 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:33.100076 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:33.100158 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:33.100148 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret podName:3b3c9cfb-2fd5-4a88-a938-77f38dd28969 nodeName:}" failed. No retries permitted until 2026-10-31 00:30:05.100128599 +0000 UTC m=+66.295041274 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret") pod "global-pull-secret-syncer-6rt5w" (UID: "3b3c9cfb-2fd5-4a88-a938-77f38dd28969") : object "kube-system"/"original-pull-secret" not registered Oct 31 00:29:33.201203 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:33.201171 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b47dq\" (UniqueName: \"kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq\") pod \"network-check-target-hnzfm\" (UID: \"4d754c0a-9f48-439b-8673-6ba91b6408ff\") " pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:33.201322 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:33.201305 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 00:29:33.201322 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:33.201319 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 00:29:33.201393 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:33.201328 2574 projected.go:196] Error preparing data for projected volume kube-api-access-b47dq for pod openshift-network-diagnostics/network-check-target-hnzfm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:33.201393 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:33.201376 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq podName:4d754c0a-9f48-439b-8673-6ba91b6408ff nodeName:}" failed. No retries permitted until 2026-10-31 00:30:05.201364417 +0000 UTC m=+66.396277075 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b47dq" (UniqueName: "kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq") pod "network-check-target-hnzfm" (UID: "4d754c0a-9f48-439b-8673-6ba91b6408ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:29:33.312301 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:33.312265 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:33.312692 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:33.312378 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzfm" podUID="4d754c0a-9f48-439b-8673-6ba91b6408ff" Oct 31 00:29:33.679592 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:33.679485 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:33.879684 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:33.879640 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:34.064524 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:34.064479 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:34.245906 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:34.245877 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:34.312078 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:34.312037 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:34.312273 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:34.312086 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:34.312273 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:34.312177 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:34.312688 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:34.312279 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:34.435014 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:34.434934 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:34.606516 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:34.606483 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:35.078950 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:35.078923 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:35.267748 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:35.267714 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:35.311861 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:35.311835 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:35.311971 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:35.311934 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzfm" podUID="4d754c0a-9f48-439b-8673-6ba91b6408ff" Oct 31 00:29:36.311782 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:36.311754 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:36.311782 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:36.311785 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:36.312300 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:36.311857 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:36.312300 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:36.312013 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:37.311640 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:37.311606 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:37.311883 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:37.311739 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzfm" podUID="4d754c0a-9f48-439b-8673-6ba91b6408ff" Oct 31 00:29:38.311947 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:38.311911 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:38.311947 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:38.311940 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:38.312373 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:38.312016 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:38.312373 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:38.312130 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:39.314559 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:39.314526 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:39.315016 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:39.314648 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzfm" podUID="4d754c0a-9f48-439b-8673-6ba91b6408ff" Oct 31 00:29:40.311677 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:40.311624 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:40.311677 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:40.311675 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:40.311913 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:40.311755 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bl5rh" podUID="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" Oct 31 00:29:40.311913 ip-10-0-134-145 kubenswrapper[2574]: E1031 00:29:40.311861 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rt5w" podUID="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" Oct 31 00:29:41.001851 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.001804 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:41.093559 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.093534 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeReady" Oct 31 00:29:41.093708 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.093665 2574 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 31 00:29:41.196830 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.196806 2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7c822"] Oct 31 00:29:41.198427 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.198400 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7c822" Oct 31 00:29:41.210879 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.210857 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 31 00:29:41.211099 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.211082 2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-f8msd"] Oct 31 00:29:41.211619 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.211601 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 31 00:29:41.211827 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.211813 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-trzmz\"" Oct 31 00:29:41.212576 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.212563 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:29:41.214872 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.214852 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7c822"] Oct 31 00:29:41.240144 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.240089 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f8msd"] Oct 31 00:29:41.244827 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.244806 2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5f5p7"] Oct 31 00:29:41.246337 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.246321 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5f5p7" Oct 31 00:29:41.263280 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.263256 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5f5p7"] Oct 31 00:29:41.284327 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.284296 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:41.311483 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.311452 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:29:41.311927 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.311910 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 31 00:29:41.312022 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.311955 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 31 00:29:41.312496 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.312475 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 31 00:29:41.312598 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.312506 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 31 00:29:41.312662 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.312641 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 31 00:29:41.312759 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.312729 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 31 00:29:41.312759 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.312737 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 31 00:29:41.312861 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.312806 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pcfpx\"" Oct 31 00:29:41.312913 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.312890 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-zxj7m\"" Oct 31 00:29:41.318599 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.318578 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-xkpl6\"" Oct 31 00:29:41.356872 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.356842 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqnv9\" (UniqueName: \"kubernetes.io/projected/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-kube-api-access-cqnv9\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:29:41.356994 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.356896 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1df475be-e1fe-4e90-b60f-dc3763a66cc6-config-volume\") pod \"dns-default-7c822\" (UID: \"1df475be-e1fe-4e90-b60f-dc3763a66cc6\") " pod="openshift-dns/dns-default-7c822" Oct 31 00:29:41.356994 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.356960 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1df475be-e1fe-4e90-b60f-dc3763a66cc6-tmp-dir\") pod \"dns-default-7c822\" (UID: \"1df475be-e1fe-4e90-b60f-dc3763a66cc6\") " pod="openshift-dns/dns-default-7c822" Oct 31 00:29:41.356994 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.356975 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-data-volume\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:29:41.356994 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.356991 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1df475be-e1fe-4e90-b60f-dc3763a66cc6-metrics-tls\") pod \"dns-default-7c822\" (UID: \"1df475be-e1fe-4e90-b60f-dc3763a66cc6\") " pod="openshift-dns/dns-default-7c822" Oct 31 00:29:41.357157 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.357014 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-crio-socket\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:29:41.357157 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.357075 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcvrc\" (UniqueName: \"kubernetes.io/projected/1df475be-e1fe-4e90-b60f-dc3763a66cc6-kube-api-access-vcvrc\") pod \"dns-default-7c822\" (UID: \"1df475be-e1fe-4e90-b60f-dc3763a66cc6\") " pod="openshift-dns/dns-default-7c822" Oct 31 00:29:41.357218 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.357177 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1cf311b-c4ed-433e-a582-b4bcfcc402a9-cert\") pod \"ingress-canary-5f5p7\" (UID: \"b1cf311b-c4ed-433e-a582-b4bcfcc402a9\") " pod="openshift-ingress-canary/ingress-canary-5f5p7" Oct 31 00:29:41.357249 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.357217 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:29:41.357280 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.357252 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fv8r\" (UniqueName: \"kubernetes.io/projected/b1cf311b-c4ed-433e-a582-b4bcfcc402a9-kube-api-access-6fv8r\") pod \"ingress-canary-5f5p7\" (UID: \"b1cf311b-c4ed-433e-a582-b4bcfcc402a9\") " pod="openshift-ingress-canary/ingress-canary-5f5p7" Oct 31 00:29:41.357280 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.357268 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:29:41.410201 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.410172 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 31 00:29:41.410349 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.410335 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 31 00:29:41.458629 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.458593 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqnv9\" (UniqueName: \"kubernetes.io/projected/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-kube-api-access-cqnv9\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:29:41.458774 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.458645 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1df475be-e1fe-4e90-b60f-dc3763a66cc6-config-volume\") pod \"dns-default-7c822\" (UID: \"1df475be-e1fe-4e90-b60f-dc3763a66cc6\") " pod="openshift-dns/dns-default-7c822" Oct 31 00:29:41.458774 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.458661 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1df475be-e1fe-4e90-b60f-dc3763a66cc6-tmp-dir\") pod \"dns-default-7c822\" (UID: \"1df475be-e1fe-4e90-b60f-dc3763a66cc6\") " pod="openshift-dns/dns-default-7c822" Oct 31 00:29:41.458774 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.458680 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-data-volume\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:29:41.458774 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.458719 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1df475be-e1fe-4e90-b60f-dc3763a66cc6-metrics-tls\") pod \"dns-default-7c822\" (UID: \"1df475be-e1fe-4e90-b60f-dc3763a66cc6\") " pod="openshift-dns/dns-default-7c822" Oct 31 00:29:41.458774 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.458764 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-crio-socket\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:29:41.458982 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.458791 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcvrc\" (UniqueName: \"kubernetes.io/projected/1df475be-e1fe-4e90-b60f-dc3763a66cc6-kube-api-access-vcvrc\") pod \"dns-default-7c822\" (UID: \"1df475be-e1fe-4e90-b60f-dc3763a66cc6\") " pod="openshift-dns/dns-default-7c822" Oct 31 00:29:41.458982 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.458828 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1cf311b-c4ed-433e-a582-b4bcfcc402a9-cert\") pod \"ingress-canary-5f5p7\" (UID: \"b1cf311b-c4ed-433e-a582-b4bcfcc402a9\") " pod="openshift-ingress-canary/ingress-canary-5f5p7" Oct 31 00:29:41.458982 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.458853 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:29:41.458982 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.458877 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fv8r\" (UniqueName: \"kubernetes.io/projected/b1cf311b-c4ed-433e-a582-b4bcfcc402a9-kube-api-access-6fv8r\") pod \"ingress-canary-5f5p7\" (UID: \"b1cf311b-c4ed-433e-a582-b4bcfcc402a9\") " pod="openshift-ingress-canary/ingress-canary-5f5p7" Oct 31 00:29:41.458982 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.458903 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:29:41.459202 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.458991 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-crio-socket\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:29:41.459202 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.459065 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-data-volume\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:29:41.459305 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.459236 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1df475be-e1fe-4e90-b60f-dc3763a66cc6-tmp-dir\") pod \"dns-default-7c822\" (UID: \"1df475be-e1fe-4e90-b60f-dc3763a66cc6\") " pod="openshift-dns/dns-default-7c822" Oct 31 00:29:41.459433 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.459395 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1df475be-e1fe-4e90-b60f-dc3763a66cc6-config-volume\") pod \"dns-default-7c822\" (UID: \"1df475be-e1fe-4e90-b60f-dc3763a66cc6\") " pod="openshift-dns/dns-default-7c822" Oct 31 00:29:41.459561 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.459544 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:29:41.462902 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.462878 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1df475be-e1fe-4e90-b60f-dc3763a66cc6-metrics-tls\") pod \"dns-default-7c822\" (UID: \"1df475be-e1fe-4e90-b60f-dc3763a66cc6\") " pod="openshift-dns/dns-default-7c822" Oct 31 00:29:41.462998 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.462899 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:29:41.463053 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.463039 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1cf311b-c4ed-433e-a582-b4bcfcc402a9-cert\") pod \"ingress-canary-5f5p7\" (UID: \"b1cf311b-c4ed-433e-a582-b4bcfcc402a9\") " pod="openshift-ingress-canary/ingress-canary-5f5p7" Oct 31 00:29:41.468477 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.468456 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqnv9\" (UniqueName: \"kubernetes.io/projected/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-kube-api-access-cqnv9\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:29:41.468623 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.468602 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcvrc\" (UniqueName: \"kubernetes.io/projected/1df475be-e1fe-4e90-b60f-dc3763a66cc6-kube-api-access-vcvrc\") pod \"dns-default-7c822\" (UID: \"1df475be-e1fe-4e90-b60f-dc3763a66cc6\") " pod="openshift-dns/dns-default-7c822" Oct 31 00:29:41.469393 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.469375 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fv8r\" (UniqueName: \"kubernetes.io/projected/b1cf311b-c4ed-433e-a582-b4bcfcc402a9-kube-api-access-6fv8r\") pod \"ingress-canary-5f5p7\" (UID: \"b1cf311b-c4ed-433e-a582-b4bcfcc402a9\") " pod="openshift-ingress-canary/ingress-canary-5f5p7" Oct 31 00:29:41.508447 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.508351 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7c822" Oct 31 00:29:41.523997 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.523963 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:29:41.555516 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.555488 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5f5p7" Oct 31 00:29:41.796531 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.796501 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7c822"] Oct 31 00:29:41.798782 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.798758 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f8msd"] Oct 31 00:29:41.801938 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:29:41.801911 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda47d5fa6_be34_46e7_93f7_44b23c9e9b89.slice/crio-41814d6b961f9a1fe99e7e679a5f3a7a05e7f3e9cef7dee556a3c987b80ffeca WatchSource:0}: Error finding container 41814d6b961f9a1fe99e7e679a5f3a7a05e7f3e9cef7dee556a3c987b80ffeca: Status 404 returned error can't find the container with id 41814d6b961f9a1fe99e7e679a5f3a7a05e7f3e9cef7dee556a3c987b80ffeca Oct 31 00:29:41.844551 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:41.844522 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5f5p7"] Oct 31 00:29:41.850375 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:29:41.850349 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1cf311b_c4ed_433e_a582_b4bcfcc402a9.slice/crio-b3a96c1256dc9604fdf940cb17f8732e748a1a454c18af3e23a2ec61daf6cd5a WatchSource:0}: Error finding container b3a96c1256dc9604fdf940cb17f8732e748a1a454c18af3e23a2ec61daf6cd5a: Status 404 returned error can't find the container with id b3a96c1256dc9604fdf940cb17f8732e748a1a454c18af3e23a2ec61daf6cd5a Oct 31 00:29:42.311750 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:42.311683 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:29:42.311750 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:42.311719 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:29:42.317145 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:42.317096 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 31 00:29:42.317145 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:42.317118 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-brqzn\"" Oct 31 00:29:42.317317 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:42.317194 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9g68m\"" Oct 31 00:29:42.317317 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:42.317235 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 31 00:29:42.653642 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:42.653609 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5f5p7" event={"ID":"b1cf311b-c4ed-433e-a582-b4bcfcc402a9","Type":"ContainerStarted","Data":"b3a96c1256dc9604fdf940cb17f8732e748a1a454c18af3e23a2ec61daf6cd5a"} Oct 31 00:29:42.656015 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:42.655986 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f8msd" event={"ID":"a47d5fa6-be34-46e7-93f7-44b23c9e9b89","Type":"ContainerStarted","Data":"84d4e686aa37cf81e5212f2bc3411f2bd5d326012889b05ac9b8a471474a2202"} Oct 31 00:29:42.656131 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:42.656048 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f8msd" event={"ID":"a47d5fa6-be34-46e7-93f7-44b23c9e9b89","Type":"ContainerStarted","Data":"41814d6b961f9a1fe99e7e679a5f3a7a05e7f3e9cef7dee556a3c987b80ffeca"} Oct 31 00:29:42.657561 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:42.657536 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7c822" event={"ID":"1df475be-e1fe-4e90-b60f-dc3763a66cc6","Type":"ContainerStarted","Data":"4efe75061d94f1640fcc0c19fa7b82f6cfd325e582d474597b1aabe36f0a42fe"} Oct 31 00:29:42.943166 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:42.943080 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g7phc_a1b304f2-676a-4a6f-bdac-8805188c415f/dns-node-resolver/0.log" Oct 31 00:29:42.945735 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:42.945701 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:43.122996 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:43.122896 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:43.664009 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:43.663971 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f8msd" event={"ID":"a47d5fa6-be34-46e7-93f7-44b23c9e9b89","Type":"ContainerStarted","Data":"c431a632124a46a65d7324659c7fbc81dd69624e90baed91ecc70905df946841"} Oct 31 00:29:44.140401 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.140356 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5nw7t_a4defb35-52f2-46fc-a314-affe5a217a84/node-ca/0.log" Oct 31 00:29:44.605246 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.604279 2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc"] Oct 31 00:29:44.607379 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.607354 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:29:44.614889 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.614866 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 31 00:29:44.615086 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.614967 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc"] Oct 31 00:29:44.615205 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.615094 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Oct 31 00:29:44.615205 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.615164 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 31 00:29:44.615315 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.615244 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 31 00:29:44.615315 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.615281 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Oct 31 00:29:44.615434 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.615352 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pzkk8\"" Oct 31 00:29:44.665721 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.665687 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:44.681029 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.680991 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f8msd" event={"ID":"a47d5fa6-be34-46e7-93f7-44b23c9e9b89","Type":"ContainerStarted","Data":"84be5a71a90afc6b40cbfcaa5d20f82040532f1392c130cfe855e4e06418eb75"} Oct 31 00:29:44.682611 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.682587 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7c822" event={"ID":"1df475be-e1fe-4e90-b60f-dc3763a66cc6","Type":"ContainerStarted","Data":"cd502ac1e36a4e098ad672ca5e53eb7faa4b41b555e1a74e9df20430a009792a"} Oct 31 00:29:44.682721 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.682627 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7c822" event={"ID":"1df475be-e1fe-4e90-b60f-dc3763a66cc6","Type":"ContainerStarted","Data":"614102c47840d5e9688d6a4e5742d107272ee6b6e3156d457952a357b167a707"} Oct 31 00:29:44.682721 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.682672 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7c822" Oct 31 00:29:44.698976 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.698931 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-f8msd" podStartSLOduration=1.385409322 podStartE2EDuration="3.698913832s" totalImagesPullingTime="2.31350451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:29:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:44.697727713 +0000 UTC m=+45.892640391" watchObservedRunningTime="2026-10-31 00:29:44.698913832 +0000 UTC m=+45.893826511" Oct 31 00:29:44.717782 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.717739 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-7c822" podStartSLOduration=1.867646149 podStartE2EDuration="3.717725993s" totalImagesPullingTime="1.850079844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:44.717040106 +0000 UTC m=+45.911952785" watchObservedRunningTime="2026-10-31 00:29:44.717725993 +0000 UTC m=+45.912638671" Oct 31 00:29:44.786456 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.786428 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-2kqbc\" (UID: \"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:29:44.786578 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.786484 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-2kqbc\" (UID: \"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:29:44.786638 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.786604 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-2kqbc\" (UID: \"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:29:44.786751 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.786723 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4stfl\" (UniqueName: \"kubernetes.io/projected/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-kube-api-access-4stfl\") pod \"prometheus-operator-9cd89b74c-2kqbc\" (UID: \"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:29:44.844727 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.844691 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:44.887244 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.887159 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-2kqbc\" (UID: \"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:29:44.887244 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.887203 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-2kqbc\" (UID: \"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:29:44.887479 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.887244 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-2kqbc\" (UID: \"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:29:44.887479 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.887268 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4stfl\" (UniqueName: \"kubernetes.io/projected/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-kube-api-access-4stfl\") pod \"prometheus-operator-9cd89b74c-2kqbc\" (UID: \"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:29:44.887914 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.887888 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-2kqbc\" (UID: \"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:29:44.889792 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.889773 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-2kqbc\" (UID: \"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:29:44.889891 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.889805 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-2kqbc\" (UID: \"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:29:44.896623 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.896595 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4stfl\" (UniqueName: \"kubernetes.io/projected/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-kube-api-access-4stfl\") pod \"prometheus-operator-9cd89b74c-2kqbc\" (UID: \"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:29:44.922532 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:44.922495 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:29:45.028585 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.028550 2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-57fd464446-59shl"] Oct 31 00:29:45.032536 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.032514 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.040758 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.040716 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 31 00:29:45.040758 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.040733 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 31 00:29:45.040916 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.040833 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 31 00:29:45.040916 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.040863 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cmvvg\"" Oct 31 00:29:45.040916 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.040896 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 31 00:29:45.040916 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.040720 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 31 00:29:45.041184 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.040990 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 31 00:29:45.041184 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.041079 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 31 00:29:45.041371 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.041353 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57fd464446-59shl"] Oct 31 00:29:45.046253 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.046231 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Oct 31 00:29:45.190274 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.190202 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7573854a-4782-4c89-b93a-43503a30fec2-console-oauth-config\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.190274 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.190236 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7573854a-4782-4c89-b93a-43503a30fec2-console-serving-cert\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.190274 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.190255 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-console-config\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.190491 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.190456 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q54rb\" (UniqueName: \"kubernetes.io/projected/7573854a-4782-4c89-b93a-43503a30fec2-kube-api-access-q54rb\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.190535 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.190490 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-trusted-ca-bundle\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.190535 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.190514 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-service-ca\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.190605 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.190534 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-oauth-serving-cert\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.190605 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.190590 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7573854a-4782-4c89-b93a-43503a30fec2-tmp\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.196274 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.196251 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc"] Oct 31 00:29:45.199275 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:29:45.199250 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e9c8bc7_67f7_4e30_99a1_09f26b0774c2.slice/crio-0693db672ea76ea9e8c59224fc5c641499eeb943122dedff78bcf2fa6f1f575e WatchSource:0}: Error finding container 0693db672ea76ea9e8c59224fc5c641499eeb943122dedff78bcf2fa6f1f575e: Status 404 returned error can't find the container with id 0693db672ea76ea9e8c59224fc5c641499eeb943122dedff78bcf2fa6f1f575e Oct 31 00:29:45.291340 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.291304 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q54rb\" (UniqueName: \"kubernetes.io/projected/7573854a-4782-4c89-b93a-43503a30fec2-kube-api-access-q54rb\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.291340 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.291339 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-trusted-ca-bundle\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.291572 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.291363 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-service-ca\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.291659 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.291638 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-oauth-serving-cert\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.291710 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.291700 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7573854a-4782-4c89-b93a-43503a30fec2-tmp\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.291768 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.291741 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7573854a-4782-4c89-b93a-43503a30fec2-console-oauth-config\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.291818 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.291769 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7573854a-4782-4c89-b93a-43503a30fec2-console-serving-cert\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.291818 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.291796 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-console-config\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.292109 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.292080 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7573854a-4782-4c89-b93a-43503a30fec2-tmp\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.292255 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.292227 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-service-ca\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.292349 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.292323 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-oauth-serving-cert\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.292405 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.292390 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-trusted-ca-bundle\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.292504 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.292486 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-console-config\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.294325 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.294302 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7573854a-4782-4c89-b93a-43503a30fec2-console-oauth-config\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.294404 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.294397 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7573854a-4782-4c89-b93a-43503a30fec2-console-serving-cert\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.300073 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.300056 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q54rb\" (UniqueName: \"kubernetes.io/projected/7573854a-4782-4c89-b93a-43503a30fec2-kube-api-access-q54rb\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.344454 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.344403 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:45.613020 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.612974 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57fd464446-59shl"] Oct 31 00:29:45.615357 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:29:45.615331 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7573854a_4782_4c89_b93a_43503a30fec2.slice/crio-c86782fa1392f6b9a0fd0c68d5f0f5e393e2d54fe272dd12463f8ce18ae1ee1c WatchSource:0}: Error finding container c86782fa1392f6b9a0fd0c68d5f0f5e393e2d54fe272dd12463f8ce18ae1ee1c: Status 404 returned error can't find the container with id c86782fa1392f6b9a0fd0c68d5f0f5e393e2d54fe272dd12463f8ce18ae1ee1c Oct 31 00:29:45.686117 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.686084 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" event={"ID":"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2","Type":"ContainerStarted","Data":"0693db672ea76ea9e8c59224fc5c641499eeb943122dedff78bcf2fa6f1f575e"} Oct 31 00:29:45.687620 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.687599 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5f5p7" event={"ID":"b1cf311b-c4ed-433e-a582-b4bcfcc402a9","Type":"ContainerStarted","Data":"d277d19ad442906c872bb090a0e12dbe938eb3680152901abc95f959a0c7aefc"} Oct 31 00:29:45.689368 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.689345 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fd464446-59shl" event={"ID":"7573854a-4782-4c89-b93a-43503a30fec2","Type":"ContainerStarted","Data":"c86782fa1392f6b9a0fd0c68d5f0f5e393e2d54fe272dd12463f8ce18ae1ee1c"} Oct 31 00:29:45.705112 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:45.705072 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5f5p7" podStartSLOduration=1.817653073 podStartE2EDuration="4.705061375s" totalImagesPullingTime="2.887408302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:45.704231233 +0000 UTC m=+46.899143911" watchObservedRunningTime="2026-10-31 00:29:45.705061375 +0000 UTC m=+46.899974053" Oct 31 00:29:46.604887 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:46.604848 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:46.701528 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:46.701492 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" event={"ID":"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2","Type":"ContainerStarted","Data":"df03eaa79034535d02bcfee2304f9af97f9dee02a9f9084ce2226186e947518f"} Oct 31 00:29:46.999177 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:46.999098 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:47.707051 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:47.707005 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" event={"ID":"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2","Type":"ContainerStarted","Data":"be7cd2d72f769c63b70d455fbe028400523e75c8c74f9a0656ac3462319f91d0"} Oct 31 00:29:47.724929 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:47.724880 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" podStartSLOduration=2.346360445 podStartE2EDuration="3.724861183s" totalImagesPullingTime="1.378500738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:47.723414374 +0000 UTC m=+48.918327053" watchObservedRunningTime="2026-10-31 00:29:47.724861183 +0000 UTC m=+48.919773864" Oct 31 00:29:47.948092 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:47.948064 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:48.118429 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:48.118396 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:48.711257 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:48.711173 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fd464446-59shl" event={"ID":"7573854a-4782-4c89-b93a-43503a30fec2","Type":"ContainerStarted","Data":"faaf654c53f2445c72615b385a62a1d09ba70a8f7167fb0b6d67049445688cd3"} Oct 31 00:29:48.773409 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:48.773379 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:48.945152 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:48.945123 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:49.328390 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:49.328340 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-57fd464446-59shl" podStartSLOduration=1.611233253 podStartE2EDuration="4.32832571s" totalImagesPullingTime="2.717092457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:48.728368839 +0000 UTC m=+49.923281520" watchObservedRunningTime="2026-10-31 00:29:49.32832571 +0000 UTC m=+50.523238389" Oct 31 00:29:49.576994 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:49.576960 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:49.838560 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:49.838524 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:50.005328 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.005299 2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zkth8"] Oct 31 00:29:50.008323 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.008304 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.039448 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.039403 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:50.100782 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.100689 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 31 00:29:50.100950 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.100789 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 31 00:29:50.100950 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.100949 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 31 00:29:50.101078 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.101067 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gm9sb\"" Oct 31 00:29:50.131254 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.131228 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81ef083c-e93d-4531-949e-22999120731e-sys\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.131350 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.131260 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81ef083c-e93d-4531-949e-22999120731e-node-exporter-textfile\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.131350 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.131308 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81ef083c-e93d-4531-949e-22999120731e-metrics-client-ca\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.131466 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.131438 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81ef083c-e93d-4531-949e-22999120731e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.131508 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.131468 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81ef083c-e93d-4531-949e-22999120731e-node-exporter-tls\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.131599 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.131580 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81ef083c-e93d-4531-949e-22999120731e-node-exporter-accelerators-collector-config\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.131652 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.131628 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81ef083c-e93d-4531-949e-22999120731e-node-exporter-wtmp\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.131694 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.131659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m7qc\" (UniqueName: \"kubernetes.io/projected/81ef083c-e93d-4531-949e-22999120731e-kube-api-access-6m7qc\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.131694 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.131677 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81ef083c-e93d-4531-949e-22999120731e-root\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.222111 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.222078 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:50.232230 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.232204 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81ef083c-e93d-4531-949e-22999120731e-root\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.232398 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.232256 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81ef083c-e93d-4531-949e-22999120731e-sys\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.232398 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.232275 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81ef083c-e93d-4531-949e-22999120731e-node-exporter-textfile\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.232398 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.232317 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81ef083c-e93d-4531-949e-22999120731e-root\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.232398 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.232329 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81ef083c-e93d-4531-949e-22999120731e-sys\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.232398 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.232376 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81ef083c-e93d-4531-949e-22999120731e-metrics-client-ca\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.232638 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.232412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81ef083c-e93d-4531-949e-22999120731e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.232638 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.232461 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81ef083c-e93d-4531-949e-22999120731e-node-exporter-tls\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.232638 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.232497 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81ef083c-e93d-4531-949e-22999120731e-node-exporter-accelerators-collector-config\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.232638 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.232516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81ef083c-e93d-4531-949e-22999120731e-node-exporter-wtmp\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.232638 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.232552 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81ef083c-e93d-4531-949e-22999120731e-node-exporter-textfile\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.232638 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.232555 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m7qc\" (UniqueName: \"kubernetes.io/projected/81ef083c-e93d-4531-949e-22999120731e-kube-api-access-6m7qc\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.232904 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.232675 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81ef083c-e93d-4531-949e-22999120731e-node-exporter-wtmp\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.232944 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.232905 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81ef083c-e93d-4531-949e-22999120731e-metrics-client-ca\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.233241 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.233223 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81ef083c-e93d-4531-949e-22999120731e-node-exporter-accelerators-collector-config\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.234923 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.234897 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81ef083c-e93d-4531-949e-22999120731e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.235011 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.234937 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81ef083c-e93d-4531-949e-22999120731e-node-exporter-tls\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.240858 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.240837 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m7qc\" (UniqueName: \"kubernetes.io/projected/81ef083c-e93d-4531-949e-22999120731e-kube-api-access-6m7qc\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.323532 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.323499 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:29:50.335229 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:29:50.335202 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81ef083c_e93d_4531_949e_22999120731e.slice/crio-15a05a1a08fb0b5fc87baa8335c7ac2acb6c2f30c786709e7c834cfc75bc3224 WatchSource:0}: Error finding container 15a05a1a08fb0b5fc87baa8335c7ac2acb6c2f30c786709e7c834cfc75bc3224: Status 404 returned error can't find the container with id 15a05a1a08fb0b5fc87baa8335c7ac2acb6c2f30c786709e7c834cfc75bc3224 Oct 31 00:29:50.478652 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.478573 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:50.650219 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.650184 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:50.721583 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:50.721549 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zkth8" event={"ID":"81ef083c-e93d-4531-949e-22999120731e","Type":"ContainerStarted","Data":"15a05a1a08fb0b5fc87baa8335c7ac2acb6c2f30c786709e7c834cfc75bc3224"} Oct 31 00:29:51.054191 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.054159 2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 31 00:29:51.057854 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.057831 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.062673 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.062648 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 31 00:29:51.062673 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.062648 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 31 00:29:51.062844 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.062648 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 31 00:29:51.062844 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.062700 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 31 00:29:51.062844 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.062714 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 31 00:29:51.062844 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.062706 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 31 00:29:51.062844 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.062730 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 31 00:29:51.062844 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.062739 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 31 00:29:51.062844 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.062776 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tgfj6\"" Oct 31 00:29:51.063150 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.063132 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 31 00:29:51.071769 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.071676 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 31 00:29:51.086247 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.086213 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:51.239366 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.239331 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7926238e-b350-435f-ac33-529829777b8a-config-out\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.239550 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.239382 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.239550 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.239447 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.239550 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.239470 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7926238e-b350-435f-ac33-529829777b8a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.239712 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.239621 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-web-config\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.239712 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.239666 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.239794 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.239735 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7926238e-b350-435f-ac33-529829777b8a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.239828 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.239802 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nqnf\" (UniqueName: \"kubernetes.io/projected/7926238e-b350-435f-ac33-529829777b8a-kube-api-access-9nqnf\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.239859 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.239823 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-config-volume\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.239941 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.239918 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.239976 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.239965 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.240021 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.239983 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7926238e-b350-435f-ac33-529829777b8a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.240069 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.240021 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7926238e-b350-435f-ac33-529829777b8a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.334715 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.334634 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:51.340666 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.340638 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.340834 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.340679 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.340834 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.340708 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7926238e-b350-435f-ac33-529829777b8a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.341268 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.341234 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-web-config\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.341384 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.341286 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.341384 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.341363 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7926238e-b350-435f-ac33-529829777b8a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.341709 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.341407 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nqnf\" (UniqueName: \"kubernetes.io/projected/7926238e-b350-435f-ac33-529829777b8a-kube-api-access-9nqnf\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.341709 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.341456 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-config-volume\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.341709 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.341521 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.341709 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.341557 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.341709 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.341586 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7926238e-b350-435f-ac33-529829777b8a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.341709 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.341628 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7926238e-b350-435f-ac33-529829777b8a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.341709 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.341616 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7926238e-b350-435f-ac33-529829777b8a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.341709 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.341656 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7926238e-b350-435f-ac33-529829777b8a-config-out\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.344088 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.344061 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.344209 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.344068 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.344347 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.344322 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7926238e-b350-435f-ac33-529829777b8a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.344670 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.344650 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.345238 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.345213 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7926238e-b350-435f-ac33-529829777b8a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.345609 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.345558 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7926238e-b350-435f-ac33-529829777b8a-config-out\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.345960 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.345937 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-config-volume\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.346294 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.346272 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.347207 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.347177 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7926238e-b350-435f-ac33-529829777b8a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.347607 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.347585 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-web-config\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.348811 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.348787 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.351488 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.351467 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nqnf\" (UniqueName: \"kubernetes.io/projected/7926238e-b350-435f-ac33-529829777b8a-kube-api-access-9nqnf\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.388244 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.388198 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:29:51.672676 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.672648 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 31 00:29:51.676176 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:29:51.676144 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7926238e_b350_435f_ac33_529829777b8a.slice/crio-62fa67ddc94be6af2d7e42c82f1dfd917d2162f5f745242ab93f3fc833aed26f WatchSource:0}: Error finding container 62fa67ddc94be6af2d7e42c82f1dfd917d2162f5f745242ab93f3fc833aed26f: Status 404 returned error can't find the container with id 62fa67ddc94be6af2d7e42c82f1dfd917d2162f5f745242ab93f3fc833aed26f Oct 31 00:29:51.725807 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.725767 2574 generic.go:356] "Generic (PLEG): container finished" podID="81ef083c-e93d-4531-949e-22999120731e" containerID="2f3f175ee042e980e38ccf49071bea6f4d56849172825d10d888e736c8699802" exitCode=0 Oct 31 00:29:51.725963 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.725847 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zkth8" event={"ID":"81ef083c-e93d-4531-949e-22999120731e","Type":"ContainerDied","Data":"2f3f175ee042e980e38ccf49071bea6f4d56849172825d10d888e736c8699802"} Oct 31 00:29:51.727105 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:51.727087 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7926238e-b350-435f-ac33-529829777b8a","Type":"ContainerStarted","Data":"62fa67ddc94be6af2d7e42c82f1dfd917d2162f5f745242ab93f3fc833aed26f"} Oct 31 00:29:52.029214 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.029176 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:52.061569 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.061534 2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-d95b77fc8-mwt72"] Oct 31 00:29:52.065208 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.065189 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.077054 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.077031 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Oct 31 00:29:52.077191 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.077174 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Oct 31 00:29:52.077325 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.077310 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-l92sm\"" Oct 31 00:29:52.077433 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.077398 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Oct 31 00:29:52.081108 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.081077 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Oct 31 00:29:52.081108 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.081095 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Oct 31 00:29:52.081439 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.081149 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fjcute43tnn6a\"" Oct 31 00:29:52.082701 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.082682 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d95b77fc8-mwt72"] Oct 31 00:29:52.149767 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.149725 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-grpc-tls\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.149767 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.149763 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.149968 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.149785 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-tls\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.149968 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.149876 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.149968 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.149943 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a57dfd1-8cba-4f8e-bdec-908249491197-tmp\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.150052 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.149976 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.150052 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.150020 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a57dfd1-8cba-4f8e-bdec-908249491197-metrics-client-ca\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.150110 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.150066 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.150140 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.150108 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr42q\" (UniqueName: \"kubernetes.io/projected/7a57dfd1-8cba-4f8e-bdec-908249491197-kube-api-access-rr42q\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.205871 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.205838 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:52.251442 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.251383 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-tls\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.251636 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.251472 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.251636 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.251526 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a57dfd1-8cba-4f8e-bdec-908249491197-tmp\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.251636 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.251583 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.251636 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.251613 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a57dfd1-8cba-4f8e-bdec-908249491197-metrics-client-ca\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.251838 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.251673 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.251838 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.251703 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr42q\" (UniqueName: \"kubernetes.io/projected/7a57dfd1-8cba-4f8e-bdec-908249491197-kube-api-access-rr42q\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.251838 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.251751 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-grpc-tls\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.251838 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.251780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.252576 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.252514 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a57dfd1-8cba-4f8e-bdec-908249491197-tmp\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.253354 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.253274 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a57dfd1-8cba-4f8e-bdec-908249491197-metrics-client-ca\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.254678 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.254653 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-tls\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.254765 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.254730 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.255183 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.255161 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.255287 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.255267 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.255558 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.255512 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-grpc-tls\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.256070 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.256053 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.260881 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.260854 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr42q\" (UniqueName: \"kubernetes.io/projected/7a57dfd1-8cba-4f8e-bdec-908249491197-kube-api-access-rr42q\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.387259 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.387220 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:52.676749 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.676562 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d95b77fc8-mwt72"] Oct 31 00:29:52.679222 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:29:52.679186 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a57dfd1_8cba_4f8e_bdec_908249491197.slice/crio-eeab9038e5292b7dea8a1af0565ba77912223d9521eaeb7635a208cfeff1f8db WatchSource:0}: Error finding container eeab9038e5292b7dea8a1af0565ba77912223d9521eaeb7635a208cfeff1f8db: Status 404 returned error can't find the container with id eeab9038e5292b7dea8a1af0565ba77912223d9521eaeb7635a208cfeff1f8db Oct 31 00:29:52.733923 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.733894 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zkth8" event={"ID":"81ef083c-e93d-4531-949e-22999120731e","Type":"ContainerStarted","Data":"9633adb4358ad13ee75ddf53ddf6351a665ae5271eb265065688d1fc34c80f5a"} Oct 31 00:29:52.733995 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.733958 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zkth8" event={"ID":"81ef083c-e93d-4531-949e-22999120731e","Type":"ContainerStarted","Data":"f94414c4717f0a9c7166ce99438b810a4da5815663aef1f3aec6d6ade617b7db"} Oct 31 00:29:52.735018 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.734997 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" event={"ID":"7a57dfd1-8cba-4f8e-bdec-908249491197","Type":"ContainerStarted","Data":"eeab9038e5292b7dea8a1af0565ba77912223d9521eaeb7635a208cfeff1f8db"} Oct 31 00:29:52.754799 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:52.754753 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zkth8" podStartSLOduration=2.533976216 podStartE2EDuration="3.754738373s" totalImagesPullingTime="1.147429152s" totalInitContainerRuntime="73.333005ms" isStatefulPod=true podCreationTimestamp="2026-10-31 00:29:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:52.753929979 +0000 UTC m=+53.948842659" watchObservedRunningTime="2026-10-31 00:29:52.754738373 +0000 UTC m=+53.949651051" Oct 31 00:29:53.059075 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:53.059038 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:53.230414 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:53.230368 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:53.741751 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:53.740921 2574 generic.go:356] "Generic (PLEG): container finished" podID="7926238e-b350-435f-ac33-529829777b8a" containerID="2877a876299322529a573a776abc04ef92cc8f7e2ffd02afb66dd8924d20e71e" exitCode=0 Oct 31 00:29:53.741751 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:53.741015 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7926238e-b350-435f-ac33-529829777b8a","Type":"ContainerDied","Data":"2877a876299322529a573a776abc04ef92cc8f7e2ffd02afb66dd8924d20e71e"} Oct 31 00:29:54.406039 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.406007 2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-98b459ffb-jkn2t"] Oct 31 00:29:54.409328 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.409304 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.418701 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.418675 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Oct 31 00:29:54.418859 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.418790 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Oct 31 00:29:54.419732 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.419705 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-98b459ffb-jkn2t"] Oct 31 00:29:54.451950 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.451647 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xt4sz\"" Oct 31 00:29:54.451950 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.451729 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Oct 31 00:29:54.451950 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.451828 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Oct 31 00:29:54.451950 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.451919 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-aa4kiasj98hbn\"" Oct 31 00:29:54.471545 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.471502 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-audit-log\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.471713 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.471619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxqqx\" (UniqueName: \"kubernetes.io/projected/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-kube-api-access-gxqqx\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.471713 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.471660 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-metrics-server-audit-profiles\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.471713 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.471688 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-client-ca-bundle\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.471883 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.471728 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-secret-metrics-server-tls\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.471883 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.471762 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.471883 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.471791 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-secret-metrics-server-client-certs\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.572626 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.572590 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-audit-log\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.572811 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.572656 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxqqx\" (UniqueName: \"kubernetes.io/projected/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-kube-api-access-gxqqx\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.572811 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.572678 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-metrics-server-audit-profiles\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.572811 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.572707 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-client-ca-bundle\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.572811 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.572756 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-secret-metrics-server-tls\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.572811 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.572801 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.573004 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.572848 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-secret-metrics-server-client-certs\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.574581 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.573485 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-audit-log\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.574581 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.574099 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-metrics-server-audit-profiles\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.574581 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.574540 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.576198 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.576166 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-secret-metrics-server-client-certs\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.576289 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.576211 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-client-ca-bundle\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.576335 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.576289 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-secret-metrics-server-tls\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.582442 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.582404 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxqqx\" (UniqueName: \"kubernetes.io/projected/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-kube-api-access-gxqqx\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.627668 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.627640 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:29:54.691862 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.691837 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7c822" Oct 31 00:29:54.726470 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.726234 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:29:54.749937 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.749905 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" event={"ID":"7a57dfd1-8cba-4f8e-bdec-908249491197","Type":"ContainerStarted","Data":"1cb8395541d8b3439a75722b1da6eed969f36752502e598bbd725d7a1e9e1324"} Oct 31 00:29:54.907142 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:54.907108 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:55.030925 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:55.030896 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-98b459ffb-jkn2t"] Oct 31 00:29:55.034401 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:29:55.034369 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc9181f_c401_4d7c_bbcb_409b4b6f60e0.slice/crio-1f558e15af7c6dbed111f7308422267e2e439e7a1a0eaf02dfeccf63432d6c20 WatchSource:0}: Error finding container 1f558e15af7c6dbed111f7308422267e2e439e7a1a0eaf02dfeccf63432d6c20: Status 404 returned error can't find the container with id 1f558e15af7c6dbed111f7308422267e2e439e7a1a0eaf02dfeccf63432d6c20 Oct 31 00:29:55.344946 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:55.344921 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:55.345038 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:55.344981 2574 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:55.350064 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:55.350043 2574 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:55.400917 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:55.400890 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:55.754745 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:55.754707 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" event={"ID":"adc9181f-c401-4d7c-bbcb-409b4b6f60e0","Type":"ContainerStarted","Data":"1f558e15af7c6dbed111f7308422267e2e439e7a1a0eaf02dfeccf63432d6c20"} Oct 31 00:29:55.757137 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:55.757112 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" event={"ID":"7a57dfd1-8cba-4f8e-bdec-908249491197","Type":"ContainerStarted","Data":"df538d808fbd71e383d2d003646c15c92b992ecd88bc82b30e6420ca76488757"} Oct 31 00:29:55.757266 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:55.757174 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" event={"ID":"7a57dfd1-8cba-4f8e-bdec-908249491197","Type":"ContainerStarted","Data":"c27abdbe743df2cb3182bd9c493d54fe8888bf412fe2c69deaeeafa7d3fff029"} Oct 31 00:29:55.760074 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:55.760054 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7926238e-b350-435f-ac33-529829777b8a","Type":"ContainerStarted","Data":"7a094f4a5fbe6123736620c20c3773a2ada0910ec0521957709daf07f8c2155a"} Oct 31 00:29:55.760184 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:55.760103 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7926238e-b350-435f-ac33-529829777b8a","Type":"ContainerStarted","Data":"c21564aa4709764b8b3f7efb1d9ba7142b2b81e32daeb991cf769cbe93c04d6a"} Oct 31 00:29:55.760184 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:55.760129 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7926238e-b350-435f-ac33-529829777b8a","Type":"ContainerStarted","Data":"cd43b17265d9d80aaeb3d31e5fc26181b6488ca04c9c6ce6d7a942a8fc0e7057"} Oct 31 00:29:55.760184 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:55.760151 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7926238e-b350-435f-ac33-529829777b8a","Type":"ContainerStarted","Data":"e39ade38def6488319a56591875ae7ff4e0518fa0373735aa8dad933cd242773"} Oct 31 00:29:55.760184 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:55.760173 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7926238e-b350-435f-ac33-529829777b8a","Type":"ContainerStarted","Data":"3a350fd76b6875aee19226dd1a470cefef5a1bb19bb2b33c00d1a4a08bf2725f"} Oct 31 00:29:55.765413 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:55.765395 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57fd464446-59shl" Oct 31 00:29:56.429335 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:56.429203 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:56.771007 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:56.770189 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" event={"ID":"7a57dfd1-8cba-4f8e-bdec-908249491197","Type":"ContainerStarted","Data":"8e68a19c4cb6bab947a3cdc6be9a6b7e16fe6a2c950a3e022ccfd4963207ec1a"} Oct 31 00:29:56.771007 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:56.770269 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" event={"ID":"7a57dfd1-8cba-4f8e-bdec-908249491197","Type":"ContainerStarted","Data":"d9bd596da1f08571f93b49401dd9bd58b593b9e8578bea7737cd6e6ed964c2ac"} Oct 31 00:29:56.771007 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:56.770305 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" event={"ID":"7a57dfd1-8cba-4f8e-bdec-908249491197","Type":"ContainerStarted","Data":"f0044a6a737bf91bc51a9fcf7e9434d9a3b8a2c10dc1604b2883cdf57d292608"} Oct 31 00:29:56.771007 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:56.770404 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:29:56.774492 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:56.774463 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7926238e-b350-435f-ac33-529829777b8a","Type":"ContainerStarted","Data":"7f1dcd8ea1dd4f4094582e88ddb7e608bd9221bd22ea8640e1cc09e91e28326c"} Oct 31 00:29:56.778409 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:56.778380 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" event={"ID":"adc9181f-c401-4d7c-bbcb-409b4b6f60e0","Type":"ContainerStarted","Data":"c99a202c5087b1887bd2437676573850566844c22cd1e464c1c8c86613db55a5"} Oct 31 00:29:56.803849 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:56.803800 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" podStartSLOduration=1.942747029 podStartE2EDuration="4.803767899s" totalImagesPullingTime="2.86102087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:56.802411823 +0000 UTC m=+57.997324501" watchObservedRunningTime="2026-10-31 00:29:56.803767899 +0000 UTC m=+57.998680578" Oct 31 00:29:56.819669 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:56.819606 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" podStartSLOduration=1.201644922 podStartE2EDuration="2.819589223s" totalImagesPullingTime="1.617944301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:56.818992636 +0000 UTC m=+58.013905320" watchObservedRunningTime="2026-10-31 00:29:56.819589223 +0000 UTC m=+58.014501903" Oct 31 00:29:56.845058 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:56.845010 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.775382881 podStartE2EDuration="5.845000348s" totalImagesPullingTime="3.057931017s" totalInitContainerRuntime="11.68645ms" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:56.843001157 +0000 UTC m=+58.037913857" watchObservedRunningTime="2026-10-31 00:29:56.845000348 +0000 UTC m=+58.039913027" Oct 31 00:29:57.129268 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.129228 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:57.236076 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.236046 2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-567c75bfd8-svz59"] Oct 31 00:29:57.239229 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.239213 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.252103 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.252080 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-567c75bfd8-svz59"] Oct 31 00:29:57.301866 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.301836 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g759d\" (UniqueName: \"kubernetes.io/projected/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-kube-api-access-g759d\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.302044 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.301872 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-tmp\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.302044 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.301901 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-trusted-ca-bundle\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.302044 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.302013 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-service-ca\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.302160 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.302080 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-oauth-config\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.302160 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.302123 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-config\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.302160 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.302147 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-serving-cert\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.302289 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.302177 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-oauth-serving-cert\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.303677 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.303654 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:57.402845 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.402750 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-service-ca\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.402845 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.402816 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-oauth-config\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.403068 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.402866 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-config\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.403068 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.402894 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-serving-cert\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.403068 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.402919 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-oauth-serving-cert\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.403068 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.402941 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g759d\" (UniqueName: \"kubernetes.io/projected/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-kube-api-access-g759d\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.403068 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.402974 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-tmp\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.403424 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.403394 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-trusted-ca-bundle\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.403753 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.403703 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-oauth-serving-cert\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.403753 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.403728 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-config\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.403874 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.403731 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-service-ca\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.403874 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.403862 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-tmp\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.404279 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.404261 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-trusted-ca-bundle\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.405528 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.405511 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-oauth-config\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.405681 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.405663 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-serving-cert\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.411804 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.411786 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g759d\" (UniqueName: \"kubernetes.io/projected/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-kube-api-access-g759d\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.484491 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.484459 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:57.549851 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.549817 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:29:57.820963 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:57.820793 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-567c75bfd8-svz59"] Oct 31 00:29:57.823476 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:29:57.823448 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09bd144b_d0cc_4ba7_84d8_c66ad7bee28c.slice/crio-0c6c2b9b49560f008183b9af37fc28fcf93f25229cd1d47cd3b5dbb06269bc38 WatchSource:0}: Error finding container 0c6c2b9b49560f008183b9af37fc28fcf93f25229cd1d47cd3b5dbb06269bc38: Status 404 returned error can't find the container with id 0c6c2b9b49560f008183b9af37fc28fcf93f25229cd1d47cd3b5dbb06269bc38 Oct 31 00:29:58.786116 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:58.786081 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567c75bfd8-svz59" event={"ID":"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c","Type":"ContainerStarted","Data":"4b93a8c2a7187a8d91107a9dab5df52424039fd7eda027423e7ebf632c212064"} Oct 31 00:29:58.786286 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:58.786131 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567c75bfd8-svz59" event={"ID":"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c","Type":"ContainerStarted","Data":"0c6c2b9b49560f008183b9af37fc28fcf93f25229cd1d47cd3b5dbb06269bc38"} Oct 31 00:29:59.150981 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:59.150898 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:29:59.340461 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:29:59.340428 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:00.760023 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:00.759983 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:00.990813 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:00.990770 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:01.397746 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:01.397701 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:01.755524 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:01.755434 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:01.938986 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:01.938942 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:02.257515 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:02.257483 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:02.443195 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:02.443159 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:03.190143 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:03.190108 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:03.364644 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:03.364613 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:03.776342 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:03.776311 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:03.793003 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:03.792981 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:30:03.821013 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:03.820967 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-567c75bfd8-svz59" podStartSLOduration=6.820954121 podStartE2EDuration="6.820954121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:58.807873251 +0000 UTC m=+60.002785931" watchObservedRunningTime="2026-10-31 00:30:03.820954121 +0000 UTC m=+65.015866800" Oct 31 00:30:03.966107 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:03.966079 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:05.073109 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.073077 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs\") pod \"network-metrics-daemon-bl5rh\" (UID: \"1720ac40-f3e0-44e3-b2f2-06db389fb9b7\") " pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:30:05.075570 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.075551 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 31 00:30:05.085866 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.085842 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs\") pod \"network-metrics-daemon-bl5rh\" (UID: \"1720ac40-f3e0-44e3-b2f2-06db389fb9b7\") " pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:30:05.128341 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.128319 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9g68m\"" Oct 31 00:30:05.136562 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.136542 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:30:05.174547 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.174475 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:30:05.177100 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.177080 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 31 00:30:05.189861 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.188187 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:30:05.275552 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.275522 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b47dq\" (UniqueName: \"kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq\") pod \"network-check-target-hnzfm\" (UID: \"4d754c0a-9f48-439b-8673-6ba91b6408ff\") " pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:30:05.277868 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.277852 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 31 00:30:05.288469 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.288452 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 31 00:30:05.298892 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.298872 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b47dq\" (UniqueName: \"kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq\") pod \"network-check-target-hnzfm\" (UID: \"4d754c0a-9f48-439b-8673-6ba91b6408ff\") " pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:30:05.327606 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.324058 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-xkpl6\"" Oct 31 00:30:05.331391 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.331373 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:30:05.409695 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.409670 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bl5rh"] Oct 31 00:30:05.412204 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:30:05.412178 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1720ac40_f3e0_44e3_b2f2_06db389fb9b7.slice/crio-97c4057b1d22f9f71e7e3fe7de0a9e08f78a6f976fbe41fccc1aca1016f82b30 WatchSource:0}: Error finding container 97c4057b1d22f9f71e7e3fe7de0a9e08f78a6f976fbe41fccc1aca1016f82b30: Status 404 returned error can't find the container with id 97c4057b1d22f9f71e7e3fe7de0a9e08f78a6f976fbe41fccc1aca1016f82b30 Oct 31 00:30:05.433598 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.433572 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-brqzn\"" Oct 31 00:30:05.441669 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.441653 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:30:05.601797 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.601735 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hnzfm"] Oct 31 00:30:05.604376 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:30:05.604352 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d754c0a_9f48_439b_8673_6ba91b6408ff.slice/crio-e49b0200d9617bbe505b4184de058405f01592d9f6f83deba62ef2f35b1e0c36 WatchSource:0}: Error finding container e49b0200d9617bbe505b4184de058405f01592d9f6f83deba62ef2f35b1e0c36: Status 404 returned error can't find the container with id e49b0200d9617bbe505b4184de058405f01592d9f6f83deba62ef2f35b1e0c36 Oct 31 00:30:05.710685 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.710660 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6rt5w"] Oct 31 00:30:05.713052 ip-10-0-134-145 kubenswrapper[2574]: W1031 00:30:05.713028 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b3c9cfb_2fd5_4a88_a938_77f38dd28969.slice/crio-dfa263748904ab39c40a676f0e533718432e5eeeab7fea765caa4be93b4b9f84 WatchSource:0}: Error finding container dfa263748904ab39c40a676f0e533718432e5eeeab7fea765caa4be93b4b9f84: Status 404 returned error can't find the container with id dfa263748904ab39c40a676f0e533718432e5eeeab7fea765caa4be93b4b9f84 Oct 31 00:30:05.815057 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.815033 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hnzfm" event={"ID":"4d754c0a-9f48-439b-8673-6ba91b6408ff","Type":"ContainerStarted","Data":"e49b0200d9617bbe505b4184de058405f01592d9f6f83deba62ef2f35b1e0c36"} Oct 31 00:30:05.816154 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.816126 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bl5rh" event={"ID":"1720ac40-f3e0-44e3-b2f2-06db389fb9b7","Type":"ContainerStarted","Data":"97c4057b1d22f9f71e7e3fe7de0a9e08f78a6f976fbe41fccc1aca1016f82b30"} Oct 31 00:30:05.817248 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:05.817230 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6rt5w" event={"ID":"3b3c9cfb-2fd5-4a88-a938-77f38dd28969","Type":"ContainerStarted","Data":"dfa263748904ab39c40a676f0e533718432e5eeeab7fea765caa4be93b4b9f84"} Oct 31 00:30:06.177841 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:06.177801 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:06.360815 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:06.360782 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:07.550855 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:07.550818 2574 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:07.551203 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:07.550915 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:07.557495 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:07.557470 2574 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:07.828049 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:07.827968 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bl5rh" event={"ID":"1720ac40-f3e0-44e3-b2f2-06db389fb9b7","Type":"ContainerStarted","Data":"c567b13d15f58244f7e11c905b9c1f860571b43f0d18cf49b386aa93a7764a09"} Oct 31 00:30:07.828049 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:07.828030 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bl5rh" event={"ID":"1720ac40-f3e0-44e3-b2f2-06db389fb9b7","Type":"ContainerStarted","Data":"8e2a22f018b10a29dafd6949961273528687da7024d86fc6bc00e288b0f1c752"} Oct 31 00:30:07.832612 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:07.832591 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:07.847361 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:07.847320 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bl5rh" podStartSLOduration=67.43666045 podStartE2EDuration="1m8.847304973s" totalImagesPullingTime="1.410644523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:30:07.845974492 +0000 UTC m=+69.040887173" watchObservedRunningTime="2026-10-31 00:30:07.847304973 +0000 UTC m=+69.042217656" Oct 31 00:30:07.897084 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:07.896275 2574 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57fd464446-59shl"] Oct 31 00:30:09.838468 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:09.838408 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hnzfm" event={"ID":"4d754c0a-9f48-439b-8673-6ba91b6408ff","Type":"ContainerStarted","Data":"938f5f3156f6749eed6d645362ba3e3c9dbfc0170cf09285b8716584c20c3c12"} Oct 31 00:30:09.838881 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:09.838578 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:30:09.855776 ip-10-0-134-145 kubenswrapper[2574]: I1031 00:30:09.855726 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hnzfm" podStartSLOduration=67.424187641 podStartE2EDuration="1m10.85571287s" totalImagesPullingTime="3.431525229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:30:09.854626885 +0000 UTC m=+71.049539583" watchObservedRunningTime="2026-10-31 00:30:09.85571287 +0000 UTC m=+71.050625549" Oct 31 00:30:10.669857 ip-10-0-134-145 systemd[1]: Stopping Kubernetes Kubelet... Oct 31 00:30:10.683870 ip-10-0-134-145 systemd[1]: kubelet.service: Deactivated successfully. Oct 31 00:30:10.684039 ip-10-0-134-145 systemd[1]: Stopped Kubernetes Kubelet. Oct 31 00:30:10.684089 ip-10-0-134-145 systemd[1]: kubelet.service: Consumed 4.388s CPU time. Oct 31 00:30:10.707242 ip-10-0-134-145 systemd[1]: Starting Kubernetes Kubelet... Oct 31 00:30:10.767182 ip-10-0-134-145 kubenswrapper[6591]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 00:30:10.767182 ip-10-0-134-145 kubenswrapper[6591]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 31 00:30:10.767182 ip-10-0-134-145 kubenswrapper[6591]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 00:30:10.767182 ip-10-0-134-145 kubenswrapper[6591]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 00:30:10.769146 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769075 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:30:10.769146 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769147 6591 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:30:10.769221 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769150 6591 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:30:10.769221 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769154 6591 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:30:10.769221 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769157 6591 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:30:10.769221 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769160 6591 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:30:10.769221 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769162 6591 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:30:10.769221 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769166 6591 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:30:10.769221 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769168 6591 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:30:10.769221 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769171 6591 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:30:10.769221 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769173 6591 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:30:10.769221 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769176 6591 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:30:10.769221 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769179 6591 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:30:10.769221 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769181 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:30:10.769221 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769184 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:30:10.769221 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769186 6591 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:30:10.769221 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769189 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:30:10.769221 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769192 6591 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:30:10.769221 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769194 6591 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:30:10.769221 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769197 6591 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:30:10.769221 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769199 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:30:10.769221 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769201 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:30:10.769775 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769204 6591 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:30:10.769775 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769207 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:30:10.769775 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769209 6591 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:30:10.769775 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769212 6591 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:30:10.769775 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769214 6591 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:30:10.769775 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769217 6591 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:30:10.769775 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769220 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:30:10.769775 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769222 6591 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:30:10.769775 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769230 6591 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:30:10.769775 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769235 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:30:10.769775 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769238 6591 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:30:10.769775 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769241 6591 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:30:10.769775 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769244 6591 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:30:10.769775 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769247 6591 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:30:10.769775 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769249 6591 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:30:10.769775 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769252 6591 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:30:10.769775 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769254 6591 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:30:10.769775 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769256 6591 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:30:10.769775 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769259 6591 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:30:10.770225 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769262 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:30:10.770225 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769264 6591 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:30:10.770225 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769267 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:30:10.770225 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769270 6591 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:30:10.770225 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769272 6591 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:30:10.770225 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769275 6591 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:30:10.770225 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769278 6591 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:30:10.770225 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769281 6591 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:30:10.770225 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769283 6591 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:30:10.770225 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769286 6591 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:30:10.770225 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769288 6591 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:30:10.770225 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769290 6591 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:30:10.770225 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769293 6591 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:30:10.770225 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769298 6591 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:30:10.770225 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769301 6591 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:30:10.770225 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769303 6591 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:30:10.770225 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769306 6591 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:30:10.770225 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769308 6591 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:30:10.770225 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769311 6591 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:30:10.770225 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769313 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:30:10.770746 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769316 6591 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:30:10.770746 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769318 6591 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:30:10.770746 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769320 6591 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:30:10.770746 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769323 6591 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:30:10.770746 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769326 6591 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:30:10.770746 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769328 6591 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:30:10.770746 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769330 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:30:10.770746 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769333 6591 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:30:10.770746 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769335 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:30:10.770746 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769338 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:30:10.770746 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769340 6591 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:30:10.770746 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769343 6591 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:30:10.770746 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769345 6591 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:30:10.770746 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769348 6591 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:30:10.770746 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769350 6591 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:30:10.770746 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769353 6591 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:30:10.770746 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769355 6591 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:30:10.770746 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769358 6591 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:30:10.770746 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769360 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:30:10.770746 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769363 6591 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:30:10.771227 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769366 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:30:10.771227 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769368 6591 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:30:10.771227 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769371 6591 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:30:10.771227 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769374 6591 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:30:10.771227 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769376 6591 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:30:10.771227 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769380 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:30:10.771227 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769383 6591 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:30:10.771227 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769386 6591 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:30:10.771227 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769390 6591 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:30:10.771227 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769394 6591 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:30:10.771227 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769397 6591 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:30:10.771227 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769400 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:30:10.771227 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769402 6591 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:30:10.771227 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769405 6591 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:30:10.771227 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769408 6591 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:30:10.771227 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769410 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:30:10.771227 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769413 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:30:10.771227 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769433 6591 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:30:10.771227 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769437 6591 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:30:10.771707 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769439 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:30:10.771707 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769442 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:30:10.771707 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769444 6591 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:30:10.771707 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769448 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:30:10.771707 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769451 6591 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:30:10.771707 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.769453 6591 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:30:10.771707 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770173 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:30:10.771707 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770179 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:30:10.771707 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770182 6591 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:30:10.771707 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770185 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:30:10.771707 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770188 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:30:10.771707 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770190 6591 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:30:10.771707 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770193 6591 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:30:10.771707 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770196 6591 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:30:10.771707 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770199 6591 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:30:10.771707 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770202 6591 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:30:10.771707 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770205 6591 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:30:10.771707 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770208 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:30:10.771707 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770211 6591 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:30:10.772179 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770215 6591 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:30:10.772179 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770220 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:30:10.772179 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770223 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:30:10.772179 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770225 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:30:10.772179 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770228 6591 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:30:10.772179 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770231 6591 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:30:10.772179 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770233 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:30:10.772179 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770236 6591 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:30:10.772179 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770238 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:30:10.772179 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770241 6591 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:30:10.772179 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770244 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:30:10.772179 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770246 6591 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:30:10.772179 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770249 6591 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:30:10.772179 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770251 6591 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:30:10.772179 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770253 6591 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:30:10.772179 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770256 6591 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:30:10.772179 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770259 6591 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:30:10.772179 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770261 6591 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:30:10.772179 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770264 6591 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:30:10.772677 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770267 6591 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:30:10.772677 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770270 6591 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:30:10.772677 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770272 6591 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:30:10.772677 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770275 6591 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:30:10.772677 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770277 6591 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:30:10.772677 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770280 6591 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:30:10.772677 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770282 6591 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:30:10.772677 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770285 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:30:10.772677 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770288 6591 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:30:10.772677 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770290 6591 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:30:10.772677 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770293 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:30:10.772677 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770295 6591 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:30:10.772677 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770298 6591 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:30:10.772677 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770301 6591 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:30:10.772677 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770303 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:30:10.772677 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770306 6591 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:30:10.772677 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770308 6591 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:30:10.772677 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770311 6591 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:30:10.772677 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770314 6591 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:30:10.772677 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770317 6591 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:30:10.773159 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770320 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:30:10.773159 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770322 6591 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:30:10.773159 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770325 6591 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:30:10.773159 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770327 6591 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:30:10.773159 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770330 6591 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:30:10.773159 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770332 6591 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:30:10.773159 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770334 6591 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:30:10.773159 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770337 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:30:10.773159 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770340 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:30:10.773159 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770342 6591 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:30:10.773159 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770344 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:30:10.773159 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770347 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:30:10.773159 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770349 6591 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:30:10.773159 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770352 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:30:10.773159 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770355 6591 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:30:10.773159 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770357 6591 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:30:10.773159 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770360 6591 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:30:10.773159 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770362 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:30:10.773159 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770365 6591 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:30:10.773643 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770367 6591 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:30:10.773643 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770370 6591 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:30:10.773643 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770373 6591 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:30:10.773643 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770375 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:30:10.773643 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770378 6591 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:30:10.773643 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770380 6591 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:30:10.773643 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770382 6591 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:30:10.773643 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770387 6591 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:30:10.773643 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770390 6591 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:30:10.773643 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770392 6591 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:30:10.773643 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770395 6591 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:30:10.773643 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770397 6591 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:30:10.773643 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770400 6591 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:30:10.773643 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770402 6591 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:30:10.773643 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770405 6591 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:30:10.773643 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770407 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:30:10.773643 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770409 6591 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:30:10.773643 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770412 6591 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:30:10.773643 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770434 6591 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:30:10.773643 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770439 6591 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:30:10.774109 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770443 6591 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:30:10.774109 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770446 6591 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:30:10.774109 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770450 6591 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:30:10.774109 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770454 6591 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:30:10.774109 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770456 6591 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:30:10.774109 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770459 6591 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:30:10.774109 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770462 6591 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:30:10.774109 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770464 6591 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:30:10.774109 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770467 6591 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:30:10.774109 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770469 6591 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:30:10.774109 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770472 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:30:10.774109 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770474 6591 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:30:10.774109 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770476 6591 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:30:10.774109 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770480 6591 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:30:10.774109 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770485 6591 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:30:10.774109 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770956 6591 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:30:10.774109 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770962 6591 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:30:10.774109 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770965 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:30:10.774109 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770968 6591 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:30:10.774595 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770972 6591 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:30:10.774595 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770975 6591 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:30:10.774595 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770978 6591 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:30:10.774595 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770981 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:30:10.774595 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770983 6591 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:30:10.774595 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770986 6591 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:30:10.774595 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770989 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:30:10.774595 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770991 6591 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:30:10.774595 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770993 6591 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:30:10.774595 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770996 6591 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:30:10.774595 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.770999 6591 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:30:10.774595 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771002 6591 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:30:10.774595 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771006 6591 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:30:10.774595 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771010 6591 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:30:10.774595 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771013 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:30:10.774595 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771016 6591 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:30:10.774595 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771020 6591 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:30:10.774595 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771023 6591 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:30:10.774595 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771026 6591 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:30:10.775042 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771028 6591 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:30:10.775042 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771031 6591 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:30:10.775042 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771033 6591 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:30:10.775042 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771036 6591 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:30:10.775042 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771038 6591 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:30:10.775042 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771041 6591 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:30:10.775042 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771043 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:30:10.775042 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771047 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:30:10.775042 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771050 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:30:10.775042 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771053 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:30:10.775042 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771055 6591 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:30:10.775042 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771058 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:30:10.775042 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771060 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:30:10.775042 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771064 6591 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:30:10.775042 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771066 6591 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:30:10.775042 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771069 6591 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:30:10.775042 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771071 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:30:10.775042 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771074 6591 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:30:10.775042 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771076 6591 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:30:10.775512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771079 6591 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:30:10.775512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771081 6591 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:30:10.775512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771084 6591 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:30:10.775512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771086 6591 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:30:10.775512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771089 6591 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:30:10.775512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771091 6591 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:30:10.775512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771094 6591 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:30:10.775512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771096 6591 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:30:10.775512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771098 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:30:10.775512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771101 6591 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:30:10.775512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771103 6591 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:30:10.775512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771106 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:30:10.775512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771109 6591 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:30:10.775512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771111 6591 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:30:10.775512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771114 6591 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:30:10.775512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771116 6591 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:30:10.775512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771118 6591 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:30:10.775512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771121 6591 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:30:10.775512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771123 6591 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:30:10.775512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771125 6591 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:30:10.776023 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771129 6591 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:30:10.776023 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771132 6591 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:30:10.776023 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771134 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:30:10.776023 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771138 6591 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:30:10.776023 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771140 6591 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:30:10.776023 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771142 6591 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:30:10.776023 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771146 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:30:10.776023 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771149 6591 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:30:10.776023 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771151 6591 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:30:10.776023 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771154 6591 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:30:10.776023 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771157 6591 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:30:10.776023 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771159 6591 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:30:10.776023 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771161 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:30:10.776023 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771164 6591 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:30:10.776023 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771166 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:30:10.776023 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771169 6591 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:30:10.776023 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771171 6591 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:30:10.776023 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771173 6591 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:30:10.776023 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771177 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:30:10.776503 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771179 6591 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:30:10.776503 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771181 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:30:10.776503 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771184 6591 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:30:10.776503 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771186 6591 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:30:10.776503 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771189 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:30:10.776503 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771191 6591 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:30:10.776503 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771194 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:30:10.776503 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771196 6591 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:30:10.776503 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771199 6591 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:30:10.776503 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771201 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:30:10.776503 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771203 6591 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:30:10.776503 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771206 6591 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:30:10.776503 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771208 6591 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:30:10.776503 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771212 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:30:10.776503 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771214 6591 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:30:10.776503 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771217 6591 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:30:10.776503 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771219 6591 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:30:10.776503 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771222 6591 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:30:10.776503 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771225 6591 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:30:10.776503 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771228 6591 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771231 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771234 6591 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771236 6591 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771239 6591 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.771241 6591 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771339 6591 flags.go:64] FLAG: --address="0.0.0.0" Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771346 6591 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771352 6591 flags.go:64] FLAG: --anonymous-auth="true" Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771357 6591 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771361 6591 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771366 6591 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771372 6591 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771377 6591 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771380 6591 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771385 6591 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771392 6591 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771397 6591 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771402 6591 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771404 6591 flags.go:64] FLAG: --cgroup-root="" Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771408 6591 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771411 6591 flags.go:64] FLAG: --client-ca-file="" Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771414 6591 flags.go:64] FLAG: --cloud-provider="external" Oct 31 00:30:10.776970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771433 6591 flags.go:64] FLAG: --cluster-dns="[]" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771437 6591 flags.go:64] FLAG: --cluster-domain="" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771440 6591 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771444 6591 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771448 6591 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771451 6591 flags.go:64] FLAG: --container-log-max-files="5" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771455 6591 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771457 6591 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771461 6591 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771466 6591 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771469 6591 flags.go:64] FLAG: --contention-profiling="false" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771472 6591 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771475 6591 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771478 6591 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771481 6591 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771485 6591 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771487 6591 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771490 6591 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771493 6591 flags.go:64] FLAG: --enable-load-reader="false" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771496 6591 flags.go:64] FLAG: --enable-server="true" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771499 6591 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771503 6591 flags.go:64] FLAG: --event-burst="100" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771506 6591 flags.go:64] FLAG: --event-qps="50" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771509 6591 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 31 00:30:10.777522 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771512 6591 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771515 6591 flags.go:64] FLAG: --eviction-hard="" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771519 6591 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771522 6591 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771525 6591 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771528 6591 flags.go:64] FLAG: --eviction-soft="" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771531 6591 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771533 6591 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771536 6591 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771539 6591 flags.go:64] FLAG: --experimental-mounter-path="" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771542 6591 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771546 6591 flags.go:64] FLAG: --fail-swap-on="true" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771549 6591 flags.go:64] FLAG: --feature-gates="" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771553 6591 flags.go:64] FLAG: --file-check-frequency="20s" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771556 6591 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771559 6591 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771562 6591 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771569 6591 flags.go:64] FLAG: --healthz-port="10248" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771573 6591 flags.go:64] FLAG: --help="false" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771576 6591 flags.go:64] FLAG: --hostname-override="ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771579 6591 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771582 6591 flags.go:64] FLAG: --http-check-frequency="20s" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771585 6591 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 31 00:30:10.778095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771588 6591 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771591 6591 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771594 6591 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771597 6591 flags.go:64] FLAG: --image-service-endpoint="" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771600 6591 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771603 6591 flags.go:64] FLAG: --kube-api-burst="100" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771606 6591 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771609 6591 flags.go:64] FLAG: --kube-api-qps="50" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771611 6591 flags.go:64] FLAG: --kube-reserved="" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771614 6591 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771617 6591 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771620 6591 flags.go:64] FLAG: --kubelet-cgroups="" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771623 6591 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771625 6591 flags.go:64] FLAG: --lock-file="" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771628 6591 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771631 6591 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771634 6591 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771640 6591 flags.go:64] FLAG: --log-json-split-stream="false" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771642 6591 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771645 6591 flags.go:64] FLAG: --log-text-split-stream="false" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771650 6591 flags.go:64] FLAG: --logging-format="text" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771653 6591 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771656 6591 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771658 6591 flags.go:64] FLAG: --manifest-url="" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771661 6591 flags.go:64] FLAG: --manifest-url-header="" Oct 31 00:30:10.778667 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771665 6591 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771669 6591 flags.go:64] FLAG: --max-open-files="1000000" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771682 6591 flags.go:64] FLAG: --max-pods="110" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771685 6591 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771688 6591 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771691 6591 flags.go:64] FLAG: --memory-manager-policy="None" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771694 6591 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771697 6591 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771700 6591 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771702 6591 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771715 6591 flags.go:64] FLAG: --node-status-max-images="50" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771718 6591 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771721 6591 flags.go:64] FLAG: --oom-score-adj="-999" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771724 6591 flags.go:64] FLAG: --pod-cidr="" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771727 6591 flags.go:64] FLAG: --pod-manifest-path="" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771729 6591 flags.go:64] FLAG: --pod-max-pids="-1" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771732 6591 flags.go:64] FLAG: --pods-per-core="0" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771735 6591 flags.go:64] FLAG: --port="10250" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771738 6591 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771741 6591 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-04b3e2fdf19e92dbe" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771744 6591 flags.go:64] FLAG: --qos-reserved="" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771746 6591 flags.go:64] FLAG: --read-only-port="10255" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771749 6591 flags.go:64] FLAG: --register-node="true" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771752 6591 flags.go:64] FLAG: --register-with-taints="" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771756 6591 flags.go:64] FLAG: --registry-burst="10" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771758 6591 flags.go:64] FLAG: --registry-qps="5" Oct 31 00:30:10.779316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771761 6591 flags.go:64] FLAG: --reserved-cpus="" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771765 6591 flags.go:64] FLAG: --reserved-memory="" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771769 6591 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771771 6591 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771774 6591 flags.go:64] FLAG: --rotate-certificates="false" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771777 6591 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771780 6591 flags.go:64] FLAG: --runonce="false" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771784 6591 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771787 6591 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771795 6591 flags.go:64] FLAG: --seccomp-default="false" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771798 6591 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771801 6591 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771804 6591 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771807 6591 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771810 6591 flags.go:64] FLAG: --storage-driver-password="root" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771813 6591 flags.go:64] FLAG: --storage-driver-secure="false" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771815 6591 flags.go:64] FLAG: --storage-driver-table="stats" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771818 6591 flags.go:64] FLAG: --storage-driver-user="root" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771821 6591 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771824 6591 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771826 6591 flags.go:64] FLAG: --system-cgroups="" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771829 6591 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771834 6591 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771837 6591 flags.go:64] FLAG: --tls-cert-file="" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771840 6591 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 31 00:30:10.780052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771844 6591 flags.go:64] FLAG: --tls-min-version="" Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771847 6591 flags.go:64] FLAG: --tls-private-key-file="" Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771849 6591 flags.go:64] FLAG: --topology-manager-policy="none" Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771852 6591 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771855 6591 flags.go:64] FLAG: --topology-manager-scope="container" Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771858 6591 flags.go:64] FLAG: --v="2" Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771862 6591 flags.go:64] FLAG: --version="false" Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771866 6591 flags.go:64] FLAG: --vmodule="" Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771870 6591 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.771873 6591 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772002 6591 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772007 6591 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772009 6591 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772012 6591 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772017 6591 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772019 6591 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772022 6591 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772025 6591 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772028 6591 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772030 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772033 6591 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:30:10.781094 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772036 6591 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:30:10.781843 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772038 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:30:10.781843 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772041 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:30:10.781843 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772044 6591 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:30:10.781843 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772046 6591 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:30:10.781843 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772049 6591 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:30:10.781843 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772051 6591 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:30:10.781843 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772053 6591 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:30:10.781843 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772056 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:30:10.781843 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772058 6591 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:30:10.781843 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772060 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:30:10.781843 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772063 6591 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:30:10.781843 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772065 6591 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:30:10.781843 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772068 6591 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:30:10.781843 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772070 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:30:10.781843 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772073 6591 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:30:10.781843 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772075 6591 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:30:10.781843 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772078 6591 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:30:10.781843 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772082 6591 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:30:10.781843 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772086 6591 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:30:10.782400 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772089 6591 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:30:10.782400 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772091 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:30:10.782400 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772094 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:30:10.782400 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772096 6591 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:30:10.782400 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772099 6591 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:30:10.782400 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772102 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:30:10.782400 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772105 6591 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:30:10.782400 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772108 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:30:10.782400 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772110 6591 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:30:10.782400 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772113 6591 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:30:10.782400 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772115 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:30:10.782400 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772118 6591 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:30:10.782400 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772120 6591 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:30:10.782400 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772123 6591 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:30:10.782400 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772125 6591 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:30:10.782400 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772127 6591 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:30:10.782400 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772130 6591 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:30:10.782400 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772132 6591 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:30:10.782400 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772135 6591 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:30:10.783066 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772137 6591 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:30:10.783066 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772139 6591 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:30:10.783066 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772142 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:30:10.783066 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772144 6591 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:30:10.783066 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772147 6591 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:30:10.783066 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772150 6591 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:30:10.783066 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772152 6591 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:30:10.783066 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772154 6591 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:30:10.783066 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772157 6591 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:30:10.783066 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772159 6591 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:30:10.783066 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772162 6591 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:30:10.783066 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772165 6591 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:30:10.783066 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772167 6591 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:30:10.783066 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772169 6591 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:30:10.783066 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772172 6591 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:30:10.783066 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772174 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:30:10.783066 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772177 6591 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:30:10.783066 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772179 6591 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:30:10.783066 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772184 6591 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:30:10.783583 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772187 6591 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:30:10.783583 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772190 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:30:10.783583 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772193 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:30:10.783583 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772195 6591 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:30:10.783583 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772199 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:30:10.783583 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772201 6591 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:30:10.783583 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772204 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:30:10.783583 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772206 6591 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:30:10.783583 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772209 6591 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:30:10.783583 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772212 6591 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:30:10.783583 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772214 6591 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:30:10.783583 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772217 6591 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:30:10.783583 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772219 6591 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:30:10.783583 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772221 6591 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:30:10.783583 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772224 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:30:10.783583 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772226 6591 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:30:10.783583 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772229 6591 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:30:10.783583 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772231 6591 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:30:10.783583 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772234 6591 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:30:10.783583 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772236 6591 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:30:10.784064 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772238 6591 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:30:10.784064 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772241 6591 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:30:10.784064 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772243 6591 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:30:10.784064 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772246 6591 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:30:10.784064 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772248 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:30:10.784064 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772250 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:30:10.784064 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772253 6591 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:30:10.784064 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772255 6591 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:30:10.784064 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772257 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:30:10.784064 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772261 6591 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:30:10.784064 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772265 6591 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:30:10.784064 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772269 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:30:10.784064 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772272 6591 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:30:10.784064 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772275 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:30:10.784064 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772277 6591 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:30:10.784064 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772280 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:30:10.784064 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772282 6591 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:30:10.784635 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.772316 6591 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 00:30:10.784635 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772355 6591 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:30:10.784635 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772359 6591 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:30:10.784635 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772364 6591 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:30:10.784635 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772367 6591 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:30:10.784635 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772369 6591 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:30:10.784635 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772372 6591 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:30:10.784635 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772374 6591 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:30:10.784635 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772377 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:30:10.784635 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772379 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:30:10.784635 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772382 6591 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:30:10.784635 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772384 6591 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:30:10.784635 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772387 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:30:10.784635 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772391 6591 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:30:10.784635 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772394 6591 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:30:10.785100 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772397 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:30:10.785100 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772401 6591 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:30:10.785100 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772403 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:30:10.785100 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772406 6591 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:30:10.785100 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772408 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:30:10.785100 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772411 6591 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:30:10.785100 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772413 6591 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:30:10.785100 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772429 6591 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:30:10.785100 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772431 6591 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:30:10.785100 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772434 6591 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:30:10.785100 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772437 6591 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:30:10.785100 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772439 6591 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:30:10.785100 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772441 6591 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:30:10.785100 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772444 6591 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:30:10.785100 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772446 6591 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:30:10.785100 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772449 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:30:10.785100 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772451 6591 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:30:10.785100 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772454 6591 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:30:10.785100 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772457 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:30:10.785638 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772459 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:30:10.785638 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772463 6591 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:30:10.785638 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772466 6591 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:30:10.785638 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772468 6591 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:30:10.785638 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772470 6591 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:30:10.785638 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772473 6591 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:30:10.785638 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772475 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:30:10.785638 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772477 6591 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:30:10.785638 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772480 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:30:10.785638 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772482 6591 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:30:10.785638 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772485 6591 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:30:10.785638 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772487 6591 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:30:10.785638 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772490 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:30:10.785638 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772492 6591 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:30:10.785638 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772495 6591 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:30:10.785638 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772497 6591 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:30:10.785638 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772502 6591 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:30:10.785638 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772506 6591 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:30:10.785638 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772509 6591 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:30:10.786082 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772512 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:30:10.786082 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772515 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:30:10.786082 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772517 6591 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:30:10.786082 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772519 6591 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:30:10.786082 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772522 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:30:10.786082 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772524 6591 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:30:10.786082 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772527 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:30:10.786082 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772529 6591 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:30:10.786082 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772531 6591 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:30:10.786082 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772534 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:30:10.786082 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772536 6591 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:30:10.786082 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772538 6591 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:30:10.786082 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772541 6591 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:30:10.786082 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772544 6591 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:30:10.786082 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772549 6591 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:30:10.786082 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772551 6591 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:30:10.786082 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772554 6591 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:30:10.786082 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772556 6591 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:30:10.786082 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772558 6591 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:30:10.786555 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772561 6591 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:30:10.786555 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772563 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:30:10.786555 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772566 6591 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:30:10.786555 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772568 6591 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:30:10.786555 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772571 6591 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:30:10.786555 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772573 6591 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:30:10.786555 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772576 6591 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:30:10.786555 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772578 6591 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:30:10.786555 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772581 6591 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:30:10.786555 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772583 6591 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:30:10.786555 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772586 6591 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:30:10.786555 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772588 6591 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:30:10.786555 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772590 6591 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:30:10.786555 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772593 6591 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:30:10.786555 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772595 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:30:10.786555 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772598 6591 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:30:10.786555 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772600 6591 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:30:10.786555 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772602 6591 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:30:10.786555 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772605 6591 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:30:10.786993 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772608 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:30:10.786993 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772610 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:30:10.786993 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772612 6591 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:30:10.786993 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772615 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:30:10.786993 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772617 6591 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:30:10.786993 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772619 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:30:10.786993 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772622 6591 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:30:10.786993 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772624 6591 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:30:10.786993 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772628 6591 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:30:10.786993 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772630 6591 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:30:10.786993 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772633 6591 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:30:10.786993 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772635 6591 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:30:10.786993 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772638 6591 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:30:10.786993 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772641 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:30:10.786993 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772644 6591 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:30:10.786993 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.772648 6591 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:30:10.786993 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.776109 6591 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 31 00:30:10.786993 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.776124 6591 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 31 00:30:10.786993 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.776141 6591 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 31 00:30:10.786993 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.776146 6591 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 31 00:30:10.787491 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776199 6591 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:30:10.787491 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776205 6591 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:30:10.787491 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776208 6591 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:30:10.787491 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776211 6591 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:30:10.787491 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776213 6591 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:30:10.787491 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776216 6591 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:30:10.787491 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776219 6591 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:30:10.787491 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776222 6591 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:30:10.787491 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776224 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:30:10.787491 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776227 6591 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:30:10.787491 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776230 6591 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:30:10.787491 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776232 6591 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:30:10.787491 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776235 6591 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:30:10.787491 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776237 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:30:10.787491 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776240 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:30:10.787491 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776242 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:30:10.787491 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776245 6591 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:30:10.787491 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776247 6591 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:30:10.787491 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776250 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:30:10.788001 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776252 6591 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:30:10.788001 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776256 6591 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:30:10.788001 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776258 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:30:10.788001 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776261 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:30:10.788001 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776263 6591 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:30:10.788001 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776266 6591 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:30:10.788001 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776268 6591 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:30:10.788001 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776271 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:30:10.788001 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776273 6591 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:30:10.788001 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776276 6591 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:30:10.788001 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776279 6591 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:30:10.788001 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776282 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:30:10.788001 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776285 6591 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:30:10.788001 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776287 6591 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:30:10.788001 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776290 6591 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:30:10.788001 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776292 6591 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:30:10.788001 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776294 6591 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:30:10.788001 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776297 6591 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:30:10.788001 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776299 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:30:10.788001 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776310 6591 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:30:10.788512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776313 6591 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:30:10.788512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776316 6591 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:30:10.788512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776319 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:30:10.788512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776321 6591 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:30:10.788512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776323 6591 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:30:10.788512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776326 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:30:10.788512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776328 6591 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:30:10.788512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776331 6591 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:30:10.788512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776334 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:30:10.788512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776337 6591 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:30:10.788512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776339 6591 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:30:10.788512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776342 6591 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:30:10.788512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776345 6591 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:30:10.788512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776347 6591 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:30:10.788512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776349 6591 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:30:10.788512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776352 6591 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:30:10.788512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776355 6591 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:30:10.788512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776357 6591 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:30:10.788512 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776360 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:30:10.788951 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776362 6591 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:30:10.788951 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776365 6591 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:30:10.788951 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776368 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:30:10.788951 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776370 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:30:10.788951 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776375 6591 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:30:10.788951 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776377 6591 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:30:10.788951 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776380 6591 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:30:10.788951 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776383 6591 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:30:10.788951 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776387 6591 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:30:10.788951 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776390 6591 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:30:10.788951 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776393 6591 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:30:10.788951 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776396 6591 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:30:10.788951 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776399 6591 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:30:10.788951 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776402 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:30:10.788951 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776405 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:30:10.788951 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776407 6591 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:30:10.788951 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776410 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:30:10.788951 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776414 6591 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:30:10.788951 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776430 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:30:10.789399 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776433 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:30:10.789399 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776436 6591 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:30:10.789399 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776439 6591 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:30:10.789399 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776441 6591 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:30:10.789399 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776444 6591 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:30:10.789399 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776446 6591 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:30:10.789399 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776449 6591 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:30:10.789399 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776451 6591 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:30:10.789399 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776454 6591 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:30:10.789399 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776457 6591 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:30:10.789399 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776459 6591 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:30:10.789399 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776462 6591 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:30:10.789399 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776464 6591 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:30:10.789399 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776467 6591 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:30:10.789399 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776469 6591 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:30:10.789399 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776472 6591 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:30:10.789399 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776474 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:30:10.789399 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776477 6591 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:30:10.789399 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776480 6591 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:30:10.789399 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776482 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:30:10.789962 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776485 6591 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:30:10.789962 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776487 6591 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:30:10.789962 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776490 6591 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:30:10.789962 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776492 6591 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:30:10.789962 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776495 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:30:10.789962 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776497 6591 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:30:10.789962 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776500 6591 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:30:10.789962 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776503 6591 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:30:10.789962 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776505 6591 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:30:10.789962 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.776533 6591 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 00:30:10.789962 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776660 6591 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:30:10.789962 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776664 6591 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:30:10.789962 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776666 6591 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:30:10.789962 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776669 6591 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:30:10.789962 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776671 6591 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:30:10.789962 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776674 6591 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:30:10.790360 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776676 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:30:10.790360 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776679 6591 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:30:10.790360 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776681 6591 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:30:10.790360 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776684 6591 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:30:10.790360 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776686 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:30:10.790360 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776689 6591 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:30:10.790360 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776691 6591 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:30:10.790360 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776694 6591 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:30:10.790360 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776696 6591 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:30:10.790360 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776699 6591 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:30:10.790360 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776701 6591 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:30:10.790360 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776704 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:30:10.790360 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776706 6591 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:30:10.790360 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776708 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:30:10.790360 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776711 6591 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:30:10.790360 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776714 6591 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:30:10.790360 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776716 6591 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:30:10.790360 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776719 6591 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:30:10.790891 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776722 6591 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:30:10.790891 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776725 6591 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:30:10.790891 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776728 6591 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:30:10.790891 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776731 6591 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:30:10.790891 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776734 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:30:10.790891 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776737 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:30:10.790891 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776740 6591 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:30:10.790891 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776742 6591 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:30:10.790891 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776744 6591 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:30:10.790891 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776747 6591 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:30:10.790891 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776749 6591 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:30:10.790891 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776752 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:30:10.790891 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776754 6591 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:30:10.790891 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776756 6591 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:30:10.790891 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776759 6591 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:30:10.790891 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776761 6591 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:30:10.790891 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776764 6591 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:30:10.790891 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776766 6591 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:30:10.790891 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776768 6591 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:30:10.790891 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776771 6591 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:30:10.791521 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776773 6591 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:30:10.791521 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776776 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:30:10.791521 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776778 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:30:10.791521 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776780 6591 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:30:10.791521 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776783 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:30:10.791521 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776786 6591 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:30:10.791521 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776788 6591 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:30:10.791521 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776791 6591 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:30:10.791521 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776793 6591 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:30:10.791521 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776796 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:30:10.791521 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776799 6591 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:30:10.791521 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776801 6591 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:30:10.791521 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776805 6591 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:30:10.791521 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776808 6591 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:30:10.791521 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776810 6591 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:30:10.791521 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776813 6591 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:30:10.791521 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776816 6591 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:30:10.791521 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776818 6591 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:30:10.791521 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776820 6591 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:30:10.792165 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776823 6591 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:30:10.792165 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776825 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:30:10.792165 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776828 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:30:10.792165 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776830 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:30:10.792165 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776833 6591 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:30:10.792165 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776835 6591 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:30:10.792165 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776838 6591 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:30:10.792165 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776840 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:30:10.792165 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776843 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:30:10.792165 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776845 6591 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:30:10.792165 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776847 6591 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:30:10.792165 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776850 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:30:10.792165 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776853 6591 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:30:10.792165 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776855 6591 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:30:10.792165 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776858 6591 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:30:10.792165 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776860 6591 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:30:10.792165 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776866 6591 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:30:10.792165 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776868 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:30:10.792165 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776872 6591 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:30:10.792786 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776875 6591 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:30:10.792786 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776877 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:30:10.792786 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776880 6591 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:30:10.792786 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776882 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:30:10.792786 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776885 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:30:10.792786 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776888 6591 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:30:10.792786 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776890 6591 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:30:10.792786 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776893 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:30:10.792786 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776895 6591 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:30:10.792786 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776898 6591 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:30:10.792786 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776900 6591 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:30:10.792786 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776903 6591 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:30:10.792786 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776905 6591 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:30:10.792786 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776908 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:30:10.792786 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776910 6591 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:30:10.792786 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776912 6591 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:30:10.792786 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776915 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:30:10.792786 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776917 6591 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:30:10.792786 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776920 6591 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:30:10.793393 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776922 6591 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:30:10.793393 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776925 6591 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:30:10.793393 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776927 6591 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:30:10.793393 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776930 6591 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:30:10.793393 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.776932 6591 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:30:10.793393 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.776956 6591 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 00:30:10.793393 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777002 6591 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:30:10.793393 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777007 6591 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:30:10.793393 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777009 6591 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:30:10.793393 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777012 6591 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:30:10.793393 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777015 6591 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:30:10.793393 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777018 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:30:10.793393 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777022 6591 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:30:10.793393 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777025 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:30:10.793393 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777028 6591 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:30:10.793393 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777030 6591 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:30:10.794076 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777032 6591 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:30:10.794076 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777035 6591 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:30:10.794076 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777039 6591 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:30:10.794076 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777043 6591 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:30:10.794076 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777046 6591 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:30:10.794076 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777049 6591 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:30:10.794076 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777052 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:30:10.794076 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777054 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:30:10.794076 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777057 6591 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:30:10.794076 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777059 6591 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:30:10.794076 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777062 6591 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:30:10.794076 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777064 6591 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:30:10.794076 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777067 6591 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:30:10.794076 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777069 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:30:10.794076 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777072 6591 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:30:10.794076 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777074 6591 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:30:10.794076 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777076 6591 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:30:10.794076 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777079 6591 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:30:10.794076 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777082 6591 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:30:10.794623 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777084 6591 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:30:10.794623 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777086 6591 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:30:10.794623 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777089 6591 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:30:10.794623 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777091 6591 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:30:10.794623 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777093 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:30:10.794623 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777096 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:30:10.794623 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777098 6591 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:30:10.794623 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777101 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:30:10.794623 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777105 6591 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:30:10.794623 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777108 6591 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:30:10.794623 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777111 6591 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:30:10.794623 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777113 6591 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:30:10.794623 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777116 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:30:10.794623 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777118 6591 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:30:10.794623 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777121 6591 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:30:10.794623 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777125 6591 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:30:10.794623 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777128 6591 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:30:10.794623 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777132 6591 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:30:10.794623 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777134 6591 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:30:10.794623 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777137 6591 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:30:10.795150 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777139 6591 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:30:10.795150 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777141 6591 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:30:10.795150 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777144 6591 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:30:10.795150 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777146 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:30:10.795150 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777149 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:30:10.795150 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777151 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:30:10.795150 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777154 6591 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:30:10.795150 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777156 6591 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:30:10.795150 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777159 6591 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:30:10.795150 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777161 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:30:10.795150 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777164 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:30:10.795150 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777166 6591 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:30:10.795150 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777168 6591 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:30:10.795150 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777171 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:30:10.795150 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777173 6591 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:30:10.795150 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777175 6591 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:30:10.795150 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777178 6591 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:30:10.795150 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777180 6591 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:30:10.795150 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777182 6591 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:30:10.795987 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777184 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:30:10.795987 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777189 6591 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:30:10.795987 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777192 6591 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:30:10.795987 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777195 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:30:10.795987 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777197 6591 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:30:10.795987 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777200 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:30:10.795987 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777202 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:30:10.795987 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777205 6591 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:30:10.795987 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777207 6591 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:30:10.795987 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777210 6591 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:30:10.795987 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777212 6591 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:30:10.795987 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777215 6591 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:30:10.795987 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777218 6591 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:30:10.795987 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777220 6591 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:30:10.795987 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777223 6591 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:30:10.795987 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777225 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:30:10.795987 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777228 6591 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:30:10.795987 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777230 6591 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:30:10.795987 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777232 6591 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:30:10.796661 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777235 6591 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:30:10.796661 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777237 6591 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:30:10.796661 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777239 6591 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:30:10.796661 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777242 6591 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:30:10.796661 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777245 6591 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:30:10.796661 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777247 6591 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:30:10.796661 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777249 6591 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:30:10.796661 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777252 6591 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:30:10.796661 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777254 6591 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:30:10.796661 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777256 6591 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:30:10.796661 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777259 6591 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:30:10.796661 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777261 6591 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:30:10.796661 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777263 6591 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:30:10.796661 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777266 6591 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:30:10.796661 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777270 6591 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:30:10.796661 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777274 6591 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:30:10.796661 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777277 6591 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:30:10.796661 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777279 6591 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:30:10.796661 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:10.777281 6591 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:30:10.796661 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.777328 6591 server.go:957] "Client rotation is on, will bootstrap in background" Oct 31 00:30:10.797151 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.778210 6591 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 31 00:30:10.797151 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.778256 6591 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 31 00:30:10.797151 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.778446 6591 server.go:1014] "Starting client certificate rotation" Oct 31 00:30:10.797151 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.778581 6591 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 31 00:30:10.797151 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.778630 6591 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 00:23:59 +0000 UTC" deadline="2028-04-04 14:58:03.439040815 +0000 UTC" Oct 31 00:30:10.797151 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.778662 6591 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12518h27m52.660380623s" Oct 31 00:30:10.797151 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.778891 6591 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 31 00:30:10.797151 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.779914 6591 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 31 00:30:10.797151 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.782405 6591 log.go:25] "Validated CRI v1 runtime API" Oct 31 00:30:10.797151 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.784291 6591 log.go:25] "Validated CRI v1 image API" Oct 31 00:30:10.797151 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.785043 6591 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 31 00:30:10.797151 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.787146 6591 fs.go:135] Filesystem UUIDs: map[2310dd9f-6ca9-4deb-81d5-c6f19f2809d5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b6667d17-927a-48fb-bee2-f2bad2f7ab2b:/dev/nvme0n1p3] Oct 31 00:30:10.797614 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.787162 6591 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0693db672ea76ea9e8c59224fc5c641499eeb943122dedff78bcf2fa6f1f575e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0693db672ea76ea9e8c59224fc5c641499eeb943122dedff78bcf2fa6f1f575e/userdata/shm major:0 minor:253 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0c6c2b9b49560f008183b9af37fc28fcf93f25229cd1d47cd3b5dbb06269bc38/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0c6c2b9b49560f008183b9af37fc28fcf93f25229cd1d47cd3b5dbb06269bc38/userdata/shm major:0 minor:402 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/105f81a407ed8ae4dcf3b52f848d31c53b4d44302ec7509c825a6cadf6b8e392/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/105f81a407ed8ae4dcf3b52f848d31c53b4d44302ec7509c825a6cadf6b8e392/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/15a05a1a08fb0b5fc87baa8335c7ac2acb6c2f30c786709e7c834cfc75bc3224/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/15a05a1a08fb0b5fc87baa8335c7ac2acb6c2f30c786709e7c834cfc75bc3224/userdata/shm major:0 minor:284 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1f558e15af7c6dbed111f7308422267e2e439e7a1a0eaf02dfeccf63432d6c20/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1f558e15af7c6dbed111f7308422267e2e439e7a1a0eaf02dfeccf63432d6c20/userdata/shm major:0 minor:335 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2f812f411c8a0981f16f3bdb1950ba4c4813e7e1ae5ac75cfdfdd5bb748bfb22/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2f812f411c8a0981f16f3bdb1950ba4c4813e7e1ae5ac75cfdfdd5bb748bfb22/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/41814d6b961f9a1fe99e7e679a5f3a7a05e7f3e9cef7dee556a3c987b80ffeca/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/41814d6b961f9a1fe99e7e679a5f3a7a05e7f3e9cef7dee556a3c987b80ffeca/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4efe75061d94f1640fcc0c19fa7b82f6cfd325e582d474597b1aabe36f0a42fe/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4efe75061d94f1640fcc0c19fa7b82f6cfd325e582d474597b1aabe36f0a42fe/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/62fa67ddc94be6af2d7e42c82f1dfd917d2162f5f745242ab93f3fc833aed26f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/62fa67ddc94be6af2d7e42c82f1dfd917d2162f5f745242ab93f3fc833aed26f/userdata/shm major:0 minor:298 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9179eca04f12367813068df1b2967a42644a337501de4361c09f8c76339c0d04/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9179eca04f12367813068df1b2967a42644a337501de4361c09f8c76339c0d04/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/95d6391c36609eb5973f7d0d4104a7818b2ce219be6a653170cf2027d252310b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/95d6391c36609eb5973f7d0d4104a7818b2ce219be6a653170cf2027d252310b/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/97c4057b1d22f9f71e7e3fe7de0a9e08f78a6f976fbe41fccc1aca1016f82b30/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/97c4057b1d22f9f71e7e3fe7de0a9e08f78a6f976fbe41fccc1aca1016f82b30/userdata/shm major:0 minor:413 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b3a96c1256dc9604fdf940cb17f8732e748a1a454c18af3e23a2ec61daf6cd5a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b3a96c1256dc9604fdf940cb17f8732e748a1a454c18af3e23a2ec61daf6cd5a/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c86782fa1392f6b9a0fd0c68d5f0f5e393e2d54fe272dd12463f8ce18ae1ee1c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c86782fa1392f6b9a0fd0c68d5f0f5e393e2d54fe272dd12463f8ce18ae1ee1c/userdata/shm major:0 minor:260 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ca9e27fce2156c2dc5929bcd4fbd1b84f6124e2126f0b1e825dd3a44dd3dee92/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ca9e27fce2156c2dc5929bcd4fbd1b84f6124e2126f0b1e825dd3a44dd3dee92/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d1e36958212cc3bad9df53ee73c7031515b019514965236038d6a8c82f4d7c1a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d1e36958212cc3bad9df53ee73c7031515b019514965236038d6a8c82f4d7c1a/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d773daf30ca65ca8b21f34273166026dc5a909a3df68e0f7b9caaed52d1c8a97/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d773daf30ca65ca8b21f34273166026dc5a909a3df68e0f7b9caaed52d1c8a97/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/dfa263748904ab39c40a676f0e533718432e5eeeab7fea765caa4be93b4b9f84/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/dfa263748904ab39c40a676f0e533718432e5eeeab7fea765caa4be93b4b9f84/userdata/shm major:0 minor:421 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e0ac25b6b8cddc86816b0d94c71cff163eee470b42bc94d08d7a0d7a770fbfea/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e0ac25b6b8cddc86816b0d94c71cff163eee470b42bc94d08d7a0d7a770fbfea/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e4199e3568a18e2466f585dcb837ed13581f40db130f2aefdf14ce9f04eeb4bb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e4199e3568a18e2466f585dcb837ed13581f40db130f2aefdf14ce9f04eeb4bb/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e49b0200d9617bbe505b4184de058405f01592d9f6f83deba62ef2f35b1e0c36/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e49b0200d9617bbe505b4184de058405f01592d9f6f83deba62ef2f35b1e0c36/userdata/shm major:0 minor:417 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/eeab9038e5292b7dea8a1af0565ba77912223d9521eaeb7635a208cfeff1f8db/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/eeab9038e5292b7dea8a1af0565ba77912223d9521eaeb7635a208cfeff1f8db/userdata/shm major:0 minor:319 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f2fbc74ff263f96e2afe196affb0ca7bbf793a53d8fd1202b97d80d72fe8d33c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f2fbc74ff263f96e2afe196affb0ca7bbf793a53d8fd1202b97d80d72fe8d33c/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c/volumes/kubernetes.io~projected/kube-api-access-g759d:{mountpoint:/var/lib/kubelet/pods/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c/volumes/kubernetes.io~projected/kube-api-access-g759d major:0 minor:401 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:395 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:400 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1720ac40-f3e0-44e3-b2f2-06db389fb9b7/volumes/kubernetes.io~projected/kube-api-access-4n87x:{mountpoint:/var/lib/kubelet/pods/1720ac40-f3e0-44e3-b2f2-06db389fb9b7/volumes/kubernetes.io~projected/kube-api-access-4n87x major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1720ac40-f3e0-44e3-b2f2-06db389fb9b7/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/1720ac40-f3e0-44e3-b2f2-06db389fb9b7/volumes/kubernetes.io~secret/metrics-certs major:0 minor:408 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1df475be-e1fe-4e90-b60f-dc3763a66cc6/volumes/kubernetes.io~projected/kube-api-access-vcvrc:{mountpoint:/var/lib/kubelet/pods/1df475be-e1fe-4e90-b60f-dc3763a66cc6/volumes/kubernetes.io~projected/kube-api-access-vcvrc major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1df475be-e1fe-4e90-b60f-dc3763a66cc6/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/1df475be-e1fe-4e90-b60f-dc3763a66cc6/volumes/kubernetes.io~secret/metrics-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2/volumes/kubernetes.io~projected/kube-api-access-4stfl:{mountpoint:/var/lib/kubelet/pods/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2/volumes/kubernetes.io~projected/kube-api-access-4stfl major:0 minor:252 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:251 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:246 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3b3c9cfb-2fd5-4a88-a938-77f38dd28969/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/3b3c9cfb-2fd5-4a88-a938-77f38dd28969/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:415 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/447b2177-70e2-46dd-a082-6c750a49db1c/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/447b2177-70e2-46dd-a082-6c750a49db1c/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/447b2177-70e2-46dd-a082-6c750a49db1c/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/447b2177-70e2-46dd-a082-6c750a49db1c/volumes/kubernetes.io~empty-dir/tmp major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/447b2177-70e2-46dd-a082-6c750a49db1c/volumes/kubernetes.io~projected/kube-api-access-xmkhp:{mountpoint:/var/lib/kubelet/pods/447b2177-70e2-46dd-a082-6c750a49db1c/volumes/kubernetes.io~projected/kube-api-access-xmkhp major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4d754c0a-9f48-439b-8673-6ba91b6408ff/volumes/kubernetes.io~projected/kube-api-access-b47dq:{mountpoint:/var/lib/kubelet/pods/4d754c0a-9f48-439b-8673-6ba91b6408ff/volumes/kubernetes.io~projected/kube-api-access-b47dq major:0 minor:416 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7573854a-4782-4c89-b93a-43503a30fec2/volumes/kubernetes.io~projected/kube-api-access-q54rb:{mountpoint:/var/lib/kubelet/pods/7573854a-4782-4c89-b93a-43503a30fec2/volumes/kubernetes.io~projected/kube-api-access-q54rb major:0 minor:259 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7573854a-4782-4c89-b93a-43503a30fec2/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/7573854a-4782-4c89-b93a-43503a30fec2/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:258 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7573854a-4782-4c89-b93a-43503a30fec2/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/7573854a-4782-4c89-b93a-43503a30fec2/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:257 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:294 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volume-subpaths/web-config/alertmanager/9 major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volume-subpaths/web-config/config-reloader/6 major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~empty-dir/config-out major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~projected/kube-api-access-9nqnf:{mountpoint:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~projected/kube-api-access-9nqnf major:0 minor:297 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~projected/tls-assets major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:294 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/config-volume major:0 minor:291 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:292 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:289 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/web-config major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~projected/kube-api-access-rr42q:{mountpoint:/var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~projected/kube-api-access-rr42q major:0 minor:318 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:313 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:317 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:309 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/81ef083c-e93d-4531-949e-22999120731e/volumes/kubernetes.io~projected/kube-api-access-6m7qc:{mountpoint:/var/lib/kubelet/pods/81ef083c-e93d-4531-949e-22999120731e/volumes/kubernetes.io~projected/kube-api-access-6m7qc major:0 minor:283 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/81ef083c-e93d-4531-949e-22999120731e/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/81ef083c-e93d-4531-949e-22999120731e/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:277 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/81ef083c-e93d-4531-949e-22999120731e/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/81ef083c-e93d-4531-949e-22999120731e/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:282 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/87931c70-7b7c-4910-89ce-f84136d7a852/volumes/kubernetes.io~projected/kube-api-access-n2cv8:{mountpoint:/var/lib/kubelet/pods/87931c70-7b7c-4910-89ce-f84136d7a852/volumes/kubernetes.io~projected/kube-api-access-n2cv8 major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a1b304f2-676a-4a6f-bdac-8805188c415f/volumes/kubernetes.io~projected/kube-api-access-z56w9:{mountpoint:/var/lib/kubelet/pods/a1b304f2-676a-4a6f-bdac-8805188c415f/volumes/kubernetes.io~projected/kube-api-access-z56w9 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a2ba2a3b-57ee-4515-a194-cb86198d246b/volumes/kubernetes.io~projected/kube-api-access-lzdpn:{mountpoint:/var/lib/kubelet/pods/a2ba2a3b-57ee-4515-a194-cb86198d246b/volumes/kubernetes.io~projected/kube-api-access-lzdpn major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a47d5fa6-be34-46e7-93f7-44b23c9e9b89/volumes/kubernetes.io~projected/kube-api-access-cqnv9:{mountpoint:/var/lib/kubelet/pods/a47d5fa6-be34-46e7-93f7-44b23c9e9b89/volumes/kubernetes.io~projected/kube-api-access-cqnv9 major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a47d5fa6-be34-46e7-93f7-44b23c9e9b89/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/a47d5fa6-be34-46e7-93f7-44b23c9e9b89/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a4defb35-52f2-46fc-a314-affe5a217a84/volumes/kubernetes.io~projected/kube-api-access-v5vvg:{mountpoint:/var/lib/kubelet/pods/a4defb35-52f2-46fc-a314-affe5a217a84/volumes/kubernetes.io~projected/kube-api-access-v5vvg major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/adc9181f-c401-4d7c-bbcb-409b4b6f60e0/volumes/kubernetes.io~projected/kube-api-access-gxqqx:{mountpoint:/var/lib/kubelet/pods/adc9181f-c401-4d7c-bbcb-409b4b6f60e0/volumes/kubernetes.io~projected/kube-api-access-gxqqx major:0 minor:326 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/adc9181f-c401-4d7c-bbcb-409b4b6f60e0/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/adc9181f-c401-4d7c-bbcb-409b4b6f60e0/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:324 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/adc9181f-c401-4d7c-bbcb-409b4b6f60e0/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/adc9181f-c401-4d7c-bbcb-409b4b6f60e0/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:323 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/adc9181f-c401-4d7c-bbcb-409b4b6f60e0/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/adc9181f-c401-4d7c-bbcb-409b4b6f60e0/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:325 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b1cf311b-c4ed-433e-a582-b4bcfcc402a9/volumes/kubernetes.io~projected/kube-api-access-6fv8r:{mountpoint:/var/lib/kubelet/pods/b1cf311b-c4ed-433e-a582-b4bcfcc402a9/volumes/kubernetes.io~projected/kube-api-access-6fv8r major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b1cf311b-c4ed-433e-a582-b4bcfcc402a9/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/b1cf311b-c4ed-433e-a582-b4bcfcc402a9/volumes/kubernetes.io~secret/cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/volumes/kubernetes.io~projected/kube-api-access-m5fmn:{mountpoint:/var/lib/kubelet/pods/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/volumes/kubernetes.io~projected/kube-api-access-m5fmn major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c3c5e8eb-fd22-42ee-a203-7c3077f48084/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/c3c5e8eb-fd22-42ee-a203-7c3077f48084/volumes/kubernetes.io~secret/agent-certs major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/db01ba46-985b-4967-a668-73e1eb99189b/volumes/kubernetes.io~projected/kube-api-access-g2l4j:{mountpoint:/var/lib/kubelet/pods/db01ba46-985b-4967-a668-73e1eb99189b/volumes/kubernetes.io~projected/kube-api-access-g2l4j major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e3af97b1-99a9-4fab-97b4-ac62b870de03/volumes/kubernetes.io~projected/kube-api-access-4gqct:{mountpoint:/var/lib/kubelet/pods/e3af97b1-99a9-4fab-97b4-ac62b870de03/volumes/kubernetes.io~projected/kube-api-access-4gqct major:0 minor:57 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/a14063e4a72ac3938e0dc31630e37bc04445cdcdcd8876703803977bc902fd88/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/71870114e9e5b24a827831176b4361b15f1a0a00cce9820b1a18a87f11e8034d/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/8020b020a42742608f8501ebd54320dd59fb6644af8921226d176cd1d5a99c98/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/4074183639c0b2701fe905bf71518633fabe96139e49c4e46569251060cd4ba6/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/7ab96f3a52e3a9e8f17df7a2c2f880b1b86b5edb2ba826d804bb3d13c86e2a79/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/80c4f62c0e3bc2e3552dbebb51f1d1434d980d42a155e0c79e1514edc870869e/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-123:{mountpoint:/var/lib/containers/storage/overlay/21bed0af4121eb6e6a00747f543f0f010aa91beee2f4e595e5749393b6c1b798/merged major:0 minor:123 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/108266f0da92095d7c1802fdca7115db518cc7106ae6bcdee970d588767eb206/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/4b26ff72affcd8b8ab2601fa592905351265430bd8d3c3e4a71eb5e5a08969e6/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/67b3c7524e3b3c5d7c1df0c6a582a7cfeb1fbbcff2716b20bba1032563103ebe/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/51b33a8e9a613ae45b08b17a429ee4eeac52da9195bf3de3ea2b8b0441f7547d/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-141:{mountpoint:/var/lib/containers/storage/overlay/ccd5c5f2a8eba43e7fd75f32b738a088f48b17446c4605e932e39bc7f05a47fa/merged major:0 minor:141 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/d9f748a381ca68a473871b04dee3009d8a4ee74b4afca7d769101a699c1178d6/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/1567ce0598c8429e0b7c5b9cda5c94ec75791729b3239d0462c71ed24e8b49cb/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-159:{mountpoint:/var/lib/containers/storage/overlay/62516f3d2abb0019114bca9f0278076e24878865bb6cf4de0b3f66c172ae1bdf/merged major:0 minor:159 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/11db376a1be90e4909be517ff4a2547e225ca05c18edab5abe366424944ebe71/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/ae5d9a2f6f47d545cdcc945042890fbb84cb5c52c3a8a11339bf41f4f12ecdaa/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/5cdb72f99196682ea6c390d54dd76e99304b745ce0034703163bf47361e6ccc4/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/2418a30f25a01143ebfb5b797a579bd5c055cc209593fcd1793f8d141ef84fc9/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/0f861affec1fc74d5222f48a7869c1ba798e9d23137737ad45d8ca84309f83d6/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/e079e59fd229a870c4f65b1340d7d6c98609ba84fa3664c21e98ad9b6bba4b75/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/ea86382dbe21550fcf2ca5da2e13c7279d4e515e74cbd452b5c14ae8a88400f2/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/a9f12d565359af1ed0a8abd750aebef98c6ffe20310d59fc28af0552ed4ec292/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/2ea2b19dde4673411012158280065ae4fbd1501c17aff2b72b8174a9d4cde8e2/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/681afafa59df4d7347d471332d257e630f4994461e5c74b3f356b1ece0bbe191/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-218:{mountpoint:/var/lib/containers/storage/overlay/e3e27e0f6a70b0fff90fbbdbd6c110992f61d0b743560265cdf62d3f1ed65b41/merged major:0 minor:218 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/4c25cfcf9ef0f0ac3c59e86d859a37afaea38b78c379837ba6ea68f657753cdd/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/c59c1a786351ec018001dcb398d52fbe4ba73887f550e20598b82891faa45dc3/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-236:{mountpoint:/var/lib/containers/storage/overlay/026119f42820b9d8877584abb6cfc888de29d6a50889b65226953b97cec6ad19/merged major:0 minor:236 fsType:overlay blockSize:0} overlay_0-241:{mountpoint:/var/lib/containers/storage/overlay/56b7aa12bb1952f7d797f297e22f30aa8fbd8947f69eefc4641f952b81eb10b6/merged major:0 minor:241 fsType:overlay blockSize:0} overlay_0-255:{mountpoint:/var/lib/containers/storage/overlay/7535966e1801a3b7d807ef8fe26b828572cfc784588a2bcf34ca969e1af61123/merged major:0 minor:255 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/cbf916fccc9e92c4652298307b2d2fc992c3e9bb71145f34bdfb4a5ac3026621/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/188d97432fd8c20d4a811de7fe6ff6a95447db21b219a94edf6e6da7b33c1ff2/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/c4dea54cb666d190846cb1f1118f2c24c7db7b9bbe6ee33cc3f2b2b354e1ba90/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-272:{mountpoint:/var/lib/containers/storage/overlay/828f42f172c62612038ca035ca546029e483c38cfc17b7f967357739bafa5465/merged major:0 minor:272 fsType:overlay blockSize:0} overlay_0-286:{mountpoint:/var/lib/containers/storage/overlay/a86953da400673013087962c4e50b75e8e12a493c84b1768ad1768e30764d0bf/merged major:0 minor:286 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/796fb27eeacf5ef8ee4ff010ce6c1d6edf26faca7c9133c109846d29225bd9ad/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/36232a7ddbfca2b318fc6d0739cfbdf83a44bc64766834fc9662fb35f7822a4c/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/a1059cb271af2946487832dbe8a22dc2456d45e3e46e685566e1c9e5fb237da6/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-321:{mountpoint:/var/lib/containers/storage/overlay/8a1247075178c0e217859a75a57565e50e7bccf73ab8d5325c5bc63b37f982b4/merged major:0 minor:321 fsType:overlay blockSize:0} overlay_0-327:{mountpoint:/var/lib/containers/storage/overlay/bced67cbda8b805cbd2d24ce4adc65232d6ea81267df0a6f1559e10952c0afea/merged major:0 minor:327 fsType:overlay blockSize:0} overlay_0-329:{mountpoint:/var/lib/containers/storage/overlay/b876fad4ea2fccaba0014245c8e4dcf067e1ae17f0d6a350a80e0f104e4acfac/merged major:0 minor:329 fsType:overlay blockSize:0} overlay_0-337:{mountpoint:/var/lib/containers/storage/overlay/44f6cf6b45ceba88659df2fea32a0a10f54020caefb2a75335462ae01d8c9456/merged major:0 minor:337 fsType:overlay blockSize:0} overlay_0-342:{mountpoint:/var/lib/containers/storage/overlay/761ad89d3ef38a37885a5eb4f252c85880e4d6c67fd234ee5df8268ad9d6e4fd/merged major:0 minor:342 fsType:overlay blockSize:0} overlay_0-347:{mountpoint:/var/lib/containers/storage/overlay/30bfbb95cfabcf80c993c2fc8e414ac0d2011e807b3863ab0b2677286d3b7dc7/merged major:0 minor:347 fsType:overlay blockSize:0} overlay_0-349:{mountpoint:/var/lib/containers/storage/overlay/75cfef8c98b21b034e4ad645a6389cd0f030a71a333a6db060a4a463d5dabbcb/merged major:0 minor:349 fsType:overlay blockSize:0} overlay_0-355:{mountpoint:/var/lib/containers/storage/overlay/e5761bc7fe7cbd3778b7bd06333438eee91926a7cfe9a9c5eea4523afdc180da/merged major:0 minor:355 fsType:overlay blockSize:0} overlay_0-360:{mountpoint:/var/lib/containers/storage/overlay/e67fc1815661fa2f0d5c9915556fd06ddd663ca554c8d2828e6e82af6bfe6aea/merged major:0 minor:360 fsType:overlay blockSize:0} overlay_0-365:{mountpoint:/var/lib/containers/storage/overlay/5b3b20a6cf76c7e87eb947b0a8d2f59dced1e75d3b97bd94430dd25d337a86ac/merged major:0 minor:365 fsType:overlay blockSize:0} overlay_0-370:{mountpoint:/var/lib/containers/storage/overlay/f1fe0aa574db782892c58d398de7b56c20ab27a542128e7c3c8ad19528afc004/merged major:0 minor:370 fsType:overlay blockSize:0} overlay_0-375:{mountpoint:/var/lib/containers/storage/overlay/a23f1f28629edcd370af4a581fee5f82ae8aa88f0c67000fc86363287d0ad063/merged major:0 minor:375 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/f82c9c6a298c8de9cf3911b5afe59c5e1f9894fb5ddc112c09ffca4a2636bf33/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-385:{mountpoint:/var/lib/containers/storage/overlay/4137e03cbc5cb5b74b4601406ad509b05b66f90835395722dbf950fec8b4f99f/merged major:0 minor:385 fsType:overlay blockSize:0} overlay_0-390:{mountpoint:/var/lib/containers/storage/overlay/1c90d7f5f05e704400450f3cef3a4691eb4c3927558b84cf32c778f3e69345df/merged major:0 minor:390 fsType:overlay blockSize:0} overlay_0-404:{mountpoint:/var/lib/containers/storage/overlay/0d908c686602202a07f5dea477a3ebc90388eeaa03b0ee1f3a1e129e41a92b06/merged major:0 minor:404 fsType:overlay blockSize:0} overlay_0-406:{mountpoint:/var/lib/containers/storage/overlay/9a35897cda2b0c9e33ca5a0f09a01f86fce0fc3b6a1304630d28a34caca81c38/merged major:0 minor:406 fsType:overlay blockSize:0} overlay_0-419:{mountpoint:/var/lib/containers/storage/overlay/6f62f3a2f1e0cc843339ead5361dd232dae88c18a4508039ab0996f1466c141b/merged major:0 minor:419 fsType:overlay blockSize:0} overlay_0-423:{mountpoint:/var/lib/containers/storage/overlay/0a7d5352d5df67648c24e152658f03032515c00c3b4905b9e92ecc7c0089ce1a/merged major:0 minor:423 fsType:overlay blockSize:0} overlay_0-425:{mountpoint:/var/lib/containers/storage/overlay/9c5b3029dcfdeeec28e9ad07f45e4b1c9358ccd46c1721afb18a0e546ae02910/merged major:0 minor:425 fsType:overlay blockSize:0} overlay_0-427:{mountpoint:/var/lib/containers/storage/overlay/a5a1587b38470af12404cd9d5b0785fc1b0995fd07fabf105475c28bce81713b/merged major:0 minor:427 fsType:overlay blockSize:0} overlay_0-429:{mountpoint:/var/lib/containers/storage/overlay/3589b80ceb33dd0bf8cd005729405cc38aaef0da404480e252c17bce9e1be4e9/merged major:0 minor:429 fsType:overlay blockSize:0} overlay_0-435:{mountpoint:/var/lib/containers/storage/overlay/110618fe9d3a273466ed38848392244edf45ccb1298c5aae157d21b4a9571ca9/merged major:0 minor:435 fsType:overlay blockSize:0} overlay_0-440:{mountpoint:/var/lib/containers/storage/overlay/d1903c59c2fbd51cb1acc34c858f7cbe237ab95886c9b3860888b97eff28afc0/merged major:0 minor:440 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/fb56d3824541e5ef482ea550a07628fc137fcdaa1cfe759794a91a0aad57a2ba/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/de0ce8fb760610e42cba4663514e0918858b56bbd33be1bfbb99f9bef52a76b2/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/f5e5774305e4c6a3d9dbbe9dc8b2e2aa8033f1e3a8cc91f1a3b9ce608f7c80d6/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/e16ef587b72ca1201f18c24b60de9c36e3b8beff154b2a1f167774ea0b47500e/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/1e63443d6560eb9b35e567149348ed123f97219798dc418e35e36d8c72a543dd/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/8f883d3de10d6ddc9974d1a126493348aee2e9e27a1ad172a9c9f1ef60103dec/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/aed4ec756a005b506ae4d275705ccf4d540664dea88bf9a2b001464a515b51bd/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/206282892b066cdcbef418010de391157b445285b282b7d5e794c980140b5364/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/efb88e3078af66320ce521d20b9e516a55e86bb6ef9da2e1103fa49c34308342/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/43927ab50d7b5f7be8f411318bba821ccd31347f25217790bfbbc39931e93b8a/merged major:0 minor:96 fsType:overlay blockSize:0}] Oct 31 00:30:10.798182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.794727 6591 manager.go:217] Machine: {Timestamp:2026-10-31 00:30:10.79426158 +0000 UTC m=+0.055535446 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3185663 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cb5b74a354a2d1e30975530338a79 SystemUUID:ec2cb5b7-4a35-4a2d-1e30-975530338a79 BootID:f25e8f8b-da20-4e77-982c-cd407af6bd39 Filesystems:[{Device:overlay_0-123 DeviceMajor:0 DeviceMinor:123 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/62fa67ddc94be6af2d7e42c82f1dfd917d2162f5f745242ab93f3fc833aed26f/userdata/shm DeviceMajor:0 DeviceMinor:298 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:296 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-390 DeviceMajor:0 DeviceMinor:390 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-141 DeviceMajor:0 DeviceMinor:141 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4d754c0a-9f48-439b-8673-6ba91b6408ff/volumes/kubernetes.io~projected/kube-api-access-b47dq DeviceMajor:0 DeviceMinor:416 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:64 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/41814d6b961f9a1fe99e7e679a5f3a7a05e7f3e9cef7dee556a3c987b80ffeca/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/3b3c9cfb-2fd5-4a88-a938-77f38dd28969/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:415 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d773daf30ca65ca8b21f34273166026dc5a909a3df68e0f7b9caaed52d1c8a97/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:251 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:288 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:315 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1720ac40-f3e0-44e3-b2f2-06db389fb9b7/volumes/kubernetes.io~projected/kube-api-access-4n87x DeviceMajor:0 DeviceMinor:61 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1f558e15af7c6dbed111f7308422267e2e439e7a1a0eaf02dfeccf63432d6c20/userdata/shm DeviceMajor:0 DeviceMinor:335 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-360 DeviceMajor:0 DeviceMinor:360 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c/volumes/kubernetes.io~projected/kube-api-access-g759d DeviceMajor:0 DeviceMinor:401 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d1e36958212cc3bad9df53ee73c7031515b019514965236038d6a8c82f4d7c1a/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/volumes/kubernetes.io~projected/kube-api-access-m5fmn DeviceMajor:0 DeviceMinor:67 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a47d5fa6-be34-46e7-93f7-44b23c9e9b89/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:45 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-236 DeviceMajor:0 DeviceMinor:236 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0693db672ea76ea9e8c59224fc5c641499eeb943122dedff78bcf2fa6f1f575e/userdata/shm DeviceMajor:0 DeviceMinor:253 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-241 DeviceMajor:0 DeviceMinor:241 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7573854a-4782-4c89-b93a-43503a30fec2/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:257 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-272 DeviceMajor:0 DeviceMinor:272 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:289 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:313 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~projected/kube-api-access-rr42q DeviceMajor:0 DeviceMinor:318 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/7573854a-4782-4c89-b93a-43503a30fec2/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:258 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/adc9181f-c401-4d7c-bbcb-409b4b6f60e0/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:325 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-329 DeviceMajor:0 DeviceMinor:329 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:294 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-355 DeviceMajor:0 DeviceMinor:355 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-427 DeviceMajor:0 DeviceMinor:427 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/447b2177-70e2-46dd-a082-6c750a49db1c/volumes/kubernetes.io~projected/kube-api-access-xmkhp DeviceMajor:0 DeviceMinor:60 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:294 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:316 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1720ac40-f3e0-44e3-b2f2-06db389fb9b7/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:408 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9179eca04f12367813068df1b2967a42644a337501de4361c09f8c76339c0d04/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:296 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-342 DeviceMajor:0 DeviceMinor:342 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:296 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-435 DeviceMajor:0 DeviceMinor:435 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-440 DeviceMajor:0 DeviceMinor:440 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-406 DeviceMajor:0 DeviceMinor:406 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/dfa263748904ab39c40a676f0e533718432e5eeeab7fea765caa4be93b4b9f84/userdata/shm DeviceMajor:0 DeviceMinor:421 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-423 DeviceMajor:0 DeviceMinor:423 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2f812f411c8a0981f16f3bdb1950ba4c4813e7e1ae5ac75cfdfdd5bb748bfb22/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a4defb35-52f2-46fc-a314-affe5a217a84/volumes/kubernetes.io~projected/kube-api-access-v5vvg DeviceMajor:0 DeviceMinor:66 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:309 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:296 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2/volumes/kubernetes.io~projected/kube-api-access-4stfl DeviceMajor:0 DeviceMinor:252 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:314 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/447b2177-70e2-46dd-a082-6c750a49db1c/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:56 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-365 DeviceMajor:0 DeviceMinor:365 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/97c4057b1d22f9f71e7e3fe7de0a9e08f78a6f976fbe41fccc1aca1016f82b30/userdata/shm DeviceMajor:0 DeviceMinor:413 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1df475be-e1fe-4e90-b60f-dc3763a66cc6/volumes/kubernetes.io~projected/kube-api-access-vcvrc DeviceMajor:0 DeviceMinor:203 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/87931c70-7b7c-4910-89ce-f84136d7a852/volumes/kubernetes.io~projected/kube-api-access-n2cv8 DeviceMajor:0 DeviceMinor:65 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1df475be-e1fe-4e90-b60f-dc3763a66cc6/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:197 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a1b304f2-676a-4a6f-bdac-8805188c415f/volumes/kubernetes.io~projected/kube-api-access-z56w9 DeviceMajor:0 DeviceMinor:59 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e4199e3568a18e2466f585dcb837ed13581f40db130f2aefdf14ce9f04eeb4bb/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/95d6391c36609eb5973f7d0d4104a7818b2ce219be6a653170cf2027d252310b/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b3a96c1256dc9604fdf940cb17f8732e748a1a454c18af3e23a2ec61daf6cd5a/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/81ef083c-e93d-4531-949e-22999120731e/volumes/kubernetes.io~projected/kube-api-access-6m7qc DeviceMajor:0 DeviceMinor:283 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:295 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-321 DeviceMajor:0 DeviceMinor:321 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-375 DeviceMajor:0 DeviceMinor:375 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e49b0200d9617bbe505b4184de058405f01592d9f6f83deba62ef2f35b1e0c36/userdata/shm DeviceMajor:0 DeviceMinor:417 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/447b2177-70e2-46dd-a082-6c750a49db1c/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:55 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7573854a-4782-4c89-b93a-43503a30fec2/volumes/kubernetes.io~projected/kube-api-access-q54rb DeviceMajor:0 DeviceMinor:259 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0c6c2b9b49560f008183b9af37fc28fcf93f25229cd1d47cd3b5dbb06269bc38/userdata/shm DeviceMajor:0 DeviceMinor:402 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c3c5e8eb-fd22-42ee-a203-7c3077f48084/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:63 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-385 DeviceMajor:0 DeviceMinor:385 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e3af97b1-99a9-4fab-97b4-ac62b870de03/volumes/kubernetes.io~projected/kube-api-access-4gqct DeviceMajor:0 DeviceMinor:57 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:246 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-255 DeviceMajor:0 DeviceMinor:255 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:290 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:293 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7a57dfd1-8cba-4f8e-bdec-908249491197/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:317 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a47d5fa6-be34-46e7-93f7-44b23c9e9b89/volumes/kubernetes.io~projected/kube-api-access-cqnv9 DeviceMajor:0 DeviceMinor:202 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b1cf311b-c4ed-433e-a582-b4bcfcc402a9/volumes/kubernetes.io~projected/kube-api-access-6fv8r DeviceMajor:0 DeviceMinor:204 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/adc9181f-c401-4d7c-bbcb-409b4b6f60e0/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:324 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-419 DeviceMajor:0 DeviceMinor:419 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e0ac25b6b8cddc86816b0d94c71cff163eee470b42bc94d08d7a0d7a770fbfea/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-218 DeviceMajor:0 DeviceMinor:218 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c86782fa1392f6b9a0fd0c68d5f0f5e393e2d54fe272dd12463f8ce18ae1ee1c/userdata/shm DeviceMajor:0 DeviceMinor:260 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/81ef083c-e93d-4531-949e-22999120731e/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:277 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-337 DeviceMajor:0 DeviceMinor:337 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-349 DeviceMajor:0 DeviceMinor:349 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-370 DeviceMajor:0 DeviceMinor:370 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b1cf311b-c4ed-433e-a582-b4bcfcc402a9/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:201 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/81ef083c-e93d-4531-949e-22999120731e/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:282 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-404 DeviceMajor:0 DeviceMinor:404 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f2fbc74ff263f96e2afe196affb0ca7bbf793a53d8fd1202b97d80d72fe8d33c/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-286 DeviceMajor:0 DeviceMinor:286 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:292 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/adc9181f-c401-4d7c-bbcb-409b4b6f60e0/volumes/kubernetes.io~projected/kube-api-access-gxqqx DeviceMajor:0 DeviceMinor:326 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-159 DeviceMajor:0 DeviceMinor:159 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/15a05a1a08fb0b5fc87baa8335c7ac2acb6c2f30c786709e7c834cfc75bc3224/userdata/shm DeviceMajor:0 DeviceMinor:284 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/eeab9038e5292b7dea8a1af0565ba77912223d9521eaeb7635a208cfeff1f8db/userdata/shm DeviceMajor:0 DeviceMinor:319 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-347 DeviceMajor:0 DeviceMinor:347 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:400 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ca9e27fce2156c2dc5929bcd4fbd1b84f6124e2126f0b1e825dd3a44dd3dee92/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:395 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4efe75061d94f1640fcc0c19fa7b82f6cfd325e582d474597b1aabe36f0a42fe/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~projected/kube-api-access-9nqnf DeviceMajor:0 DeviceMinor:297 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-327 DeviceMajor:0 DeviceMinor:327 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-429 DeviceMajor:0 DeviceMinor:429 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/db01ba46-985b-4967-a668-73e1eb99189b/volumes/kubernetes.io~projected/kube-api-access-g2l4j DeviceMajor:0 DeviceMinor:58 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/105f81a407ed8ae4dcf3b52f848d31c53b4d44302ec7509c825a6cadf6b8e392/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:291 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/adc9181f-c401-4d7c-bbcb-409b4b6f60e0/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:323 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-425 DeviceMajor:0 DeviceMinor:425 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a2ba2a3b-57ee-4515-a194-cb86198d246b/volumes/kubernetes.io~projected/kube-api-access-lzdpn DeviceMajor:0 DeviceMinor:62 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0693db672ea76ea MacAddress:ce:be:cf:4b:19:ec Speed:10000 Mtu:8901} {Name:0c6c2b9b49560f0 MacAddress:06:e3:a0:b5:70:4f Speed:10000 Mtu:8901} {Name:1f558e15af7c6db MacAddress:ea:8b:37:40:8d:a6 Speed:10000 Mtu:8901} {Name:41814d6b961f9a1 MacAddress:12:18:bc:d2:a5:17 Speed:10000 Mtu:8901} {Name:4efe75061d94f16 MacAddress:92:90:f9:3f:16:50 Speed:10000 Mtu:8901} {Name:62fa67ddc94be6a MacAddress:42:77:67:65:47:40 Speed:10000 Mtu:8901} {Name:97c4057b1d22f9f MacAddress:c2:ae:9f:32:39:93 Speed:10000 Mtu:8901} {Name:b3a96c1256dc960 MacAddress:a6:9e:e5:7b:b2:f2 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:c8:46:d9:9f Speed:0 Mtu:9001} {Name:br-int MacAddress:a6:55:ce:6d:39:45 Speed:0 Mtu:8901} {Name:c86782fa1392f6b MacAddress:8a:4d:d0:43:c2:39 Speed:10000 Mtu:8901} {Name:dfa263748904ab3 MacAddress:26:56:cc:50:10:4a Speed:10000 Mtu:8901} {Name:e49b0200d9617bb MacAddress:52:10:a2:73:64:83 Speed:10000 Mtu:8901} {Name:eeab9038e5292b7 MacAddress:1a:f8:61:31:c9:cf Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:c8:46:d9:9f Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:be:a1:31:c5:0a:10 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:2a:a9:bc:49:37:39 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 31 00:30:10.798182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.795128 6591 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 31 00:30:10.798182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.795171 6591 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 31 00:30:10.798182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.795449 6591 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 31 00:30:10.798182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.795472 6591 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-145.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 31 00:30:10.798182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.795599 6591 topology_manager.go:143] "Creating topology manager with none policy" Oct 31 00:30:10.798182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.795607 6591 container_manager_linux.go:311] "Creating device plugin manager" Oct 31 00:30:10.798182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.795621 6591 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 31 00:30:10.798182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.795633 6591 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 31 00:30:10.798182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.795703 6591 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 31 00:30:10.798182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.795872 6591 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 31 00:30:10.798182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.795975 6591 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 31 00:30:10.798182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.796005 6591 kubelet.go:493] "Attempting to sync node with API server" Oct 31 00:30:10.798182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.796018 6591 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 31 00:30:10.798182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.796028 6591 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 31 00:30:10.798182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.796038 6591 kubelet.go:405] "Adding apiserver pod source" Oct 31 00:30:10.798182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.796047 6591 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 31 00:30:10.798182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.797496 6591 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 31 00:30:10.798182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.797516 6591 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 31 00:30:10.799188 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.798925 6591 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 31 00:30:10.802550 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.802536 6591 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 31 00:30:10.802550 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.802550 6591 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 31 00:30:10.802661 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.802651 6591 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 31 00:30:10.802833 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.802823 6591 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 31 00:30:10.802861 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.802851 6591 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 31 00:30:10.802938 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.802930 6591 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 31 00:30:10.802970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.802943 6591 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 31 00:30:10.802970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.802953 6591 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 31 00:30:10.802970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.802962 6591 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 31 00:30:10.802970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.802970 6591 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 31 00:30:10.803073 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.802976 6591 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 31 00:30:10.803073 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.802981 6591 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 31 00:30:10.803073 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.802986 6591 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 31 00:30:10.803073 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.802993 6591 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 31 00:30:10.803073 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.802999 6591 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 31 00:30:10.803073 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.803008 6591 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 31 00:30:10.803073 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.803023 6591 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 31 00:30:10.803073 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.803048 6591 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 31 00:30:10.803073 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.803056 6591 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 31 00:30:10.806328 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.806288 6591 server.go:1263] "Started kubelet" Oct 31 00:30:10.807203 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.806599 6591 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 31 00:30:10.807203 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.806408 6591 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 31 00:30:10.807203 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.806853 6591 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 31 00:30:10.807203 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.807116 6591 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 31 00:30:10.806806 ip-10-0-134-145 systemd[1]: Started Kubernetes Kubelet. Oct 31 00:30:10.808198 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.808177 6591 server.go:317] "Adding debug handlers to kubelet server" Oct 31 00:30:10.810928 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.810906 6591 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 31 00:30:10.811194 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.811175 6591 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 31 00:30:10.813946 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:30:10.813887 6591 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-145.us-east-2.compute.internal\" not found" Oct 31 00:30:10.815691 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.815669 6591 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 31 00:30:10.815691 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.815688 6591 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 31 00:30:10.815879 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.815857 6591 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 31 00:30:10.816327 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.816185 6591 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 00:24:01 +0000 UTC" deadline="2028-07-16 14:08:54.474819308 +0000 UTC" Oct 31 00:30:10.816327 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.816230 6591 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14989h38m43.658593621s" Oct 31 00:30:10.817304 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.817283 6591 factory.go:55] Registering systemd factory Oct 31 00:30:10.817304 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.817306 6591 factory.go:223] Registration of the systemd container factory successfully Oct 31 00:30:10.817559 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.817538 6591 factory.go:153] Registering CRI-O factory Oct 31 00:30:10.817559 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.817560 6591 factory.go:223] Registration of the crio container factory successfully Oct 31 00:30:10.817688 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.817610 6591 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 31 00:30:10.817688 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.817632 6591 factory.go:103] Registering Raw factory Oct 31 00:30:10.817688 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.817646 6591 manager.go:1199] Started watching for new ooms in manager Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.817979 6591 manager.go:319] Starting recovery of all containers Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819105 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db01ba46-985b-4967-a668-73e1eb99189b" volumeName="kubernetes.io/projected/db01ba46-985b-4967-a668-73e1eb99189b-kube-api-access-g2l4j" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819153 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" volumeName="kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-service-ca" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819162 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" volumeName="kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-oauth-serving-cert" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819170 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1df475be-e1fe-4e90-b60f-dc3763a66cc6" volumeName="kubernetes.io/empty-dir/1df475be-e1fe-4e90-b60f-dc3763a66cc6-tmp-dir" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819180 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1e9c8bc7-67f7-4e30-99a1-09f26b0774c2" volumeName="kubernetes.io/projected/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-kube-api-access-4stfl" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819188 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="447b2177-70e2-46dd-a082-6c750a49db1c" volumeName="kubernetes.io/projected/447b2177-70e2-46dd-a082-6c750a49db1c-kube-api-access-xmkhp" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819195 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a47d5fa6-be34-46e7-93f7-44b23c9e9b89" volumeName="kubernetes.io/empty-dir/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-data-volume" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819215 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e3af97b1-99a9-4fab-97b4-ac62b870de03" volumeName="kubernetes.io/configmap/e3af97b1-99a9-4fab-97b4-ac62b870de03-iptables-alerter-script" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819234 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4d754c0a-9f48-439b-8673-6ba91b6408ff" volumeName="kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819242 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7926238e-b350-435f-ac33-529829777b8a" volumeName="kubernetes.io/empty-dir/7926238e-b350-435f-ac33-529829777b8a-config-out" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819250 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="81ef083c-e93d-4531-949e-22999120731e" volumeName="kubernetes.io/secret/81ef083c-e93d-4531-949e-22999120731e-node-exporter-tls" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819257 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a57dfd1-8cba-4f8e-bdec-908249491197" volumeName="kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819264 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" volumeName="kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-config" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819271 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" volumeName="kubernetes.io/secret/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-oauth-config" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819281 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" volumeName="kubernetes.io/projected/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-kube-api-access-4n87x" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819288 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7926238e-b350-435f-ac33-529829777b8a" volumeName="kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-cluster-tls-config" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819296 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a57dfd1-8cba-4f8e-bdec-908249491197" volumeName="kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819303 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a57dfd1-8cba-4f8e-bdec-908249491197" volumeName="kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819309 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="81ef083c-e93d-4531-949e-22999120731e" volumeName="kubernetes.io/projected/81ef083c-e93d-4531-949e-22999120731e-kube-api-access-6m7qc" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819318 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7926238e-b350-435f-ac33-529829777b8a" volumeName="kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-config-volume" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819326 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a57dfd1-8cba-4f8e-bdec-908249491197" volumeName="kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819334 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="447b2177-70e2-46dd-a082-6c750a49db1c" volumeName="kubernetes.io/empty-dir/447b2177-70e2-46dd-a082-6c750a49db1c-tmp" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819342 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7926238e-b350-435f-ac33-529829777b8a" volumeName="kubernetes.io/configmap/7926238e-b350-435f-ac33-529829777b8a-metrics-client-ca" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819349 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7926238e-b350-435f-ac33-529829777b8a" volumeName="kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-main-tls" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819357 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3" volumeName="kubernetes.io/projected/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-kube-api-access-m5fmn" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819365 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1e9c8bc7-67f7-4e30-99a1-09f26b0774c2" volumeName="kubernetes.io/configmap/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-metrics-client-ca" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819372 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7573854a-4782-4c89-b93a-43503a30fec2" volumeName="kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-oauth-serving-cert" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819380 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7926238e-b350-435f-ac33-529829777b8a" volumeName="kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819404 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87931c70-7b7c-4910-89ce-f84136d7a852" volumeName="kubernetes.io/configmap/87931c70-7b7c-4910-89ce-f84136d7a852-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819412 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87931c70-7b7c-4910-89ce-f84136d7a852" volumeName="kubernetes.io/configmap/87931c70-7b7c-4910-89ce-f84136d7a852-cni-binary-copy" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819455 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a47d5fa6-be34-46e7-93f7-44b23c9e9b89" volumeName="kubernetes.io/configmap/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-kube-rbac-proxy-cm" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819464 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="adc9181f-c401-4d7c-bbcb-409b4b6f60e0" volumeName="kubernetes.io/secret/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-secret-metrics-server-tls" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819484 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b1cf311b-c4ed-433e-a582-b4bcfcc402a9" volumeName="kubernetes.io/projected/b1cf311b-c4ed-433e-a582-b4bcfcc402a9-kube-api-access-6fv8r" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819491 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" volumeName="kubernetes.io/secret/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-serving-cert" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819501 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1720ac40-f3e0-44e3-b2f2-06db389fb9b7" volumeName="kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819509 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1df475be-e1fe-4e90-b60f-dc3763a66cc6" volumeName="kubernetes.io/secret/1df475be-e1fe-4e90-b60f-dc3763a66cc6-metrics-tls" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819516 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7573854a-4782-4c89-b93a-43503a30fec2" volumeName="kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-console-config" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819523 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87931c70-7b7c-4910-89ce-f84136d7a852" volumeName="kubernetes.io/projected/87931c70-7b7c-4910-89ce-f84136d7a852-kube-api-access-n2cv8" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819531 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3c5e8eb-fd22-42ee-a203-7c3077f48084" volumeName="kubernetes.io/configmap/c3c5e8eb-fd22-42ee-a203-7c3077f48084-konnectivity-ca" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819538 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" volumeName="kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-trusted-ca-bundle" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819545 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1e9c8bc7-67f7-4e30-99a1-09f26b0774c2" volumeName="kubernetes.io/secret/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819552 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7573854a-4782-4c89-b93a-43503a30fec2" volumeName="kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-service-ca" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819559 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7926238e-b350-435f-ac33-529829777b8a" volumeName="kubernetes.io/empty-dir/7926238e-b350-435f-ac33-529829777b8a-alertmanager-main-db" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819567 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7926238e-b350-435f-ac33-529829777b8a" volumeName="kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819573 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7926238e-b350-435f-ac33-529829777b8a" volumeName="kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819580 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4defb35-52f2-46fc-a314-affe5a217a84" volumeName="kubernetes.io/projected/a4defb35-52f2-46fc-a314-affe5a217a84-kube-api-access-v5vvg" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819589 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db01ba46-985b-4967-a668-73e1eb99189b" volumeName="kubernetes.io/configmap/db01ba46-985b-4967-a668-73e1eb99189b-cni-binary-copy" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819596 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7573854a-4782-4c89-b93a-43503a30fec2" volumeName="kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-trusted-ca-bundle" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819603 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7926238e-b350-435f-ac33-529829777b8a" volumeName="kubernetes.io/projected/7926238e-b350-435f-ac33-529829777b8a-tls-assets" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819612 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a57dfd1-8cba-4f8e-bdec-908249491197" volumeName="kubernetes.io/configmap/7a57dfd1-8cba-4f8e-bdec-908249491197-metrics-client-ca" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819620 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1b304f2-676a-4a6f-bdac-8805188c415f" volumeName="kubernetes.io/empty-dir/a1b304f2-676a-4a6f-bdac-8805188c415f-tmp-dir" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819626 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a47d5fa6-be34-46e7-93f7-44b23c9e9b89" volumeName="kubernetes.io/secret/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-insights-runtime-extractor-tls" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819633 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="adc9181f-c401-4d7c-bbcb-409b4b6f60e0" volumeName="kubernetes.io/configmap/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-configmap-kubelet-serving-ca-bundle" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819641 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" volumeName="kubernetes.io/empty-dir/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-tmp" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819662 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" volumeName="kubernetes.io/projected/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-kube-api-access-g759d" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819670 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1df475be-e1fe-4e90-b60f-dc3763a66cc6" volumeName="kubernetes.io/projected/1df475be-e1fe-4e90-b60f-dc3763a66cc6-kube-api-access-vcvrc" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819687 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="81ef083c-e93d-4531-949e-22999120731e" volumeName="kubernetes.io/configmap/81ef083c-e93d-4531-949e-22999120731e-metrics-client-ca" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819694 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="81ef083c-e93d-4531-949e-22999120731e" volumeName="kubernetes.io/configmap/81ef083c-e93d-4531-949e-22999120731e-node-exporter-accelerators-collector-config" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819702 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="447b2177-70e2-46dd-a082-6c750a49db1c" volumeName="kubernetes.io/empty-dir/447b2177-70e2-46dd-a082-6c750a49db1c-etc-tuned" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819709 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7573854a-4782-4c89-b93a-43503a30fec2" volumeName="kubernetes.io/secret/7573854a-4782-4c89-b93a-43503a30fec2-console-oauth-config" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819716 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4defb35-52f2-46fc-a314-affe5a217a84" volumeName="kubernetes.io/configmap/a4defb35-52f2-46fc-a314-affe5a217a84-serviceca" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819723 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b1cf311b-c4ed-433e-a582-b4bcfcc402a9" volumeName="kubernetes.io/secret/b1cf311b-c4ed-433e-a582-b4bcfcc402a9-cert" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819731 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1df475be-e1fe-4e90-b60f-dc3763a66cc6" volumeName="kubernetes.io/configmap/1df475be-e1fe-4e90-b60f-dc3763a66cc6-config-volume" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819737 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7573854a-4782-4c89-b93a-43503a30fec2" volumeName="kubernetes.io/empty-dir/7573854a-4782-4c89-b93a-43503a30fec2-tmp" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819744 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7573854a-4782-4c89-b93a-43503a30fec2" volumeName="kubernetes.io/projected/7573854a-4782-4c89-b93a-43503a30fec2-kube-api-access-q54rb" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819751 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7926238e-b350-435f-ac33-529829777b8a" volumeName="kubernetes.io/configmap/7926238e-b350-435f-ac33-529829777b8a-alertmanager-trusted-ca-bundle" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819759 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7926238e-b350-435f-ac33-529829777b8a" volumeName="kubernetes.io/projected/7926238e-b350-435f-ac33-529829777b8a-kube-api-access-9nqnf" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819766 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a2ba2a3b-57ee-4515-a194-cb86198d246b" volumeName="kubernetes.io/projected/a2ba2a3b-57ee-4515-a194-cb86198d246b-kube-api-access-lzdpn" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819773 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="adc9181f-c401-4d7c-bbcb-409b4b6f60e0" volumeName="kubernetes.io/empty-dir/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-audit-log" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819779 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="adc9181f-c401-4d7c-bbcb-409b4b6f60e0" volumeName="kubernetes.io/secret/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-client-ca-bundle" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819788 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1e9c8bc7-67f7-4e30-99a1-09f26b0774c2" volumeName="kubernetes.io/secret/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-prometheus-operator-tls" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819795 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3b3c9cfb-2fd5-4a88-a938-77f38dd28969" volumeName="kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819802 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87931c70-7b7c-4910-89ce-f84136d7a852" volumeName="kubernetes.io/configmap/87931c70-7b7c-4910-89ce-f84136d7a852-cni-sysctl-allowlist" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819809 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="adc9181f-c401-4d7c-bbcb-409b4b6f60e0" volumeName="kubernetes.io/configmap/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-metrics-server-audit-profiles" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819818 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="adc9181f-c401-4d7c-bbcb-409b4b6f60e0" volumeName="kubernetes.io/projected/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-kube-api-access-gxqqx" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819826 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3" volumeName="kubernetes.io/configmap/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-env-overrides" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819833 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3" volumeName="kubernetes.io/configmap/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-ovnkube-script-lib" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819841 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3" volumeName="kubernetes.io/configmap/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-ovnkube-config" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819849 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7573854a-4782-4c89-b93a-43503a30fec2" volumeName="kubernetes.io/secret/7573854a-4782-4c89-b93a-43503a30fec2-console-serving-cert" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819856 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a57dfd1-8cba-4f8e-bdec-908249491197" volumeName="kubernetes.io/empty-dir/7a57dfd1-8cba-4f8e-bdec-908249491197-tmp" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819862 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a57dfd1-8cba-4f8e-bdec-908249491197" volumeName="kubernetes.io/projected/7a57dfd1-8cba-4f8e-bdec-908249491197-kube-api-access-rr42q" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819869 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a57dfd1-8cba-4f8e-bdec-908249491197" volumeName="kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-grpc-tls" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819876 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3c5e8eb-fd22-42ee-a203-7c3077f48084" volumeName="kubernetes.io/secret/c3c5e8eb-fd22-42ee-a203-7c3077f48084-agent-certs" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819883 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e3af97b1-99a9-4fab-97b4-ac62b870de03" volumeName="kubernetes.io/projected/e3af97b1-99a9-4fab-97b4-ac62b870de03-kube-api-access-4gqct" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819890 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7926238e-b350-435f-ac33-529829777b8a" volumeName="kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-web-config" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819898 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a57dfd1-8cba-4f8e-bdec-908249491197" volumeName="kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-tls" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819905 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="81ef083c-e93d-4531-949e-22999120731e" volumeName="kubernetes.io/empty-dir/81ef083c-e93d-4531-949e-22999120731e-node-exporter-textfile" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819912 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="81ef083c-e93d-4531-949e-22999120731e" volumeName="kubernetes.io/secret/81ef083c-e93d-4531-949e-22999120731e-node-exporter-kube-rbac-proxy-config" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819932 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a47d5fa6-be34-46e7-93f7-44b23c9e9b89" volumeName="kubernetes.io/projected/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-kube-api-access-cqnv9" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819942 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="adc9181f-c401-4d7c-bbcb-409b4b6f60e0" volumeName="kubernetes.io/secret/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-secret-metrics-server-client-certs" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819948 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3" volumeName="kubernetes.io/secret/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-ovn-node-metrics-cert" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819977 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db01ba46-985b-4967-a668-73e1eb99189b" volumeName="kubernetes.io/configmap/db01ba46-985b-4967-a668-73e1eb99189b-multus-daemon-config" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819986 6591 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1b304f2-676a-4a6f-bdac-8805188c415f" volumeName="kubernetes.io/projected/a1b304f2-676a-4a6f-bdac-8805188c415f-kube-api-access-z56w9" seLinuxMountContext="" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819993 6591 reconstruct.go:97] "Volume reconstruction finished" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.819998 6591 reconciler.go:29] "Reconciler: start to sync state" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.820161 6591 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:30:10.822463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.821013 6591 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:30:10.827182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.822857 6591 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:30:10.827182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.824011 6591 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 31 00:30:10.842009 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.841970 6591 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 31 00:30:10.843567 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.843549 6591 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 31 00:30:10.843567 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.843569 6591 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 31 00:30:10.843698 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.843588 6591 kubelet.go:2521] "Starting kubelet main sync loop" Oct 31 00:30:10.843698 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:30:10.843621 6591 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 31 00:30:10.847957 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.847815 6591 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:30:10.848346 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.848330 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9vvz_c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/ovn-acl-logging/0.log" Oct 31 00:30:10.848912 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.848896 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9vvz_c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/ovn-acl-logging/0.log" Oct 31 00:30:10.860288 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.860255 6591 generic.go:356] "Generic (PLEG): container finished" podID="81ef083c-e93d-4531-949e-22999120731e" containerID="2f3f175ee042e980e38ccf49071bea6f4d56849172825d10d888e736c8699802" exitCode=0 Oct 31 00:30:10.870194 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.870176 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9vvz_c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/ovn-acl-logging/0.log" Oct 31 00:30:10.870557 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.870531 6591 generic.go:356] "Generic (PLEG): container finished" podID="c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3" containerID="d3e40fce623e9ecd45ea44fe4efafdec09044e0c7b4515dc55ed45fb31b082e8" exitCode=1 Oct 31 00:30:10.874310 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.874289 6591 generic.go:356] "Generic (PLEG): container finished" podID="a5bf9502ef5bfb3cbf20de88306bbc22" containerID="da2b4a203f237bd1a0519397b56804930c980774c9cbbf01a98b6b572b7a7065" exitCode=0 Oct 31 00:30:10.879648 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.879629 6591 generic.go:356] "Generic (PLEG): container finished" podID="7926238e-b350-435f-ac33-529829777b8a" containerID="2877a876299322529a573a776abc04ef92cc8f7e2ffd02afb66dd8924d20e71e" exitCode=0 Oct 31 00:30:10.885684 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.885646 6591 generic.go:356] "Generic (PLEG): container finished" podID="87931c70-7b7c-4910-89ce-f84136d7a852" containerID="06de7caf076d2aa54833211cdf82f073b58b5a2817cf41382d1b187dbd1c58e4" exitCode=0 Oct 31 00:30:10.885684 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.885678 6591 generic.go:356] "Generic (PLEG): container finished" podID="87931c70-7b7c-4910-89ce-f84136d7a852" containerID="74b59817a92e916c94770d829aac1df807ede77aa24563ebeb73f8c509e50806" exitCode=0 Oct 31 00:30:10.885782 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.885689 6591 generic.go:356] "Generic (PLEG): container finished" podID="87931c70-7b7c-4910-89ce-f84136d7a852" containerID="321f52b11f70c28c18391db7adddd7a333a4f89ab5cef80bb5dd68057ce90830" exitCode=0 Oct 31 00:30:10.885782 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.885695 6591 generic.go:356] "Generic (PLEG): container finished" podID="87931c70-7b7c-4910-89ce-f84136d7a852" containerID="b436188e93a8296435430ad5d8ea351fdfeaaa7679be6597b1b11523de2806b0" exitCode=0 Oct 31 00:30:10.885782 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.885703 6591 generic.go:356] "Generic (PLEG): container finished" podID="87931c70-7b7c-4910-89ce-f84136d7a852" containerID="b4c725bc8e2052608f6fc3ddd5cf3c1b62cd888f1580da1bbed1e77997c4fe0f" exitCode=0 Oct 31 00:30:10.885782 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.885712 6591 generic.go:356] "Generic (PLEG): container finished" podID="87931c70-7b7c-4910-89ce-f84136d7a852" containerID="cede29c40dcb0eb381767fee61e5b790ab9d946e76e6bcef85362ed281bde163" exitCode=0 Oct 31 00:30:10.921226 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.921210 6591 manager.go:324] Recovery completed Oct 31 00:30:10.943289 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.943229 6591 cpu_manager.go:226] "Starting" policy="none" Oct 31 00:30:10.943289 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.943245 6591 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 31 00:30:10.943289 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.943264 6591 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 31 00:30:10.943510 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.943404 6591 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 31 00:30:10.943510 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.943444 6591 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 31 00:30:10.943510 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.943468 6591 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 31 00:30:10.943510 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.943476 6591 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 31 00:30:10.943510 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.943484 6591 policy_none.go:50] "Start" Oct 31 00:30:10.943510 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.943496 6591 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 31 00:30:10.943510 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.943508 6591 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 31 00:30:10.943862 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:30:10.943648 6591 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Oct 31 00:30:10.943862 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.943686 6591 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 31 00:30:10.943862 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.943698 6591 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 31 00:30:10.943862 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.943706 6591 policy_none.go:44] "Start" Oct 31 00:30:10.948128 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.948103 6591 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 31 00:30:10.950623 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.950610 6591 manager.go:341] "Starting Device Plugin manager" Oct 31 00:30:10.951042 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:30:10.950637 6591 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 31 00:30:10.951113 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.951045 6591 server.go:87] "Starting device plugin registration server" Oct 31 00:30:10.951327 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.951314 6591 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 31 00:30:10.951389 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.951328 6591 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 31 00:30:10.951455 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.951397 6591 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 31 00:30:10.951529 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.951502 6591 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 31 00:30:10.951582 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.951536 6591 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 31 00:30:10.951582 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.951544 6591 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 31 00:30:10.951672 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.951573 6591 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T00:30:10.951526238Z","UUID":"2a0a1fcd-f296-40be-b899-481b49e45b93","Handler":null,"Name":"","Endpoint":""} Oct 31 00:30:10.952812 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.952796 6591 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 31 00:30:10.952883 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:10.952822 6591 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 31 00:30:10.953109 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:30:10.953087 6591 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 31 00:30:11.052077 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.052055 6591 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:30:11.054097 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.054080 6591 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 31 00:30:11.054180 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.054110 6591 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 31 00:30:11.054180 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.054123 6591 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-145.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 31 00:30:11.054180 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.054160 6591 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:11.066608 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.066587 6591 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:11.066669 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.066639 6591 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:11.144099 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.144061 6591 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal"] Oct 31 00:30:11.144676 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.144650 6591 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:11.144769 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.144687 6591 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:11.144769 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.144636 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" event={"ID":"a5bf9502ef5bfb3cbf20de88306bbc22","Type":"ContainerStarted","Data":"3613a151416ed84b556defc289c5829c5a424700d7ac32ffa06bf126398c5491"} Oct 31 00:30:11.144839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.144775 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" event={"ID":"a5bf9502ef5bfb3cbf20de88306bbc22","Type":"ContainerDied","Data":"da2b4a203f237bd1a0519397b56804930c980774c9cbbf01a98b6b572b7a7065"} Oct 31 00:30:11.144839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.144798 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" event={"ID":"a5bf9502ef5bfb3cbf20de88306bbc22","Type":"ContainerStarted","Data":"d1e36958212cc3bad9df53ee73c7031515b019514965236038d6a8c82f4d7c1a"} Oct 31 00:30:11.144895 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.144867 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal" event={"ID":"e99a684e1e1866230a776f45fdda194d","Type":"ContainerStarted","Data":"22864bcb875f5fbd90f9d2180ec1e6598b1d9ed7b74a94318e5b6a05878296f3"} Oct 31 00:30:11.144895 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.144883 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal" event={"ID":"e99a684e1e1866230a776f45fdda194d","Type":"ContainerStarted","Data":"d773daf30ca65ca8b21f34273166026dc5a909a3df68e0f7b9caaed52d1c8a97"} Oct 31 00:30:11.162602 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.162587 6591 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 00:30:11.162655 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:30:11.162619 6591 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:11.162685 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.162668 6591 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 00:30:11.162713 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:30:11.162702 6591 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:11.227036 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.226987 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e99a684e1e1866230a776f45fdda194d-config\") pod \"kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal\" (UID: \"e99a684e1e1866230a776f45fdda194d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:11.227099 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.227033 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5bf9502ef5bfb3cbf20de88306bbc22-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal\" (UID: \"a5bf9502ef5bfb3cbf20de88306bbc22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:11.227099 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.227051 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5bf9502ef5bfb3cbf20de88306bbc22-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal\" (UID: \"a5bf9502ef5bfb3cbf20de88306bbc22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:11.327571 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.327553 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5bf9502ef5bfb3cbf20de88306bbc22-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal\" (UID: \"a5bf9502ef5bfb3cbf20de88306bbc22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:11.327622 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.327571 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5bf9502ef5bfb3cbf20de88306bbc22-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal\" (UID: \"a5bf9502ef5bfb3cbf20de88306bbc22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:11.327622 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.327588 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5bf9502ef5bfb3cbf20de88306bbc22-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal\" (UID: \"a5bf9502ef5bfb3cbf20de88306bbc22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:11.327622 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.327607 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e99a684e1e1866230a776f45fdda194d-config\") pod \"kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal\" (UID: \"e99a684e1e1866230a776f45fdda194d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:11.327714 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.327636 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e99a684e1e1866230a776f45fdda194d-config\") pod \"kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal\" (UID: \"e99a684e1e1866230a776f45fdda194d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:11.327714 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.327674 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5bf9502ef5bfb3cbf20de88306bbc22-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal\" (UID: \"a5bf9502ef5bfb3cbf20de88306bbc22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:11.796351 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.796321 6591 apiserver.go:52] "Watching apiserver" Oct 31 00:30:11.811833 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.811802 6591 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 31 00:30:11.812404 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.812385 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-d95b77fc8-mwt72","openshift-insights/insights-runtime-extractor-f8msd","openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc","kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal","openshift-monitoring/alertmanager-main-0","openshift-dns/dns-default-7c822","openshift-monitoring/node-exporter-zkth8","openshift-multus/multus-additional-cni-plugins-qsxkm","openshift-multus/network-metrics-daemon-bl5rh","openshift-dns/node-resolver-g7phc","openshift-image-registry/node-ca-5nw7t","openshift-console/console-567c75bfd8-svz59","openshift-multus/multus-h2bhb","openshift-console/console-57fd464446-59shl","openshift-ingress-canary/ingress-canary-5f5p7","openshift-network-diagnostics/network-check-target-hnzfm","kube-system/global-pull-secret-syncer-6rt5w","openshift-monitoring/metrics-server-98b459ffb-jkn2t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal","kube-system/konnectivity-agent-ch4wj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg","openshift-cluster-node-tuning-operator/tuned-csst9","openshift-network-operator/iptables-alerter-csk4z","openshift-ovn-kubernetes/ovnkube-node-d9vvz"] Oct 31 00:30:11.819639 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.819610 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-l9cjs\"" Oct 31 00:30:11.829008 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.828985 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-node-log\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.829095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829020 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-ovnkube-config\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.829095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829057 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3c5e8eb-fd22-42ee-a203-7c3077f48084-agent-certs\") pod \"konnectivity-agent-ch4wj\" (UID: \"c3c5e8eb-fd22-42ee-a203-7c3077f48084\") " pod="kube-system/konnectivity-agent-ch4wj" Oct 31 00:30:11.829180 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829130 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-run-k8s-cni-cncf-io\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.829180 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829157 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:30:11.829180 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829176 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/447b2177-70e2-46dd-a082-6c750a49db1c-tmp\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.829313 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829198 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-run-netns\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.829313 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829249 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3af97b1-99a9-4fab-97b4-ac62b870de03-iptables-alerter-script\") pod \"iptables-alerter-csk4z\" (UID: \"e3af97b1-99a9-4fab-97b4-ac62b870de03\") " pod="openshift-network-operator/iptables-alerter-csk4z" Oct 31 00:30:11.829313 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829288 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-socket-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:30:11.829516 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829346 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1b304f2-676a-4a6f-bdac-8805188c415f-tmp-dir\") pod \"node-resolver-g7phc\" (UID: \"a1b304f2-676a-4a6f-bdac-8805188c415f\") " pod="openshift-dns/node-resolver-g7phc" Oct 31 00:30:11.829516 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829351 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/447b2177-70e2-46dd-a082-6c750a49db1c-tmp\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.829516 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829391 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-cni-netd\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.829516 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829433 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1b304f2-676a-4a6f-bdac-8805188c415f-tmp-dir\") pod \"node-resolver-g7phc\" (UID: \"a1b304f2-676a-4a6f-bdac-8805188c415f\") " pod="openshift-dns/node-resolver-g7phc" Oct 31 00:30:11.829516 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829463 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-ovn-node-metrics-cert\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.829516 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829492 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-etc-kubernetes\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.829707 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829517 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-registration-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:30:11.829707 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829583 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-kubelet\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.829707 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829624 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-kubernetes\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.829707 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829654 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-sysctl-conf\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.829707 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829698 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmkhp\" (UniqueName: \"kubernetes.io/projected/447b2177-70e2-46dd-a082-6c750a49db1c-kube-api-access-xmkhp\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.829855 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829727 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-var-lib-cni-multus\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.829855 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829757 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3c5e8eb-fd22-42ee-a203-7c3077f48084-konnectivity-ca\") pod \"konnectivity-agent-ch4wj\" (UID: \"c3c5e8eb-fd22-42ee-a203-7c3077f48084\") " pod="kube-system/konnectivity-agent-ch4wj" Oct 31 00:30:11.829855 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829832 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-system-cni-dir\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.830006 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829875 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-multus-cni-dir\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.830006 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829903 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-multus-conf-dir\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.830006 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829932 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n87x\" (UniqueName: \"kubernetes.io/projected/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-kube-api-access-4n87x\") pod \"network-metrics-daemon-bl5rh\" (UID: \"1720ac40-f3e0-44e3-b2f2-06db389fb9b7\") " pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:30:11.830006 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829955 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-sys\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.830006 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.829980 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-etc-openvswitch\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.830159 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830005 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzdpn\" (UniqueName: \"kubernetes.io/projected/a2ba2a3b-57ee-4515-a194-cb86198d246b-kube-api-access-lzdpn\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:30:11.830159 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830032 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z56w9\" (UniqueName: \"kubernetes.io/projected/a1b304f2-676a-4a6f-bdac-8805188c415f-kube-api-access-z56w9\") pod \"node-resolver-g7phc\" (UID: \"a1b304f2-676a-4a6f-bdac-8805188c415f\") " pod="openshift-dns/node-resolver-g7phc" Oct 31 00:30:11.830159 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830136 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-run\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.830159 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830156 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-var-lib-cni-bin\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.830302 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830175 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2l4j\" (UniqueName: \"kubernetes.io/projected/db01ba46-985b-4967-a668-73e1eb99189b-kube-api-access-g2l4j\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.830302 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830192 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-slash\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.830393 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830314 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-etc-selinux\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:30:11.830393 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830355 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b47dq\" (UniqueName: \"kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq\") pod \"network-check-target-hnzfm\" (UID: \"4d754c0a-9f48-439b-8673-6ba91b6408ff\") " pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:30:11.830393 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830386 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-run-openvswitch\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.830563 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830462 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-log-socket\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.830563 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830499 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-systemd\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.830563 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830525 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5fmn\" (UniqueName: \"kubernetes.io/projected/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-kube-api-access-m5fmn\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.830698 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830574 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-kubelet-config\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:30:11.830698 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830617 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-cnibin\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.830698 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830651 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db01ba46-985b-4967-a668-73e1eb99189b-cni-binary-copy\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.830698 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830691 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-run-netns\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.830868 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830717 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-modprobe-d\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.830868 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830756 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-run-systemd\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.830868 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830782 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-var-lib-openvswitch\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.830868 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830805 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-run-ovn\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.830868 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830835 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.830868 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830860 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-env-overrides\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.831127 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830926 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-sysconfig\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.831127 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830956 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/447b2177-70e2-46dd-a082-6c750a49db1c-etc-tuned\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.831127 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.830981 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:30:11.831127 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831005 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-sys-fs\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:30:11.831127 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831041 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs\") pod \"network-metrics-daemon-bl5rh\" (UID: \"1720ac40-f3e0-44e3-b2f2-06db389fb9b7\") " pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:30:11.831127 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831054 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/447b2177-70e2-46dd-a082-6c750a49db1c-etc-tuned\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.831127 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831087 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-cni-bin\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.831360 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831145 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.831360 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831169 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-dbus\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:30:11.831360 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831195 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-ovnkube-script-lib\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.831360 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831224 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-sysctl-d\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.831360 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831253 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-hostroot\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.831360 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831274 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-run-multus-certs\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.831360 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831307 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gqct\" (UniqueName: \"kubernetes.io/projected/e3af97b1-99a9-4fab-97b4-ac62b870de03-kube-api-access-4gqct\") pod \"iptables-alerter-csk4z\" (UID: \"e3af97b1-99a9-4fab-97b4-ac62b870de03\") " pod="openshift-network-operator/iptables-alerter-csk4z" Oct 31 00:30:11.831360 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831350 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-device-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:30:11.831707 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831465 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a1b304f2-676a-4a6f-bdac-8805188c415f-hosts-file\") pod \"node-resolver-g7phc\" (UID: \"a1b304f2-676a-4a6f-bdac-8805188c415f\") " pod="openshift-dns/node-resolver-g7phc" Oct 31 00:30:11.831707 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831501 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-lib-modules\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.831707 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831539 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-var-lib-kubelet\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.831707 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831578 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-host\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.831707 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831605 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-multus-socket-dir-parent\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.831707 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831629 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-var-lib-kubelet\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.831707 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831652 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3af97b1-99a9-4fab-97b4-ac62b870de03-host-slash\") pod \"iptables-alerter-csk4z\" (UID: \"e3af97b1-99a9-4fab-97b4-ac62b870de03\") " pod="openshift-network-operator/iptables-alerter-csk4z" Oct 31 00:30:11.831707 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831671 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-systemd-units\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.831707 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.831689 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/db01ba46-985b-4967-a668-73e1eb99189b-multus-daemon-config\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.839525 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.839498 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 31 00:30:11.839706 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.839686 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 31 00:30:11.839792 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.839716 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 31 00:30:11.839842 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.839813 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 31 00:30:11.840074 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.840054 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 31 00:30:11.840157 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.840100 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 31 00:30:11.840297 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.840280 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 31 00:30:11.840435 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.840405 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 31 00:30:11.840511 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.840405 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 31 00:30:11.840511 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.840459 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Oct 31 00:30:11.840628 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.840614 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 31 00:30:11.840696 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.840680 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Oct 31 00:30:11.840745 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.840693 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 31 00:30:11.840854 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.840837 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 31 00:30:11.840911 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.840899 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 31 00:30:11.840972 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.840943 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 31 00:30:11.840972 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.840949 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 31 00:30:11.840972 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.840966 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 31 00:30:11.841090 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.840990 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 31 00:30:11.841090 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.840959 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 31 00:30:11.841090 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.841020 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 31 00:30:11.841090 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.841032 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 31 00:30:11.841090 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.841058 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 31 00:30:11.841278 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.841262 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 31 00:30:11.841966 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.841950 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 31 00:30:11.842070 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.841967 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/db01ba46-985b-4967-a668-73e1eb99189b-multus-daemon-config\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.842070 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.841957 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 31 00:30:11.842070 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.842014 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 31 00:30:11.842070 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.841998 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 31 00:30:11.842070 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.842038 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 31 00:30:11.842070 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.842056 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 31 00:30:11.842070 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.842067 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 31 00:30:11.842294 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.842077 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 31 00:30:11.842294 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.842085 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 31 00:30:11.842294 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.842090 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:30:11.842294 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.842105 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 31 00:30:11.842294 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.842110 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 31 00:30:11.842294 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.842105 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 31 00:30:11.842294 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.842048 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:30:11.842294 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.842121 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 31 00:30:11.842943 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.842929 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 31 00:30:11.843115 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.843102 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 31 00:30:11.844546 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.844530 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 31 00:30:11.846963 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.846948 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Oct 31 00:30:11.847083 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.847067 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4cbmj\"" Oct 31 00:30:11.847151 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.847132 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 31 00:30:11.847195 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.847134 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 31 00:30:11.847472 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.847452 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 31 00:30:11.847472 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.847455 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-xkpl6\"" Oct 31 00:30:11.847595 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.847567 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 31 00:30:11.847656 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.847642 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rn9j5\"" Oct 31 00:30:11.847724 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.847713 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-brqzn\"" Oct 31 00:30:11.847782 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.847773 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-72tmz\"" Oct 31 00:30:11.848058 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.848043 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9g68m\"" Oct 31 00:30:11.848058 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.848046 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 31 00:30:11.848174 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.848127 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 31 00:30:11.848174 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.848128 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jhx4l\"" Oct 31 00:30:11.848174 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.848151 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vxzr5\"" Oct 31 00:30:11.848320 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.848224 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-9nqcj\"" Oct 31 00:30:11.848377 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.848320 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pnvd5\"" Oct 31 00:30:11.848780 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.848763 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmkhp\" (UniqueName: \"kubernetes.io/projected/447b2177-70e2-46dd-a082-6c750a49db1c-kube-api-access-xmkhp\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.848862 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.848778 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gqct\" (UniqueName: \"kubernetes.io/projected/e3af97b1-99a9-4fab-97b4-ac62b870de03-kube-api-access-4gqct\") pod \"iptables-alerter-csk4z\" (UID: \"e3af97b1-99a9-4fab-97b4-ac62b870de03\") " pod="openshift-network-operator/iptables-alerter-csk4z" Oct 31 00:30:11.848862 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.848790 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z56w9\" (UniqueName: \"kubernetes.io/projected/a1b304f2-676a-4a6f-bdac-8805188c415f-kube-api-access-z56w9\") pod \"node-resolver-g7phc\" (UID: \"a1b304f2-676a-4a6f-bdac-8805188c415f\") " pod="openshift-dns/node-resolver-g7phc" Oct 31 00:30:11.848862 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.848815 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2l4j\" (UniqueName: \"kubernetes.io/projected/db01ba46-985b-4967-a668-73e1eb99189b-kube-api-access-g2l4j\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.848862 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.848791 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5fmn\" (UniqueName: \"kubernetes.io/projected/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-kube-api-access-m5fmn\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.849011 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.848903 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n87x\" (UniqueName: \"kubernetes.io/projected/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-kube-api-access-4n87x\") pod \"network-metrics-daemon-bl5rh\" (UID: \"1720ac40-f3e0-44e3-b2f2-06db389fb9b7\") " pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:30:11.849011 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.848909 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzdpn\" (UniqueName: \"kubernetes.io/projected/a2ba2a3b-57ee-4515-a194-cb86198d246b-kube-api-access-lzdpn\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:30:11.849675 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.849655 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3af97b1-99a9-4fab-97b4-ac62b870de03-iptables-alerter-script\") pod \"iptables-alerter-csk4z\" (UID: \"e3af97b1-99a9-4fab-97b4-ac62b870de03\") " pod="openshift-network-operator/iptables-alerter-csk4z" Oct 31 00:30:11.849762 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.849739 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3c5e8eb-fd22-42ee-a203-7c3077f48084-agent-certs\") pod \"konnectivity-agent-ch4wj\" (UID: \"c3c5e8eb-fd22-42ee-a203-7c3077f48084\") " pod="kube-system/konnectivity-agent-ch4wj" Oct 31 00:30:11.849801 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.849740 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-ovn-node-metrics-cert\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.849838 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.849798 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-ovnkube-config\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.850347 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.850329 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3c5e8eb-fd22-42ee-a203-7c3077f48084-konnectivity-ca\") pod \"konnectivity-agent-ch4wj\" (UID: \"c3c5e8eb-fd22-42ee-a203-7c3077f48084\") " pod="kube-system/konnectivity-agent-ch4wj" Oct 31 00:30:11.851555 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.851536 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-env-overrides\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.851651 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.851568 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1720ac40-f3e0-44e3-b2f2-06db389fb9b7-metrics-certs\") pod \"network-metrics-daemon-bl5rh\" (UID: \"1720ac40-f3e0-44e3-b2f2-06db389fb9b7\") " pod="openshift-multus/network-metrics-daemon-bl5rh" Oct 31 00:30:11.851651 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.851594 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db01ba46-985b-4967-a668-73e1eb99189b-cni-binary-copy\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.851651 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.851621 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-ovnkube-script-lib\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.851765 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.851653 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-original-pull-secret\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:30:11.907797 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.907771 6591 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:11.907944 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.907926 6591 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:11.917481 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.917459 6591 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 31 00:30:11.917846 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.917828 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 31 00:30:11.918109 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.918087 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 31 00:30:11.918109 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.918104 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 31 00:30:11.918247 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.918150 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-l92sm\"" Oct 31 00:30:11.918247 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.918172 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Oct 31 00:30:11.918247 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.918154 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 31 00:30:11.918382 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.918362 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Oct 31 00:30:11.918768 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.918739 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Oct 31 00:30:11.918768 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.918748 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 31 00:30:11.918768 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.918760 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xt4sz\"" Oct 31 00:30:11.918768 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.918768 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 31 00:30:11.919129 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.918850 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Oct 31 00:30:11.919129 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.918928 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Oct 31 00:30:11.919129 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.918935 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cmvvg\"" Oct 31 00:30:11.919318 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.919298 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 31 00:30:11.919395 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.919318 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Oct 31 00:30:11.919395 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.919365 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gm9sb\"" Oct 31 00:30:11.919498 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.919451 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-trzmz\"" Oct 31 00:30:11.919498 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.919456 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 31 00:30:11.919498 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.919485 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 31 00:30:11.919498 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.919365 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pl6tx\"" Oct 31 00:30:11.919605 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.919555 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 31 00:30:11.919605 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.919585 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 31 00:30:11.919659 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.919630 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 31 00:30:11.919772 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.919756 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Oct 31 00:30:11.919835 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.919782 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pcfpx\"" Oct 31 00:30:11.919835 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.919794 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 31 00:30:11.919835 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.919808 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 31 00:30:11.919835 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.919809 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-aa4kiasj98hbn\"" Oct 31 00:30:11.919835 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.919835 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Oct 31 00:30:11.920024 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.919840 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-zxj7m\"" Oct 31 00:30:11.920024 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.919857 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tgfj6\"" Oct 31 00:30:11.920024 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.919864 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Oct 31 00:30:11.920024 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.919966 6591 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 00:30:11.920220 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.920200 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fjcute43tnn6a\"" Oct 31 00:30:11.920320 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.920243 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pzkk8\"" Oct 31 00:30:11.920383 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.920350 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 31 00:30:11.920452 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:30:11.920437 6591 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:11.920673 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.920658 6591 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 00:30:11.920707 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:30:11.920700 6591 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-145.us-east-2.compute.internal" Oct 31 00:30:11.932206 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932186 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-run-systemd\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.932298 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932212 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.932298 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932228 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-sysconfig\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.932298 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932242 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-tls\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:30:11.932298 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932257 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81ef083c-e93d-4531-949e-22999120731e-node-exporter-textfile\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:11.932298 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932271 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-cni-bin\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.932298 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932288 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.932611 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932306 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-run-systemd\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.932611 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932325 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-cni-bin\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.932611 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932335 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.932611 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932364 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-dbus\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:30:11.932611 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932375 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81ef083c-e93d-4531-949e-22999120731e-node-exporter-textfile\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:11.932611 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932384 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81ef083c-e93d-4531-949e-22999120731e-node-exporter-tls\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:11.932611 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932375 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.932611 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932339 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-sysconfig\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.932611 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932441 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nqnf\" (UniqueName: \"kubernetes.io/projected/7926238e-b350-435f-ac33-529829777b8a-kube-api-access-9nqnf\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.932611 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932459 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-dbus\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:30:11.932611 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932478 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-audit-log\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:30:11.932611 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932502 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-run-multus-certs\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.932611 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932526 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-serving-cert\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:11.932611 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932548 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-trusted-ca-bundle\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:11.932611 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932562 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-audit-log\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:30:11.932611 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932568 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-run-multus-certs\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.932611 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932571 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-web-config\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.932611 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932564 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-tls\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932641 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81ef083c-e93d-4531-949e-22999120731e-node-exporter-tls\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932694 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-device-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932725 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-multus-socket-dir-parent\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932748 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81ef083c-e93d-4531-949e-22999120731e-node-exporter-wtmp\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932774 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-systemd-units\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932790 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-multus-socket-dir-parent\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932798 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4defb35-52f2-46fc-a314-affe5a217a84-host\") pod \"node-ca-5nw7t\" (UID: \"a4defb35-52f2-46fc-a314-affe5a217a84\") " pod="openshift-image-registry/node-ca-5nw7t" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932791 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-device-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932798 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-serving-cert\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932810 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-web-config\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932839 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932867 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-systemd-units\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932877 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-trusted-ca-bundle\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932908 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7926238e-b350-435f-ac33-529829777b8a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.932985 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1df475be-e1fe-4e90-b60f-dc3763a66cc6-config-volume\") pod \"dns-default-7c822\" (UID: \"1df475be-e1fe-4e90-b60f-dc3763a66cc6\") " pod="openshift-dns/dns-default-7c822" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933069 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933074 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87931c70-7b7c-4910-89ce-f84136d7a852-system-cni-dir\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933164 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933197 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933227 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr42q\" (UniqueName: \"kubernetes.io/projected/7a57dfd1-8cba-4f8e-bdec-908249491197-kube-api-access-rr42q\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933250 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1df475be-e1fe-4e90-b60f-dc3763a66cc6-config-volume\") pod \"dns-default-7c822\" (UID: \"1df475be-e1fe-4e90-b60f-dc3763a66cc6\") " pod="openshift-dns/dns-default-7c822" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933260 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-oauth-serving-cert\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933263 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933283 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7926238e-b350-435f-ac33-529829777b8a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933286 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7926238e-b350-435f-ac33-529829777b8a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933301 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-socket-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933319 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-cni-netd\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933341 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-kubelet\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933356 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-kubernetes\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933365 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-socket-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933371 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-var-lib-cni-multus\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933383 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-cni-netd\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.933372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933393 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933445 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-oauth-serving-cert\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933457 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-kubelet\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933462 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933467 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-kubernetes\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933456 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-var-lib-cni-multus\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933485 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933446 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7926238e-b350-435f-ac33-529829777b8a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933521 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcvrc\" (UniqueName: \"kubernetes.io/projected/1df475be-e1fe-4e90-b60f-dc3763a66cc6-kube-api-access-vcvrc\") pod \"dns-default-7c822\" (UID: \"1df475be-e1fe-4e90-b60f-dc3763a66cc6\") " pod="openshift-dns/dns-default-7c822" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933541 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-system-cni-dir\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933564 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-multus-conf-dir\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933589 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933623 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-system-cni-dir\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933632 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-multus-conf-dir\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933634 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933651 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-crio-socket\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933652 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933677 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-secret-metrics-server-tls\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933706 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1df475be-e1fe-4e90-b60f-dc3763a66cc6-tmp-dir\") pod \"dns-default-7c822\" (UID: \"1df475be-e1fe-4e90-b60f-dc3763a66cc6\") " pod="openshift-dns/dns-default-7c822" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933739 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-sys\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933761 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a57dfd1-8cba-4f8e-bdec-908249491197-tmp\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933765 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933781 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-sys\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933787 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2cv8\" (UniqueName: \"kubernetes.io/projected/87931c70-7b7c-4910-89ce-f84136d7a852-kube-api-access-n2cv8\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933790 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1df475be-e1fe-4e90-b60f-dc3763a66cc6-tmp-dir\") pod \"dns-default-7c822\" (UID: \"1df475be-e1fe-4e90-b60f-dc3763a66cc6\") " pod="openshift-dns/dns-default-7c822" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933816 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-2kqbc\" (UID: \"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933822 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a57dfd1-8cba-4f8e-bdec-908249491197-tmp\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933843 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-2kqbc\" (UID: \"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933866 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-run\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933882 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fv8r\" (UniqueName: \"kubernetes.io/projected/b1cf311b-c4ed-433e-a582-b4bcfcc402a9-kube-api-access-6fv8r\") pod \"ingress-canary-5f5p7\" (UID: \"b1cf311b-c4ed-433e-a582-b4bcfcc402a9\") " pod="openshift-ingress-canary/ingress-canary-5f5p7" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933900 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/87931c70-7b7c-4910-89ce-f84136d7a852-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933923 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-slash\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933933 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-run\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933947 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933958 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-secret-metrics-server-tls\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933972 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-log-socket\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933990 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-2kqbc\" (UID: \"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.933998 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-systemd\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934020 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-tmp\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934045 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-log-socket\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934078 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-2kqbc\" (UID: \"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934067 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m7qc\" (UniqueName: \"kubernetes.io/projected/81ef083c-e93d-4531-949e-22999120731e-kube-api-access-6m7qc\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934101 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-systemd\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934110 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-cnibin\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934123 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-slash\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934126 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-tmp\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934152 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-run-netns\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934161 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/87931c70-7b7c-4910-89ce-f84136d7a852-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934177 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-config-volume\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934197 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-cnibin\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934202 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-oauth-config\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934210 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-run-netns\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934174 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934234 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81ef083c-e93d-4531-949e-22999120731e-sys\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934282 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81ef083c-e93d-4531-949e-22999120731e-root\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934315 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7926238e-b350-435f-ac33-529829777b8a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934343 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7926238e-b350-435f-ac33-529829777b8a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934365 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-config-volume\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934368 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-var-lib-openvswitch\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934399 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-oauth-config\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934441 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-var-lib-openvswitch\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934450 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-run-ovn\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934482 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81ef083c-e93d-4531-949e-22999120731e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934486 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-run-ovn\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934507 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-secret-metrics-server-client-certs\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934536 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-sys-fs\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934541 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7926238e-b350-435f-ac33-529829777b8a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934561 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934580 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7926238e-b350-435f-ac33-529829777b8a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934587 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxqqx\" (UniqueName: \"kubernetes.io/projected/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-kube-api-access-gxqqx\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934596 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-sys-fs\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934611 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/87931c70-7b7c-4910-89ce-f84136d7a852-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934656 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81ef083c-e93d-4531-949e-22999120731e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934638 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q54rb\" (UniqueName: \"kubernetes.io/projected/7573854a-4782-4c89-b93a-43503a30fec2-kube-api-access-q54rb\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934688 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-sysctl-d\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934710 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-hostroot\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934739 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-grpc-tls\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934775 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934783 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-hostroot\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934707 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-secret-metrics-server-client-certs\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934830 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81ef083c-e93d-4531-949e-22999120731e-node-exporter-accelerators-collector-config\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934847 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/87931c70-7b7c-4910-89ce-f84136d7a852-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934859 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934881 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-sysctl-d\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.934839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934886 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934920 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a1b304f2-676a-4a6f-bdac-8805188c415f-hosts-file\") pod \"node-resolver-g7phc\" (UID: \"a1b304f2-676a-4a6f-bdac-8805188c415f\") " pod="openshift-dns/node-resolver-g7phc" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934943 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-lib-modules\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934977 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a1b304f2-676a-4a6f-bdac-8805188c415f-hosts-file\") pod \"node-resolver-g7phc\" (UID: \"a1b304f2-676a-4a6f-bdac-8805188c415f\") " pod="openshift-dns/node-resolver-g7phc" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934976 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-var-lib-kubelet\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935004 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-host\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935019 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-var-lib-kubelet\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935019 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-var-lib-kubelet\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935033 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81ef083c-e93d-4531-949e-22999120731e-node-exporter-accelerators-collector-config\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.934945 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-grpc-tls\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935059 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-host\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935058 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935062 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-var-lib-kubelet\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935073 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935082 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-data-volume\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935105 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1df475be-e1fe-4e90-b60f-dc3763a66cc6-metrics-tls\") pod \"dns-default-7c822\" (UID: \"1df475be-e1fe-4e90-b60f-dc3763a66cc6\") " pod="openshift-dns/dns-default-7c822" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935120 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3af97b1-99a9-4fab-97b4-ac62b870de03-host-slash\") pod \"iptables-alerter-csk4z\" (UID: \"e3af97b1-99a9-4fab-97b4-ac62b870de03\") " pod="openshift-network-operator/iptables-alerter-csk4z" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935140 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7573854a-4782-4c89-b93a-43503a30fec2-console-serving-cert\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935148 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-data-volume\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935158 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-console-config\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935175 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-lib-modules\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935187 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-node-log\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935243 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-run-k8s-cni-cncf-io\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935271 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7573854a-4782-4c89-b93a-43503a30fec2-tmp\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935294 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4defb35-52f2-46fc-a314-affe5a217a84-serviceca\") pod \"node-ca-5nw7t\" (UID: \"a4defb35-52f2-46fc-a314-affe5a217a84\") " pod="openshift-image-registry/node-ca-5nw7t" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935322 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5vvg\" (UniqueName: \"kubernetes.io/projected/a4defb35-52f2-46fc-a314-affe5a217a84-kube-api-access-v5vvg\") pod \"node-ca-5nw7t\" (UID: \"a4defb35-52f2-46fc-a314-affe5a217a84\") " pod="openshift-image-registry/node-ca-5nw7t" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935339 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7573854a-4782-4c89-b93a-43503a30fec2-console-serving-cert\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935349 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqnv9\" (UniqueName: \"kubernetes.io/projected/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-kube-api-access-cqnv9\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935374 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-run-netns\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935383 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-run-k8s-cni-cncf-io\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935402 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-etc-kubernetes\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935411 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3af97b1-99a9-4fab-97b4-ac62b870de03-host-slash\") pod \"iptables-alerter-csk4z\" (UID: \"e3af97b1-99a9-4fab-97b4-ac62b870de03\") " pod="openshift-network-operator/iptables-alerter-csk4z" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935461 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935350 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1df475be-e1fe-4e90-b60f-dc3763a66cc6-metrics-tls\") pod \"dns-default-7c822\" (UID: \"1df475be-e1fe-4e90-b60f-dc3763a66cc6\") " pod="openshift-dns/dns-default-7c822" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935489 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87931c70-7b7c-4910-89ce-f84136d7a852-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935514 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-registration-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935538 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-sysctl-conf\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935559 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-host-run-netns\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935563 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935610 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87931c70-7b7c-4910-89ce-f84136d7a852-cni-binary-copy\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935637 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-oauth-serving-cert\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935641 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-etc-kubernetes\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935664 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-multus-cni-dir\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935690 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g759d\" (UniqueName: \"kubernetes.io/projected/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-kube-api-access-g759d\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935715 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-console-config\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935720 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-config\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935743 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935729 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7a57dfd1-8cba-4f8e-bdec-908249491197-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935778 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-node-log\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935791 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-client-ca-bundle\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935823 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87931c70-7b7c-4910-89ce-f84136d7a852-cni-binary-copy\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935826 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87931c70-7b7c-4910-89ce-f84136d7a852-cnibin\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935771 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7573854a-4782-4c89-b93a-43503a30fec2-tmp\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935869 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-etc-openvswitch\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935909 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-etc-openvswitch\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935933 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4defb35-52f2-46fc-a314-affe5a217a84-serviceca\") pod \"node-ca-5nw7t\" (UID: \"a4defb35-52f2-46fc-a314-affe5a217a84\") " pod="openshift-image-registry/node-ca-5nw7t" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935945 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935952 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-oauth-serving-cert\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935959 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-registration-dir\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.935996 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-var-lib-cni-bin\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936003 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-multus-cni-dir\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936031 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-service-ca\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936038 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db01ba46-985b-4967-a668-73e1eb99189b-host-var-lib-cni-bin\") pod \"multus-h2bhb\" (UID: \"db01ba46-985b-4967-a668-73e1eb99189b\") " pod="openshift-multus/multus-h2bhb" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936060 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936065 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81ef083c-e93d-4531-949e-22999120731e-metrics-client-ca\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936097 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-2kqbc\" (UID: \"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936123 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-etc-selinux\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936126 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-client-ca-bundle\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936147 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-run-openvswitch\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936149 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-sysctl-conf\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936171 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a57dfd1-8cba-4f8e-bdec-908249491197-metrics-client-ca\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936186 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a2ba2a3b-57ee-4515-a194-cb86198d246b-etc-selinux\") pod \"aws-ebs-csi-driver-node-qx8zg\" (UID: \"a2ba2a3b-57ee-4515-a194-cb86198d246b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qx8zg" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936194 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3-run-openvswitch\") pod \"ovnkube-node-d9vvz\" (UID: \"c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936198 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-kubelet-config\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936194 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-service-ca\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936209 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-config\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936229 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7926238e-b350-435f-ac33-529829777b8a-config-out\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936236 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81ef083c-e93d-4531-949e-22999120731e-metrics-client-ca\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936252 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1cf311b-c4ed-433e-a582-b4bcfcc402a9-cert\") pod \"ingress-canary-5f5p7\" (UID: \"b1cf311b-c4ed-433e-a582-b4bcfcc402a9\") " pod="openshift-ingress-canary/ingress-canary-5f5p7" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936257 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b3c9cfb-2fd5-4a88-a938-77f38dd28969-kubelet-config\") pod \"global-pull-secret-syncer-6rt5w\" (UID: \"3b3c9cfb-2fd5-4a88-a938-77f38dd28969\") " pod="kube-system/global-pull-secret-syncer-6rt5w" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936272 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7573854a-4782-4c89-b93a-43503a30fec2-console-oauth-config\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936289 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-trusted-ca-bundle\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936289 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7926238e-b350-435f-ac33-529829777b8a-config-out\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936303 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-modprobe-d\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936324 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-2kqbc\" (UID: \"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936334 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-metrics-server-audit-profiles\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936354 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a57dfd1-8cba-4f8e-bdec-908249491197-metrics-client-ca\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936359 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4stfl\" (UniqueName: \"kubernetes.io/projected/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-kube-api-access-4stfl\") pod \"prometheus-operator-9cd89b74c-2kqbc\" (UID: \"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936402 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-service-ca\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936453 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/447b2177-70e2-46dd-a082-6c750a49db1c-etc-modprobe-d\") pod \"tuned-csst9\" (UID: \"447b2177-70e2-46dd-a082-6c750a49db1c\") " pod="openshift-cluster-node-tuning-operator/tuned-csst9" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936467 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7573854a-4782-4c89-b93a-43503a30fec2-console-oauth-config\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936494 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1cf311b-c4ed-433e-a582-b4bcfcc402a9-cert\") pod \"ingress-canary-5f5p7\" (UID: \"b1cf311b-c4ed-433e-a582-b4bcfcc402a9\") " pod="openshift-ingress-canary/ingress-canary-5f5p7" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936612 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-metrics-server-audit-profiles\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936619 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-service-ca\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:30:11.937849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.936628 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-trusted-ca-bundle\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:30:11.940357 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.938253 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 31 00:30:11.940357 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.939719 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b47dq\" (UniqueName: \"kubernetes.io/projected/4d754c0a-9f48-439b-8673-6ba91b6408ff-kube-api-access-b47dq\") pod \"network-check-target-hnzfm\" (UID: \"4d754c0a-9f48-439b-8673-6ba91b6408ff\") " pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:30:11.943459 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.943403 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nqnf\" (UniqueName: \"kubernetes.io/projected/7926238e-b350-435f-ac33-529829777b8a-kube-api-access-9nqnf\") pod \"alertmanager-main-0\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:11.945804 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.945786 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4stfl\" (UniqueName: \"kubernetes.io/projected/1e9c8bc7-67f7-4e30-99a1-09f26b0774c2-kube-api-access-4stfl\") pod \"prometheus-operator-9cd89b74c-2kqbc\" (UID: \"1e9c8bc7-67f7-4e30-99a1-09f26b0774c2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2kqbc" Oct 31 00:30:11.946188 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.946169 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fv8r\" (UniqueName: \"kubernetes.io/projected/b1cf311b-c4ed-433e-a582-b4bcfcc402a9-kube-api-access-6fv8r\") pod \"ingress-canary-5f5p7\" (UID: \"b1cf311b-c4ed-433e-a582-b4bcfcc402a9\") " pod="openshift-ingress-canary/ingress-canary-5f5p7" Oct 31 00:30:11.946516 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.946500 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g759d\" (UniqueName: \"kubernetes.io/projected/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-kube-api-access-g759d\") pod \"console-567c75bfd8-svz59\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:11.946556 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.946534 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q54rb\" (UniqueName: \"kubernetes.io/projected/7573854a-4782-4c89-b93a-43503a30fec2-kube-api-access-q54rb\") pod \"console-57fd464446-59shl\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " pod="openshift-console/console-57fd464446-59shl" Oct 31 00:30:11.947032 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.947009 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcvrc\" (UniqueName: \"kubernetes.io/projected/1df475be-e1fe-4e90-b60f-dc3763a66cc6-kube-api-access-vcvrc\") pod \"dns-default-7c822\" (UID: \"1df475be-e1fe-4e90-b60f-dc3763a66cc6\") " pod="openshift-dns/dns-default-7c822" Oct 31 00:30:11.947110 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.947021 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5vvg\" (UniqueName: \"kubernetes.io/projected/a4defb35-52f2-46fc-a314-affe5a217a84-kube-api-access-v5vvg\") pod \"node-ca-5nw7t\" (UID: \"a4defb35-52f2-46fc-a314-affe5a217a84\") " pod="openshift-image-registry/node-ca-5nw7t" Oct 31 00:30:11.947110 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.947048 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m7qc\" (UniqueName: \"kubernetes.io/projected/81ef083c-e93d-4531-949e-22999120731e-kube-api-access-6m7qc\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:11.947110 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.947072 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2cv8\" (UniqueName: \"kubernetes.io/projected/87931c70-7b7c-4910-89ce-f84136d7a852-kube-api-access-n2cv8\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:30:11.947110 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.947106 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqnv9\" (UniqueName: \"kubernetes.io/projected/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-kube-api-access-cqnv9\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:30:11.947261 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.947245 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr42q\" (UniqueName: \"kubernetes.io/projected/7a57dfd1-8cba-4f8e-bdec-908249491197-kube-api-access-rr42q\") pod \"thanos-querier-d95b77fc8-mwt72\" (UID: \"7a57dfd1-8cba-4f8e-bdec-908249491197\") " pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:30:11.947298 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:11.947275 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxqqx\" (UniqueName: \"kubernetes.io/projected/adc9181f-c401-4d7c-bbcb-409b4b6f60e0-kube-api-access-gxqqx\") pod \"metrics-server-98b459ffb-jkn2t\" (UID: \"adc9181f-c401-4d7c-bbcb-409b4b6f60e0\") " pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:30:12.037124 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:12.037096 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87931c70-7b7c-4910-89ce-f84136d7a852-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:30:12.037201 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:12.037130 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87931c70-7b7c-4910-89ce-f84136d7a852-cnibin\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:30:12.037201 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:12.037158 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81ef083c-e93d-4531-949e-22999120731e-node-exporter-wtmp\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:12.037201 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:12.037173 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4defb35-52f2-46fc-a314-affe5a217a84-host\") pod \"node-ca-5nw7t\" (UID: \"a4defb35-52f2-46fc-a314-affe5a217a84\") " pod="openshift-image-registry/node-ca-5nw7t" Oct 31 00:30:12.037201 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:12.037196 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87931c70-7b7c-4910-89ce-f84136d7a852-system-cni-dir\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:30:12.037394 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:12.037222 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87931c70-7b7c-4910-89ce-f84136d7a852-cnibin\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:30:12.037394 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:12.037225 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87931c70-7b7c-4910-89ce-f84136d7a852-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:30:12.037394 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:12.037228 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-crio-socket\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:30:12.037394 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:12.037243 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4defb35-52f2-46fc-a314-affe5a217a84-host\") pod \"node-ca-5nw7t\" (UID: \"a4defb35-52f2-46fc-a314-affe5a217a84\") " pod="openshift-image-registry/node-ca-5nw7t" Oct 31 00:30:12.037394 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:12.037255 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81ef083c-e93d-4531-949e-22999120731e-node-exporter-wtmp\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:12.037394 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:12.037266 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87931c70-7b7c-4910-89ce-f84136d7a852-system-cni-dir\") pod \"multus-additional-cni-plugins-qsxkm\" (UID: \"87931c70-7b7c-4910-89ce-f84136d7a852\") " pod="openshift-multus/multus-additional-cni-plugins-qsxkm" Oct 31 00:30:12.037394 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:12.037271 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a47d5fa6-be34-46e7-93f7-44b23c9e9b89-crio-socket\") pod \"insights-runtime-extractor-f8msd\" (UID: \"a47d5fa6-be34-46e7-93f7-44b23c9e9b89\") " pod="openshift-insights/insights-runtime-extractor-f8msd" Oct 31 00:30:12.037394 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:12.037285 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81ef083c-e93d-4531-949e-22999120731e-sys\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:12.037394 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:12.037315 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81ef083c-e93d-4531-949e-22999120731e-root\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:12.037394 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:12.037320 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81ef083c-e93d-4531-949e-22999120731e-sys\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:12.037394 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:12.037369 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81ef083c-e93d-4531-949e-22999120731e-root\") pod \"node-exporter-zkth8\" (UID: \"81ef083c-e93d-4531-949e-22999120731e\") " pod="openshift-monitoring/node-exporter-zkth8" Oct 31 00:30:12.350554 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:12.350530 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ch4wj" Oct 31 00:30:14.103455 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:14.103400 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7c822" Oct 31 00:30:14.323302 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:14.323267 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-d95b77fc8-mwt72" Oct 31 00:30:15.721057 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:15.721029 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:30:16.060314 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:16.060281 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:16.188454 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:16.188430 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:16.258512 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:16.258482 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:18.775146 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:18.775096 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:18.863468 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:30:18.863437 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:30:18.944536 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:18.944502 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:19.384373 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:19.384339 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:30:20.051828 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:20.051798 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:20.052178 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:20.051979 6591 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 31 00:30:25.445763 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:25.445734 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-98b459ffb-jkn2t" Oct 31 00:30:28.644012 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:28.643978 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:28.824934 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:28.824899 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:29.824112 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:29.824047 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:30.001771 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:30.001740 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:30.792557 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:30.792525 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 31 00:30:30.792856 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:30.792832 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="alertmanager" containerID="cri-o://3a350fd76b6875aee19226dd1a470cefef5a1bb19bb2b33c00d1a4a08bf2725f" gracePeriod=120 Oct 31 00:30:30.792903 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:30.792884 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="kube-rbac-proxy-metric" containerID="cri-o://7a094f4a5fbe6123736620c20c3773a2ada0910ec0521957709daf07f8c2155a" gracePeriod=120 Oct 31 00:30:30.792952 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:30.792922 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="kube-rbac-proxy-web" containerID="cri-o://cd43b17265d9d80aaeb3d31e5fc26181b6488ca04c9c6ce6d7a942a8fc0e7057" gracePeriod=120 Oct 31 00:30:30.793011 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:30.792942 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="config-reloader" containerID="cri-o://e39ade38def6488319a56591875ae7ff4e0518fa0373735aa8dad933cd242773" gracePeriod=120 Oct 31 00:30:30.793011 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:30.792973 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="prom-label-proxy" containerID="cri-o://7f1dcd8ea1dd4f4094582e88ddb7e608bd9221bd22ea8640e1cc09e91e28326c" gracePeriod=120 Oct 31 00:30:30.793120 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:30.792954 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="kube-rbac-proxy" containerID="cri-o://c21564aa4709764b8b3f7efb1d9ba7142b2b81e32daeb991cf769cbe93c04d6a" gracePeriod=120 Oct 31 00:30:30.979945 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:30.979912 6591 generic.go:356] "Generic (PLEG): container finished" podID="7926238e-b350-435f-ac33-529829777b8a" containerID="7f1dcd8ea1dd4f4094582e88ddb7e608bd9221bd22ea8640e1cc09e91e28326c" exitCode=0 Oct 31 00:30:30.979945 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:30.979941 6591 generic.go:356] "Generic (PLEG): container finished" podID="7926238e-b350-435f-ac33-529829777b8a" containerID="c21564aa4709764b8b3f7efb1d9ba7142b2b81e32daeb991cf769cbe93c04d6a" exitCode=0 Oct 31 00:30:30.979945 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:30.979948 6591 generic.go:356] "Generic (PLEG): container finished" podID="7926238e-b350-435f-ac33-529829777b8a" containerID="e39ade38def6488319a56591875ae7ff4e0518fa0373735aa8dad933cd242773" exitCode=0 Oct 31 00:30:30.980518 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:30.979954 6591 generic.go:356] "Generic (PLEG): container finished" podID="7926238e-b350-435f-ac33-529829777b8a" containerID="3a350fd76b6875aee19226dd1a470cefef5a1bb19bb2b33c00d1a4a08bf2725f" exitCode=0 Oct 31 00:30:30.980518 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:30.979986 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7926238e-b350-435f-ac33-529829777b8a","Type":"ContainerDied","Data":"7f1dcd8ea1dd4f4094582e88ddb7e608bd9221bd22ea8640e1cc09e91e28326c"} Oct 31 00:30:30.980518 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:30.980049 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7926238e-b350-435f-ac33-529829777b8a","Type":"ContainerDied","Data":"c21564aa4709764b8b3f7efb1d9ba7142b2b81e32daeb991cf769cbe93c04d6a"} Oct 31 00:30:30.980518 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:30.980077 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7926238e-b350-435f-ac33-529829777b8a","Type":"ContainerDied","Data":"e39ade38def6488319a56591875ae7ff4e0518fa0373735aa8dad933cd242773"} Oct 31 00:30:30.980518 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:30.980102 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7926238e-b350-435f-ac33-529829777b8a","Type":"ContainerDied","Data":"3a350fd76b6875aee19226dd1a470cefef5a1bb19bb2b33c00d1a4a08bf2725f"} Oct 31 00:30:31.987933 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:31.987899 6591 generic.go:356] "Generic (PLEG): container finished" podID="7926238e-b350-435f-ac33-529829777b8a" containerID="7a094f4a5fbe6123736620c20c3773a2ada0910ec0521957709daf07f8c2155a" exitCode=0 Oct 31 00:30:31.987933 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:31.987925 6591 generic.go:356] "Generic (PLEG): container finished" podID="7926238e-b350-435f-ac33-529829777b8a" containerID="cd43b17265d9d80aaeb3d31e5fc26181b6488ca04c9c6ce6d7a942a8fc0e7057" exitCode=0 Oct 31 00:30:31.988290 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:31.987969 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7926238e-b350-435f-ac33-529829777b8a","Type":"ContainerDied","Data":"7a094f4a5fbe6123736620c20c3773a2ada0910ec0521957709daf07f8c2155a"} Oct 31 00:30:31.988290 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:31.988044 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7926238e-b350-435f-ac33-529829777b8a","Type":"ContainerDied","Data":"cd43b17265d9d80aaeb3d31e5fc26181b6488ca04c9c6ce6d7a942a8fc0e7057"} Oct 31 00:30:32.020936 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.020911 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:32.085171 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.085143 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7926238e-b350-435f-ac33-529829777b8a-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7926238e-b350-435f-ac33-529829777b8a-alertmanager-trusted-ca-bundle\") pod \"7926238e-b350-435f-ac33-529829777b8a\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " Oct 31 00:30:32.085171 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.085173 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7926238e-b350-435f-ac33-529829777b8a-kube-api-access-9nqnf\" (UniqueName: \"kubernetes.io/projected/7926238e-b350-435f-ac33-529829777b8a-kube-api-access-9nqnf\") pod \"7926238e-b350-435f-ac33-529829777b8a\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " Oct 31 00:30:32.085377 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.085207 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7926238e-b350-435f-ac33-529829777b8a-config-out\" (UniqueName: \"kubernetes.io/empty-dir/7926238e-b350-435f-ac33-529829777b8a-config-out\") pod \"7926238e-b350-435f-ac33-529829777b8a\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " Oct 31 00:30:32.085377 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.085230 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7926238e-b350-435f-ac33-529829777b8a\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " Oct 31 00:30:32.085377 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.085350 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7926238e-b350-435f-ac33-529829777b8a-tls-assets\" (UniqueName: \"kubernetes.io/projected/7926238e-b350-435f-ac33-529829777b8a-tls-assets\") pod \"7926238e-b350-435f-ac33-529829777b8a\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " Oct 31 00:30:32.085574 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.085454 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-web-config\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-web-config\") pod \"7926238e-b350-435f-ac33-529829777b8a\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " Oct 31 00:30:32.085574 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.085495 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7926238e-b350-435f-ac33-529829777b8a-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7926238e-b350-435f-ac33-529829777b8a-metrics-client-ca\") pod \"7926238e-b350-435f-ac33-529829777b8a\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " Oct 31 00:30:32.085574 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.085534 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-config-volume\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-config-volume\") pod \"7926238e-b350-435f-ac33-529829777b8a\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " Oct 31 00:30:32.085737 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.085585 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-main-tls\") pod \"7926238e-b350-435f-ac33-529829777b8a\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " Oct 31 00:30:32.085737 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.085616 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7926238e-b350-435f-ac33-529829777b8a-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7926238e-b350-435f-ac33-529829777b8a-alertmanager-main-db\") pod \"7926238e-b350-435f-ac33-529829777b8a\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " Oct 31 00:30:32.085737 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.085665 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-cluster-tls-config\") pod \"7926238e-b350-435f-ac33-529829777b8a\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " Oct 31 00:30:32.085737 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.085694 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy-web\") pod \"7926238e-b350-435f-ac33-529829777b8a\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " Oct 31 00:30:32.085737 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.085724 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy\") pod \"7926238e-b350-435f-ac33-529829777b8a\" (UID: \"7926238e-b350-435f-ac33-529829777b8a\") " Oct 31 00:30:32.088329 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.085609 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7926238e-b350-435f-ac33-529829777b8a-alertmanager-trusted-ca-bundle" pod "7926238e-b350-435f-ac33-529829777b8a" (UID: "7926238e-b350-435f-ac33-529829777b8a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:30:32.088831 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.085891 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7926238e-b350-435f-ac33-529829777b8a-metrics-client-ca" pod "7926238e-b350-435f-ac33-529829777b8a" (UID: "7926238e-b350-435f-ac33-529829777b8a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:30:32.088831 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.086012 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7926238e-b350-435f-ac33-529829777b8a-alertmanager-main-db" pod "7926238e-b350-435f-ac33-529829777b8a" (UID: "7926238e-b350-435f-ac33-529829777b8a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:30:32.088996 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.088939 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-config-volume" pod "7926238e-b350-435f-ac33-529829777b8a" (UID: "7926238e-b350-435f-ac33-529829777b8a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:30:32.088996 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.088947 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7926238e-b350-435f-ac33-529829777b8a-config-out" pod "7926238e-b350-435f-ac33-529829777b8a" (UID: "7926238e-b350-435f-ac33-529829777b8a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:30:32.089201 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.089129 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7926238e-b350-435f-ac33-529829777b8a-kube-api-access-9nqnf" pod "7926238e-b350-435f-ac33-529829777b8a" (UID: "7926238e-b350-435f-ac33-529829777b8a"). InnerVolumeSpecName "kube-api-access-9nqnf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:30:32.089274 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.089253 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy" pod "7926238e-b350-435f-ac33-529829777b8a" (UID: "7926238e-b350-435f-ac33-529829777b8a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:30:32.089661 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.089614 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy-metric" pod "7926238e-b350-435f-ac33-529829777b8a" (UID: "7926238e-b350-435f-ac33-529829777b8a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:30:32.090263 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.090223 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-main-tls" pod "7926238e-b350-435f-ac33-529829777b8a" (UID: "7926238e-b350-435f-ac33-529829777b8a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:30:32.090821 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.090797 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy-web" pod "7926238e-b350-435f-ac33-529829777b8a" (UID: "7926238e-b350-435f-ac33-529829777b8a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:30:32.090913 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.090830 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7926238e-b350-435f-ac33-529829777b8a-tls-assets" pod "7926238e-b350-435f-ac33-529829777b8a" (UID: "7926238e-b350-435f-ac33-529829777b8a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:30:32.094393 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.094242 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-cluster-tls-config" pod "7926238e-b350-435f-ac33-529829777b8a" (UID: "7926238e-b350-435f-ac33-529829777b8a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:30:32.101407 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.101360 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-web-config" pod "7926238e-b350-435f-ac33-529829777b8a" (UID: "7926238e-b350-435f-ac33-529829777b8a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:30:32.186515 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.186488 6591 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7926238e-b350-435f-ac33-529829777b8a-config-out\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:32.186515 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.186510 6591 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:32.186625 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.186520 6591 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7926238e-b350-435f-ac33-529829777b8a-tls-assets\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:32.186625 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.186531 6591 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-web-config\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:32.186625 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.186541 6591 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7926238e-b350-435f-ac33-529829777b8a-metrics-client-ca\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:32.186625 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.186551 6591 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-config-volume\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:32.186625 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.186560 6591 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-main-tls\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:32.186625 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.186570 6591 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7926238e-b350-435f-ac33-529829777b8a-alertmanager-main-db\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:32.186625 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.186578 6591 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-cluster-tls-config\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:32.186625 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.186587 6591 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:32.186625 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.186597 6591 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7926238e-b350-435f-ac33-529829777b8a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:32.186625 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.186605 6591 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7926238e-b350-435f-ac33-529829777b8a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:32.186625 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.186613 6591 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nqnf\" (UniqueName: \"kubernetes.io/projected/7926238e-b350-435f-ac33-529829777b8a-kube-api-access-9nqnf\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:32.994660 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.994586 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7926238e-b350-435f-ac33-529829777b8a","Type":"ContainerDied","Data":"62fa67ddc94be6af2d7e42c82f1dfd917d2162f5f745242ab93f3fc833aed26f"} Oct 31 00:30:32.994660 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.994653 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:32.995112 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:32.994684 6591 scope.go:122] "RemoveContainer" containerID="7f1dcd8ea1dd4f4094582e88ddb7e608bd9221bd22ea8640e1cc09e91e28326c" Oct 31 00:30:33.003432 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.003398 6591 scope.go:122] "RemoveContainer" containerID="7a094f4a5fbe6123736620c20c3773a2ada0910ec0521957709daf07f8c2155a" Oct 31 00:30:33.010536 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.010513 6591 scope.go:122] "RemoveContainer" containerID="c21564aa4709764b8b3f7efb1d9ba7142b2b81e32daeb991cf769cbe93c04d6a" Oct 31 00:30:33.017225 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.017204 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 31 00:30:33.017581 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.017542 6591 scope.go:122] "RemoveContainer" containerID="cd43b17265d9d80aaeb3d31e5fc26181b6488ca04c9c6ce6d7a942a8fc0e7057" Oct 31 00:30:33.022703 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.022681 6591 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 31 00:30:33.026740 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.026721 6591 scope.go:122] "RemoveContainer" containerID="e39ade38def6488319a56591875ae7ff4e0518fa0373735aa8dad933cd242773" Oct 31 00:30:33.033776 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.033760 6591 scope.go:122] "RemoveContainer" containerID="3a350fd76b6875aee19226dd1a470cefef5a1bb19bb2b33c00d1a4a08bf2725f" Oct 31 00:30:33.040718 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.040700 6591 scope.go:122] "RemoveContainer" containerID="2877a876299322529a573a776abc04ef92cc8f7e2ffd02afb66dd8924d20e71e" Oct 31 00:30:33.056126 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056102 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 31 00:30:33.056341 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056329 6591 cpu_manager.go:414] "containerMap: removing container" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="prom-label-proxy" Oct 31 00:30:33.056387 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056342 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="prom-label-proxy" Oct 31 00:30:33.056387 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056352 6591 cpu_manager.go:414] "containerMap: removing container" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="kube-rbac-proxy-web" Oct 31 00:30:33.056387 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056356 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="kube-rbac-proxy-web" Oct 31 00:30:33.056387 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056374 6591 cpu_manager.go:414] "containerMap: removing container" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="alertmanager" Oct 31 00:30:33.056387 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056379 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="alertmanager" Oct 31 00:30:33.056387 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056391 6591 cpu_manager.go:414] "containerMap: removing container" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="init-config-reloader" Oct 31 00:30:33.056387 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056403 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="init-config-reloader" Oct 31 00:30:33.056387 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056411 6591 cpu_manager.go:414] "containerMap: removing container" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="kube-rbac-proxy-metric" Oct 31 00:30:33.056387 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056433 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="kube-rbac-proxy-metric" Oct 31 00:30:33.056699 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056445 6591 cpu_manager.go:414] "containerMap: removing container" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="kube-rbac-proxy" Oct 31 00:30:33.056699 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056451 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="kube-rbac-proxy" Oct 31 00:30:33.056699 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056458 6591 cpu_manager.go:414] "containerMap: removing container" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="config-reloader" Oct 31 00:30:33.056699 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056462 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="config-reloader" Oct 31 00:30:33.056699 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056530 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="alertmanager" Oct 31 00:30:33.056699 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056537 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="init-config-reloader" Oct 31 00:30:33.056699 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056544 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="kube-rbac-proxy-metric" Oct 31 00:30:33.056699 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056550 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="kube-rbac-proxy" Oct 31 00:30:33.056699 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056555 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="config-reloader" Oct 31 00:30:33.056699 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056560 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="prom-label-proxy" Oct 31 00:30:33.056699 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.056565 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="7926238e-b350-435f-ac33-529829777b8a" containerName="kube-rbac-proxy-web" Oct 31 00:30:33.059684 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.059668 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.063884 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.063864 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 31 00:30:33.064957 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.064120 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 31 00:30:33.064957 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.064182 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 31 00:30:33.064957 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.064190 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 31 00:30:33.064957 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.064251 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 31 00:30:33.064957 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.064384 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 31 00:30:33.064957 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.064413 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 31 00:30:33.064957 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.064459 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 31 00:30:33.064957 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.064789 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tgfj6\"" Oct 31 00:30:33.068622 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.068598 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 31 00:30:33.075390 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.075368 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 31 00:30:33.193999 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.193965 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-web-config\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.194113 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.194002 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.194113 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.194038 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.194113 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.194094 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.194235 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.194148 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.194235 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.194195 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.194306 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.194269 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.194341 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.194304 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.194341 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.194323 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.194463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.194340 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.194463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.194362 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbpc5\" (UniqueName: \"kubernetes.io/projected/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-kube-api-access-jbpc5\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.194577 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.194476 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.194577 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.194561 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-config-out\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.295355 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.295335 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.295466 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.295362 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.295466 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.295377 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.295466 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.295397 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.295466 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.295441 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbpc5\" (UniqueName: \"kubernetes.io/projected/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-kube-api-access-jbpc5\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.295649 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.295467 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.295649 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.295500 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-config-out\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.295649 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.295552 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-web-config\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.295649 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.295577 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.295649 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.295612 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.295649 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.295630 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.295924 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.295653 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.295924 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.295676 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.295924 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.295742 6591 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 31 00:30:33.296086 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.296057 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.296644 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.296617 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.297235 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.296917 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.298586 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.298559 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.298754 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.298730 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.298834 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.298776 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-config-out\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.298905 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.298843 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.299120 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.298929 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.299506 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.299483 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.299594 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.299483 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.300082 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.300063 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-web-config\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.300604 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.300577 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.304046 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.304028 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbpc5\" (UniqueName: \"kubernetes.io/projected/3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b-kube-api-access-jbpc5\") pod \"alertmanager-main-0\" (UID: \"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b\") " pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.381170 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.381138 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 31 00:30:33.660563 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.660496 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 31 00:30:33.664476 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:33.664444 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cd7aa21_007e_4ccc_8156_0bfb3f1eae4b.slice/crio-1018810cf873cc9b37f4bd4c201a9f43a3369f7b8f88d4c26436928f324955a4 WatchSource:0}: Error finding container 1018810cf873cc9b37f4bd4c201a9f43a3369f7b8f88d4c26436928f324955a4: Status 404 returned error can't find the container with id 1018810cf873cc9b37f4bd4c201a9f43a3369f7b8f88d4c26436928f324955a4 Oct 31 00:30:33.999641 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.999571 6591 generic.go:356] "Generic (PLEG): container finished" podID="3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b" containerID="e322be0c9649bfcf2668552bb7fa7554967ec7598fbf92a1a32ca050c636f828" exitCode=0 Oct 31 00:30:34.000022 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.999661 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b","Type":"ContainerDied","Data":"e322be0c9649bfcf2668552bb7fa7554967ec7598fbf92a1a32ca050c636f828"} Oct 31 00:30:34.000022 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:33.999751 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b","Type":"ContainerStarted","Data":"1018810cf873cc9b37f4bd4c201a9f43a3369f7b8f88d4c26436928f324955a4"} Oct 31 00:30:34.774141 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:34.774111 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6cfc94d455-4q5tk"] Oct 31 00:30:34.776483 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:34.776459 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:34.780640 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:34.780504 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Oct 31 00:30:34.780640 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:34.780566 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Oct 31 00:30:34.780909 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:34.780888 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Oct 31 00:30:34.780998 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:34.780982 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-kpn79\"" Oct 31 00:30:34.781085 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:34.781065 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Oct 31 00:30:34.781343 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:34.781272 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Oct 31 00:30:34.783933 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:34.783902 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\"" Oct 31 00:30:34.793403 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:34.793386 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cfc94d455-4q5tk"] Oct 31 00:30:34.851632 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:34.851601 6591 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7926238e-b350-435f-ac33-529829777b8a" path="/var/lib/kubelet/pods/7926238e-b350-435f-ac33-529829777b8a/volumes" Oct 31 00:30:34.907688 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:34.907660 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beed9c31-8361-45c9-8159-64961ded0b5f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:34.907830 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:34.907714 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beed9c31-8361-45c9-8159-64961ded0b5f-metrics-client-ca\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:34.907830 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:34.907797 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beed9c31-8361-45c9-8159-64961ded0b5f-serving-certs-ca-bundle\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:34.907951 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:34.907832 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/beed9c31-8361-45c9-8159-64961ded0b5f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:34.907951 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:34.907858 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/beed9c31-8361-45c9-8159-64961ded0b5f-federate-client-tls\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:34.908029 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:34.907954 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/beed9c31-8361-45c9-8159-64961ded0b5f-telemeter-client-tls\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:34.908029 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:34.907996 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/beed9c31-8361-45c9-8159-64961ded0b5f-secret-telemeter-client\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:34.908029 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:34.908026 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc96b\" (UniqueName: \"kubernetes.io/projected/beed9c31-8361-45c9-8159-64961ded0b5f-kube-api-access-rc96b\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:35.008566 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.008533 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beed9c31-8361-45c9-8159-64961ded0b5f-metrics-client-ca\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:35.009111 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.009083 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beed9c31-8361-45c9-8159-64961ded0b5f-serving-certs-ca-bundle\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:35.009232 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.009129 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/beed9c31-8361-45c9-8159-64961ded0b5f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:35.009232 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.009171 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/beed9c31-8361-45c9-8159-64961ded0b5f-federate-client-tls\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:35.009232 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.009211 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/beed9c31-8361-45c9-8159-64961ded0b5f-telemeter-client-tls\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:35.009383 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.009241 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/beed9c31-8361-45c9-8159-64961ded0b5f-secret-telemeter-client\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:35.009383 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.009281 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc96b\" (UniqueName: \"kubernetes.io/projected/beed9c31-8361-45c9-8159-64961ded0b5f-kube-api-access-rc96b\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:35.009383 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.009329 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beed9c31-8361-45c9-8159-64961ded0b5f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:35.010382 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.010353 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beed9c31-8361-45c9-8159-64961ded0b5f-serving-certs-ca-bundle\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:35.010382 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.010364 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b","Type":"ContainerStarted","Data":"cf5bbb87039be1a9ff2801558473308703ea9243a4de4f322903b3523e5cc6ca"} Oct 31 00:30:35.010382 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.010383 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beed9c31-8361-45c9-8159-64961ded0b5f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:35.010779 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.010467 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b","Type":"ContainerStarted","Data":"e751da00c3fc750973357d9bfb0ef3b6309790aa97ab2919d9e6e60f8bb2fefd"} Oct 31 00:30:35.010779 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.010509 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b","Type":"ContainerStarted","Data":"3fbdf4a7665d0c41f59e9dbbe37fd90093929fecb291a519a22638a123f96d62"} Oct 31 00:30:35.010779 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.010545 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b","Type":"ContainerStarted","Data":"e6d7c80077cef5079216e372992d41fe6723a0bee450433465cea508cb4978ff"} Oct 31 00:30:35.010779 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.010580 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b","Type":"ContainerStarted","Data":"e59fe4192fdc467f287e3b02cef46ae089faef6aa47e08afac8699270d0e86d8"} Oct 31 00:30:35.010779 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.010597 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beed9c31-8361-45c9-8159-64961ded0b5f-metrics-client-ca\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:35.010779 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.010614 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b","Type":"ContainerStarted","Data":"84901039e13f33c514f2611478487178e76b92c5a1fd7a207ad4e271b9ff891e"} Oct 31 00:30:35.012623 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.012603 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/beed9c31-8361-45c9-8159-64961ded0b5f-telemeter-client-tls\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:35.013529 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.013497 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/beed9c31-8361-45c9-8159-64961ded0b5f-secret-telemeter-client\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:35.013529 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.013523 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/beed9c31-8361-45c9-8159-64961ded0b5f-federate-client-tls\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:35.013643 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.013614 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/beed9c31-8361-45c9-8159-64961ded0b5f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:35.018238 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.018217 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc96b\" (UniqueName: \"kubernetes.io/projected/beed9c31-8361-45c9-8159-64961ded0b5f-kube-api-access-rc96b\") pod \"telemeter-client-6cfc94d455-4q5tk\" (UID: \"beed9c31-8361-45c9-8159-64961ded0b5f\") " pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:35.038043 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.037967 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.025532728 podStartE2EDuration="2.037955116s" totalImagesPullingTime="0s" totalInitContainerRuntime="12.422388ms" isStatefulPod=false podCreationTimestamp="2026-10-31 00:30:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:30:35.036740071 +0000 UTC m=+24.298013949" watchObservedRunningTime="2026-10-31 00:30:35.037955116 +0000 UTC m=+24.299228991" Oct 31 00:30:35.093601 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.093569 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" Oct 31 00:30:35.375630 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.375551 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cfc94d455-4q5tk"] Oct 31 00:30:35.381405 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:35.381386 6591 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 31 00:30:36.018576 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:36.018537 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" event={"ID":"beed9c31-8361-45c9-8159-64961ded0b5f","Type":"ContainerStarted","Data":"f528c3469c55745a2fed59ee7e0601f0fb6ea2a8c64c55a05a84f007f302bd2f"} Oct 31 00:30:36.843156 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:36.843091 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-57fd464446-59shl" podUID="7573854a-4782-4c89-b93a-43503a30fec2" containerName="console" containerID="cri-o://faaf654c53f2445c72615b385a62a1d09ba70a8f7167fb0b6d67049445688cd3" gracePeriod=15 Oct 31 00:30:37.029787 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.026359 6591 generic.go:356] "Generic (PLEG): container finished" podID="7573854a-4782-4c89-b93a-43503a30fec2" containerID="faaf654c53f2445c72615b385a62a1d09ba70a8f7167fb0b6d67049445688cd3" exitCode=0 Oct 31 00:30:37.029787 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.026452 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fd464446-59shl" event={"ID":"7573854a-4782-4c89-b93a-43503a30fec2","Type":"ContainerDied","Data":"faaf654c53f2445c72615b385a62a1d09ba70a8f7167fb0b6d67049445688cd3"} Oct 31 00:30:37.088903 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.088883 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fd464446-59shl" Oct 31 00:30:37.231948 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.231918 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7573854a-4782-4c89-b93a-43503a30fec2-tmp\" (UniqueName: \"kubernetes.io/empty-dir/7573854a-4782-4c89-b93a-43503a30fec2-tmp\") pod \"7573854a-4782-4c89-b93a-43503a30fec2\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " Oct 31 00:30:37.232052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.231965 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7573854a-4782-4c89-b93a-43503a30fec2-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7573854a-4782-4c89-b93a-43503a30fec2-console-serving-cert\") pod \"7573854a-4782-4c89-b93a-43503a30fec2\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " Oct 31 00:30:37.232052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.231997 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7573854a-4782-4c89-b93a-43503a30fec2-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7573854a-4782-4c89-b93a-43503a30fec2-console-oauth-config\") pod \"7573854a-4782-4c89-b93a-43503a30fec2\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " Oct 31 00:30:37.232052 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.232042 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-console-config\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-console-config\") pod \"7573854a-4782-4c89-b93a-43503a30fec2\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " Oct 31 00:30:37.232201 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.232084 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7573854a-4782-4c89-b93a-43503a30fec2-kube-api-access-q54rb\" (UniqueName: \"kubernetes.io/projected/7573854a-4782-4c89-b93a-43503a30fec2-kube-api-access-q54rb\") pod \"7573854a-4782-4c89-b93a-43503a30fec2\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " Oct 31 00:30:37.232201 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.232147 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7573854a-4782-4c89-b93a-43503a30fec2-tmp" pod "7573854a-4782-4c89-b93a-43503a30fec2" (UID: "7573854a-4782-4c89-b93a-43503a30fec2"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:30:37.232201 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.232175 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-trusted-ca-bundle\") pod \"7573854a-4782-4c89-b93a-43503a30fec2\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " Oct 31 00:30:37.232345 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.232230 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-oauth-serving-cert\") pod \"7573854a-4782-4c89-b93a-43503a30fec2\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " Oct 31 00:30:37.232345 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.232263 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-service-ca\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-service-ca\") pod \"7573854a-4782-4c89-b93a-43503a30fec2\" (UID: \"7573854a-4782-4c89-b93a-43503a30fec2\") " Oct 31 00:30:37.232473 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.232455 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-console-config" pod "7573854a-4782-4c89-b93a-43503a30fec2" (UID: "7573854a-4782-4c89-b93a-43503a30fec2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:30:37.232827 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.232542 6591 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7573854a-4782-4c89-b93a-43503a30fec2-tmp\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:37.232827 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.232563 6591 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-console-config\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:37.232827 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.232777 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-service-ca" pod "7573854a-4782-4c89-b93a-43503a30fec2" (UID: "7573854a-4782-4c89-b93a-43503a30fec2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:30:37.233089 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.232828 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-trusted-ca-bundle" pod "7573854a-4782-4c89-b93a-43503a30fec2" (UID: "7573854a-4782-4c89-b93a-43503a30fec2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:30:37.233155 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.233117 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-oauth-serving-cert" pod "7573854a-4782-4c89-b93a-43503a30fec2" (UID: "7573854a-4782-4c89-b93a-43503a30fec2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:30:37.234447 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.234404 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7573854a-4782-4c89-b93a-43503a30fec2-console-oauth-config" pod "7573854a-4782-4c89-b93a-43503a30fec2" (UID: "7573854a-4782-4c89-b93a-43503a30fec2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:30:37.234619 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.234594 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7573854a-4782-4c89-b93a-43503a30fec2-console-serving-cert" pod "7573854a-4782-4c89-b93a-43503a30fec2" (UID: "7573854a-4782-4c89-b93a-43503a30fec2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:30:37.234837 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.234818 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7573854a-4782-4c89-b93a-43503a30fec2-kube-api-access-q54rb" pod "7573854a-4782-4c89-b93a-43503a30fec2" (UID: "7573854a-4782-4c89-b93a-43503a30fec2"). InnerVolumeSpecName "kube-api-access-q54rb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:30:37.333041 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.333013 6591 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-oauth-serving-cert\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:37.333041 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.333037 6591 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-service-ca\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:37.333186 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.333049 6591 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7573854a-4782-4c89-b93a-43503a30fec2-console-serving-cert\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:37.333186 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.333058 6591 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7573854a-4782-4c89-b93a-43503a30fec2-console-oauth-config\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:37.333186 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.333069 6591 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q54rb\" (UniqueName: \"kubernetes.io/projected/7573854a-4782-4c89-b93a-43503a30fec2-kube-api-access-q54rb\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:37.333186 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:37.333078 6591 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7573854a-4782-4c89-b93a-43503a30fec2-trusted-ca-bundle\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:30:38.031498 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.031461 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fd464446-59shl" event={"ID":"7573854a-4782-4c89-b93a-43503a30fec2","Type":"ContainerDied","Data":"c86782fa1392f6b9a0fd0c68d5f0f5e393e2d54fe272dd12463f8ce18ae1ee1c"} Oct 31 00:30:38.031498 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.031481 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fd464446-59shl" Oct 31 00:30:38.031971 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.031531 6591 scope.go:122] "RemoveContainer" containerID="faaf654c53f2445c72615b385a62a1d09ba70a8f7167fb0b6d67049445688cd3" Oct 31 00:30:38.033928 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.033905 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" event={"ID":"beed9c31-8361-45c9-8159-64961ded0b5f","Type":"ContainerStarted","Data":"7f2fdfc67a8764b2149f9d6f46dfeb42b5ddcbe72c0606c20f503623e26c4238"} Oct 31 00:30:38.034038 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.033958 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" event={"ID":"beed9c31-8361-45c9-8159-64961ded0b5f","Type":"ContainerStarted","Data":"b26d009f0a3ddfff2764948ef3a2a45354391c1fd22bce6fcf9a0b368f43871b"} Oct 31 00:30:38.034038 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.033990 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" event={"ID":"beed9c31-8361-45c9-8159-64961ded0b5f","Type":"ContainerStarted","Data":"d85328b5b5e0347d17a731f881d85f418a70e05ce7ad605b83501fc143131a3a"} Oct 31 00:30:38.057355 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.057316 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6cfc94d455-4q5tk" podStartSLOduration=2.349820955 podStartE2EDuration="4.057302168s" totalImagesPullingTime="1.707481213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:30:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:30:38.055858519 +0000 UTC m=+27.317132413" watchObservedRunningTime="2026-10-31 00:30:38.057302168 +0000 UTC m=+27.318576040" Oct 31 00:30:38.070768 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.070748 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57fd464446-59shl"] Oct 31 00:30:38.076509 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.076488 6591 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57fd464446-59shl"] Oct 31 00:30:38.152634 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.152612 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-775747895b-sd9fl"] Oct 31 00:30:38.152884 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.152873 6591 cpu_manager.go:414] "containerMap: removing container" podUID="7573854a-4782-4c89-b93a-43503a30fec2" containerName="console" Oct 31 00:30:38.152939 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.152886 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7573854a-4782-4c89-b93a-43503a30fec2" containerName="console" Oct 31 00:30:38.152990 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.152979 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="7573854a-4782-4c89-b93a-43503a30fec2" containerName="console" Oct 31 00:30:38.158190 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.158175 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.165908 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.165886 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-775747895b-sd9fl"] Oct 31 00:30:38.220643 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.220622 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9vvz" Oct 31 00:30:38.242097 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.242078 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsghh\" (UniqueName: \"kubernetes.io/projected/bd695c60-f353-487b-9b9c-30a4365c2d56-kube-api-access-qsghh\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.242189 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.242106 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd695c60-f353-487b-9b9c-30a4365c2d56-console-serving-cert\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.242189 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.242138 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd695c60-f353-487b-9b9c-30a4365c2d56-console-oauth-config\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.242308 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.242199 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-trusted-ca-bundle\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.242308 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.242297 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-oauth-serving-cert\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.242412 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.242339 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-console-config\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.242476 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.242457 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-service-ca\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.242508 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.242478 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd695c60-f353-487b-9b9c-30a4365c2d56-tmp\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.323373 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.323329 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:38.343350 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.343317 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd695c60-f353-487b-9b9c-30a4365c2d56-console-oauth-config\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.343456 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.343359 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-trusted-ca-bundle\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.343456 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.343401 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-oauth-serving-cert\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.343572 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.343475 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-console-config\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.343572 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.343557 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-service-ca\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.343676 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.343585 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd695c60-f353-487b-9b9c-30a4365c2d56-tmp\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.343676 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.343618 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsghh\" (UniqueName: \"kubernetes.io/projected/bd695c60-f353-487b-9b9c-30a4365c2d56-kube-api-access-qsghh\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.343676 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.343652 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd695c60-f353-487b-9b9c-30a4365c2d56-console-serving-cert\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.344329 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.344298 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-trusted-ca-bundle\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.344767 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.344739 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd695c60-f353-487b-9b9c-30a4365c2d56-tmp\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.344767 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.344757 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-service-ca\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.344887 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.344799 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-console-config\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.344887 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.344799 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-oauth-serving-cert\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.345750 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.345730 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd695c60-f353-487b-9b9c-30a4365c2d56-console-oauth-config\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.345945 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.345930 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd695c60-f353-487b-9b9c-30a4365c2d56-console-serving-cert\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.352147 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.352129 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsghh\" (UniqueName: \"kubernetes.io/projected/bd695c60-f353-487b-9b9c-30a4365c2d56-kube-api-access-qsghh\") pod \"console-775747895b-sd9fl\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.470355 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.470316 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:38.496827 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.496801 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:38.682772 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.682656 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:38.741555 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.741527 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-775747895b-sd9fl"] Oct 31 00:30:38.744734 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:30:38.744705 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd695c60_f353_487b_9b9c_30a4365c2d56.slice/crio-3bcf7cb6ff965ca0e8ad6e7d159de86e18327e0076a0b8a3fe102046784565bb WatchSource:0}: Error finding container 3bcf7cb6ff965ca0e8ad6e7d159de86e18327e0076a0b8a3fe102046784565bb: Status 404 returned error can't find the container with id 3bcf7cb6ff965ca0e8ad6e7d159de86e18327e0076a0b8a3fe102046784565bb Oct 31 00:30:38.850314 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.850275 6591 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7573854a-4782-4c89-b93a-43503a30fec2" path="/var/lib/kubelet/pods/7573854a-4782-4c89-b93a-43503a30fec2/volumes" Oct 31 00:30:38.856832 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:38.856781 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:30:39.043182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:39.043149 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-775747895b-sd9fl" event={"ID":"bd695c60-f353-487b-9b9c-30a4365c2d56","Type":"ContainerStarted","Data":"65dd9e54365686d77ad2271148f2ac4c720700a0abd96dd5c0018516d176c6f7"} Oct 31 00:30:39.043681 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:39.043197 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-775747895b-sd9fl" event={"ID":"bd695c60-f353-487b-9b9c-30a4365c2d56","Type":"ContainerStarted","Data":"3bcf7cb6ff965ca0e8ad6e7d159de86e18327e0076a0b8a3fe102046784565bb"} Oct 31 00:30:39.062090 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:39.062034 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-775747895b-sd9fl" podStartSLOduration=1.062016273 podStartE2EDuration="1.062016273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:30:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:30:39.061610527 +0000 UTC m=+28.322884403" watchObservedRunningTime="2026-10-31 00:30:39.062016273 +0000 UTC m=+28.323290158" Oct 31 00:30:39.386689 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:39.386603 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hnzfm" Oct 31 00:30:48.471409 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:48.471368 6591 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:48.471880 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:48.471439 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:48.475908 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:48.475886 6591 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:48.867128 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:30:48.867093 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:30:49.078803 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:49.078778 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:30:49.125261 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:30:49.125187 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-567c75bfd8-svz59"] Oct 31 00:31:08.758182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:08.758149 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:08.930336 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:08.930308 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:14.148847 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.148781 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-567c75bfd8-svz59" podUID="09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" containerName="console" containerID="cri-o://4b93a8c2a7187a8d91107a9dab5df52424039fd7eda027423e7ebf632c212064" gracePeriod=15 Oct 31 00:31:14.398293 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.398271 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:31:14.508260 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.508196 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-serving-cert\") pod \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " Oct 31 00:31:14.508260 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.508238 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-oauth-serving-cert\") pod \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " Oct 31 00:31:14.508489 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.508267 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-trusted-ca-bundle\") pod \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " Oct 31 00:31:14.508489 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.508308 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-tmp\" (UniqueName: \"kubernetes.io/empty-dir/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-tmp\") pod \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " Oct 31 00:31:14.508489 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.508325 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-oauth-config\") pod \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " Oct 31 00:31:14.508489 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.508344 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-config\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-config\") pod \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " Oct 31 00:31:14.508489 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.508401 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-service-ca\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-service-ca\") pod \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " Oct 31 00:31:14.508489 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.508475 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-kube-api-access-g759d\" (UniqueName: \"kubernetes.io/projected/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-kube-api-access-g759d\") pod \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\" (UID: \"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c\") " Oct 31 00:31:14.508795 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.508590 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-tmp" pod "09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" (UID: "09bd144b-d0cc-4ba7-84d8-c66ad7bee28c"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:31:14.508795 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.508732 6591 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-tmp\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:31:14.508908 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.508802 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-trusted-ca-bundle" pod "09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" (UID: "09bd144b-d0cc-4ba7-84d8-c66ad7bee28c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:31:14.508908 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.508816 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-oauth-serving-cert" pod "09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" (UID: "09bd144b-d0cc-4ba7-84d8-c66ad7bee28c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:31:14.508908 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.508843 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-service-ca" pod "09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" (UID: "09bd144b-d0cc-4ba7-84d8-c66ad7bee28c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:31:14.509155 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.509136 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-config" pod "09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" (UID: "09bd144b-d0cc-4ba7-84d8-c66ad7bee28c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:31:14.510564 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.510539 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-serving-cert" pod "09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" (UID: "09bd144b-d0cc-4ba7-84d8-c66ad7bee28c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:31:14.510831 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.510814 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-oauth-config" pod "09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" (UID: "09bd144b-d0cc-4ba7-84d8-c66ad7bee28c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:31:14.510893 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.510870 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-kube-api-access-g759d" pod "09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" (UID: "09bd144b-d0cc-4ba7-84d8-c66ad7bee28c"). InnerVolumeSpecName "kube-api-access-g759d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:31:14.609260 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.609233 6591 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-oauth-config\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:31:14.609260 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.609257 6591 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-config\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:31:14.609387 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.609267 6591 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-service-ca\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:31:14.609387 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.609276 6591 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g759d\" (UniqueName: \"kubernetes.io/projected/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-kube-api-access-g759d\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:31:14.609387 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.609285 6591 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-console-serving-cert\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:31:14.609387 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.609293 6591 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-oauth-serving-cert\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:31:14.609387 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:14.609302 6591 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c-trusted-ca-bundle\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:31:15.164357 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:15.164275 6591 generic.go:356] "Generic (PLEG): container finished" podID="09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" containerID="4b93a8c2a7187a8d91107a9dab5df52424039fd7eda027423e7ebf632c212064" exitCode=0 Oct 31 00:31:15.164357 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:15.164321 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567c75bfd8-svz59" Oct 31 00:31:15.164820 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:15.164364 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567c75bfd8-svz59" event={"ID":"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c","Type":"ContainerDied","Data":"4b93a8c2a7187a8d91107a9dab5df52424039fd7eda027423e7ebf632c212064"} Oct 31 00:31:15.164820 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:15.164414 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567c75bfd8-svz59" event={"ID":"09bd144b-d0cc-4ba7-84d8-c66ad7bee28c","Type":"ContainerDied","Data":"0c6c2b9b49560f008183b9af37fc28fcf93f25229cd1d47cd3b5dbb06269bc38"} Oct 31 00:31:15.164820 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:15.164460 6591 scope.go:122] "RemoveContainer" containerID="4b93a8c2a7187a8d91107a9dab5df52424039fd7eda027423e7ebf632c212064" Oct 31 00:31:15.172689 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:15.172671 6591 scope.go:122] "RemoveContainer" containerID="4b93a8c2a7187a8d91107a9dab5df52424039fd7eda027423e7ebf632c212064" Oct 31 00:31:15.172976 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:31:15.172954 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b93a8c2a7187a8d91107a9dab5df52424039fd7eda027423e7ebf632c212064\": container with ID starting with 4b93a8c2a7187a8d91107a9dab5df52424039fd7eda027423e7ebf632c212064 not found: ID does not exist" containerID="4b93a8c2a7187a8d91107a9dab5df52424039fd7eda027423e7ebf632c212064" Oct 31 00:31:15.173058 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:15.172989 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b93a8c2a7187a8d91107a9dab5df52424039fd7eda027423e7ebf632c212064"} err="failed to get container status \"4b93a8c2a7187a8d91107a9dab5df52424039fd7eda027423e7ebf632c212064\": rpc error: code = NotFound desc = could not find container \"4b93a8c2a7187a8d91107a9dab5df52424039fd7eda027423e7ebf632c212064\": container with ID starting with 4b93a8c2a7187a8d91107a9dab5df52424039fd7eda027423e7ebf632c212064 not found: ID does not exist" Oct 31 00:31:15.180864 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:15.180845 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-567c75bfd8-svz59"] Oct 31 00:31:15.185136 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:15.185115 6591 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-567c75bfd8-svz59"] Oct 31 00:31:16.081134 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:16.081103 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:16.848588 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:16.848555 6591 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" path="/var/lib/kubelet/pods/09bd144b-d0cc-4ba7-84d8-c66ad7bee28c/volumes" Oct 31 00:31:18.864901 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:31:18.864863 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:31:25.061377 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:25.061328 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:25.234339 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:25.234281 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:28.518431 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.518381 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-577ff8bcf5-dqdbw"] Oct 31 00:31:28.518830 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.518705 6591 cpu_manager.go:414] "containerMap: removing container" podUID="09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" containerName="console" Oct 31 00:31:28.518830 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.518719 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" containerName="console" Oct 31 00:31:28.518830 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.518801 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="09bd144b-d0cc-4ba7-84d8-c66ad7bee28c" containerName="console" Oct 31 00:31:28.521458 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.521443 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.533341 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.533206 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-577ff8bcf5-dqdbw"] Oct 31 00:31:28.601898 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.601863 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34c8cdd0-2427-43ab-8a65-31c604d52a7e-tmp\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.601898 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.601902 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6pbn\" (UniqueName: \"kubernetes.io/projected/34c8cdd0-2427-43ab-8a65-31c604d52a7e-kube-api-access-j6pbn\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.602075 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.601984 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34c8cdd0-2427-43ab-8a65-31c604d52a7e-console-config\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.602075 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.602043 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34c8cdd0-2427-43ab-8a65-31c604d52a7e-service-ca\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.602075 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.602064 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34c8cdd0-2427-43ab-8a65-31c604d52a7e-oauth-serving-cert\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.602209 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.602081 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34c8cdd0-2427-43ab-8a65-31c604d52a7e-console-serving-cert\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.602209 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.602169 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34c8cdd0-2427-43ab-8a65-31c604d52a7e-console-oauth-config\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.602209 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.602201 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34c8cdd0-2427-43ab-8a65-31c604d52a7e-trusted-ca-bundle\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.703133 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.703108 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34c8cdd0-2427-43ab-8a65-31c604d52a7e-console-config\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.703227 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.703135 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34c8cdd0-2427-43ab-8a65-31c604d52a7e-service-ca\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.703227 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.703151 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34c8cdd0-2427-43ab-8a65-31c604d52a7e-oauth-serving-cert\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.703227 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.703172 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34c8cdd0-2427-43ab-8a65-31c604d52a7e-console-serving-cert\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.703227 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.703222 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34c8cdd0-2427-43ab-8a65-31c604d52a7e-console-oauth-config\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.703359 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.703259 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34c8cdd0-2427-43ab-8a65-31c604d52a7e-trusted-ca-bundle\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.703359 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.703293 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34c8cdd0-2427-43ab-8a65-31c604d52a7e-tmp\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.703359 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.703326 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6pbn\" (UniqueName: \"kubernetes.io/projected/34c8cdd0-2427-43ab-8a65-31c604d52a7e-kube-api-access-j6pbn\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.703932 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.703868 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34c8cdd0-2427-43ab-8a65-31c604d52a7e-tmp\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.704198 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.703952 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34c8cdd0-2427-43ab-8a65-31c604d52a7e-oauth-serving-cert\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.704198 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.704142 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34c8cdd0-2427-43ab-8a65-31c604d52a7e-console-config\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.704198 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.704192 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34c8cdd0-2427-43ab-8a65-31c604d52a7e-service-ca\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.704371 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.704192 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34c8cdd0-2427-43ab-8a65-31c604d52a7e-trusted-ca-bundle\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.705921 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.705904 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34c8cdd0-2427-43ab-8a65-31c604d52a7e-console-serving-cert\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.706003 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.705925 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34c8cdd0-2427-43ab-8a65-31c604d52a7e-console-oauth-config\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.711151 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.711130 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6pbn\" (UniqueName: \"kubernetes.io/projected/34c8cdd0-2427-43ab-8a65-31c604d52a7e-kube-api-access-j6pbn\") pod \"console-577ff8bcf5-dqdbw\" (UID: \"34c8cdd0-2427-43ab-8a65-31c604d52a7e\") " pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:28.721650 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.721617 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:28.833079 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:28.833029 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:29.106293 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:29.106223 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-577ff8bcf5-dqdbw"] Oct 31 00:31:29.109470 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:31:29.109445 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34c8cdd0_2427_43ab_8a65_31c604d52a7e.slice/crio-6f7543fe8a5f1f000a253349c67d1a0744e2a8a2c74af27a2c644f65946201d0 WatchSource:0}: Error finding container 6f7543fe8a5f1f000a253349c67d1a0744e2a8a2c74af27a2c644f65946201d0: Status 404 returned error can't find the container with id 6f7543fe8a5f1f000a253349c67d1a0744e2a8a2c74af27a2c644f65946201d0 Oct 31 00:31:29.215652 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:29.215624 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577ff8bcf5-dqdbw" event={"ID":"34c8cdd0-2427-43ab-8a65-31c604d52a7e","Type":"ContainerStarted","Data":"63cc8e7fef26bbd212bba27dd2ca13bec893dd0abcf5944757b7aa7788b4e7c3"} Oct 31 00:31:29.215817 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:29.215668 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577ff8bcf5-dqdbw" event={"ID":"34c8cdd0-2427-43ab-8a65-31c604d52a7e","Type":"ContainerStarted","Data":"6f7543fe8a5f1f000a253349c67d1a0744e2a8a2c74af27a2c644f65946201d0"} Oct 31 00:31:29.232236 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:29.232177 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-577ff8bcf5-dqdbw" podStartSLOduration=1.232162294 podStartE2EDuration="1.232162294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:31:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:31:29.231735336 +0000 UTC m=+78.493009214" watchObservedRunningTime="2026-10-31 00:31:29.232162294 +0000 UTC m=+78.493436170" Oct 31 00:31:30.441660 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:30.441625 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:30.609190 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:30.609157 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:32.335120 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:32.335082 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:32.510939 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:32.510907 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:37.673853 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:37.673818 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:37.844721 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:37.844688 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:38.833229 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:38.833195 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:38.833646 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:38.833248 6591 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:38.837884 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:38.837860 6591 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:39.252469 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:39.252356 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-577ff8bcf5-dqdbw" Oct 31 00:31:39.302546 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:39.302518 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-775747895b-sd9fl"] Oct 31 00:31:48.782941 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:48.782899 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:48.864570 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:31:48.864531 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:31:48.963772 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:48.963741 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:31:58.479831 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:31:58.479752 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:32:00.431160 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:00.431129 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:32:04.322631 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.322561 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-775747895b-sd9fl" podUID="bd695c60-f353-487b-9b9c-30a4365c2d56" containerName="console" containerID="cri-o://65dd9e54365686d77ad2271148f2ac4c720700a0abd96dd5c0018516d176c6f7" gracePeriod=15 Oct 31 00:32:04.560197 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.560171 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:32:04.685383 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.685300 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bd695c60-f353-487b-9b9c-30a4365c2d56-kube-api-access-qsghh\" (UniqueName: \"kubernetes.io/projected/bd695c60-f353-487b-9b9c-30a4365c2d56-kube-api-access-qsghh\") pod \"bd695c60-f353-487b-9b9c-30a4365c2d56\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " Oct 31 00:32:04.685383 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.685356 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-service-ca\") pod \"bd695c60-f353-487b-9b9c-30a4365c2d56\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " Oct 31 00:32:04.685610 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.685454 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bd695c60-f353-487b-9b9c-30a4365c2d56-tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd695c60-f353-487b-9b9c-30a4365c2d56-tmp\") pod \"bd695c60-f353-487b-9b9c-30a4365c2d56\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " Oct 31 00:32:04.685610 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.685489 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bd695c60-f353-487b-9b9c-30a4365c2d56-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd695c60-f353-487b-9b9c-30a4365c2d56-console-serving-cert\") pod \"bd695c60-f353-487b-9b9c-30a4365c2d56\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " Oct 31 00:32:04.685610 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.685527 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-console-config\" (UniqueName: \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-console-config\") pod \"bd695c60-f353-487b-9b9c-30a4365c2d56\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " Oct 31 00:32:04.685610 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.685574 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-trusted-ca-bundle\") pod \"bd695c60-f353-487b-9b9c-30a4365c2d56\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " Oct 31 00:32:04.685610 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.685609 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bd695c60-f353-487b-9b9c-30a4365c2d56-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd695c60-f353-487b-9b9c-30a4365c2d56-console-oauth-config\") pod \"bd695c60-f353-487b-9b9c-30a4365c2d56\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " Oct 31 00:32:04.685858 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.685642 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-oauth-serving-cert\") pod \"bd695c60-f353-487b-9b9c-30a4365c2d56\" (UID: \"bd695c60-f353-487b-9b9c-30a4365c2d56\") " Oct 31 00:32:04.685858 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.685724 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-service-ca" pod "bd695c60-f353-487b-9b9c-30a4365c2d56" (UID: "bd695c60-f353-487b-9b9c-30a4365c2d56"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:32:04.685858 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.685823 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd695c60-f353-487b-9b9c-30a4365c2d56-tmp" pod "bd695c60-f353-487b-9b9c-30a4365c2d56" (UID: "bd695c60-f353-487b-9b9c-30a4365c2d56"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:32:04.686019 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.685935 6591 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-service-ca\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:32:04.686019 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.685956 6591 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd695c60-f353-487b-9b9c-30a4365c2d56-tmp\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:32:04.686132 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.686056 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-console-config" pod "bd695c60-f353-487b-9b9c-30a4365c2d56" (UID: "bd695c60-f353-487b-9b9c-30a4365c2d56"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:32:04.686186 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.686146 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-trusted-ca-bundle" pod "bd695c60-f353-487b-9b9c-30a4365c2d56" (UID: "bd695c60-f353-487b-9b9c-30a4365c2d56"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:32:04.686353 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.686314 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-oauth-serving-cert" pod "bd695c60-f353-487b-9b9c-30a4365c2d56" (UID: "bd695c60-f353-487b-9b9c-30a4365c2d56"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:32:04.687813 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.687794 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd695c60-f353-487b-9b9c-30a4365c2d56-kube-api-access-qsghh" pod "bd695c60-f353-487b-9b9c-30a4365c2d56" (UID: "bd695c60-f353-487b-9b9c-30a4365c2d56"). InnerVolumeSpecName "kube-api-access-qsghh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:32:04.687992 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.687972 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd695c60-f353-487b-9b9c-30a4365c2d56-console-serving-cert" pod "bd695c60-f353-487b-9b9c-30a4365c2d56" (UID: "bd695c60-f353-487b-9b9c-30a4365c2d56"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:32:04.688054 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.688001 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd695c60-f353-487b-9b9c-30a4365c2d56-console-oauth-config" pod "bd695c60-f353-487b-9b9c-30a4365c2d56" (UID: "bd695c60-f353-487b-9b9c-30a4365c2d56"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:32:04.786874 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.786841 6591 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-trusted-ca-bundle\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:32:04.786874 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.786867 6591 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd695c60-f353-487b-9b9c-30a4365c2d56-console-oauth-config\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:32:04.786874 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.786877 6591 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-oauth-serving-cert\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:32:04.787091 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.786887 6591 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsghh\" (UniqueName: \"kubernetes.io/projected/bd695c60-f353-487b-9b9c-30a4365c2d56-kube-api-access-qsghh\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:32:04.787091 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.786897 6591 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd695c60-f353-487b-9b9c-30a4365c2d56-console-serving-cert\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:32:04.787091 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:04.786905 6591 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd695c60-f353-487b-9b9c-30a4365c2d56-console-config\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:32:05.338973 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:05.338941 6591 generic.go:356] "Generic (PLEG): container finished" podID="bd695c60-f353-487b-9b9c-30a4365c2d56" containerID="65dd9e54365686d77ad2271148f2ac4c720700a0abd96dd5c0018516d176c6f7" exitCode=0 Oct 31 00:32:05.339387 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:05.338987 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-775747895b-sd9fl" Oct 31 00:32:05.339387 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:05.338989 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-775747895b-sd9fl" event={"ID":"bd695c60-f353-487b-9b9c-30a4365c2d56","Type":"ContainerDied","Data":"65dd9e54365686d77ad2271148f2ac4c720700a0abd96dd5c0018516d176c6f7"} Oct 31 00:32:05.339387 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:05.339089 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-775747895b-sd9fl" event={"ID":"bd695c60-f353-487b-9b9c-30a4365c2d56","Type":"ContainerDied","Data":"3bcf7cb6ff965ca0e8ad6e7d159de86e18327e0076a0b8a3fe102046784565bb"} Oct 31 00:32:05.339387 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:05.339110 6591 scope.go:122] "RemoveContainer" containerID="65dd9e54365686d77ad2271148f2ac4c720700a0abd96dd5c0018516d176c6f7" Oct 31 00:32:05.347160 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:05.347146 6591 scope.go:122] "RemoveContainer" containerID="65dd9e54365686d77ad2271148f2ac4c720700a0abd96dd5c0018516d176c6f7" Oct 31 00:32:05.347551 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:32:05.347527 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65dd9e54365686d77ad2271148f2ac4c720700a0abd96dd5c0018516d176c6f7\": container with ID starting with 65dd9e54365686d77ad2271148f2ac4c720700a0abd96dd5c0018516d176c6f7 not found: ID does not exist" containerID="65dd9e54365686d77ad2271148f2ac4c720700a0abd96dd5c0018516d176c6f7" Oct 31 00:32:05.347640 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:05.347561 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65dd9e54365686d77ad2271148f2ac4c720700a0abd96dd5c0018516d176c6f7"} err="failed to get container status \"65dd9e54365686d77ad2271148f2ac4c720700a0abd96dd5c0018516d176c6f7\": rpc error: code = NotFound desc = could not find container \"65dd9e54365686d77ad2271148f2ac4c720700a0abd96dd5c0018516d176c6f7\": container with ID starting with 65dd9e54365686d77ad2271148f2ac4c720700a0abd96dd5c0018516d176c6f7 not found: ID does not exist" Oct 31 00:32:05.355672 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:05.355651 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-775747895b-sd9fl"] Oct 31 00:32:05.362598 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:05.362577 6591 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-775747895b-sd9fl"] Oct 31 00:32:05.444574 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:05.444540 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:32:05.618293 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:05.618210 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:32:06.849174 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:06.849141 6591 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bd695c60-f353-487b-9b9c-30a4365c2d56" path="/var/lib/kubelet/pods/bd695c60-f353-487b-9b9c-30a4365c2d56/volumes" Oct 31 00:32:16.138219 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:32:16.138182 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:32:18.864233 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:32:18.864194 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:32:48.864248 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:32:48.864204 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:33:16.185512 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:33:16.185473 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:33:18.862604 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:33:18.862566 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:33:37.467342 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:33:37.467260 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:33:37.637312 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:33:37.637281 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:33:48.862395 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:33:48.862360 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:34:12.183174 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:12.183139 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:13.172562 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.172525 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg"] Oct 31 00:34:13.172894 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.172877 6591 cpu_manager.go:414] "containerMap: removing container" podUID="bd695c60-f353-487b-9b9c-30a4365c2d56" containerName="console" Oct 31 00:34:13.172979 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.172897 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd695c60-f353-487b-9b9c-30a4365c2d56" containerName="console" Oct 31 00:34:13.173036 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.172984 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd695c60-f353-487b-9b9c-30a4365c2d56" containerName="console" Oct 31 00:34:13.175916 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.175896 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg" Oct 31 00:34:13.181540 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.181499 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Oct 31 00:34:13.181540 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.181528 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Oct 31 00:34:13.181682 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.181534 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"98a21a31f7a8ae0212b9c22cc643f9202bfa37-6b211c7f-dockercfg-j4kmq\"" Oct 31 00:34:13.190508 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.190489 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg"] Oct 31 00:34:13.259596 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.259574 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xb26\" (UniqueName: \"kubernetes.io/projected/5ed303df-5662-4392-a5ed-2d702a8ea452-kube-api-access-9xb26\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg\" (UID: \"5ed303df-5662-4392-a5ed-2d702a8ea452\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg" Oct 31 00:34:13.259701 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.259608 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ed303df-5662-4392-a5ed-2d702a8ea452-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg\" (UID: \"5ed303df-5662-4392-a5ed-2d702a8ea452\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg" Oct 31 00:34:13.259701 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.259643 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ed303df-5662-4392-a5ed-2d702a8ea452-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg\" (UID: \"5ed303df-5662-4392-a5ed-2d702a8ea452\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg" Oct 31 00:34:13.361056 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.361031 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xb26\" (UniqueName: \"kubernetes.io/projected/5ed303df-5662-4392-a5ed-2d702a8ea452-kube-api-access-9xb26\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg\" (UID: \"5ed303df-5662-4392-a5ed-2d702a8ea452\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg" Oct 31 00:34:13.361143 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.361065 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ed303df-5662-4392-a5ed-2d702a8ea452-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg\" (UID: \"5ed303df-5662-4392-a5ed-2d702a8ea452\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg" Oct 31 00:34:13.361143 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.361111 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ed303df-5662-4392-a5ed-2d702a8ea452-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg\" (UID: \"5ed303df-5662-4392-a5ed-2d702a8ea452\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg" Oct 31 00:34:13.361380 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.361363 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ed303df-5662-4392-a5ed-2d702a8ea452-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg\" (UID: \"5ed303df-5662-4392-a5ed-2d702a8ea452\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg" Oct 31 00:34:13.361484 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.361469 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ed303df-5662-4392-a5ed-2d702a8ea452-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg\" (UID: \"5ed303df-5662-4392-a5ed-2d702a8ea452\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg" Oct 31 00:34:13.369992 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.369969 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xb26\" (UniqueName: \"kubernetes.io/projected/5ed303df-5662-4392-a5ed-2d702a8ea452-kube-api-access-9xb26\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg\" (UID: \"5ed303df-5662-4392-a5ed-2d702a8ea452\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg" Oct 31 00:34:13.400311 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.400287 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:13.490858 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.490807 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg" Oct 31 00:34:13.760640 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.760474 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg"] Oct 31 00:34:13.763126 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:34:13.763094 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed303df_5662_4392_a5ed_2d702a8ea452.slice/crio-e10e39dafc9c3fb19990406ae065f3815ebe138865929425bc8c70da8fc1033d WatchSource:0}: Error finding container e10e39dafc9c3fb19990406ae065f3815ebe138865929425bc8c70da8fc1033d: Status 404 returned error can't find the container with id e10e39dafc9c3fb19990406ae065f3815ebe138865929425bc8c70da8fc1033d Oct 31 00:34:13.775426 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:13.775396 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg" event={"ID":"5ed303df-5662-4392-a5ed-2d702a8ea452","Type":"ContainerStarted","Data":"e10e39dafc9c3fb19990406ae065f3815ebe138865929425bc8c70da8fc1033d"} Oct 31 00:34:16.241042 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:16.241007 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:18.867797 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:34:18.867765 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:34:21.806807 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:21.806773 6591 generic.go:356] "Generic (PLEG): container finished" podID="5ed303df-5662-4392-a5ed-2d702a8ea452" containerID="da18b8a25b83e269735eebae656319497ba49a5e08b94398ab3ec5f248e33862" exitCode=0 Oct 31 00:34:21.807153 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:21.806818 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg" event={"ID":"5ed303df-5662-4392-a5ed-2d702a8ea452","Type":"ContainerDied","Data":"da18b8a25b83e269735eebae656319497ba49a5e08b94398ab3ec5f248e33862"} Oct 31 00:34:24.818894 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:24.818866 6591 generic.go:356] "Generic (PLEG): container finished" podID="5ed303df-5662-4392-a5ed-2d702a8ea452" containerID="f06e283992ecb2383aa46f38d4d384da5c10d8f3d2a53eae780fcc29d7e51f0a" exitCode=0 Oct 31 00:34:24.819187 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:24.818904 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg" event={"ID":"5ed303df-5662-4392-a5ed-2d702a8ea452","Type":"ContainerDied","Data":"f06e283992ecb2383aa46f38d4d384da5c10d8f3d2a53eae780fcc29d7e51f0a"} Oct 31 00:34:28.761786 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:28.761747 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:28.933980 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:28.933950 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:31.740827 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:31.740790 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:31.913815 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:31.913762 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:34.858206 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:34.858181 6591 generic.go:356] "Generic (PLEG): container finished" podID="5ed303df-5662-4392-a5ed-2d702a8ea452" containerID="c9794a4895e7c339a3443fe2ab55104d1ac82d746cdd5964ed030c1602e8dbf0" exitCode=0 Oct 31 00:34:34.858588 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:34.858214 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg" event={"ID":"5ed303df-5662-4392-a5ed-2d702a8ea452","Type":"ContainerDied","Data":"c9794a4895e7c339a3443fe2ab55104d1ac82d746cdd5964ed030c1602e8dbf0"} Oct 31 00:34:36.027198 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:36.027159 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg" Oct 31 00:34:36.033358 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:36.033338 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5ed303df-5662-4392-a5ed-2d702a8ea452-bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ed303df-5662-4392-a5ed-2d702a8ea452-bundle\") pod \"5ed303df-5662-4392-a5ed-2d702a8ea452\" (UID: \"5ed303df-5662-4392-a5ed-2d702a8ea452\") " Oct 31 00:34:36.033499 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:36.033368 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5ed303df-5662-4392-a5ed-2d702a8ea452-util\" (UniqueName: \"kubernetes.io/empty-dir/5ed303df-5662-4392-a5ed-2d702a8ea452-util\") pod \"5ed303df-5662-4392-a5ed-2d702a8ea452\" (UID: \"5ed303df-5662-4392-a5ed-2d702a8ea452\") " Oct 31 00:34:36.033499 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:36.033413 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5ed303df-5662-4392-a5ed-2d702a8ea452-kube-api-access-9xb26\" (UniqueName: \"kubernetes.io/projected/5ed303df-5662-4392-a5ed-2d702a8ea452-kube-api-access-9xb26\") pod \"5ed303df-5662-4392-a5ed-2d702a8ea452\" (UID: \"5ed303df-5662-4392-a5ed-2d702a8ea452\") " Oct 31 00:34:36.033999 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:36.033973 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ed303df-5662-4392-a5ed-2d702a8ea452-bundle" pod "5ed303df-5662-4392-a5ed-2d702a8ea452" (UID: "5ed303df-5662-4392-a5ed-2d702a8ea452"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:34:36.035638 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:36.035615 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ed303df-5662-4392-a5ed-2d702a8ea452-kube-api-access-9xb26" pod "5ed303df-5662-4392-a5ed-2d702a8ea452" (UID: "5ed303df-5662-4392-a5ed-2d702a8ea452"). InnerVolumeSpecName "kube-api-access-9xb26". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:34:36.037450 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:36.037410 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ed303df-5662-4392-a5ed-2d702a8ea452-util" pod "5ed303df-5662-4392-a5ed-2d702a8ea452" (UID: "5ed303df-5662-4392-a5ed-2d702a8ea452"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:34:36.134822 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:36.134758 6591 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ed303df-5662-4392-a5ed-2d702a8ea452-bundle\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:34:36.134822 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:36.134782 6591 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ed303df-5662-4392-a5ed-2d702a8ea452-util\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:34:36.134822 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:36.134791 6591 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xb26\" (UniqueName: \"kubernetes.io/projected/5ed303df-5662-4392-a5ed-2d702a8ea452-kube-api-access-9xb26\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:34:36.866395 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:36.866366 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg" event={"ID":"5ed303df-5662-4392-a5ed-2d702a8ea452","Type":"ContainerDied","Data":"e10e39dafc9c3fb19990406ae065f3815ebe138865929425bc8c70da8fc1033d"} Oct 31 00:34:36.866550 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:36.866411 6591 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e10e39dafc9c3fb19990406ae065f3815ebe138865929425bc8c70da8fc1033d" Oct 31 00:34:36.866550 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:36.866435 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cw25cg" Oct 31 00:34:39.414322 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:39.414285 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:39.624185 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:39.624153 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:40.393881 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.393846 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-pqqjg"] Oct 31 00:34:40.394193 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.394180 6591 cpu_manager.go:414] "containerMap: removing container" podUID="5ed303df-5662-4392-a5ed-2d702a8ea452" containerName="util" Oct 31 00:34:40.394279 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.394194 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ed303df-5662-4392-a5ed-2d702a8ea452" containerName="util" Oct 31 00:34:40.394279 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.394209 6591 cpu_manager.go:414] "containerMap: removing container" podUID="5ed303df-5662-4392-a5ed-2d702a8ea452" containerName="pull" Oct 31 00:34:40.394279 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.394213 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ed303df-5662-4392-a5ed-2d702a8ea452" containerName="pull" Oct 31 00:34:40.394279 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.394226 6591 cpu_manager.go:414] "containerMap: removing container" podUID="5ed303df-5662-4392-a5ed-2d702a8ea452" containerName="extract" Oct 31 00:34:40.394279 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.394231 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ed303df-5662-4392-a5ed-2d702a8ea452" containerName="extract" Oct 31 00:34:40.394279 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.394280 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ed303df-5662-4392-a5ed-2d702a8ea452" containerName="extract" Oct 31 00:34:40.396097 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.396081 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-pqqjg" Oct 31 00:34:40.402703 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.402684 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Oct 31 00:34:40.402703 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.402696 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Oct 31 00:34:40.405088 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.405073 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-k7wbc\"" Oct 31 00:34:40.405193 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.405132 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Oct 31 00:34:40.409063 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.409046 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-pqqjg"] Oct 31 00:34:40.465986 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.465948 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwd9f\" (UniqueName: \"kubernetes.io/projected/1dfee680-ec04-49d6-b89f-086bb7f7df03-kube-api-access-vwd9f\") pod \"custom-metrics-autoscaler-operator-c667576c8-pqqjg\" (UID: \"1dfee680-ec04-49d6-b89f-086bb7f7df03\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-pqqjg" Oct 31 00:34:40.466363 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.466006 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/1dfee680-ec04-49d6-b89f-086bb7f7df03-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-pqqjg\" (UID: \"1dfee680-ec04-49d6-b89f-086bb7f7df03\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-pqqjg" Oct 31 00:34:40.566743 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.566702 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwd9f\" (UniqueName: \"kubernetes.io/projected/1dfee680-ec04-49d6-b89f-086bb7f7df03-kube-api-access-vwd9f\") pod \"custom-metrics-autoscaler-operator-c667576c8-pqqjg\" (UID: \"1dfee680-ec04-49d6-b89f-086bb7f7df03\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-pqqjg" Oct 31 00:34:40.566894 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.566758 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/1dfee680-ec04-49d6-b89f-086bb7f7df03-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-pqqjg\" (UID: \"1dfee680-ec04-49d6-b89f-086bb7f7df03\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-pqqjg" Oct 31 00:34:40.569169 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.569148 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/1dfee680-ec04-49d6-b89f-086bb7f7df03-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-pqqjg\" (UID: \"1dfee680-ec04-49d6-b89f-086bb7f7df03\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-pqqjg" Oct 31 00:34:40.575370 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.575346 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwd9f\" (UniqueName: \"kubernetes.io/projected/1dfee680-ec04-49d6-b89f-086bb7f7df03-kube-api-access-vwd9f\") pod \"custom-metrics-autoscaler-operator-c667576c8-pqqjg\" (UID: \"1dfee680-ec04-49d6-b89f-086bb7f7df03\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-pqqjg" Oct 31 00:34:40.706754 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.706684 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-pqqjg" Oct 31 00:34:40.977860 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:40.977780 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-pqqjg"] Oct 31 00:34:40.980899 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:34:40.980871 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dfee680_ec04_49d6_b89f_086bb7f7df03.slice/crio-482d8b06384d51434c5ee023951e0fde62d71740337c3384d9e8414a9b0aada6 WatchSource:0}: Error finding container 482d8b06384d51434c5ee023951e0fde62d71740337c3384d9e8414a9b0aada6: Status 404 returned error can't find the container with id 482d8b06384d51434c5ee023951e0fde62d71740337c3384d9e8414a9b0aada6 Oct 31 00:34:41.884022 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:41.883990 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-pqqjg" event={"ID":"1dfee680-ec04-49d6-b89f-086bb7f7df03","Type":"ContainerStarted","Data":"482d8b06384d51434c5ee023951e0fde62d71740337c3384d9e8414a9b0aada6"} Oct 31 00:34:44.897063 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:44.896985 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-pqqjg" event={"ID":"1dfee680-ec04-49d6-b89f-086bb7f7df03","Type":"ContainerStarted","Data":"fdd01ceb34a2994f6c746d4bf4a448ab1c958e3df387f8c8ce8428107edee443"} Oct 31 00:34:44.897063 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:44.897054 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-pqqjg" Oct 31 00:34:44.916775 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:44.916732 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-pqqjg" podStartSLOduration=1.33667027 podStartE2EDuration="4.916719045s" totalImagesPullingTime="3.580048775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:34:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:34:44.915619758 +0000 UTC m=+274.176893632" watchObservedRunningTime="2026-10-31 00:34:44.916719045 +0000 UTC m=+274.177992921" Oct 31 00:34:45.170682 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.170605 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:45.342067 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.342037 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-7dc85965f-wqfkp"] Oct 31 00:34:45.343944 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.343929 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-7dc85965f-wqfkp" Oct 31 00:34:45.353319 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.353280 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Oct 31 00:34:45.353474 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.353385 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-d652v\"" Oct 31 00:34:45.353474 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.353414 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Oct 31 00:34:45.353917 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.353896 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-7dc85965f-wqfkp"] Oct 31 00:34:45.408063 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.408035 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79vzd\" (UniqueName: \"kubernetes.io/projected/87e78a10-5e45-4af0-8a2e-c4d840c716f0-kube-api-access-79vzd\") pod \"keda-operator-7dc85965f-wqfkp\" (UID: \"87e78a10-5e45-4af0-8a2e-c4d840c716f0\") " pod="openshift-keda/keda-operator-7dc85965f-wqfkp" Oct 31 00:34:45.408186 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.408077 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/87e78a10-5e45-4af0-8a2e-c4d840c716f0-certificates\") pod \"keda-operator-7dc85965f-wqfkp\" (UID: \"87e78a10-5e45-4af0-8a2e-c4d840c716f0\") " pod="openshift-keda/keda-operator-7dc85965f-wqfkp" Oct 31 00:34:45.408186 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.408099 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/87e78a10-5e45-4af0-8a2e-c4d840c716f0-cabundle0\") pod \"keda-operator-7dc85965f-wqfkp\" (UID: \"87e78a10-5e45-4af0-8a2e-c4d840c716f0\") " pod="openshift-keda/keda-operator-7dc85965f-wqfkp" Oct 31 00:34:45.439262 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.439198 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:45.509154 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.509120 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/87e78a10-5e45-4af0-8a2e-c4d840c716f0-cabundle0\") pod \"keda-operator-7dc85965f-wqfkp\" (UID: \"87e78a10-5e45-4af0-8a2e-c4d840c716f0\") " pod="openshift-keda/keda-operator-7dc85965f-wqfkp" Oct 31 00:34:45.509316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.509217 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79vzd\" (UniqueName: \"kubernetes.io/projected/87e78a10-5e45-4af0-8a2e-c4d840c716f0-kube-api-access-79vzd\") pod \"keda-operator-7dc85965f-wqfkp\" (UID: \"87e78a10-5e45-4af0-8a2e-c4d840c716f0\") " pod="openshift-keda/keda-operator-7dc85965f-wqfkp" Oct 31 00:34:45.509316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.509279 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/87e78a10-5e45-4af0-8a2e-c4d840c716f0-certificates\") pod \"keda-operator-7dc85965f-wqfkp\" (UID: \"87e78a10-5e45-4af0-8a2e-c4d840c716f0\") " pod="openshift-keda/keda-operator-7dc85965f-wqfkp" Oct 31 00:34:45.509449 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:34:45.509410 6591 secret.go:281] references non-existent secret key: ca.crt Oct 31 00:34:45.509514 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:34:45.509456 6591 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Oct 31 00:34:45.509514 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:34:45.509469 6591 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-7dc85965f-wqfkp: references non-existent secret key: ca.crt Oct 31 00:34:45.509606 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:34:45.509540 6591 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87e78a10-5e45-4af0-8a2e-c4d840c716f0-certificates podName:87e78a10-5e45-4af0-8a2e-c4d840c716f0 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:46.009520089 +0000 UTC m=+275.270793963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/87e78a10-5e45-4af0-8a2e-c4d840c716f0-certificates") pod "keda-operator-7dc85965f-wqfkp" (UID: "87e78a10-5e45-4af0-8a2e-c4d840c716f0") : references non-existent secret key: ca.crt Oct 31 00:34:45.509797 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.509780 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/87e78a10-5e45-4af0-8a2e-c4d840c716f0-cabundle0\") pod \"keda-operator-7dc85965f-wqfkp\" (UID: \"87e78a10-5e45-4af0-8a2e-c4d840c716f0\") " pod="openshift-keda/keda-operator-7dc85965f-wqfkp" Oct 31 00:34:45.517645 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.517621 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79vzd\" (UniqueName: \"kubernetes.io/projected/87e78a10-5e45-4af0-8a2e-c4d840c716f0-kube-api-access-79vzd\") pod \"keda-operator-7dc85965f-wqfkp\" (UID: \"87e78a10-5e45-4af0-8a2e-c4d840c716f0\") " pod="openshift-keda/keda-operator-7dc85965f-wqfkp" Oct 31 00:34:45.538460 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.538438 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp"] Oct 31 00:34:45.540447 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.540412 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp" Oct 31 00:34:45.545291 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.545267 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Oct 31 00:34:45.550783 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.550762 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp"] Oct 31 00:34:45.610598 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.610573 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsqrm\" (UniqueName: \"kubernetes.io/projected/df934119-8202-4623-8bc9-918f5aff3bc5-kube-api-access-hsqrm\") pod \"keda-metrics-apiserver-86bd856cfb-rtpbp\" (UID: \"df934119-8202-4623-8bc9-918f5aff3bc5\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp" Oct 31 00:34:45.610699 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.610621 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/df934119-8202-4623-8bc9-918f5aff3bc5-temp-vol\") pod \"keda-metrics-apiserver-86bd856cfb-rtpbp\" (UID: \"df934119-8202-4623-8bc9-918f5aff3bc5\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp" Oct 31 00:34:45.610699 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.610650 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/df934119-8202-4623-8bc9-918f5aff3bc5-certificates\") pod \"keda-metrics-apiserver-86bd856cfb-rtpbp\" (UID: \"df934119-8202-4623-8bc9-918f5aff3bc5\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp" Oct 31 00:34:45.615266 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.615222 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:45.711970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.711888 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsqrm\" (UniqueName: \"kubernetes.io/projected/df934119-8202-4623-8bc9-918f5aff3bc5-kube-api-access-hsqrm\") pod \"keda-metrics-apiserver-86bd856cfb-rtpbp\" (UID: \"df934119-8202-4623-8bc9-918f5aff3bc5\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp" Oct 31 00:34:45.711970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.711948 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/df934119-8202-4623-8bc9-918f5aff3bc5-temp-vol\") pod \"keda-metrics-apiserver-86bd856cfb-rtpbp\" (UID: \"df934119-8202-4623-8bc9-918f5aff3bc5\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp" Oct 31 00:34:45.711970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.711970 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/df934119-8202-4623-8bc9-918f5aff3bc5-certificates\") pod \"keda-metrics-apiserver-86bd856cfb-rtpbp\" (UID: \"df934119-8202-4623-8bc9-918f5aff3bc5\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp" Oct 31 00:34:45.712185 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:34:45.712076 6591 secret.go:281] references non-existent secret key: tls.crt Oct 31 00:34:45.712185 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:34:45.712089 6591 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Oct 31 00:34:45.712185 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:34:45.712107 6591 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp: references non-existent secret key: tls.crt Oct 31 00:34:45.712185 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:34:45.712162 6591 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/df934119-8202-4623-8bc9-918f5aff3bc5-certificates podName:df934119-8202-4623-8bc9-918f5aff3bc5 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:46.212148513 +0000 UTC m=+275.473422383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/df934119-8202-4623-8bc9-918f5aff3bc5-certificates") pod "keda-metrics-apiserver-86bd856cfb-rtpbp" (UID: "df934119-8202-4623-8bc9-918f5aff3bc5") : references non-existent secret key: tls.crt Oct 31 00:34:45.712313 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.712302 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/df934119-8202-4623-8bc9-918f5aff3bc5-temp-vol\") pod \"keda-metrics-apiserver-86bd856cfb-rtpbp\" (UID: \"df934119-8202-4623-8bc9-918f5aff3bc5\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp" Oct 31 00:34:45.720603 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.720570 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsqrm\" (UniqueName: \"kubernetes.io/projected/df934119-8202-4623-8bc9-918f5aff3bc5-kube-api-access-hsqrm\") pod \"keda-metrics-apiserver-86bd856cfb-rtpbp\" (UID: \"df934119-8202-4623-8bc9-918f5aff3bc5\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp" Oct 31 00:34:45.796554 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:45.796524 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:46.014624 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:46.014600 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/87e78a10-5e45-4af0-8a2e-c4d840c716f0-certificates\") pod \"keda-operator-7dc85965f-wqfkp\" (UID: \"87e78a10-5e45-4af0-8a2e-c4d840c716f0\") " pod="openshift-keda/keda-operator-7dc85965f-wqfkp" Oct 31 00:34:46.014971 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:34:46.014768 6591 secret.go:281] references non-existent secret key: ca.crt Oct 31 00:34:46.014971 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:34:46.014788 6591 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Oct 31 00:34:46.014971 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:34:46.014799 6591 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-7dc85965f-wqfkp: references non-existent secret key: ca.crt Oct 31 00:34:46.014971 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:34:46.014864 6591 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87e78a10-5e45-4af0-8a2e-c4d840c716f0-certificates podName:87e78a10-5e45-4af0-8a2e-c4d840c716f0 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:47.014842006 +0000 UTC m=+276.276115876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/87e78a10-5e45-4af0-8a2e-c4d840c716f0-certificates") pod "keda-operator-7dc85965f-wqfkp" (UID: "87e78a10-5e45-4af0-8a2e-c4d840c716f0") : references non-existent secret key: ca.crt Oct 31 00:34:46.217279 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:46.217246 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/df934119-8202-4623-8bc9-918f5aff3bc5-certificates\") pod \"keda-metrics-apiserver-86bd856cfb-rtpbp\" (UID: \"df934119-8202-4623-8bc9-918f5aff3bc5\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp" Oct 31 00:34:46.217489 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:34:46.217387 6591 secret.go:281] references non-existent secret key: tls.crt Oct 31 00:34:46.217489 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:34:46.217412 6591 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Oct 31 00:34:46.217489 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:34:46.217456 6591 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp: references non-existent secret key: tls.crt Oct 31 00:34:46.217659 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:34:46.217524 6591 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/df934119-8202-4623-8bc9-918f5aff3bc5-certificates podName:df934119-8202-4623-8bc9-918f5aff3bc5 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:47.217505681 +0000 UTC m=+276.478779541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/df934119-8202-4623-8bc9-918f5aff3bc5-certificates") pod "keda-metrics-apiserver-86bd856cfb-rtpbp" (UID: "df934119-8202-4623-8bc9-918f5aff3bc5") : references non-existent secret key: tls.crt Oct 31 00:34:46.316925 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:46.316844 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:46.398909 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:46.398880 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-7b7c985c58-c9sw8"] Oct 31 00:34:46.401038 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:46.401021 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-7b7c985c58-c9sw8" Oct 31 00:34:46.404601 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:46.404581 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Oct 31 00:34:46.411865 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:46.411832 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-7b7c985c58-c9sw8"] Oct 31 00:34:46.500358 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:46.500328 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:46.519783 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:46.519750 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6hnk\" (UniqueName: \"kubernetes.io/projected/5d264ded-c0ef-4986-9816-436284534e3a-kube-api-access-m6hnk\") pod \"keda-admission-7b7c985c58-c9sw8\" (UID: \"5d264ded-c0ef-4986-9816-436284534e3a\") " pod="openshift-keda/keda-admission-7b7c985c58-c9sw8" Oct 31 00:34:46.519937 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:46.519806 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5d264ded-c0ef-4986-9816-436284534e3a-certificates\") pod \"keda-admission-7b7c985c58-c9sw8\" (UID: \"5d264ded-c0ef-4986-9816-436284534e3a\") " pod="openshift-keda/keda-admission-7b7c985c58-c9sw8" Oct 31 00:34:46.622456 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:46.622348 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6hnk\" (UniqueName: \"kubernetes.io/projected/5d264ded-c0ef-4986-9816-436284534e3a-kube-api-access-m6hnk\") pod \"keda-admission-7b7c985c58-c9sw8\" (UID: \"5d264ded-c0ef-4986-9816-436284534e3a\") " pod="openshift-keda/keda-admission-7b7c985c58-c9sw8" Oct 31 00:34:46.622456 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:46.622402 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5d264ded-c0ef-4986-9816-436284534e3a-certificates\") pod \"keda-admission-7b7c985c58-c9sw8\" (UID: \"5d264ded-c0ef-4986-9816-436284534e3a\") " pod="openshift-keda/keda-admission-7b7c985c58-c9sw8" Oct 31 00:34:46.625116 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:46.625092 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5d264ded-c0ef-4986-9816-436284534e3a-certificates\") pod \"keda-admission-7b7c985c58-c9sw8\" (UID: \"5d264ded-c0ef-4986-9816-436284534e3a\") " pod="openshift-keda/keda-admission-7b7c985c58-c9sw8" Oct 31 00:34:46.638691 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:46.638663 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6hnk\" (UniqueName: \"kubernetes.io/projected/5d264ded-c0ef-4986-9816-436284534e3a-kube-api-access-m6hnk\") pod \"keda-admission-7b7c985c58-c9sw8\" (UID: \"5d264ded-c0ef-4986-9816-436284534e3a\") " pod="openshift-keda/keda-admission-7b7c985c58-c9sw8" Oct 31 00:34:46.696385 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:46.696359 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:46.712566 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:46.712537 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-7b7c985c58-c9sw8" Oct 31 00:34:46.898379 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:46.898296 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:46.995967 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:46.995937 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-7b7c985c58-c9sw8"] Oct 31 00:34:46.999241 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:34:46.999207 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d264ded_c0ef_4986_9816_436284534e3a.slice/crio-069273111e678068c7aad12755446f36808bc7e39d3d76784307bc992fff99b0 WatchSource:0}: Error finding container 069273111e678068c7aad12755446f36808bc7e39d3d76784307bc992fff99b0: Status 404 returned error can't find the container with id 069273111e678068c7aad12755446f36808bc7e39d3d76784307bc992fff99b0 Oct 31 00:34:47.027495 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:47.027465 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/87e78a10-5e45-4af0-8a2e-c4d840c716f0-certificates\") pod \"keda-operator-7dc85965f-wqfkp\" (UID: \"87e78a10-5e45-4af0-8a2e-c4d840c716f0\") " pod="openshift-keda/keda-operator-7dc85965f-wqfkp" Oct 31 00:34:47.030115 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:47.030095 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/87e78a10-5e45-4af0-8a2e-c4d840c716f0-certificates\") pod \"keda-operator-7dc85965f-wqfkp\" (UID: \"87e78a10-5e45-4af0-8a2e-c4d840c716f0\") " pod="openshift-keda/keda-operator-7dc85965f-wqfkp" Oct 31 00:34:47.101963 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:47.101934 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:47.155512 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:47.155450 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-7dc85965f-wqfkp" Oct 31 00:34:47.229126 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:47.229099 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/df934119-8202-4623-8bc9-918f5aff3bc5-certificates\") pod \"keda-metrics-apiserver-86bd856cfb-rtpbp\" (UID: \"df934119-8202-4623-8bc9-918f5aff3bc5\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp" Oct 31 00:34:47.231541 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:47.231515 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/df934119-8202-4623-8bc9-918f5aff3bc5-certificates\") pod \"keda-metrics-apiserver-86bd856cfb-rtpbp\" (UID: \"df934119-8202-4623-8bc9-918f5aff3bc5\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp" Oct 31 00:34:47.321224 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:47.321194 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:34:47.352288 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:47.352267 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp" Oct 31 00:34:47.426221 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:47.426142 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-7dc85965f-wqfkp"] Oct 31 00:34:47.429440 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:34:47.429395 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e78a10_5e45_4af0_8a2e_c4d840c716f0.slice/crio-324f9bc3768c1b338198e7696d957962b9b167262ca4ece7618604b043d914a9 WatchSource:0}: Error finding container 324f9bc3768c1b338198e7696d957962b9b167262ca4ece7618604b043d914a9: Status 404 returned error can't find the container with id 324f9bc3768c1b338198e7696d957962b9b167262ca4ece7618604b043d914a9 Oct 31 00:34:47.622471 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:47.622411 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp"] Oct 31 00:34:47.625117 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:34:47.625092 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf934119_8202_4623_8bc9_918f5aff3bc5.slice/crio-5a4f1fd3d572679bb8a39f945e87520e0fe0d48a4b0adda50da103f7151ed7e5 WatchSource:0}: Error finding container 5a4f1fd3d572679bb8a39f945e87520e0fe0d48a4b0adda50da103f7151ed7e5: Status 404 returned error can't find the container with id 5a4f1fd3d572679bb8a39f945e87520e0fe0d48a4b0adda50da103f7151ed7e5 Oct 31 00:34:47.910642 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:47.910590 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-7dc85965f-wqfkp" event={"ID":"87e78a10-5e45-4af0-8a2e-c4d840c716f0","Type":"ContainerStarted","Data":"324f9bc3768c1b338198e7696d957962b9b167262ca4ece7618604b043d914a9"} Oct 31 00:34:47.911708 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:47.911681 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-7b7c985c58-c9sw8" event={"ID":"5d264ded-c0ef-4986-9816-436284534e3a","Type":"ContainerStarted","Data":"069273111e678068c7aad12755446f36808bc7e39d3d76784307bc992fff99b0"} Oct 31 00:34:47.912768 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:47.912748 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp" event={"ID":"df934119-8202-4623-8bc9-918f5aff3bc5","Type":"ContainerStarted","Data":"5a4f1fd3d572679bb8a39f945e87520e0fe0d48a4b0adda50da103f7151ed7e5"} Oct 31 00:34:48.865267 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:34:48.865230 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:34:49.922830 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:49.922743 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-7b7c985c58-c9sw8" event={"ID":"5d264ded-c0ef-4986-9816-436284534e3a","Type":"ContainerStarted","Data":"92e8a0bffd3fcee88fe68d01f05d5da649cc6119e9e0abcc9742874a32624556"} Oct 31 00:34:49.923381 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:49.922877 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-7b7c985c58-c9sw8" Oct 31 00:34:49.939306 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:49.939249 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/keda-admission-7b7c985c58-c9sw8" podStartSLOduration=1.42594969 podStartE2EDuration="3.939233083s" totalImagesPullingTime="2.513283393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:34:49.938578414 +0000 UTC m=+279.199852291" watchObservedRunningTime="2026-10-31 00:34:49.939233083 +0000 UTC m=+279.200506960" Oct 31 00:34:51.934390 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:51.934305 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp" event={"ID":"df934119-8202-4623-8bc9-918f5aff3bc5","Type":"ContainerStarted","Data":"aeca8461c01f5a2c9c3dad1b5004fbc005efe457f5d5015b567f7c560d64477d"} Oct 31 00:34:51.934861 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:51.934462 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp" Oct 31 00:34:51.953918 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:51.953871 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp" podStartSLOduration=2.988272441 podStartE2EDuration="6.953858413s" totalImagesPullingTime="3.965585972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:34:51.952124067 +0000 UTC m=+281.213397943" watchObservedRunningTime="2026-10-31 00:34:51.953858413 +0000 UTC m=+281.215132266" Oct 31 00:34:54.950542 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:54.950509 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-7dc85965f-wqfkp" event={"ID":"87e78a10-5e45-4af0-8a2e-c4d840c716f0","Type":"ContainerStarted","Data":"41fb017ed6147af614ed46c30f5bb12166d947f71fb73f0d720223ca0d545d69"} Oct 31 00:34:54.950954 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:54.950662 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-7dc85965f-wqfkp" Oct 31 00:34:54.968059 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:34:54.968006 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/keda-operator-7dc85965f-wqfkp" podStartSLOduration=3.174072883 podStartE2EDuration="9.967994065s" totalImagesPullingTime="6.793921182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:34:54.96674731 +0000 UTC m=+284.228021184" watchObservedRunningTime="2026-10-31 00:34:54.967994065 +0000 UTC m=+284.229267953" Oct 31 00:35:02.943589 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:35:02.943556 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rtpbp" Oct 31 00:35:05.902908 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:35:05.902874 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-pqqjg" Oct 31 00:35:10.876847 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:35:10.876818 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9vvz_c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/ovn-acl-logging/0.log" Oct 31 00:35:10.879911 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:35:10.879888 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9vvz_c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/ovn-acl-logging/0.log" Oct 31 00:35:10.930146 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:35:10.930125 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-7b7c985c58-c9sw8" Oct 31 00:35:15.957701 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:35:15.957671 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-7dc85965f-wqfkp" Oct 31 00:35:16.278469 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:35:16.278442 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:35:18.863762 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:35:18.863729 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:35:40.095497 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:35:40.095466 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:35:40.291570 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:35:40.291531 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:35:48.863480 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:35:48.863444 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:36:10.297684 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.297643 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:36:10.340914 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.340887 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-5bbfdbf8df-tfp8l"] Oct 31 00:36:10.344018 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.344002 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5bbfdbf8df-tfp8l" Oct 31 00:36:10.351671 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.351652 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Oct 31 00:36:10.351801 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.351738 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Oct 31 00:36:10.351868 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.351834 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Oct 31 00:36:10.351914 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.351890 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-rknhb\"" Oct 31 00:36:10.352182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.352163 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5bbfdbf8df-tfp8l"] Oct 31 00:36:10.369542 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.369520 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-7696d678f8-49q2t"] Oct 31 00:36:10.372488 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.372474 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-7696d678f8-49q2t" Oct 31 00:36:10.381047 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.381024 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-7696d678f8-49q2t"] Oct 31 00:36:10.425495 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.425474 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-696n4\"" Oct 31 00:36:10.425680 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.425667 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Oct 31 00:36:10.462400 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.462358 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:36:10.504546 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.504524 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6913e393-6953-4087-af4d-308f14be5311-cert\") pod \"llmisvc-controller-manager-7696d678f8-49q2t\" (UID: \"6913e393-6953-4087-af4d-308f14be5311\") " pod="kserve/llmisvc-controller-manager-7696d678f8-49q2t" Oct 31 00:36:10.504654 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.504563 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11e4a935-2b2b-459f-bb8f-a5c749aa3d84-cert\") pod \"kserve-controller-manager-5bbfdbf8df-tfp8l\" (UID: \"11e4a935-2b2b-459f-bb8f-a5c749aa3d84\") " pod="kserve/kserve-controller-manager-5bbfdbf8df-tfp8l" Oct 31 00:36:10.504654 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.504603 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcdd4\" (UniqueName: \"kubernetes.io/projected/11e4a935-2b2b-459f-bb8f-a5c749aa3d84-kube-api-access-zcdd4\") pod \"kserve-controller-manager-5bbfdbf8df-tfp8l\" (UID: \"11e4a935-2b2b-459f-bb8f-a5c749aa3d84\") " pod="kserve/kserve-controller-manager-5bbfdbf8df-tfp8l" Oct 31 00:36:10.504728 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.504694 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg222\" (UniqueName: \"kubernetes.io/projected/6913e393-6953-4087-af4d-308f14be5311-kube-api-access-mg222\") pod \"llmisvc-controller-manager-7696d678f8-49q2t\" (UID: \"6913e393-6953-4087-af4d-308f14be5311\") " pod="kserve/llmisvc-controller-manager-7696d678f8-49q2t" Oct 31 00:36:10.605948 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.605893 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6913e393-6953-4087-af4d-308f14be5311-cert\") pod \"llmisvc-controller-manager-7696d678f8-49q2t\" (UID: \"6913e393-6953-4087-af4d-308f14be5311\") " pod="kserve/llmisvc-controller-manager-7696d678f8-49q2t" Oct 31 00:36:10.605948 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.605933 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11e4a935-2b2b-459f-bb8f-a5c749aa3d84-cert\") pod \"kserve-controller-manager-5bbfdbf8df-tfp8l\" (UID: \"11e4a935-2b2b-459f-bb8f-a5c749aa3d84\") " pod="kserve/kserve-controller-manager-5bbfdbf8df-tfp8l" Oct 31 00:36:10.606077 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.605970 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcdd4\" (UniqueName: \"kubernetes.io/projected/11e4a935-2b2b-459f-bb8f-a5c749aa3d84-kube-api-access-zcdd4\") pod \"kserve-controller-manager-5bbfdbf8df-tfp8l\" (UID: \"11e4a935-2b2b-459f-bb8f-a5c749aa3d84\") " pod="kserve/kserve-controller-manager-5bbfdbf8df-tfp8l" Oct 31 00:36:10.606077 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.605996 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg222\" (UniqueName: \"kubernetes.io/projected/6913e393-6953-4087-af4d-308f14be5311-kube-api-access-mg222\") pod \"llmisvc-controller-manager-7696d678f8-49q2t\" (UID: \"6913e393-6953-4087-af4d-308f14be5311\") " pod="kserve/llmisvc-controller-manager-7696d678f8-49q2t" Oct 31 00:36:10.608462 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.608434 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6913e393-6953-4087-af4d-308f14be5311-cert\") pod \"llmisvc-controller-manager-7696d678f8-49q2t\" (UID: \"6913e393-6953-4087-af4d-308f14be5311\") " pod="kserve/llmisvc-controller-manager-7696d678f8-49q2t" Oct 31 00:36:10.608560 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.608490 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11e4a935-2b2b-459f-bb8f-a5c749aa3d84-cert\") pod \"kserve-controller-manager-5bbfdbf8df-tfp8l\" (UID: \"11e4a935-2b2b-459f-bb8f-a5c749aa3d84\") " pod="kserve/kserve-controller-manager-5bbfdbf8df-tfp8l" Oct 31 00:36:10.614644 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.614625 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg222\" (UniqueName: \"kubernetes.io/projected/6913e393-6953-4087-af4d-308f14be5311-kube-api-access-mg222\") pod \"llmisvc-controller-manager-7696d678f8-49q2t\" (UID: \"6913e393-6953-4087-af4d-308f14be5311\") " pod="kserve/llmisvc-controller-manager-7696d678f8-49q2t" Oct 31 00:36:10.614882 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.614864 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcdd4\" (UniqueName: \"kubernetes.io/projected/11e4a935-2b2b-459f-bb8f-a5c749aa3d84-kube-api-access-zcdd4\") pod \"kserve-controller-manager-5bbfdbf8df-tfp8l\" (UID: \"11e4a935-2b2b-459f-bb8f-a5c749aa3d84\") " pod="kserve/kserve-controller-manager-5bbfdbf8df-tfp8l" Oct 31 00:36:10.636072 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.636050 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:36:10.657600 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.657578 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5bbfdbf8df-tfp8l" Oct 31 00:36:10.684499 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.684475 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-7696d678f8-49q2t" Oct 31 00:36:10.931364 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.931301 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5bbfdbf8df-tfp8l"] Oct 31 00:36:10.933817 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:36:10.933791 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11e4a935_2b2b_459f_bb8f_a5c749aa3d84.slice/crio-00caaa52dce7ba4c0d8ceba73d6b911de2fe1209dd73ae36d005082682682827 WatchSource:0}: Error finding container 00caaa52dce7ba4c0d8ceba73d6b911de2fe1209dd73ae36d005082682682827: Status 404 returned error can't find the container with id 00caaa52dce7ba4c0d8ceba73d6b911de2fe1209dd73ae36d005082682682827 Oct 31 00:36:10.935093 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.935076 6591 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 31 00:36:10.958375 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:10.958352 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-7696d678f8-49q2t"] Oct 31 00:36:10.960751 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:36:10.960729 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6913e393_6953_4087_af4d_308f14be5311.slice/crio-ced34b1cb089e98830d5685cd69adb778bf40c2be422ff8411f52334aac55dc1 WatchSource:0}: Error finding container ced34b1cb089e98830d5685cd69adb778bf40c2be422ff8411f52334aac55dc1: Status 404 returned error can't find the container with id ced34b1cb089e98830d5685cd69adb778bf40c2be422ff8411f52334aac55dc1 Oct 31 00:36:11.249956 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:11.249870 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5bbfdbf8df-tfp8l" event={"ID":"11e4a935-2b2b-459f-bb8f-a5c749aa3d84","Type":"ContainerStarted","Data":"00caaa52dce7ba4c0d8ceba73d6b911de2fe1209dd73ae36d005082682682827"} Oct 31 00:36:11.250981 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:11.250957 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7696d678f8-49q2t" event={"ID":"6913e393-6953-4087-af4d-308f14be5311","Type":"ContainerStarted","Data":"ced34b1cb089e98830d5685cd69adb778bf40c2be422ff8411f52334aac55dc1"} Oct 31 00:36:12.086719 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:12.086689 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:36:12.247329 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:12.247291 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:36:16.316171 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:16.316144 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:36:18.282072 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:18.282037 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7696d678f8-49q2t" event={"ID":"6913e393-6953-4087-af4d-308f14be5311","Type":"ContainerStarted","Data":"1963dac1a989fc5df99be48282d4e26553251eaf4d332862922e8411b161bd53"} Oct 31 00:36:18.282449 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:18.282161 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-7696d678f8-49q2t" Oct 31 00:36:18.299692 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:18.299644 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-7696d678f8-49q2t" podStartSLOduration=1.097239143 podStartE2EDuration="8.299631488s" totalImagesPullingTime="7.202392345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:36:18.298251479 +0000 UTC m=+367.559525350" watchObservedRunningTime="2026-10-31 00:36:18.299631488 +0000 UTC m=+367.560905362" Oct 31 00:36:18.868998 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:36:18.868948 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:36:21.296604 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:21.296566 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5bbfdbf8df-tfp8l" event={"ID":"11e4a935-2b2b-459f-bb8f-a5c749aa3d84","Type":"ContainerStarted","Data":"3f05c50471ed1091ccfae04d9c735a5272ad0a4cc82af68d79e1467624edfb6a"} Oct 31 00:36:21.296972 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:21.296672 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-5bbfdbf8df-tfp8l" Oct 31 00:36:21.313330 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:21.313277 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/kserve-controller-manager-5bbfdbf8df-tfp8l" podStartSLOduration=1.8558755420000002 podStartE2EDuration="11.313264328s" totalImagesPullingTime="9.457388786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:36:21.312105142 +0000 UTC m=+370.573379016" watchObservedRunningTime="2026-10-31 00:36:21.313264328 +0000 UTC m=+370.574538219" Oct 31 00:36:25.823439 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:25.823393 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:36:48.864069 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:36:48.864029 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:36:49.289151 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:49.289124 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-7696d678f8-49q2t" Oct 31 00:36:52.304811 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:52.304783 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-5bbfdbf8df-tfp8l" Oct 31 00:36:58.930872 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:58.930839 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-5bbfdbf8df-tfp8l"] Oct 31 00:36:58.931394 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:58.931035 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="kserve/kserve-controller-manager-5bbfdbf8df-tfp8l" podUID="11e4a935-2b2b-459f-bb8f-a5c749aa3d84" containerName="manager" containerID="cri-o://3f05c50471ed1091ccfae04d9c735a5272ad0a4cc82af68d79e1467624edfb6a" gracePeriod=10 Oct 31 00:36:58.956093 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:58.956070 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-5bbfdbf8df-2wslt"] Oct 31 00:36:58.958595 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:58.958580 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5bbfdbf8df-2wslt" Oct 31 00:36:58.967300 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:58.967277 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5bbfdbf8df-2wslt"] Oct 31 00:36:59.093791 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.093754 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9ltb\" (UniqueName: \"kubernetes.io/projected/93804cde-52fd-4c5d-ad92-b56500ae32a1-kube-api-access-r9ltb\") pod \"kserve-controller-manager-5bbfdbf8df-2wslt\" (UID: \"93804cde-52fd-4c5d-ad92-b56500ae32a1\") " pod="kserve/kserve-controller-manager-5bbfdbf8df-2wslt" Oct 31 00:36:59.093953 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.093842 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93804cde-52fd-4c5d-ad92-b56500ae32a1-cert\") pod \"kserve-controller-manager-5bbfdbf8df-2wslt\" (UID: \"93804cde-52fd-4c5d-ad92-b56500ae32a1\") " pod="kserve/kserve-controller-manager-5bbfdbf8df-2wslt" Oct 31 00:36:59.172365 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.172343 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5bbfdbf8df-tfp8l" Oct 31 00:36:59.195147 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.195087 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9ltb\" (UniqueName: \"kubernetes.io/projected/93804cde-52fd-4c5d-ad92-b56500ae32a1-kube-api-access-r9ltb\") pod \"kserve-controller-manager-5bbfdbf8df-2wslt\" (UID: \"93804cde-52fd-4c5d-ad92-b56500ae32a1\") " pod="kserve/kserve-controller-manager-5bbfdbf8df-2wslt" Oct 31 00:36:59.195147 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.195137 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93804cde-52fd-4c5d-ad92-b56500ae32a1-cert\") pod \"kserve-controller-manager-5bbfdbf8df-2wslt\" (UID: \"93804cde-52fd-4c5d-ad92-b56500ae32a1\") " pod="kserve/kserve-controller-manager-5bbfdbf8df-2wslt" Oct 31 00:36:59.197824 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.197797 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93804cde-52fd-4c5d-ad92-b56500ae32a1-cert\") pod \"kserve-controller-manager-5bbfdbf8df-2wslt\" (UID: \"93804cde-52fd-4c5d-ad92-b56500ae32a1\") " pod="kserve/kserve-controller-manager-5bbfdbf8df-2wslt" Oct 31 00:36:59.205374 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.205348 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9ltb\" (UniqueName: \"kubernetes.io/projected/93804cde-52fd-4c5d-ad92-b56500ae32a1-kube-api-access-r9ltb\") pod \"kserve-controller-manager-5bbfdbf8df-2wslt\" (UID: \"93804cde-52fd-4c5d-ad92-b56500ae32a1\") " pod="kserve/kserve-controller-manager-5bbfdbf8df-2wslt" Oct 31 00:36:59.296117 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.296080 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/11e4a935-2b2b-459f-bb8f-a5c749aa3d84-cert\" (UniqueName: \"kubernetes.io/secret/11e4a935-2b2b-459f-bb8f-a5c749aa3d84-cert\") pod \"11e4a935-2b2b-459f-bb8f-a5c749aa3d84\" (UID: \"11e4a935-2b2b-459f-bb8f-a5c749aa3d84\") " Oct 31 00:36:59.296278 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.296162 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11e4a935-2b2b-459f-bb8f-a5c749aa3d84-kube-api-access-zcdd4\" (UniqueName: \"kubernetes.io/projected/11e4a935-2b2b-459f-bb8f-a5c749aa3d84-kube-api-access-zcdd4\") pod \"11e4a935-2b2b-459f-bb8f-a5c749aa3d84\" (UID: \"11e4a935-2b2b-459f-bb8f-a5c749aa3d84\") " Oct 31 00:36:59.298266 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.298242 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11e4a935-2b2b-459f-bb8f-a5c749aa3d84-cert" pod "11e4a935-2b2b-459f-bb8f-a5c749aa3d84" (UID: "11e4a935-2b2b-459f-bb8f-a5c749aa3d84"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:36:59.298344 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.298302 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11e4a935-2b2b-459f-bb8f-a5c749aa3d84-kube-api-access-zcdd4" pod "11e4a935-2b2b-459f-bb8f-a5c749aa3d84" (UID: "11e4a935-2b2b-459f-bb8f-a5c749aa3d84"). InnerVolumeSpecName "kube-api-access-zcdd4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:36:59.316495 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.316474 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5bbfdbf8df-2wslt" Oct 31 00:36:59.397671 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.397644 6591 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcdd4\" (UniqueName: \"kubernetes.io/projected/11e4a935-2b2b-459f-bb8f-a5c749aa3d84-kube-api-access-zcdd4\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:36:59.397671 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.397672 6591 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11e4a935-2b2b-459f-bb8f-a5c749aa3d84-cert\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:36:59.444073 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.444048 6591 generic.go:356] "Generic (PLEG): container finished" podID="11e4a935-2b2b-459f-bb8f-a5c749aa3d84" containerID="3f05c50471ed1091ccfae04d9c735a5272ad0a4cc82af68d79e1467624edfb6a" exitCode=0 Oct 31 00:36:59.444184 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.444104 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5bbfdbf8df-tfp8l" Oct 31 00:36:59.444184 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.444114 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5bbfdbf8df-tfp8l" event={"ID":"11e4a935-2b2b-459f-bb8f-a5c749aa3d84","Type":"ContainerDied","Data":"3f05c50471ed1091ccfae04d9c735a5272ad0a4cc82af68d79e1467624edfb6a"} Oct 31 00:36:59.444184 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.444166 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5bbfdbf8df-tfp8l" event={"ID":"11e4a935-2b2b-459f-bb8f-a5c749aa3d84","Type":"ContainerDied","Data":"00caaa52dce7ba4c0d8ceba73d6b911de2fe1209dd73ae36d005082682682827"} Oct 31 00:36:59.444290 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.444189 6591 scope.go:122] "RemoveContainer" containerID="3f05c50471ed1091ccfae04d9c735a5272ad0a4cc82af68d79e1467624edfb6a" Oct 31 00:36:59.452605 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.452583 6591 scope.go:122] "RemoveContainer" containerID="3f05c50471ed1091ccfae04d9c735a5272ad0a4cc82af68d79e1467624edfb6a" Oct 31 00:36:59.452863 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:36:59.452844 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f05c50471ed1091ccfae04d9c735a5272ad0a4cc82af68d79e1467624edfb6a\": container with ID starting with 3f05c50471ed1091ccfae04d9c735a5272ad0a4cc82af68d79e1467624edfb6a not found: ID does not exist" containerID="3f05c50471ed1091ccfae04d9c735a5272ad0a4cc82af68d79e1467624edfb6a" Oct 31 00:36:59.452929 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.452872 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f05c50471ed1091ccfae04d9c735a5272ad0a4cc82af68d79e1467624edfb6a"} err="failed to get container status \"3f05c50471ed1091ccfae04d9c735a5272ad0a4cc82af68d79e1467624edfb6a\": rpc error: code = NotFound desc = could not find container \"3f05c50471ed1091ccfae04d9c735a5272ad0a4cc82af68d79e1467624edfb6a\": container with ID starting with 3f05c50471ed1091ccfae04d9c735a5272ad0a4cc82af68d79e1467624edfb6a not found: ID does not exist" Oct 31 00:36:59.465353 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.465333 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-5bbfdbf8df-tfp8l"] Oct 31 00:36:59.470282 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.470265 6591 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-5bbfdbf8df-tfp8l"] Oct 31 00:36:59.582779 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:36:59.582756 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5bbfdbf8df-2wslt"] Oct 31 00:36:59.585629 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:36:59.585607 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93804cde_52fd_4c5d_ad92_b56500ae32a1.slice/crio-e5cffe02295c9a3656b584ab0bdc0e39886e452bbd0b7214fb367386d2f019e6 WatchSource:0}: Error finding container e5cffe02295c9a3656b584ab0bdc0e39886e452bbd0b7214fb367386d2f019e6: Status 404 returned error can't find the container with id e5cffe02295c9a3656b584ab0bdc0e39886e452bbd0b7214fb367386d2f019e6 Oct 31 00:37:00.451094 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:37:00.451058 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5bbfdbf8df-2wslt" event={"ID":"93804cde-52fd-4c5d-ad92-b56500ae32a1","Type":"ContainerStarted","Data":"5545ee74a13706b9f09763e28d7e3e32e5c75a5b9a0340f098ebca7783939ee7"} Oct 31 00:37:00.451516 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:37:00.451115 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5bbfdbf8df-2wslt" event={"ID":"93804cde-52fd-4c5d-ad92-b56500ae32a1","Type":"ContainerStarted","Data":"e5cffe02295c9a3656b584ab0bdc0e39886e452bbd0b7214fb367386d2f019e6"} Oct 31 00:37:00.451516 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:37:00.451187 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-5bbfdbf8df-2wslt" Oct 31 00:37:00.469250 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:37:00.469201 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/kserve-controller-manager-5bbfdbf8df-2wslt" podStartSLOduration=1.927774852 podStartE2EDuration="2.469185521s" totalImagesPullingTime="541.410669ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:36:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:37:00.469150155 +0000 UTC m=+409.730424027" watchObservedRunningTime="2026-10-31 00:37:00.469185521 +0000 UTC m=+409.730459398" Oct 31 00:37:00.849266 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:37:00.849235 6591 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="11e4a935-2b2b-459f-bb8f-a5c749aa3d84" path="/var/lib/kubelet/pods/11e4a935-2b2b-459f-bb8f-a5c749aa3d84/volumes" Oct 31 00:37:16.374357 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:37:16.374324 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:37:18.864502 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:37:18.864466 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:37:24.295739 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:37:24.295702 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:37:31.460580 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:37:31.460550 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-5bbfdbf8df-2wslt" Oct 31 00:37:33.432909 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:37:33.432870 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:37:33.618552 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:37:33.618517 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:37:33.855598 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:37:33.855565 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:37:36.926641 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:37:36.926603 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:37:37.102255 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:37:37.102223 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:37:48.864502 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:37:48.864458 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:38:16.417719 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:38:16.417685 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:38:18.718922 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:38:18.718880 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:38:18.863377 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:38:18.863347 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:38:48.866979 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:38:48.866940 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:39:14.271542 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:14.271515 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:16.119732 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:16.119696 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:16.459649 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:16.459569 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:18.865633 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:39:18.865599 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:39:32.918474 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:32.918385 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:33.095570 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:33.095532 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:33.997574 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:33.997543 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:34.170331 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.170305 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws"] Oct 31 00:39:34.170664 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.170651 6591 cpu_manager.go:414] "containerMap: removing container" podUID="11e4a935-2b2b-459f-bb8f-a5c749aa3d84" containerName="manager" Oct 31 00:39:34.170710 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.170666 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11e4a935-2b2b-459f-bb8f-a5c749aa3d84" containerName="manager" Oct 31 00:39:34.170771 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.170725 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="11e4a935-2b2b-459f-bb8f-a5c749aa3d84" containerName="manager" Oct 31 00:39:34.173917 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.173893 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:39:34.183722 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.183698 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"openshift-service-ca.crt\"" Oct 31 00:39:34.183883 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.183862 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"isvc-canary-rollback-kube-rbac-proxy-sar-config\"" Oct 31 00:39:34.184039 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.183897 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"odh-kserve-custom-ca-bundle\"" Oct 31 00:39:34.184039 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.183912 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"kube-root-ca.crt\"" Oct 31 00:39:34.184231 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.184132 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws"] Oct 31 00:39:34.191682 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.191659 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:34.229896 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.229872 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"seaweedfs-s3-creds\"" Oct 31 00:39:34.230002 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.229918 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"isvc-canary-rollback-predictor-serving-cert\"" Oct 31 00:39:34.230060 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.230025 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"default-dockercfg-84b4v\"" Oct 31 00:39:34.280317 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.280294 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b91d2f69-6e8f-4119-ad36-8e8b662e7498-proxy-tls\") pod \"isvc-canary-rollback-predictor-5bb5f8559f-rblws\" (UID: \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\") " pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:39:34.280493 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.280340 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-5bb5f8559f-rblws\" (UID: \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\") " pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:39:34.280493 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.280370 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-5bb5f8559f-rblws\" (UID: \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\") " pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:39:34.280597 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.280499 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvvr9\" (UniqueName: \"kubernetes.io/projected/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kube-api-access-dvvr9\") pod \"isvc-canary-rollback-predictor-5bb5f8559f-rblws\" (UID: \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\") " pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:39:34.280597 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.280537 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b91d2f69-6e8f-4119-ad36-8e8b662e7498-cabundle-cert\") pod \"isvc-canary-rollback-predictor-5bb5f8559f-rblws\" (UID: \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\") " pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:39:34.370209 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.370169 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:34.381205 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.381184 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-5bb5f8559f-rblws\" (UID: \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\") " pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:39:34.381294 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.381222 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-5bb5f8559f-rblws\" (UID: \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\") " pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:39:34.381294 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.381255 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvvr9\" (UniqueName: \"kubernetes.io/projected/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kube-api-access-dvvr9\") pod \"isvc-canary-rollback-predictor-5bb5f8559f-rblws\" (UID: \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\") " pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:39:34.381294 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.381279 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b91d2f69-6e8f-4119-ad36-8e8b662e7498-cabundle-cert\") pod \"isvc-canary-rollback-predictor-5bb5f8559f-rblws\" (UID: \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\") " pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:39:34.381450 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.381315 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b91d2f69-6e8f-4119-ad36-8e8b662e7498-proxy-tls\") pod \"isvc-canary-rollback-predictor-5bb5f8559f-rblws\" (UID: \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\") " pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:39:34.381648 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.381630 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-5bb5f8559f-rblws\" (UID: \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\") " pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:39:34.381933 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.381914 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-5bb5f8559f-rblws\" (UID: \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\") " pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:39:34.381933 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.381924 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b91d2f69-6e8f-4119-ad36-8e8b662e7498-cabundle-cert\") pod \"isvc-canary-rollback-predictor-5bb5f8559f-rblws\" (UID: \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\") " pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:39:34.383830 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.383813 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b91d2f69-6e8f-4119-ad36-8e8b662e7498-proxy-tls\") pod \"isvc-canary-rollback-predictor-5bb5f8559f-rblws\" (UID: \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\") " pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:39:34.389757 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.389734 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvvr9\" (UniqueName: \"kubernetes.io/projected/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kube-api-access-dvvr9\") pod \"isvc-canary-rollback-predictor-5bb5f8559f-rblws\" (UID: \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\") " pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:39:34.493545 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.493522 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:39:34.549483 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.549456 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:39:34.767714 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:34.767693 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws"] Oct 31 00:39:34.770601 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:39:34.770571 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91d2f69_6e8f_4119_ad36_8e8b662e7498.slice/crio-ff08091224880d72ec3ad57af20a5573b1ee434e1f33e3fafeeb398ab844985b WatchSource:0}: Error finding container ff08091224880d72ec3ad57af20a5573b1ee434e1f33e3fafeeb398ab844985b: Status 404 returned error can't find the container with id ff08091224880d72ec3ad57af20a5573b1ee434e1f33e3fafeeb398ab844985b Oct 31 00:39:35.067002 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:35.066970 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" event={"ID":"b91d2f69-6e8f-4119-ad36-8e8b662e7498","Type":"ContainerStarted","Data":"ff08091224880d72ec3ad57af20a5573b1ee434e1f33e3fafeeb398ab844985b"} Oct 31 00:39:40.090532 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:40.090449 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" event={"ID":"b91d2f69-6e8f-4119-ad36-8e8b662e7498","Type":"ContainerStarted","Data":"003bd0e4b7819169fa86f28cf819afbadb5db4708e9f62bcf8ca48f3e301edf0"} Oct 31 00:39:44.106963 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:44.106928 6591 generic.go:356] "Generic (PLEG): container finished" podID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerID="003bd0e4b7819169fa86f28cf819afbadb5db4708e9f62bcf8ca48f3e301edf0" exitCode=0 Oct 31 00:39:44.107386 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:39:44.106999 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" event={"ID":"b91d2f69-6e8f-4119-ad36-8e8b662e7498","Type":"ContainerDied","Data":"003bd0e4b7819169fa86f28cf819afbadb5db4708e9f62bcf8ca48f3e301edf0"} Oct 31 00:39:48.871829 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:39:48.871793 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:40:01.193330 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:40:01.193295 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" event={"ID":"b91d2f69-6e8f-4119-ad36-8e8b662e7498","Type":"ContainerStarted","Data":"cd0a977e7603e50a5d2af58b78de8cd2af4dbf9626a7e62db83c8ebe733a66f7"} Oct 31 00:40:03.203483 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:40:03.203391 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" event={"ID":"b91d2f69-6e8f-4119-ad36-8e8b662e7498","Type":"ContainerStarted","Data":"c99454cecd27ce7927c9d9b6be18a9ff196b7c071f65bc5bdf28b4624a000ba2"} Oct 31 00:40:03.203878 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:40:03.203570 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:40:03.203878 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:40:03.203612 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:40:03.204890 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:40:03.204856 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 31 00:40:03.223314 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:40:03.223146 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" podStartSLOduration=1.758975969 podStartE2EDuration="29.223133385s" totalImagesPullingTime="23.717521842s" totalInitContainerRuntime="3.746635574s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:39:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:40:03.222328181 +0000 UTC m=+592.483602076" watchObservedRunningTime="2026-10-31 00:40:03.223133385 +0000 UTC m=+592.484407261" Oct 31 00:40:04.207237 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:40:04.207197 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 31 00:40:09.211905 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:40:09.211878 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:40:09.212361 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:40:09.212337 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 31 00:40:10.907154 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:40:10.907126 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9vvz_c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/ovn-acl-logging/0.log" Oct 31 00:40:10.910406 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:40:10.910384 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9vvz_c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/ovn-acl-logging/0.log" Oct 31 00:40:16.517743 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:40:16.517702 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:40:18.863235 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:40:18.863200 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:40:19.212571 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:40:19.212499 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 31 00:40:29.213273 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:40:29.213239 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 31 00:40:39.212392 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:40:39.212354 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 31 00:40:48.863605 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:40:48.863568 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:40:49.212302 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:40:49.212221 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 31 00:40:59.213324 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:40:59.213231 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 31 00:41:09.213026 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:41:09.212982 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 31 00:41:16.570778 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:41:16.570739 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:41:16.849120 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:41:16.849037 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:41:18.865454 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:41:18.865401 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:41:25.357754 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:41:25.357719 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:41:28.849249 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:41:28.849194 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:41:34.162186 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:41:34.162142 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:41:48.863581 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:41:48.863545 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:41:49.857258 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:41:49.857227 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:42:16.615649 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:42:16.615615 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:42:18.863404 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:42:18.863372 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:42:21.666973 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:42:21.666886 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:42:21.843084 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:42:21.843029 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:42:22.015969 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:42:22.015941 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:42:48.864139 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:42:48.864106 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:43:04.316703 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:04.316670 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws"] Oct 31 00:43:04.317218 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:04.317013 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerName="kube-rbac-proxy" containerID="cri-o://c99454cecd27ce7927c9d9b6be18a9ff196b7c071f65bc5bdf28b4624a000ba2" gracePeriod=30 Oct 31 00:43:04.317218 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:04.316994 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerName="kserve-container" containerID="cri-o://cd0a977e7603e50a5d2af58b78de8cd2af4dbf9626a7e62db83c8ebe733a66f7" gracePeriod=30 Oct 31 00:43:04.451880 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:04.451851 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:43:04.932760 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:04.932727 6591 generic.go:356] "Generic (PLEG): container finished" podID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerID="c99454cecd27ce7927c9d9b6be18a9ff196b7c071f65bc5bdf28b4624a000ba2" exitCode=0 Oct 31 00:43:04.932924 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:04.932798 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" event={"ID":"b91d2f69-6e8f-4119-ad36-8e8b662e7498","Type":"ContainerDied","Data":"c99454cecd27ce7927c9d9b6be18a9ff196b7c071f65bc5bdf28b4624a000ba2"} Oct 31 00:43:06.844772 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:06.844725 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 31 00:43:07.897721 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:07.897672 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:43:08.951540 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:08.951506 6591 generic.go:356] "Generic (PLEG): container finished" podID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerID="cd0a977e7603e50a5d2af58b78de8cd2af4dbf9626a7e62db83c8ebe733a66f7" exitCode=0 Oct 31 00:43:08.951855 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:08.951563 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" event={"ID":"b91d2f69-6e8f-4119-ad36-8e8b662e7498","Type":"ContainerDied","Data":"cd0a977e7603e50a5d2af58b78de8cd2af4dbf9626a7e62db83c8ebe733a66f7"} Oct 31 00:43:08.968380 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:08.968359 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:43:09.030576 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.030541 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b91d2f69-6e8f-4119-ad36-8e8b662e7498-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b91d2f69-6e8f-4119-ad36-8e8b662e7498-cabundle-cert\") pod \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\" (UID: \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\") " Oct 31 00:43:09.030748 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.030623 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kube-rbac-proxy-sar-config\") pod \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\" (UID: \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\") " Oct 31 00:43:09.030748 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.030649 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kserve-provision-location\") pod \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\" (UID: \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\") " Oct 31 00:43:09.030864 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.030838 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kube-api-access-dvvr9\" (UniqueName: \"kubernetes.io/projected/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kube-api-access-dvvr9\") pod \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\" (UID: \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\") " Oct 31 00:43:09.030918 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.030899 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b91d2f69-6e8f-4119-ad36-8e8b662e7498-proxy-tls\" (UniqueName: \"kubernetes.io/secret/b91d2f69-6e8f-4119-ad36-8e8b662e7498-proxy-tls\") pod \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\" (UID: \"b91d2f69-6e8f-4119-ad36-8e8b662e7498\") " Oct 31 00:43:09.030971 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.030933 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kserve-provision-location" pod "b91d2f69-6e8f-4119-ad36-8e8b662e7498" (UID: "b91d2f69-6e8f-4119-ad36-8e8b662e7498"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:43:09.030971 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.030936 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b91d2f69-6e8f-4119-ad36-8e8b662e7498-cabundle-cert" pod "b91d2f69-6e8f-4119-ad36-8e8b662e7498" (UID: "b91d2f69-6e8f-4119-ad36-8e8b662e7498"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:43:09.031077 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.030978 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kube-rbac-proxy-sar-config" pod "b91d2f69-6e8f-4119-ad36-8e8b662e7498" (UID: "b91d2f69-6e8f-4119-ad36-8e8b662e7498"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:43:09.031135 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.031118 6591 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b91d2f69-6e8f-4119-ad36-8e8b662e7498-cabundle-cert\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:43:09.031135 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.031131 6591 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:43:09.031236 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.031140 6591 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kserve-provision-location\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:43:09.033181 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.033150 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kube-api-access-dvvr9" pod "b91d2f69-6e8f-4119-ad36-8e8b662e7498" (UID: "b91d2f69-6e8f-4119-ad36-8e8b662e7498"). InnerVolumeSpecName "kube-api-access-dvvr9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:43:09.033181 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.033160 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b91d2f69-6e8f-4119-ad36-8e8b662e7498-proxy-tls" pod "b91d2f69-6e8f-4119-ad36-8e8b662e7498" (UID: "b91d2f69-6e8f-4119-ad36-8e8b662e7498"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:43:09.131651 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.131619 6591 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvvr9\" (UniqueName: \"kubernetes.io/projected/b91d2f69-6e8f-4119-ad36-8e8b662e7498-kube-api-access-dvvr9\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:43:09.131651 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.131645 6591 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b91d2f69-6e8f-4119-ad36-8e8b662e7498-proxy-tls\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:43:09.958017 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.957981 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" Oct 31 00:43:09.958017 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.957992 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws" event={"ID":"b91d2f69-6e8f-4119-ad36-8e8b662e7498","Type":"ContainerDied","Data":"ff08091224880d72ec3ad57af20a5573b1ee434e1f33e3fafeeb398ab844985b"} Oct 31 00:43:09.958559 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.958075 6591 scope.go:122] "RemoveContainer" containerID="c99454cecd27ce7927c9d9b6be18a9ff196b7c071f65bc5bdf28b4624a000ba2" Oct 31 00:43:09.966864 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.966844 6591 scope.go:122] "RemoveContainer" containerID="cd0a977e7603e50a5d2af58b78de8cd2af4dbf9626a7e62db83c8ebe733a66f7" Oct 31 00:43:09.973988 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.973974 6591 scope.go:122] "RemoveContainer" containerID="003bd0e4b7819169fa86f28cf819afbadb5db4708e9f62bcf8ca48f3e301edf0" Oct 31 00:43:09.979805 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.979785 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws"] Oct 31 00:43:09.984175 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:09.984157 6591 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-rollback-predictor-5bb5f8559f-rblws"] Oct 31 00:43:10.849529 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:10.849485 6591 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" path="/var/lib/kubelet/pods/b91d2f69-6e8f-4119-ad36-8e8b662e7498/volumes" Oct 31 00:43:10.912926 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:10.912895 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx"] Oct 31 00:43:10.913219 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:10.913206 6591 cpu_manager.go:414] "containerMap: removing container" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerName="storage-initializer" Oct 31 00:43:10.913292 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:10.913221 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerName="storage-initializer" Oct 31 00:43:10.913292 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:10.913245 6591 cpu_manager.go:414] "containerMap: removing container" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerName="kserve-container" Oct 31 00:43:10.913292 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:10.913251 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerName="kserve-container" Oct 31 00:43:10.913292 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:10.913269 6591 cpu_manager.go:414] "containerMap: removing container" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerName="kube-rbac-proxy" Oct 31 00:43:10.913292 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:10.913274 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerName="kube-rbac-proxy" Oct 31 00:43:10.913563 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:10.913326 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerName="kube-rbac-proxy" Oct 31 00:43:10.913563 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:10.913337 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="b91d2f69-6e8f-4119-ad36-8e8b662e7498" containerName="kserve-container" Oct 31 00:43:10.921221 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:10.921195 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:43:10.926781 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:10.926758 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"odh-kserve-custom-ca-bundle\"" Oct 31 00:43:10.931613 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:10.926963 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"seaweedfs-s3-creds\"" Oct 31 00:43:10.931697 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:10.927011 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"isvc-canary-stop-kube-rbac-proxy-sar-config\"" Oct 31 00:43:10.931779 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:10.927170 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"isvc-canary-stop-v2-predictor-serving-cert\"" Oct 31 00:43:10.931863 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:10.927245 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"kube-root-ca.crt\"" Oct 31 00:43:10.931939 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:10.927524 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"default-dockercfg-84b4v\"" Oct 31 00:43:10.931939 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:10.927574 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"openshift-service-ca.crt\"" Oct 31 00:43:10.932113 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:10.929487 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx"] Oct 31 00:43:10.990297 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:10.990266 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:43:11.038345 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.038316 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd"] Oct 31 00:43:11.042172 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.042152 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:43:11.047368 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.047346 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bd847580-0191-4f21-8c03-c1d4c27830f7-kserve-provision-location\") pod \"isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx\" (UID: \"bd847580-0191-4f21-8c03-c1d4c27830f7\") " pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:43:11.047504 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.047440 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bd847580-0191-4f21-8c03-c1d4c27830f7-cabundle-cert\") pod \"isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx\" (UID: \"bd847580-0191-4f21-8c03-c1d4c27830f7\") " pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:43:11.047571 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.047528 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bd847580-0191-4f21-8c03-c1d4c27830f7-proxy-tls\") pod \"isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx\" (UID: \"bd847580-0191-4f21-8c03-c1d4c27830f7\") " pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:43:11.047571 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.047565 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ndlx\" (UniqueName: \"kubernetes.io/projected/bd847580-0191-4f21-8c03-c1d4c27830f7-kube-api-access-6ndlx\") pod \"isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx\" (UID: \"bd847580-0191-4f21-8c03-c1d4c27830f7\") " pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:43:11.047682 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.047585 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bd847580-0191-4f21-8c03-c1d4c27830f7-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx\" (UID: \"bd847580-0191-4f21-8c03-c1d4c27830f7\") " pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:43:11.054764 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.054741 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd"] Oct 31 00:43:11.091474 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.091450 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"isvc-canary-stop-predictor-serving-cert\"" Oct 31 00:43:11.148654 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.148578 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bd847580-0191-4f21-8c03-c1d4c27830f7-kserve-provision-location\") pod \"isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx\" (UID: \"bd847580-0191-4f21-8c03-c1d4c27830f7\") " pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:43:11.148654 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.148620 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1a8f2e85-0399-47a0-86ba-44a5e78562a6-proxy-tls\") pod \"isvc-canary-stop-predictor-65dd46dbb7-7qvcd\" (UID: \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\") " pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:43:11.148835 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.148660 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-65dd46dbb7-7qvcd\" (UID: \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\") " pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:43:11.148835 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.148697 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kserve-provision-location\") pod \"isvc-canary-stop-predictor-65dd46dbb7-7qvcd\" (UID: \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\") " pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:43:11.148835 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.148723 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1a8f2e85-0399-47a0-86ba-44a5e78562a6-cabundle-cert\") pod \"isvc-canary-stop-predictor-65dd46dbb7-7qvcd\" (UID: \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\") " pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:43:11.148952 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.148850 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bd847580-0191-4f21-8c03-c1d4c27830f7-cabundle-cert\") pod \"isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx\" (UID: \"bd847580-0191-4f21-8c03-c1d4c27830f7\") " pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:43:11.148952 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.148897 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bd847580-0191-4f21-8c03-c1d4c27830f7-proxy-tls\") pod \"isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx\" (UID: \"bd847580-0191-4f21-8c03-c1d4c27830f7\") " pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:43:11.148952 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.148925 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqbm2\" (UniqueName: \"kubernetes.io/projected/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kube-api-access-qqbm2\") pod \"isvc-canary-stop-predictor-65dd46dbb7-7qvcd\" (UID: \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\") " pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:43:11.149071 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.148955 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ndlx\" (UniqueName: \"kubernetes.io/projected/bd847580-0191-4f21-8c03-c1d4c27830f7-kube-api-access-6ndlx\") pod \"isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx\" (UID: \"bd847580-0191-4f21-8c03-c1d4c27830f7\") " pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:43:11.149071 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.148961 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bd847580-0191-4f21-8c03-c1d4c27830f7-kserve-provision-location\") pod \"isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx\" (UID: \"bd847580-0191-4f21-8c03-c1d4c27830f7\") " pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:43:11.149071 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.148976 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bd847580-0191-4f21-8c03-c1d4c27830f7-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx\" (UID: \"bd847580-0191-4f21-8c03-c1d4c27830f7\") " pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:43:11.149474 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.149456 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bd847580-0191-4f21-8c03-c1d4c27830f7-cabundle-cert\") pod \"isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx\" (UID: \"bd847580-0191-4f21-8c03-c1d4c27830f7\") " pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:43:11.149595 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.149575 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bd847580-0191-4f21-8c03-c1d4c27830f7-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx\" (UID: \"bd847580-0191-4f21-8c03-c1d4c27830f7\") " pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:43:11.151659 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.151630 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bd847580-0191-4f21-8c03-c1d4c27830f7-proxy-tls\") pod \"isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx\" (UID: \"bd847580-0191-4f21-8c03-c1d4c27830f7\") " pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:43:11.156834 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.156808 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ndlx\" (UniqueName: \"kubernetes.io/projected/bd847580-0191-4f21-8c03-c1d4c27830f7-kube-api-access-6ndlx\") pod \"isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx\" (UID: \"bd847580-0191-4f21-8c03-c1d4c27830f7\") " pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:43:11.164529 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.164504 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:43:11.244765 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.244728 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:43:11.250343 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.250315 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kserve-provision-location\") pod \"isvc-canary-stop-predictor-65dd46dbb7-7qvcd\" (UID: \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\") " pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:43:11.250484 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.250350 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1a8f2e85-0399-47a0-86ba-44a5e78562a6-cabundle-cert\") pod \"isvc-canary-stop-predictor-65dd46dbb7-7qvcd\" (UID: \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\") " pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:43:11.250726 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.250707 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kserve-provision-location\") pod \"isvc-canary-stop-predictor-65dd46dbb7-7qvcd\" (UID: \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\") " pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:43:11.250788 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.250715 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqbm2\" (UniqueName: \"kubernetes.io/projected/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kube-api-access-qqbm2\") pod \"isvc-canary-stop-predictor-65dd46dbb7-7qvcd\" (UID: \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\") " pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:43:11.250837 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.250821 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1a8f2e85-0399-47a0-86ba-44a5e78562a6-proxy-tls\") pod \"isvc-canary-stop-predictor-65dd46dbb7-7qvcd\" (UID: \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\") " pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:43:11.250878 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.250855 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-65dd46dbb7-7qvcd\" (UID: \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\") " pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:43:11.251010 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.250994 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1a8f2e85-0399-47a0-86ba-44a5e78562a6-cabundle-cert\") pod \"isvc-canary-stop-predictor-65dd46dbb7-7qvcd\" (UID: \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\") " pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:43:11.251433 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.251395 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-65dd46dbb7-7qvcd\" (UID: \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\") " pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:43:11.253883 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.253860 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1a8f2e85-0399-47a0-86ba-44a5e78562a6-proxy-tls\") pod \"isvc-canary-stop-predictor-65dd46dbb7-7qvcd\" (UID: \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\") " pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:43:11.259483 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.259461 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqbm2\" (UniqueName: \"kubernetes.io/projected/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kube-api-access-qqbm2\") pod \"isvc-canary-stop-predictor-65dd46dbb7-7qvcd\" (UID: \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\") " pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:43:11.335135 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.335091 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:43:11.359737 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.359703 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:43:11.510142 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.510104 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:43:11.519276 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.519256 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx"] Oct 31 00:43:11.520916 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:43:11.520891 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd847580_0191_4f21_8c03_c1d4c27830f7.slice/crio-c1bff621d6ac976fa7f50557cb77a26ba78fecd0843cbfc5ff583841a0d1ebc5 WatchSource:0}: Error finding container c1bff621d6ac976fa7f50557cb77a26ba78fecd0843cbfc5ff583841a0d1ebc5: Status 404 returned error can't find the container with id c1bff621d6ac976fa7f50557cb77a26ba78fecd0843cbfc5ff583841a0d1ebc5 Oct 31 00:43:11.632479 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.632390 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd"] Oct 31 00:43:11.635115 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:43:11.635088 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a8f2e85_0399_47a0_86ba_44a5e78562a6.slice/crio-1af86839dd9001dff7a9d6eeb6ef9753901008f2f2b76ac7910e829e7614e3ee WatchSource:0}: Error finding container 1af86839dd9001dff7a9d6eeb6ef9753901008f2f2b76ac7910e829e7614e3ee: Status 404 returned error can't find the container with id 1af86839dd9001dff7a9d6eeb6ef9753901008f2f2b76ac7910e829e7614e3ee Oct 31 00:43:11.968723 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.968624 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" event={"ID":"bd847580-0191-4f21-8c03-c1d4c27830f7","Type":"ContainerStarted","Data":"a8fabd3d9d62242245dd276c18531a1d431678162f7c7be9450c3999092391a4"} Oct 31 00:43:11.968723 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.968698 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" event={"ID":"bd847580-0191-4f21-8c03-c1d4c27830f7","Type":"ContainerStarted","Data":"c1bff621d6ac976fa7f50557cb77a26ba78fecd0843cbfc5ff583841a0d1ebc5"} Oct 31 00:43:11.970373 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.970348 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" event={"ID":"1a8f2e85-0399-47a0-86ba-44a5e78562a6","Type":"ContainerStarted","Data":"870e619966898d2e7078b09d73fb045177a6d3b0c3380742b43d1b710c3b7f95"} Oct 31 00:43:11.970510 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:11.970396 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" event={"ID":"1a8f2e85-0399-47a0-86ba-44a5e78562a6","Type":"ContainerStarted","Data":"1af86839dd9001dff7a9d6eeb6ef9753901008f2f2b76ac7910e829e7614e3ee"} Oct 31 00:43:15.987959 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:15.987870 6591 generic.go:356] "Generic (PLEG): container finished" podID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerID="a8fabd3d9d62242245dd276c18531a1d431678162f7c7be9450c3999092391a4" exitCode=0 Oct 31 00:43:15.988411 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:15.987949 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" event={"ID":"bd847580-0191-4f21-8c03-c1d4c27830f7","Type":"ContainerDied","Data":"a8fabd3d9d62242245dd276c18531a1d431678162f7c7be9450c3999092391a4"} Oct 31 00:43:15.989549 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:15.989527 6591 generic.go:356] "Generic (PLEG): container finished" podID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerID="870e619966898d2e7078b09d73fb045177a6d3b0c3380742b43d1b710c3b7f95" exitCode=0 Oct 31 00:43:15.989626 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:15.989578 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" event={"ID":"1a8f2e85-0399-47a0-86ba-44a5e78562a6","Type":"ContainerDied","Data":"870e619966898d2e7078b09d73fb045177a6d3b0c3380742b43d1b710c3b7f95"} Oct 31 00:43:16.656130 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:16.656092 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:43:16.996672 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:16.996591 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" event={"ID":"bd847580-0191-4f21-8c03-c1d4c27830f7","Type":"ContainerStarted","Data":"4427dba65cde73cf6b043bf79c5bb34801654be889d44ace848942b1cc6465cd"} Oct 31 00:43:16.996672 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:16.996658 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" event={"ID":"bd847580-0191-4f21-8c03-c1d4c27830f7","Type":"ContainerStarted","Data":"7b5f375733f3c060079f037b68d7911ccf0c4d10a222c7202a14f97bb203be3f"} Oct 31 00:43:16.997154 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:16.996963 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:43:16.997154 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:16.997112 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:43:16.998598 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:16.998572 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 31 00:43:16.998899 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:16.998878 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" event={"ID":"1a8f2e85-0399-47a0-86ba-44a5e78562a6","Type":"ContainerStarted","Data":"2da05e18e74d7544e955d9854ea81367ceabcccbaec5b6c4750e4cbc25abd381"} Oct 31 00:43:16.998955 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:16.998925 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" event={"ID":"1a8f2e85-0399-47a0-86ba-44a5e78562a6","Type":"ContainerStarted","Data":"cef3c22598130cdada22e5947fa805938d2356a986d3d64812ade12eb0474aa4"} Oct 31 00:43:16.999110 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:16.999096 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:43:17.016857 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:17.016819 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" podStartSLOduration=3.040942844 podStartE2EDuration="7.016808133s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.975865289s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:43:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:43:17.015922926 +0000 UTC m=+786.277196799" watchObservedRunningTime="2026-10-31 00:43:17.016808133 +0000 UTC m=+786.278082005" Oct 31 00:43:17.037554 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:17.037516 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" podStartSLOduration=2.224971168 podStartE2EDuration="6.037506691s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.812535523s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:43:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:43:17.036584547 +0000 UTC m=+786.297858425" watchObservedRunningTime="2026-10-31 00:43:17.037506691 +0000 UTC m=+786.298780565" Oct 31 00:43:18.003628 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:18.003585 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 31 00:43:18.003628 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:18.003627 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:43:18.004722 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:18.004700 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 31 00:43:18.867941 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:43:18.867900 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:43:19.009752 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:19.009713 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 31 00:43:23.007860 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:23.007831 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:43:23.008385 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:23.008245 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 31 00:43:24.014150 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:24.014122 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:43:24.014628 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:24.014605 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 31 00:43:33.008945 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:33.008902 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 31 00:43:34.015375 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:34.015338 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 31 00:43:43.008837 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:43.008796 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 31 00:43:44.015308 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:44.015270 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 31 00:43:48.866309 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:43:48.866275 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:43:53.008377 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:53.008276 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 31 00:43:54.014899 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:43:54.014855 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 31 00:44:03.008462 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:03.008397 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 31 00:44:04.015520 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:04.015484 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 31 00:44:11.922039 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:11.922007 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:44:12.098330 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:12.098297 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:44:13.009236 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:13.009196 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 31 00:44:14.015141 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:14.015100 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 31 00:44:16.735256 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:16.735224 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:44:18.865150 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:44:18.865115 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:44:22.200099 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:22.200071 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:44:22.374888 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:22.374853 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:44:23.009018 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:23.008977 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 31 00:44:24.014610 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:24.014570 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 31 00:44:28.844534 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:28.844493 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 31 00:44:29.665680 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:29.665633 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:44:29.867185 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:29.867154 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:44:30.072532 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:30.072504 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:44:34.015569 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:34.015542 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:44:38.849143 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:38.849114 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:44:41.069295 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:41.067668 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx"] Oct 31 00:44:41.069295 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:41.068049 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="kserve-container" containerID="cri-o://7b5f375733f3c060079f037b68d7911ccf0c4d10a222c7202a14f97bb203be3f" gracePeriod=30 Oct 31 00:44:41.069295 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:41.068490 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="kube-rbac-proxy" containerID="cri-o://4427dba65cde73cf6b043bf79c5bb34801654be889d44ace848942b1cc6465cd" gracePeriod=30 Oct 31 00:44:41.113761 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:41.113724 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd"] Oct 31 00:44:41.114010 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:41.113985 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="kserve-container" containerID="cri-o://cef3c22598130cdada22e5947fa805938d2356a986d3d64812ade12eb0474aa4" gracePeriod=30 Oct 31 00:44:41.114108 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:41.114031 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="kube-rbac-proxy" containerID="cri-o://2da05e18e74d7544e955d9854ea81367ceabcccbaec5b6c4750e4cbc25abd381" gracePeriod=30 Oct 31 00:44:41.188449 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:41.188405 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:44:41.358762 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:41.358662 6591 generic.go:356] "Generic (PLEG): container finished" podID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerID="4427dba65cde73cf6b043bf79c5bb34801654be889d44ace848942b1cc6465cd" exitCode=0 Oct 31 00:44:41.358762 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:41.358737 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" event={"ID":"bd847580-0191-4f21-8c03-c1d4c27830f7","Type":"ContainerDied","Data":"4427dba65cde73cf6b043bf79c5bb34801654be889d44ace848942b1cc6465cd"} Oct 31 00:44:41.360999 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:41.360974 6591 generic.go:356] "Generic (PLEG): container finished" podID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerID="2da05e18e74d7544e955d9854ea81367ceabcccbaec5b6c4750e4cbc25abd381" exitCode=0 Oct 31 00:44:41.361143 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:41.361010 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" event={"ID":"1a8f2e85-0399-47a0-86ba-44a5e78562a6","Type":"ContainerDied","Data":"2da05e18e74d7544e955d9854ea81367ceabcccbaec5b6c4750e4cbc25abd381"} Oct 31 00:44:41.680201 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:41.680123 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:44:43.004024 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:43.003985 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.28:8643/healthz\": dial tcp 10.133.0.28:8643: connect: connection refused" Oct 31 00:44:44.010286 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:44.010248 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.29:8643/healthz\": dial tcp 10.133.0.29:8643: connect: connection refused" Oct 31 00:44:44.014547 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:44.014524 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 31 00:44:45.985813 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:45.985787 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:44:45.988666 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:45.988646 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:44:46.053187 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.053131 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1a8f2e85-0399-47a0-86ba-44a5e78562a6-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1a8f2e85-0399-47a0-86ba-44a5e78562a6-cabundle-cert\") pod \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\" (UID: \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\") " Oct 31 00:44:46.053344 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.053275 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1a8f2e85-0399-47a0-86ba-44a5e78562a6-proxy-tls\" (UniqueName: \"kubernetes.io/secret/1a8f2e85-0399-47a0-86ba-44a5e78562a6-proxy-tls\") pod \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\" (UID: \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\") " Oct 31 00:44:46.053344 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.053315 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kube-rbac-proxy-sar-config\") pod \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\" (UID: \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\") " Oct 31 00:44:46.053449 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.053353 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bd847580-0191-4f21-8c03-c1d4c27830f7-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bd847580-0191-4f21-8c03-c1d4c27830f7-kserve-provision-location\") pod \"bd847580-0191-4f21-8c03-c1d4c27830f7\" (UID: \"bd847580-0191-4f21-8c03-c1d4c27830f7\") " Oct 31 00:44:46.053449 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.053382 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kserve-provision-location\") pod \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\" (UID: \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\") " Oct 31 00:44:46.053528 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.053454 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bd847580-0191-4f21-8c03-c1d4c27830f7-proxy-tls\" (UniqueName: \"kubernetes.io/secret/bd847580-0191-4f21-8c03-c1d4c27830f7-proxy-tls\") pod \"bd847580-0191-4f21-8c03-c1d4c27830f7\" (UID: \"bd847580-0191-4f21-8c03-c1d4c27830f7\") " Oct 31 00:44:46.053528 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.053500 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kube-api-access-qqbm2\" (UniqueName: \"kubernetes.io/projected/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kube-api-access-qqbm2\") pod \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\" (UID: \"1a8f2e85-0399-47a0-86ba-44a5e78562a6\") " Oct 31 00:44:46.053629 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.053531 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bd847580-0191-4f21-8c03-c1d4c27830f7-kube-api-access-6ndlx\" (UniqueName: \"kubernetes.io/projected/bd847580-0191-4f21-8c03-c1d4c27830f7-kube-api-access-6ndlx\") pod \"bd847580-0191-4f21-8c03-c1d4c27830f7\" (UID: \"bd847580-0191-4f21-8c03-c1d4c27830f7\") " Oct 31 00:44:46.053629 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.053561 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bd847580-0191-4f21-8c03-c1d4c27830f7-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bd847580-0191-4f21-8c03-c1d4c27830f7-cabundle-cert\") pod \"bd847580-0191-4f21-8c03-c1d4c27830f7\" (UID: \"bd847580-0191-4f21-8c03-c1d4c27830f7\") " Oct 31 00:44:46.053629 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.053560 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a8f2e85-0399-47a0-86ba-44a5e78562a6-cabundle-cert" pod "1a8f2e85-0399-47a0-86ba-44a5e78562a6" (UID: "1a8f2e85-0399-47a0-86ba-44a5e78562a6"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:44:46.053787 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.053723 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bd847580-0191-4f21-8c03-c1d4c27830f7-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bd847580-0191-4f21-8c03-c1d4c27830f7-kube-rbac-proxy-sar-config\") pod \"bd847580-0191-4f21-8c03-c1d4c27830f7\" (UID: \"bd847580-0191-4f21-8c03-c1d4c27830f7\") " Oct 31 00:44:46.053787 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.053725 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd847580-0191-4f21-8c03-c1d4c27830f7-kserve-provision-location" pod "bd847580-0191-4f21-8c03-c1d4c27830f7" (UID: "bd847580-0191-4f21-8c03-c1d4c27830f7"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:44:46.053787 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.053757 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kube-rbac-proxy-sar-config" pod "1a8f2e85-0399-47a0-86ba-44a5e78562a6" (UID: "1a8f2e85-0399-47a0-86ba-44a5e78562a6"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:44:46.053998 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.053977 6591 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1a8f2e85-0399-47a0-86ba-44a5e78562a6-cabundle-cert\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:44:46.054055 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.054005 6591 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:44:46.054055 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.054005 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kserve-provision-location" pod "1a8f2e85-0399-47a0-86ba-44a5e78562a6" (UID: "1a8f2e85-0399-47a0-86ba-44a5e78562a6"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:44:46.054055 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.054020 6591 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bd847580-0191-4f21-8c03-c1d4c27830f7-kserve-provision-location\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:44:46.054375 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.054193 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd847580-0191-4f21-8c03-c1d4c27830f7-kube-rbac-proxy-sar-config" pod "bd847580-0191-4f21-8c03-c1d4c27830f7" (UID: "bd847580-0191-4f21-8c03-c1d4c27830f7"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:44:46.054375 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.054231 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd847580-0191-4f21-8c03-c1d4c27830f7-cabundle-cert" pod "bd847580-0191-4f21-8c03-c1d4c27830f7" (UID: "bd847580-0191-4f21-8c03-c1d4c27830f7"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:44:46.055625 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.055603 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a8f2e85-0399-47a0-86ba-44a5e78562a6-proxy-tls" pod "1a8f2e85-0399-47a0-86ba-44a5e78562a6" (UID: "1a8f2e85-0399-47a0-86ba-44a5e78562a6"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:44:46.055725 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.055699 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd847580-0191-4f21-8c03-c1d4c27830f7-proxy-tls" pod "bd847580-0191-4f21-8c03-c1d4c27830f7" (UID: "bd847580-0191-4f21-8c03-c1d4c27830f7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:44:46.055764 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.055750 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd847580-0191-4f21-8c03-c1d4c27830f7-kube-api-access-6ndlx" pod "bd847580-0191-4f21-8c03-c1d4c27830f7" (UID: "bd847580-0191-4f21-8c03-c1d4c27830f7"). InnerVolumeSpecName "kube-api-access-6ndlx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:44:46.055839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.055823 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kube-api-access-qqbm2" pod "1a8f2e85-0399-47a0-86ba-44a5e78562a6" (UID: "1a8f2e85-0399-47a0-86ba-44a5e78562a6"). InnerVolumeSpecName "kube-api-access-qqbm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:44:46.154579 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.154547 6591 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kserve-provision-location\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:44:46.154579 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.154574 6591 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bd847580-0191-4f21-8c03-c1d4c27830f7-proxy-tls\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:44:46.154579 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.154584 6591 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqbm2\" (UniqueName: \"kubernetes.io/projected/1a8f2e85-0399-47a0-86ba-44a5e78562a6-kube-api-access-qqbm2\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:44:46.154795 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.154594 6591 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ndlx\" (UniqueName: \"kubernetes.io/projected/bd847580-0191-4f21-8c03-c1d4c27830f7-kube-api-access-6ndlx\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:44:46.154795 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.154602 6591 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bd847580-0191-4f21-8c03-c1d4c27830f7-cabundle-cert\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:44:46.154795 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.154611 6591 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bd847580-0191-4f21-8c03-c1d4c27830f7-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:44:46.154795 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.154619 6591 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1a8f2e85-0399-47a0-86ba-44a5e78562a6-proxy-tls\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:44:46.384712 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.384628 6591 generic.go:356] "Generic (PLEG): container finished" podID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerID="7b5f375733f3c060079f037b68d7911ccf0c4d10a222c7202a14f97bb203be3f" exitCode=0 Oct 31 00:44:46.384871 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.384703 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" event={"ID":"bd847580-0191-4f21-8c03-c1d4c27830f7","Type":"ContainerDied","Data":"7b5f375733f3c060079f037b68d7911ccf0c4d10a222c7202a14f97bb203be3f"} Oct 31 00:44:46.384871 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.384715 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" Oct 31 00:44:46.384871 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.384803 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx" event={"ID":"bd847580-0191-4f21-8c03-c1d4c27830f7","Type":"ContainerDied","Data":"c1bff621d6ac976fa7f50557cb77a26ba78fecd0843cbfc5ff583841a0d1ebc5"} Oct 31 00:44:46.384871 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.384833 6591 scope.go:122] "RemoveContainer" containerID="4427dba65cde73cf6b043bf79c5bb34801654be889d44ace848942b1cc6465cd" Oct 31 00:44:46.386675 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.386647 6591 generic.go:356] "Generic (PLEG): container finished" podID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerID="cef3c22598130cdada22e5947fa805938d2356a986d3d64812ade12eb0474aa4" exitCode=0 Oct 31 00:44:46.386804 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.386682 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" event={"ID":"1a8f2e85-0399-47a0-86ba-44a5e78562a6","Type":"ContainerDied","Data":"cef3c22598130cdada22e5947fa805938d2356a986d3d64812ade12eb0474aa4"} Oct 31 00:44:46.386804 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.386716 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" event={"ID":"1a8f2e85-0399-47a0-86ba-44a5e78562a6","Type":"ContainerDied","Data":"1af86839dd9001dff7a9d6eeb6ef9753901008f2f2b76ac7910e829e7614e3ee"} Oct 31 00:44:46.386804 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.386796 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd" Oct 31 00:44:46.394382 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.394304 6591 scope.go:122] "RemoveContainer" containerID="7b5f375733f3c060079f037b68d7911ccf0c4d10a222c7202a14f97bb203be3f" Oct 31 00:44:46.401701 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.401686 6591 scope.go:122] "RemoveContainer" containerID="a8fabd3d9d62242245dd276c18531a1d431678162f7c7be9450c3999092391a4" Oct 31 00:44:46.408789 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.408766 6591 scope.go:122] "RemoveContainer" containerID="4427dba65cde73cf6b043bf79c5bb34801654be889d44ace848942b1cc6465cd" Oct 31 00:44:46.409434 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:44:46.409386 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4427dba65cde73cf6b043bf79c5bb34801654be889d44ace848942b1cc6465cd\": container with ID starting with 4427dba65cde73cf6b043bf79c5bb34801654be889d44ace848942b1cc6465cd not found: ID does not exist" containerID="4427dba65cde73cf6b043bf79c5bb34801654be889d44ace848942b1cc6465cd" Oct 31 00:44:46.409536 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.409455 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4427dba65cde73cf6b043bf79c5bb34801654be889d44ace848942b1cc6465cd"} err="failed to get container status \"4427dba65cde73cf6b043bf79c5bb34801654be889d44ace848942b1cc6465cd\": rpc error: code = NotFound desc = could not find container \"4427dba65cde73cf6b043bf79c5bb34801654be889d44ace848942b1cc6465cd\": container with ID starting with 4427dba65cde73cf6b043bf79c5bb34801654be889d44ace848942b1cc6465cd not found: ID does not exist" Oct 31 00:44:46.409536 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.409478 6591 scope.go:122] "RemoveContainer" containerID="7b5f375733f3c060079f037b68d7911ccf0c4d10a222c7202a14f97bb203be3f" Oct 31 00:44:46.410477 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.410455 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd"] Oct 31 00:44:46.410701 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:44:46.410683 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b5f375733f3c060079f037b68d7911ccf0c4d10a222c7202a14f97bb203be3f\": container with ID starting with 7b5f375733f3c060079f037b68d7911ccf0c4d10a222c7202a14f97bb203be3f not found: ID does not exist" containerID="7b5f375733f3c060079f037b68d7911ccf0c4d10a222c7202a14f97bb203be3f" Oct 31 00:44:46.410765 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.410711 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b5f375733f3c060079f037b68d7911ccf0c4d10a222c7202a14f97bb203be3f"} err="failed to get container status \"7b5f375733f3c060079f037b68d7911ccf0c4d10a222c7202a14f97bb203be3f\": rpc error: code = NotFound desc = could not find container \"7b5f375733f3c060079f037b68d7911ccf0c4d10a222c7202a14f97bb203be3f\": container with ID starting with 7b5f375733f3c060079f037b68d7911ccf0c4d10a222c7202a14f97bb203be3f not found: ID does not exist" Oct 31 00:44:46.410765 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.410726 6591 scope.go:122] "RemoveContainer" containerID="a8fabd3d9d62242245dd276c18531a1d431678162f7c7be9450c3999092391a4" Oct 31 00:44:46.410975 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:44:46.410956 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8fabd3d9d62242245dd276c18531a1d431678162f7c7be9450c3999092391a4\": container with ID starting with a8fabd3d9d62242245dd276c18531a1d431678162f7c7be9450c3999092391a4 not found: ID does not exist" containerID="a8fabd3d9d62242245dd276c18531a1d431678162f7c7be9450c3999092391a4" Oct 31 00:44:46.411022 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.410985 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8fabd3d9d62242245dd276c18531a1d431678162f7c7be9450c3999092391a4"} err="failed to get container status \"a8fabd3d9d62242245dd276c18531a1d431678162f7c7be9450c3999092391a4\": rpc error: code = NotFound desc = could not find container \"a8fabd3d9d62242245dd276c18531a1d431678162f7c7be9450c3999092391a4\": container with ID starting with a8fabd3d9d62242245dd276c18531a1d431678162f7c7be9450c3999092391a4 not found: ID does not exist" Oct 31 00:44:46.411022 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.410997 6591 scope.go:122] "RemoveContainer" containerID="2da05e18e74d7544e955d9854ea81367ceabcccbaec5b6c4750e4cbc25abd381" Oct 31 00:44:46.414177 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.414157 6591 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-stop-predictor-65dd46dbb7-7qvcd"] Oct 31 00:44:46.418461 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.418443 6591 scope.go:122] "RemoveContainer" containerID="cef3c22598130cdada22e5947fa805938d2356a986d3d64812ade12eb0474aa4" Oct 31 00:44:46.425136 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.425110 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx"] Oct 31 00:44:46.428396 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.428363 6591 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-stop-v2-predictor-dcbfbc986-tsdtx"] Oct 31 00:44:46.430928 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.430907 6591 scope.go:122] "RemoveContainer" containerID="870e619966898d2e7078b09d73fb045177a6d3b0c3380742b43d1b710c3b7f95" Oct 31 00:44:46.437809 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.437786 6591 scope.go:122] "RemoveContainer" containerID="2da05e18e74d7544e955d9854ea81367ceabcccbaec5b6c4750e4cbc25abd381" Oct 31 00:44:46.438052 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:44:46.438034 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2da05e18e74d7544e955d9854ea81367ceabcccbaec5b6c4750e4cbc25abd381\": container with ID starting with 2da05e18e74d7544e955d9854ea81367ceabcccbaec5b6c4750e4cbc25abd381 not found: ID does not exist" containerID="2da05e18e74d7544e955d9854ea81367ceabcccbaec5b6c4750e4cbc25abd381" Oct 31 00:44:46.438145 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.438061 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2da05e18e74d7544e955d9854ea81367ceabcccbaec5b6c4750e4cbc25abd381"} err="failed to get container status \"2da05e18e74d7544e955d9854ea81367ceabcccbaec5b6c4750e4cbc25abd381\": rpc error: code = NotFound desc = could not find container \"2da05e18e74d7544e955d9854ea81367ceabcccbaec5b6c4750e4cbc25abd381\": container with ID starting with 2da05e18e74d7544e955d9854ea81367ceabcccbaec5b6c4750e4cbc25abd381 not found: ID does not exist" Oct 31 00:44:46.438145 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.438084 6591 scope.go:122] "RemoveContainer" containerID="cef3c22598130cdada22e5947fa805938d2356a986d3d64812ade12eb0474aa4" Oct 31 00:44:46.438342 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:44:46.438325 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cef3c22598130cdada22e5947fa805938d2356a986d3d64812ade12eb0474aa4\": container with ID starting with cef3c22598130cdada22e5947fa805938d2356a986d3d64812ade12eb0474aa4 not found: ID does not exist" containerID="cef3c22598130cdada22e5947fa805938d2356a986d3d64812ade12eb0474aa4" Oct 31 00:44:46.438396 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.438348 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cef3c22598130cdada22e5947fa805938d2356a986d3d64812ade12eb0474aa4"} err="failed to get container status \"cef3c22598130cdada22e5947fa805938d2356a986d3d64812ade12eb0474aa4\": rpc error: code = NotFound desc = could not find container \"cef3c22598130cdada22e5947fa805938d2356a986d3d64812ade12eb0474aa4\": container with ID starting with cef3c22598130cdada22e5947fa805938d2356a986d3d64812ade12eb0474aa4 not found: ID does not exist" Oct 31 00:44:46.438396 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.438364 6591 scope.go:122] "RemoveContainer" containerID="870e619966898d2e7078b09d73fb045177a6d3b0c3380742b43d1b710c3b7f95" Oct 31 00:44:46.438608 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:44:46.438593 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"870e619966898d2e7078b09d73fb045177a6d3b0c3380742b43d1b710c3b7f95\": container with ID starting with 870e619966898d2e7078b09d73fb045177a6d3b0c3380742b43d1b710c3b7f95 not found: ID does not exist" containerID="870e619966898d2e7078b09d73fb045177a6d3b0c3380742b43d1b710c3b7f95" Oct 31 00:44:46.438647 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.438612 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"870e619966898d2e7078b09d73fb045177a6d3b0c3380742b43d1b710c3b7f95"} err="failed to get container status \"870e619966898d2e7078b09d73fb045177a6d3b0c3380742b43d1b710c3b7f95\": rpc error: code = NotFound desc = could not find container \"870e619966898d2e7078b09d73fb045177a6d3b0c3380742b43d1b710c3b7f95\": container with ID starting with 870e619966898d2e7078b09d73fb045177a6d3b0c3380742b43d1b710c3b7f95 not found: ID does not exist" Oct 31 00:44:46.850809 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.850779 6591 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" path="/var/lib/kubelet/pods/1a8f2e85-0399-47a0-86ba-44a5e78562a6/volumes" Oct 31 00:44:46.851290 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:46.851276 6591 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" path="/var/lib/kubelet/pods/bd847580-0191-4f21-8c03-c1d4c27830f7/volumes" Oct 31 00:44:48.670175 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.670140 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g"] Oct 31 00:44:48.670585 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.670465 6591 cpu_manager.go:414] "containerMap: removing container" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="kserve-container" Oct 31 00:44:48.670585 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.670476 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="kserve-container" Oct 31 00:44:48.670585 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.670493 6591 cpu_manager.go:414] "containerMap: removing container" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="kserve-container" Oct 31 00:44:48.670585 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.670498 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="kserve-container" Oct 31 00:44:48.670585 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.670511 6591 cpu_manager.go:414] "containerMap: removing container" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="storage-initializer" Oct 31 00:44:48.670585 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.670517 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="storage-initializer" Oct 31 00:44:48.670585 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.670523 6591 cpu_manager.go:414] "containerMap: removing container" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="kube-rbac-proxy" Oct 31 00:44:48.670585 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.670528 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="kube-rbac-proxy" Oct 31 00:44:48.670585 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.670539 6591 cpu_manager.go:414] "containerMap: removing container" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="storage-initializer" Oct 31 00:44:48.670585 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.670543 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="storage-initializer" Oct 31 00:44:48.670585 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.670550 6591 cpu_manager.go:414] "containerMap: removing container" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="kube-rbac-proxy" Oct 31 00:44:48.670585 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.670555 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="kube-rbac-proxy" Oct 31 00:44:48.671053 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.670631 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="kube-rbac-proxy" Oct 31 00:44:48.671053 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.670655 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="kserve-container" Oct 31 00:44:48.671053 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.670663 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a8f2e85-0399-47a0-86ba-44a5e78562a6" containerName="kserve-container" Oct 31 00:44:48.671053 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.670669 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd847580-0191-4f21-8c03-c1d4c27830f7" containerName="kube-rbac-proxy" Oct 31 00:44:48.675490 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.675471 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:44:48.682177 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.681734 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"odh-kserve-custom-ca-bundle\"" Oct 31 00:44:48.682177 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.681865 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"default-dockercfg-84b4v\"" Oct 31 00:44:48.682177 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.681925 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"openshift-service-ca.crt\"" Oct 31 00:44:48.682177 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.682003 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"seaweedfs-s3-creds\"" Oct 31 00:44:48.682177 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.682079 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"kube-root-ca.crt\"" Oct 31 00:44:48.682177 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.682153 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"isvc-primary-f54d2d-kube-rbac-proxy-sar-config\"" Oct 31 00:44:48.682855 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.682269 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"isvc-primary-f54d2d-predictor-serving-cert\"" Oct 31 00:44:48.683833 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.683807 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g"] Oct 31 00:44:48.740488 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.740456 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:44:48.774867 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.774834 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8dlw\" (UniqueName: \"kubernetes.io/projected/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kube-api-access-z8dlw\") pod \"isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g\" (UID: \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\") " pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:44:48.775028 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.774885 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kube-rbac-proxy-sar-config\") pod \"isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g\" (UID: \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\") " pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:44:48.775028 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.775002 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kserve-provision-location\") pod \"isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g\" (UID: \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\") " pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:44:48.775105 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.775045 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-proxy-tls\") pod \"isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g\" (UID: \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\") " pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:44:48.775148 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.775135 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-cabundle-cert\") pod \"isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g\" (UID: \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\") " pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:44:48.864067 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:44:48.864033 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:44:48.876504 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.876476 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8dlw\" (UniqueName: \"kubernetes.io/projected/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kube-api-access-z8dlw\") pod \"isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g\" (UID: \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\") " pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:44:48.876655 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.876529 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kube-rbac-proxy-sar-config\") pod \"isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g\" (UID: \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\") " pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:44:48.876655 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.876567 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kserve-provision-location\") pod \"isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g\" (UID: \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\") " pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:44:48.876655 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.876601 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-proxy-tls\") pod \"isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g\" (UID: \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\") " pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:44:48.876655 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.876628 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-cabundle-cert\") pod \"isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g\" (UID: \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\") " pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:44:48.877006 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.876982 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kserve-provision-location\") pod \"isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g\" (UID: \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\") " pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:44:48.877313 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.877296 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-cabundle-cert\") pod \"isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g\" (UID: \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\") " pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:44:48.877352 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.877301 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kube-rbac-proxy-sar-config\") pod \"isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g\" (UID: \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\") " pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:44:48.879082 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.879062 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-proxy-tls\") pod \"isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g\" (UID: \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\") " pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:44:48.885121 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.885088 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8dlw\" (UniqueName: \"kubernetes.io/projected/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kube-api-access-z8dlw\") pod \"isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g\" (UID: \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\") " pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:44:48.898986 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.898960 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:44:48.993645 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:48.993561 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:44:49.266710 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:49.266648 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g"] Oct 31 00:44:49.269057 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:44:49.269030 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f73511_9d6b_48de_9bfc_a808aa1f0d23.slice/crio-a7411959706587fa47b1aa490ecb407acc2f78a524046de9d2a9d6f3813d630f WatchSource:0}: Error finding container a7411959706587fa47b1aa490ecb407acc2f78a524046de9d2a9d6f3813d630f: Status 404 returned error can't find the container with id a7411959706587fa47b1aa490ecb407acc2f78a524046de9d2a9d6f3813d630f Oct 31 00:44:49.404160 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:49.404123 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" event={"ID":"b2f73511-9d6b-48de-9bfc-a808aa1f0d23","Type":"ContainerStarted","Data":"7e7a4d95ff1e55bf0fc6699a982fef72e0974f22040608eecfff46dd267551bd"} Oct 31 00:44:49.404333 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:49.404181 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" event={"ID":"b2f73511-9d6b-48de-9bfc-a808aa1f0d23","Type":"ContainerStarted","Data":"a7411959706587fa47b1aa490ecb407acc2f78a524046de9d2a9d6f3813d630f"} Oct 31 00:44:53.421560 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:53.421521 6591 generic.go:356] "Generic (PLEG): container finished" podID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerID="7e7a4d95ff1e55bf0fc6699a982fef72e0974f22040608eecfff46dd267551bd" exitCode=0 Oct 31 00:44:53.421968 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:53.421594 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" event={"ID":"b2f73511-9d6b-48de-9bfc-a808aa1f0d23","Type":"ContainerDied","Data":"7e7a4d95ff1e55bf0fc6699a982fef72e0974f22040608eecfff46dd267551bd"} Oct 31 00:44:54.427902 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:54.427868 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" event={"ID":"b2f73511-9d6b-48de-9bfc-a808aa1f0d23","Type":"ContainerStarted","Data":"8377eaa6afdbaa851ba8abcccae579c8b9917cc30f82e448c3c78b762b6f7f93"} Oct 31 00:44:54.428491 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:54.427939 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" event={"ID":"b2f73511-9d6b-48de-9bfc-a808aa1f0d23","Type":"ContainerStarted","Data":"4b957fb89a0d2311b929bb5146e7a6d0c020b0cb5c326413013db60fe69e3523"} Oct 31 00:44:54.428491 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:54.428217 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:44:54.428491 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:54.428262 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:44:54.429685 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:54.429663 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 31 00:44:54.447568 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:54.447512 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" podStartSLOduration=2.49772601 podStartE2EDuration="6.447500707s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.949774697s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:44:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:44:54.446038428 +0000 UTC m=+883.707312301" watchObservedRunningTime="2026-10-31 00:44:54.447500707 +0000 UTC m=+883.708774581" Oct 31 00:44:55.432134 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:44:55.432090 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 31 00:45:00.436209 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:45:00.436179 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:45:00.436691 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:45:00.436644 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 31 00:45:10.436944 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:45:10.436906 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 31 00:45:10.935026 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:45:10.935000 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9vvz_c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/ovn-acl-logging/0.log" Oct 31 00:45:10.939310 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:45:10.939290 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9vvz_c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/ovn-acl-logging/0.log" Oct 31 00:45:16.741679 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:45:16.741641 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:45:18.864632 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:45:18.864595 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:45:20.436863 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:45:20.436780 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 31 00:45:30.436881 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:45:30.436835 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 31 00:45:40.437328 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:45:40.437292 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 31 00:45:48.864368 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:45:48.864332 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:45:50.436685 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:45:50.436645 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 31 00:46:00.436893 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:00.436854 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 31 00:46:04.844933 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:04.844890 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 31 00:46:09.832673 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:09.832638 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:46:09.991633 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:09.991564 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:46:14.849051 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:14.849025 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:46:16.786064 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:16.786030 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:46:18.864932 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:46:18.864900 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:46:20.220995 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:20.220961 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:46:20.395507 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:20.395477 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:46:27.526693 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:27.526649 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:46:27.688948 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:27.688916 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:46:31.259865 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:31.259832 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:46:34.194123 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:34.194091 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:46:34.349743 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:34.349704 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:46:47.638623 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:47.638591 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:46:47.809828 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:47.809794 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:46:48.864481 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:46:48.864440 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:46:52.283906 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:52.283821 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g"] Oct 31 00:46:52.284406 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:52.284162 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="kserve-container" containerID="cri-o://4b957fb89a0d2311b929bb5146e7a6d0c020b0cb5c326413013db60fe69e3523" gracePeriod=30 Oct 31 00:46:52.284564 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:52.284515 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="kube-rbac-proxy" containerID="cri-o://8377eaa6afdbaa851ba8abcccae579c8b9917cc30f82e448c3c78b762b6f7f93" gracePeriod=30 Oct 31 00:46:52.365757 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:52.365720 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:46:52.514629 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:52.514597 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:46:52.919663 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:52.919628 6591 generic.go:356] "Generic (PLEG): container finished" podID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerID="8377eaa6afdbaa851ba8abcccae579c8b9917cc30f82e448c3c78b762b6f7f93" exitCode=0 Oct 31 00:46:52.919839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:52.919700 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" event={"ID":"b2f73511-9d6b-48de-9bfc-a808aa1f0d23","Type":"ContainerDied","Data":"8377eaa6afdbaa851ba8abcccae579c8b9917cc30f82e448c3c78b762b6f7f93"} Oct 31 00:46:54.844895 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:54.844855 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 31 00:46:55.432823 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:55.432776 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.30:8643/healthz\": dial tcp 10.133.0.30:8643: connect: connection refused" Oct 31 00:46:57.324598 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.324568 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:46:57.401444 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.401367 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-cabundle-cert\") pod \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\" (UID: \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\") " Oct 31 00:46:57.401444 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.401458 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kserve-provision-location\") pod \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\" (UID: \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\") " Oct 31 00:46:57.401705 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.401510 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-proxy-tls\" (UniqueName: \"kubernetes.io/secret/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-proxy-tls\") pod \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\" (UID: \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\") " Oct 31 00:46:57.401705 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.401545 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kube-rbac-proxy-sar-config\") pod \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\" (UID: \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\") " Oct 31 00:46:57.401705 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.401578 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kube-api-access-z8dlw\" (UniqueName: \"kubernetes.io/projected/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kube-api-access-z8dlw\") pod \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\" (UID: \"b2f73511-9d6b-48de-9bfc-a808aa1f0d23\") " Oct 31 00:46:57.401865 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.401773 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kserve-provision-location" pod "b2f73511-9d6b-48de-9bfc-a808aa1f0d23" (UID: "b2f73511-9d6b-48de-9bfc-a808aa1f0d23"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:46:57.401923 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.401896 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-cabundle-cert" pod "b2f73511-9d6b-48de-9bfc-a808aa1f0d23" (UID: "b2f73511-9d6b-48de-9bfc-a808aa1f0d23"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:46:57.402002 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.401979 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kube-rbac-proxy-sar-config" pod "b2f73511-9d6b-48de-9bfc-a808aa1f0d23" (UID: "b2f73511-9d6b-48de-9bfc-a808aa1f0d23"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:46:57.403752 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.403709 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-proxy-tls" pod "b2f73511-9d6b-48de-9bfc-a808aa1f0d23" (UID: "b2f73511-9d6b-48de-9bfc-a808aa1f0d23"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:46:57.403917 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.403900 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kube-api-access-z8dlw" pod "b2f73511-9d6b-48de-9bfc-a808aa1f0d23" (UID: "b2f73511-9d6b-48de-9bfc-a808aa1f0d23"). InnerVolumeSpecName "kube-api-access-z8dlw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:46:57.502513 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.502465 6591 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-proxy-tls\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:46:57.502513 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.502506 6591 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:46:57.502513 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.502518 6591 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8dlw\" (UniqueName: \"kubernetes.io/projected/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kube-api-access-z8dlw\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:46:57.502513 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.502530 6591 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-cabundle-cert\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:46:57.502780 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.502539 6591 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b2f73511-9d6b-48de-9bfc-a808aa1f0d23-kserve-provision-location\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:46:57.942551 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.942518 6591 generic.go:356] "Generic (PLEG): container finished" podID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerID="4b957fb89a0d2311b929bb5146e7a6d0c020b0cb5c326413013db60fe69e3523" exitCode=0 Oct 31 00:46:57.942764 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.942607 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" Oct 31 00:46:57.942764 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.942616 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" event={"ID":"b2f73511-9d6b-48de-9bfc-a808aa1f0d23","Type":"ContainerDied","Data":"4b957fb89a0d2311b929bb5146e7a6d0c020b0cb5c326413013db60fe69e3523"} Oct 31 00:46:57.942764 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.942682 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g" event={"ID":"b2f73511-9d6b-48de-9bfc-a808aa1f0d23","Type":"ContainerDied","Data":"a7411959706587fa47b1aa490ecb407acc2f78a524046de9d2a9d6f3813d630f"} Oct 31 00:46:57.942764 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.942711 6591 scope.go:122] "RemoveContainer" containerID="8377eaa6afdbaa851ba8abcccae579c8b9917cc30f82e448c3c78b762b6f7f93" Oct 31 00:46:57.951236 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.951219 6591 scope.go:122] "RemoveContainer" containerID="4b957fb89a0d2311b929bb5146e7a6d0c020b0cb5c326413013db60fe69e3523" Oct 31 00:46:57.958843 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.958823 6591 scope.go:122] "RemoveContainer" containerID="7e7a4d95ff1e55bf0fc6699a982fef72e0974f22040608eecfff46dd267551bd" Oct 31 00:46:57.964562 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.964534 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g"] Oct 31 00:46:57.967469 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.967443 6591 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c950106202/isvc-primary-f54d2d-predictor-7b6cf4d99-sh26g"] Oct 31 00:46:57.967739 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.967721 6591 scope.go:122] "RemoveContainer" containerID="8377eaa6afdbaa851ba8abcccae579c8b9917cc30f82e448c3c78b762b6f7f93" Oct 31 00:46:57.968060 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:46:57.968036 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8377eaa6afdbaa851ba8abcccae579c8b9917cc30f82e448c3c78b762b6f7f93\": container with ID starting with 8377eaa6afdbaa851ba8abcccae579c8b9917cc30f82e448c3c78b762b6f7f93 not found: ID does not exist" containerID="8377eaa6afdbaa851ba8abcccae579c8b9917cc30f82e448c3c78b762b6f7f93" Oct 31 00:46:57.968167 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.968069 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8377eaa6afdbaa851ba8abcccae579c8b9917cc30f82e448c3c78b762b6f7f93"} err="failed to get container status \"8377eaa6afdbaa851ba8abcccae579c8b9917cc30f82e448c3c78b762b6f7f93\": rpc error: code = NotFound desc = could not find container \"8377eaa6afdbaa851ba8abcccae579c8b9917cc30f82e448c3c78b762b6f7f93\": container with ID starting with 8377eaa6afdbaa851ba8abcccae579c8b9917cc30f82e448c3c78b762b6f7f93 not found: ID does not exist" Oct 31 00:46:57.968167 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.968087 6591 scope.go:122] "RemoveContainer" containerID="4b957fb89a0d2311b929bb5146e7a6d0c020b0cb5c326413013db60fe69e3523" Oct 31 00:46:57.968383 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:46:57.968370 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b957fb89a0d2311b929bb5146e7a6d0c020b0cb5c326413013db60fe69e3523\": container with ID starting with 4b957fb89a0d2311b929bb5146e7a6d0c020b0cb5c326413013db60fe69e3523 not found: ID does not exist" containerID="4b957fb89a0d2311b929bb5146e7a6d0c020b0cb5c326413013db60fe69e3523" Oct 31 00:46:57.968501 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.968385 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b957fb89a0d2311b929bb5146e7a6d0c020b0cb5c326413013db60fe69e3523"} err="failed to get container status \"4b957fb89a0d2311b929bb5146e7a6d0c020b0cb5c326413013db60fe69e3523\": rpc error: code = NotFound desc = could not find container \"4b957fb89a0d2311b929bb5146e7a6d0c020b0cb5c326413013db60fe69e3523\": container with ID starting with 4b957fb89a0d2311b929bb5146e7a6d0c020b0cb5c326413013db60fe69e3523 not found: ID does not exist" Oct 31 00:46:57.968501 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.968397 6591 scope.go:122] "RemoveContainer" containerID="7e7a4d95ff1e55bf0fc6699a982fef72e0974f22040608eecfff46dd267551bd" Oct 31 00:46:57.968932 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:46:57.968900 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e7a4d95ff1e55bf0fc6699a982fef72e0974f22040608eecfff46dd267551bd\": container with ID starting with 7e7a4d95ff1e55bf0fc6699a982fef72e0974f22040608eecfff46dd267551bd not found: ID does not exist" containerID="7e7a4d95ff1e55bf0fc6699a982fef72e0974f22040608eecfff46dd267551bd" Oct 31 00:46:57.968998 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:57.968941 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e7a4d95ff1e55bf0fc6699a982fef72e0974f22040608eecfff46dd267551bd"} err="failed to get container status \"7e7a4d95ff1e55bf0fc6699a982fef72e0974f22040608eecfff46dd267551bd\": rpc error: code = NotFound desc = could not find container \"7e7a4d95ff1e55bf0fc6699a982fef72e0974f22040608eecfff46dd267551bd\": container with ID starting with 7e7a4d95ff1e55bf0fc6699a982fef72e0974f22040608eecfff46dd267551bd not found: ID does not exist" Oct 31 00:46:58.849708 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:58.849658 6591 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" path="/var/lib/kubelet/pods/b2f73511-9d6b-48de-9bfc-a808aa1f0d23/volumes" Oct 31 00:46:58.957594 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:58.957565 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n"] Oct 31 00:46:58.957939 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:58.957925 6591 cpu_manager.go:414] "containerMap: removing container" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="kube-rbac-proxy" Oct 31 00:46:58.957989 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:58.957941 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="kube-rbac-proxy" Oct 31 00:46:58.957989 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:58.957951 6591 cpu_manager.go:414] "containerMap: removing container" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="storage-initializer" Oct 31 00:46:58.957989 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:58.957957 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="storage-initializer" Oct 31 00:46:58.957989 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:58.957966 6591 cpu_manager.go:414] "containerMap: removing container" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="kserve-container" Oct 31 00:46:58.957989 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:58.957970 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="kserve-container" Oct 31 00:46:58.958144 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:58.958024 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="kube-rbac-proxy" Oct 31 00:46:58.958144 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:58.958032 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2f73511-9d6b-48de-9bfc-a808aa1f0d23" containerName="kserve-container" Oct 31 00:46:58.962561 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:58.962539 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" Oct 31 00:46:58.974815 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:58.974792 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"isvc-init-fail-8a6312-kube-rbac-proxy-sar-config\"" Oct 31 00:46:58.974815 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:58.974799 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"odh-kserve-custom-ca-bundle\"" Oct 31 00:46:58.974966 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:58.974799 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"fail-s3-secret-8a6312\"" Oct 31 00:46:58.975274 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:58.975259 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"isvc-init-fail-8a6312-predictor-serving-cert\"" Oct 31 00:46:58.975311 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:58.975285 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"openshift-service-ca.crt\"" Oct 31 00:46:58.977526 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:58.977511 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"fail-s3-sa-8a6312-dockercfg-jjsnc\"" Oct 31 00:46:58.977581 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:58.977570 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"kube-root-ca.crt\"" Oct 31 00:46:58.979619 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:58.979600 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n"] Oct 31 00:46:59.014692 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.014655 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:46:59.116201 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.116124 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e55526d2-281b-4566-af40-c8b14afff708-kserve-provision-location\") pod \"isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n\" (UID: \"e55526d2-281b-4566-af40-c8b14afff708\") " pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" Oct 31 00:46:59.116201 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.116168 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkxgq\" (UniqueName: \"kubernetes.io/projected/e55526d2-281b-4566-af40-c8b14afff708-kube-api-access-mkxgq\") pod \"isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n\" (UID: \"e55526d2-281b-4566-af40-c8b14afff708\") " pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" Oct 31 00:46:59.116411 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.116252 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e55526d2-281b-4566-af40-c8b14afff708-kube-rbac-proxy-sar-config\") pod \"isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n\" (UID: \"e55526d2-281b-4566-af40-c8b14afff708\") " pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" Oct 31 00:46:59.116411 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.116279 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e55526d2-281b-4566-af40-c8b14afff708-cabundle-cert\") pod \"isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n\" (UID: \"e55526d2-281b-4566-af40-c8b14afff708\") " pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" Oct 31 00:46:59.116411 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.116310 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e55526d2-281b-4566-af40-c8b14afff708-proxy-tls\") pod \"isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n\" (UID: \"e55526d2-281b-4566-af40-c8b14afff708\") " pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" Oct 31 00:46:59.217239 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.217201 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e55526d2-281b-4566-af40-c8b14afff708-kserve-provision-location\") pod \"isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n\" (UID: \"e55526d2-281b-4566-af40-c8b14afff708\") " pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" Oct 31 00:46:59.217239 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.217256 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkxgq\" (UniqueName: \"kubernetes.io/projected/e55526d2-281b-4566-af40-c8b14afff708-kube-api-access-mkxgq\") pod \"isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n\" (UID: \"e55526d2-281b-4566-af40-c8b14afff708\") " pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" Oct 31 00:46:59.217546 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.217305 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e55526d2-281b-4566-af40-c8b14afff708-kube-rbac-proxy-sar-config\") pod \"isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n\" (UID: \"e55526d2-281b-4566-af40-c8b14afff708\") " pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" Oct 31 00:46:59.217546 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.217326 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e55526d2-281b-4566-af40-c8b14afff708-cabundle-cert\") pod \"isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n\" (UID: \"e55526d2-281b-4566-af40-c8b14afff708\") " pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" Oct 31 00:46:59.217546 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.217353 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e55526d2-281b-4566-af40-c8b14afff708-proxy-tls\") pod \"isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n\" (UID: \"e55526d2-281b-4566-af40-c8b14afff708\") " pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" Oct 31 00:46:59.217731 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.217690 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e55526d2-281b-4566-af40-c8b14afff708-kserve-provision-location\") pod \"isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n\" (UID: \"e55526d2-281b-4566-af40-c8b14afff708\") " pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" Oct 31 00:46:59.218047 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.218028 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e55526d2-281b-4566-af40-c8b14afff708-cabundle-cert\") pod \"isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n\" (UID: \"e55526d2-281b-4566-af40-c8b14afff708\") " pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" Oct 31 00:46:59.218099 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.218033 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e55526d2-281b-4566-af40-c8b14afff708-kube-rbac-proxy-sar-config\") pod \"isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n\" (UID: \"e55526d2-281b-4566-af40-c8b14afff708\") " pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" Oct 31 00:46:59.219987 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.219965 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e55526d2-281b-4566-af40-c8b14afff708-proxy-tls\") pod \"isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n\" (UID: \"e55526d2-281b-4566-af40-c8b14afff708\") " pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" Oct 31 00:46:59.228498 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.228476 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkxgq\" (UniqueName: \"kubernetes.io/projected/e55526d2-281b-4566-af40-c8b14afff708-kube-api-access-mkxgq\") pod \"isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n\" (UID: \"e55526d2-281b-4566-af40-c8b14afff708\") " pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" Oct 31 00:46:59.279575 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.279541 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" Oct 31 00:46:59.282107 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.282079 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:46:59.555107 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.555072 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n"] Oct 31 00:46:59.558556 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:46:59.558526 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode55526d2_281b_4566_af40_c8b14afff708.slice/crio-6ce2a5287e28fb907ea9f0009e205fb7028e8e69f49f126a3abfe1fb176a049f WatchSource:0}: Error finding container 6ce2a5287e28fb907ea9f0009e205fb7028e8e69f49f126a3abfe1fb176a049f: Status 404 returned error can't find the container with id 6ce2a5287e28fb907ea9f0009e205fb7028e8e69f49f126a3abfe1fb176a049f Oct 31 00:46:59.955217 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.955124 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" event={"ID":"e55526d2-281b-4566-af40-c8b14afff708","Type":"ContainerStarted","Data":"783cb2f380e21517926941af662fd047fefe8c86242538074874b0789d2031fc"} Oct 31 00:46:59.955217 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:46:59.955194 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" event={"ID":"e55526d2-281b-4566-af40-c8b14afff708","Type":"ContainerStarted","Data":"6ce2a5287e28fb907ea9f0009e205fb7028e8e69f49f126a3abfe1fb176a049f"} Oct 31 00:47:05.980197 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:05.980166 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c950106202_isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n_e55526d2-281b-4566-af40-c8b14afff708/storage-initializer/0.log" Oct 31 00:47:05.980603 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:05.980209 6591 generic.go:356] "Generic (PLEG): container finished" podID="e55526d2-281b-4566-af40-c8b14afff708" containerID="783cb2f380e21517926941af662fd047fefe8c86242538074874b0789d2031fc" exitCode=1 Oct 31 00:47:05.980603 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:05.980261 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" event={"ID":"e55526d2-281b-4566-af40-c8b14afff708","Type":"ContainerDied","Data":"783cb2f380e21517926941af662fd047fefe8c86242538074874b0789d2031fc"} Oct 31 00:47:06.986348 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:06.986319 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c950106202_isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n_e55526d2-281b-4566-af40-c8b14afff708/storage-initializer/0.log" Oct 31 00:47:06.986771 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:06.986442 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" event={"ID":"e55526d2-281b-4566-af40-c8b14afff708","Type":"ContainerStarted","Data":"26d7f71d634d466cdf3ad78dc44b5b7af13bb2bae8806cb1e031ef7e9fb328ae"} Oct 31 00:47:09.006749 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:09.006718 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n"] Oct 31 00:47:09.007208 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:09.006941 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" podUID="e55526d2-281b-4566-af40-c8b14afff708" containerName="storage-initializer" containerID="cri-o://26d7f71d634d466cdf3ad78dc44b5b7af13bb2bae8806cb1e031ef7e9fb328ae" gracePeriod=30 Oct 31 00:47:09.117922 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:09.117886 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:47:10.556436 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:10.556397 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c950106202_isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n_e55526d2-281b-4566-af40-c8b14afff708/storage-initializer/1.log" Oct 31 00:47:10.556802 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:10.556788 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c950106202_isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n_e55526d2-281b-4566-af40-c8b14afff708/storage-initializer/0.log" Oct 31 00:47:10.559053 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:10.559038 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" Oct 31 00:47:10.720972 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:10.720875 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e55526d2-281b-4566-af40-c8b14afff708-proxy-tls\" (UniqueName: \"kubernetes.io/secret/e55526d2-281b-4566-af40-c8b14afff708-proxy-tls\") pod \"e55526d2-281b-4566-af40-c8b14afff708\" (UID: \"e55526d2-281b-4566-af40-c8b14afff708\") " Oct 31 00:47:10.720972 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:10.720949 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e55526d2-281b-4566-af40-c8b14afff708-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e55526d2-281b-4566-af40-c8b14afff708-kserve-provision-location\") pod \"e55526d2-281b-4566-af40-c8b14afff708\" (UID: \"e55526d2-281b-4566-af40-c8b14afff708\") " Oct 31 00:47:10.721171 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:10.720988 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e55526d2-281b-4566-af40-c8b14afff708-kube-api-access-mkxgq\" (UniqueName: \"kubernetes.io/projected/e55526d2-281b-4566-af40-c8b14afff708-kube-api-access-mkxgq\") pod \"e55526d2-281b-4566-af40-c8b14afff708\" (UID: \"e55526d2-281b-4566-af40-c8b14afff708\") " Oct 31 00:47:10.721171 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:10.721025 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e55526d2-281b-4566-af40-c8b14afff708-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e55526d2-281b-4566-af40-c8b14afff708-cabundle-cert\") pod \"e55526d2-281b-4566-af40-c8b14afff708\" (UID: \"e55526d2-281b-4566-af40-c8b14afff708\") " Oct 31 00:47:10.721171 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:10.721086 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e55526d2-281b-4566-af40-c8b14afff708-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e55526d2-281b-4566-af40-c8b14afff708-kube-rbac-proxy-sar-config\") pod \"e55526d2-281b-4566-af40-c8b14afff708\" (UID: \"e55526d2-281b-4566-af40-c8b14afff708\") " Oct 31 00:47:10.721298 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:10.721252 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e55526d2-281b-4566-af40-c8b14afff708-kserve-provision-location" pod "e55526d2-281b-4566-af40-c8b14afff708" (UID: "e55526d2-281b-4566-af40-c8b14afff708"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:47:10.721411 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:10.721384 6591 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e55526d2-281b-4566-af40-c8b14afff708-kserve-provision-location\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:47:10.721411 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:10.721386 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e55526d2-281b-4566-af40-c8b14afff708-cabundle-cert" pod "e55526d2-281b-4566-af40-c8b14afff708" (UID: "e55526d2-281b-4566-af40-c8b14afff708"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:47:10.721539 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:10.721477 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e55526d2-281b-4566-af40-c8b14afff708-kube-rbac-proxy-sar-config" pod "e55526d2-281b-4566-af40-c8b14afff708" (UID: "e55526d2-281b-4566-af40-c8b14afff708"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:47:10.723279 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:10.723257 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e55526d2-281b-4566-af40-c8b14afff708-proxy-tls" pod "e55526d2-281b-4566-af40-c8b14afff708" (UID: "e55526d2-281b-4566-af40-c8b14afff708"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:47:10.723372 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:10.723258 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e55526d2-281b-4566-af40-c8b14afff708-kube-api-access-mkxgq" pod "e55526d2-281b-4566-af40-c8b14afff708" (UID: "e55526d2-281b-4566-af40-c8b14afff708"). InnerVolumeSpecName "kube-api-access-mkxgq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:47:10.822642 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:10.822589 6591 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e55526d2-281b-4566-af40-c8b14afff708-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:47:10.822642 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:10.822632 6591 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e55526d2-281b-4566-af40-c8b14afff708-proxy-tls\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:47:10.822642 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:10.822642 6591 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkxgq\" (UniqueName: \"kubernetes.io/projected/e55526d2-281b-4566-af40-c8b14afff708-kube-api-access-mkxgq\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:47:10.822642 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:10.822652 6591 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e55526d2-281b-4566-af40-c8b14afff708-cabundle-cert\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:47:11.003104 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.003023 6591 generic.go:356] "Generic (PLEG): container finished" podID="e55526d2-281b-4566-af40-c8b14afff708" containerID="26d7f71d634d466cdf3ad78dc44b5b7af13bb2bae8806cb1e031ef7e9fb328ae" exitCode=1 Oct 31 00:47:11.003104 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.003083 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" Oct 31 00:47:11.003271 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.003105 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" event={"ID":"e55526d2-281b-4566-af40-c8b14afff708","Type":"ContainerDied","Data":"26d7f71d634d466cdf3ad78dc44b5b7af13bb2bae8806cb1e031ef7e9fb328ae"} Oct 31 00:47:11.003271 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.003192 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n" event={"ID":"e55526d2-281b-4566-af40-c8b14afff708","Type":"ContainerDied","Data":"6ce2a5287e28fb907ea9f0009e205fb7028e8e69f49f126a3abfe1fb176a049f"} Oct 31 00:47:11.003271 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.003226 6591 scope.go:122] "RemoveContainer" containerID="26d7f71d634d466cdf3ad78dc44b5b7af13bb2bae8806cb1e031ef7e9fb328ae" Oct 31 00:47:11.011341 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.011321 6591 scope.go:122] "RemoveContainer" containerID="783cb2f380e21517926941af662fd047fefe8c86242538074874b0789d2031fc" Oct 31 00:47:11.018265 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.018243 6591 scope.go:122] "RemoveContainer" containerID="26d7f71d634d466cdf3ad78dc44b5b7af13bb2bae8806cb1e031ef7e9fb328ae" Oct 31 00:47:11.018541 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:47:11.018516 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26d7f71d634d466cdf3ad78dc44b5b7af13bb2bae8806cb1e031ef7e9fb328ae\": container with ID starting with 26d7f71d634d466cdf3ad78dc44b5b7af13bb2bae8806cb1e031ef7e9fb328ae not found: ID does not exist" containerID="26d7f71d634d466cdf3ad78dc44b5b7af13bb2bae8806cb1e031ef7e9fb328ae" Oct 31 00:47:11.018601 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.018545 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26d7f71d634d466cdf3ad78dc44b5b7af13bb2bae8806cb1e031ef7e9fb328ae"} err="failed to get container status \"26d7f71d634d466cdf3ad78dc44b5b7af13bb2bae8806cb1e031ef7e9fb328ae\": rpc error: code = NotFound desc = could not find container \"26d7f71d634d466cdf3ad78dc44b5b7af13bb2bae8806cb1e031ef7e9fb328ae\": container with ID starting with 26d7f71d634d466cdf3ad78dc44b5b7af13bb2bae8806cb1e031ef7e9fb328ae not found: ID does not exist" Oct 31 00:47:11.018601 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.018561 6591 scope.go:122] "RemoveContainer" containerID="783cb2f380e21517926941af662fd047fefe8c86242538074874b0789d2031fc" Oct 31 00:47:11.018834 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:47:11.018814 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"783cb2f380e21517926941af662fd047fefe8c86242538074874b0789d2031fc\": container with ID starting with 783cb2f380e21517926941af662fd047fefe8c86242538074874b0789d2031fc not found: ID does not exist" containerID="783cb2f380e21517926941af662fd047fefe8c86242538074874b0789d2031fc" Oct 31 00:47:11.018883 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.018840 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"783cb2f380e21517926941af662fd047fefe8c86242538074874b0789d2031fc"} err="failed to get container status \"783cb2f380e21517926941af662fd047fefe8c86242538074874b0789d2031fc\": rpc error: code = NotFound desc = could not find container \"783cb2f380e21517926941af662fd047fefe8c86242538074874b0789d2031fc\": container with ID starting with 783cb2f380e21517926941af662fd047fefe8c86242538074874b0789d2031fc not found: ID does not exist" Oct 31 00:47:11.048733 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.048702 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n"] Oct 31 00:47:11.053718 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.053693 6591 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c950106202/isvc-init-fail-8a6312-predictor-66cd79f664-jhr4n"] Oct 31 00:47:11.572198 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.572163 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8"] Oct 31 00:47:11.572599 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.572498 6591 cpu_manager.go:414] "containerMap: removing container" podUID="e55526d2-281b-4566-af40-c8b14afff708" containerName="storage-initializer" Oct 31 00:47:11.572599 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.572509 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e55526d2-281b-4566-af40-c8b14afff708" containerName="storage-initializer" Oct 31 00:47:11.572599 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.572520 6591 cpu_manager.go:414] "containerMap: removing container" podUID="e55526d2-281b-4566-af40-c8b14afff708" containerName="storage-initializer" Oct 31 00:47:11.572599 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.572526 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e55526d2-281b-4566-af40-c8b14afff708" containerName="storage-initializer" Oct 31 00:47:11.572723 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.572610 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="e55526d2-281b-4566-af40-c8b14afff708" containerName="storage-initializer" Oct 31 00:47:11.572723 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.572617 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="e55526d2-281b-4566-af40-c8b14afff708" containerName="storage-initializer" Oct 31 00:47:11.577182 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.577160 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:47:11.584963 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.584931 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"raw-sklearn-60f43-predictor-serving-cert\"" Oct 31 00:47:11.585122 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.584990 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"openshift-service-ca.crt\"" Oct 31 00:47:11.585122 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.584993 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"default-dockercfg-84b4v\"" Oct 31 00:47:11.585122 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.585019 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"raw-sklearn-60f43-kube-rbac-proxy-sar-config\"" Oct 31 00:47:11.585122 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.584996 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"seaweedfs-s3-creds\"" Oct 31 00:47:11.585122 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.585045 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"odh-kserve-custom-ca-bundle\"" Oct 31 00:47:11.585122 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.585083 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"kube-root-ca.crt\"" Oct 31 00:47:11.585634 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.585608 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8"] Oct 31 00:47:11.628466 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.628433 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:47:11.729301 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.729257 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-proxy-tls\") pod \"raw-sklearn-60f43-predictor-75df667678-ktlw8\" (UID: \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\") " pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:47:11.729301 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.729299 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-cabundle-cert\") pod \"raw-sklearn-60f43-predictor-75df667678-ktlw8\" (UID: \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\") " pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:47:11.729626 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.729327 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-60f43-predictor-75df667678-ktlw8\" (UID: \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\") " pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:47:11.729626 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.729535 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kserve-provision-location\") pod \"raw-sklearn-60f43-predictor-75df667678-ktlw8\" (UID: \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\") " pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:47:11.729626 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.729572 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn5h2\" (UniqueName: \"kubernetes.io/projected/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kube-api-access-mn5h2\") pod \"raw-sklearn-60f43-predictor-75df667678-ktlw8\" (UID: \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\") " pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:47:11.788065 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.788023 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:47:11.830440 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.830320 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-proxy-tls\") pod \"raw-sklearn-60f43-predictor-75df667678-ktlw8\" (UID: \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\") " pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:47:11.830440 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.830371 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-cabundle-cert\") pod \"raw-sklearn-60f43-predictor-75df667678-ktlw8\" (UID: \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\") " pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:47:11.830656 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.830520 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-60f43-predictor-75df667678-ktlw8\" (UID: \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\") " pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:47:11.830656 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.830616 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kserve-provision-location\") pod \"raw-sklearn-60f43-predictor-75df667678-ktlw8\" (UID: \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\") " pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:47:11.830656 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.830649 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn5h2\" (UniqueName: \"kubernetes.io/projected/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kube-api-access-mn5h2\") pod \"raw-sklearn-60f43-predictor-75df667678-ktlw8\" (UID: \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\") " pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:47:11.830982 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.830958 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kserve-provision-location\") pod \"raw-sklearn-60f43-predictor-75df667678-ktlw8\" (UID: \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\") " pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:47:11.831096 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.831076 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-cabundle-cert\") pod \"raw-sklearn-60f43-predictor-75df667678-ktlw8\" (UID: \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\") " pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:47:11.831362 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.831251 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-60f43-predictor-75df667678-ktlw8\" (UID: \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\") " pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:47:11.833094 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.833078 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-proxy-tls\") pod \"raw-sklearn-60f43-predictor-75df667678-ktlw8\" (UID: \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\") " pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:47:11.839807 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.839782 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn5h2\" (UniqueName: \"kubernetes.io/projected/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kube-api-access-mn5h2\") pod \"raw-sklearn-60f43-predictor-75df667678-ktlw8\" (UID: \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\") " pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:47:11.895497 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:11.895459 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:47:12.171845 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:12.171762 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8"] Oct 31 00:47:12.174753 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:47:12.174710 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bcf9c3d_f3e2_428a_9cb7_fab58e52e297.slice/crio-77ddc70fbdb677845f9288f443440a14a04d5c838cef71186f2e9331903cea41 WatchSource:0}: Error finding container 77ddc70fbdb677845f9288f443440a14a04d5c838cef71186f2e9331903cea41: Status 404 returned error can't find the container with id 77ddc70fbdb677845f9288f443440a14a04d5c838cef71186f2e9331903cea41 Oct 31 00:47:12.849490 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:12.849456 6591 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e55526d2-281b-4566-af40-c8b14afff708" path="/var/lib/kubelet/pods/e55526d2-281b-4566-af40-c8b14afff708/volumes" Oct 31 00:47:13.014492 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:13.014457 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" event={"ID":"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297","Type":"ContainerStarted","Data":"040e2c9a524c1777c774a816c2d04747008abb7ae1aa1509354e906712f51684"} Oct 31 00:47:13.014673 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:13.014515 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" event={"ID":"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297","Type":"ContainerStarted","Data":"77ddc70fbdb677845f9288f443440a14a04d5c838cef71186f2e9331903cea41"} Oct 31 00:47:15.362539 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:15.362508 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:47:16.028681 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:16.028652 6591 generic.go:356] "Generic (PLEG): container finished" podID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerID="040e2c9a524c1777c774a816c2d04747008abb7ae1aa1509354e906712f51684" exitCode=0 Oct 31 00:47:16.028857 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:16.028708 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" event={"ID":"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297","Type":"ContainerDied","Data":"040e2c9a524c1777c774a816c2d04747008abb7ae1aa1509354e906712f51684"} Oct 31 00:47:16.835006 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:16.834971 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:47:17.034964 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:17.034933 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" event={"ID":"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297","Type":"ContainerStarted","Data":"066c3ec07ba5a2ff583fad8b39fb2c98d1077787eb325ee0344bebbf31b2ed37"} Oct 31 00:47:17.035103 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:17.034989 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" event={"ID":"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297","Type":"ContainerStarted","Data":"896eff8298cc55b8a2044cbd051797647ad32db5f66cf65764738bec98340b28"} Oct 31 00:47:17.035292 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:17.035271 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:47:17.035466 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:17.035442 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:47:17.036697 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:17.036670 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 31 00:47:17.058007 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:17.057964 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" podStartSLOduration=2.457759168 podStartE2EDuration="6.057952914s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.600193746s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:47:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:47:17.056725642 +0000 UTC m=+1026.317999517" watchObservedRunningTime="2026-10-31 00:47:17.057952914 +0000 UTC m=+1026.319226789" Oct 31 00:47:18.038704 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:18.038661 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 31 00:47:18.868982 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:47:18.868943 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:47:23.043497 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:23.043468 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:47:23.044139 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:23.044111 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 31 00:47:33.044000 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:33.043955 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 31 00:47:43.044226 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:43.044183 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 31 00:47:48.864948 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:47:48.864910 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:47:53.044696 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:47:53.044655 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 31 00:48:03.045983 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:03.045948 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 31 00:48:13.044027 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:13.043991 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 31 00:48:16.890954 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:16.890915 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:48:18.864175 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:48:18.864140 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:48:23.044373 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:23.044285 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 31 00:48:23.627646 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:23.627604 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:48:23.777895 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:23.777866 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:48:33.044596 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:33.044562 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:48:42.438495 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:42.438448 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8"] Oct 31 00:48:42.438961 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:42.438703 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="kserve-container" containerID="cri-o://896eff8298cc55b8a2044cbd051797647ad32db5f66cf65764738bec98340b28" gracePeriod=30 Oct 31 00:48:42.438961 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:42.438752 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="kube-rbac-proxy" containerID="cri-o://066c3ec07ba5a2ff583fad8b39fb2c98d1077787eb325ee0344bebbf31b2ed37" gracePeriod=30 Oct 31 00:48:42.516769 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:42.516734 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:48:43.039534 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:43.039486 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.32:8643/healthz\": dial tcp 10.133.0.32:8643: connect: connection refused" Oct 31 00:48:43.044831 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:43.044808 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 31 00:48:43.383088 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:43.383004 6591 generic.go:356] "Generic (PLEG): container finished" podID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerID="066c3ec07ba5a2ff583fad8b39fb2c98d1077787eb325ee0344bebbf31b2ed37" exitCode=0 Oct 31 00:48:43.383220 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:43.383080 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" event={"ID":"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297","Type":"ContainerDied","Data":"066c3ec07ba5a2ff583fad8b39fb2c98d1077787eb325ee0344bebbf31b2ed37"} Oct 31 00:48:47.182259 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.182234 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:48:47.273215 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.273190 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-cabundle-cert\") pod \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\" (UID: \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\") " Oct 31 00:48:47.273357 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.273222 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kube-rbac-proxy-sar-config\") pod \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\" (UID: \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\") " Oct 31 00:48:47.273357 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.273244 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kube-api-access-mn5h2\" (UniqueName: \"kubernetes.io/projected/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kube-api-access-mn5h2\") pod \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\" (UID: \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\") " Oct 31 00:48:47.273357 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.273332 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kserve-provision-location\") pod \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\" (UID: \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\") " Oct 31 00:48:47.273527 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.273366 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-proxy-tls\" (UniqueName: \"kubernetes.io/secret/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-proxy-tls\") pod \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\" (UID: \"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297\") " Oct 31 00:48:47.273678 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.273641 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-cabundle-cert" pod "1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" (UID: "1bcf9c3d-f3e2-428a-9cb7-fab58e52e297"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:48:47.273782 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.273684 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kube-rbac-proxy-sar-config" pod "1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" (UID: "1bcf9c3d-f3e2-428a-9cb7-fab58e52e297"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:48:47.273782 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.273707 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kserve-provision-location" pod "1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" (UID: "1bcf9c3d-f3e2-428a-9cb7-fab58e52e297"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:48:47.275482 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.275457 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-proxy-tls" pod "1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" (UID: "1bcf9c3d-f3e2-428a-9cb7-fab58e52e297"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:48:47.275570 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.275545 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kube-api-access-mn5h2" pod "1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" (UID: "1bcf9c3d-f3e2-428a-9cb7-fab58e52e297"). InnerVolumeSpecName "kube-api-access-mn5h2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:48:47.374374 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.374341 6591 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-cabundle-cert\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:48:47.374374 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.374369 6591 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:48:47.374374 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.374379 6591 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mn5h2\" (UniqueName: \"kubernetes.io/projected/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kube-api-access-mn5h2\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:48:47.374623 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.374388 6591 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-kserve-provision-location\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:48:47.374623 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.374397 6591 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297-proxy-tls\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:48:47.406294 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.406265 6591 generic.go:356] "Generic (PLEG): container finished" podID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerID="896eff8298cc55b8a2044cbd051797647ad32db5f66cf65764738bec98340b28" exitCode=0 Oct 31 00:48:47.406478 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.406306 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" event={"ID":"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297","Type":"ContainerDied","Data":"896eff8298cc55b8a2044cbd051797647ad32db5f66cf65764738bec98340b28"} Oct 31 00:48:47.406478 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.406338 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" Oct 31 00:48:47.406478 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.406351 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8" event={"ID":"1bcf9c3d-f3e2-428a-9cb7-fab58e52e297","Type":"ContainerDied","Data":"77ddc70fbdb677845f9288f443440a14a04d5c838cef71186f2e9331903cea41"} Oct 31 00:48:47.406478 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.406377 6591 scope.go:122] "RemoveContainer" containerID="066c3ec07ba5a2ff583fad8b39fb2c98d1077787eb325ee0344bebbf31b2ed37" Oct 31 00:48:47.415096 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.415070 6591 scope.go:122] "RemoveContainer" containerID="896eff8298cc55b8a2044cbd051797647ad32db5f66cf65764738bec98340b28" Oct 31 00:48:47.422095 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.422081 6591 scope.go:122] "RemoveContainer" containerID="040e2c9a524c1777c774a816c2d04747008abb7ae1aa1509354e906712f51684" Oct 31 00:48:47.428159 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.428137 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8"] Oct 31 00:48:47.429310 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.429291 6591 scope.go:122] "RemoveContainer" containerID="066c3ec07ba5a2ff583fad8b39fb2c98d1077787eb325ee0344bebbf31b2ed37" Oct 31 00:48:47.429604 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:48:47.429586 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"066c3ec07ba5a2ff583fad8b39fb2c98d1077787eb325ee0344bebbf31b2ed37\": container with ID starting with 066c3ec07ba5a2ff583fad8b39fb2c98d1077787eb325ee0344bebbf31b2ed37 not found: ID does not exist" containerID="066c3ec07ba5a2ff583fad8b39fb2c98d1077787eb325ee0344bebbf31b2ed37" Oct 31 00:48:47.429668 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.429616 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"066c3ec07ba5a2ff583fad8b39fb2c98d1077787eb325ee0344bebbf31b2ed37"} err="failed to get container status \"066c3ec07ba5a2ff583fad8b39fb2c98d1077787eb325ee0344bebbf31b2ed37\": rpc error: code = NotFound desc = could not find container \"066c3ec07ba5a2ff583fad8b39fb2c98d1077787eb325ee0344bebbf31b2ed37\": container with ID starting with 066c3ec07ba5a2ff583fad8b39fb2c98d1077787eb325ee0344bebbf31b2ed37 not found: ID does not exist" Oct 31 00:48:47.429668 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.429638 6591 scope.go:122] "RemoveContainer" containerID="896eff8298cc55b8a2044cbd051797647ad32db5f66cf65764738bec98340b28" Oct 31 00:48:47.429888 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:48:47.429871 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"896eff8298cc55b8a2044cbd051797647ad32db5f66cf65764738bec98340b28\": container with ID starting with 896eff8298cc55b8a2044cbd051797647ad32db5f66cf65764738bec98340b28 not found: ID does not exist" containerID="896eff8298cc55b8a2044cbd051797647ad32db5f66cf65764738bec98340b28" Oct 31 00:48:47.429929 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.429893 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"896eff8298cc55b8a2044cbd051797647ad32db5f66cf65764738bec98340b28"} err="failed to get container status \"896eff8298cc55b8a2044cbd051797647ad32db5f66cf65764738bec98340b28\": rpc error: code = NotFound desc = could not find container \"896eff8298cc55b8a2044cbd051797647ad32db5f66cf65764738bec98340b28\": container with ID starting with 896eff8298cc55b8a2044cbd051797647ad32db5f66cf65764738bec98340b28 not found: ID does not exist" Oct 31 00:48:47.429929 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.429908 6591 scope.go:122] "RemoveContainer" containerID="040e2c9a524c1777c774a816c2d04747008abb7ae1aa1509354e906712f51684" Oct 31 00:48:47.430132 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:48:47.430115 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"040e2c9a524c1777c774a816c2d04747008abb7ae1aa1509354e906712f51684\": container with ID starting with 040e2c9a524c1777c774a816c2d04747008abb7ae1aa1509354e906712f51684 not found: ID does not exist" containerID="040e2c9a524c1777c774a816c2d04747008abb7ae1aa1509354e906712f51684" Oct 31 00:48:47.430183 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.430140 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"040e2c9a524c1777c774a816c2d04747008abb7ae1aa1509354e906712f51684"} err="failed to get container status \"040e2c9a524c1777c774a816c2d04747008abb7ae1aa1509354e906712f51684\": rpc error: code = NotFound desc = could not find container \"040e2c9a524c1777c774a816c2d04747008abb7ae1aa1509354e906712f51684\": container with ID starting with 040e2c9a524c1777c774a816c2d04747008abb7ae1aa1509354e906712f51684 not found: ID does not exist" Oct 31 00:48:47.434230 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.434211 6591 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c950106202/raw-sklearn-60f43-predictor-75df667678-ktlw8"] Oct 31 00:48:47.833643 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.833615 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt"] Oct 31 00:48:47.833941 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.833929 6591 cpu_manager.go:414] "containerMap: removing container" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="kserve-container" Oct 31 00:48:47.833981 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.833942 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="kserve-container" Oct 31 00:48:47.834015 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.833986 6591 cpu_manager.go:414] "containerMap: removing container" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="kube-rbac-proxy" Oct 31 00:48:47.834015 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.833992 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="kube-rbac-proxy" Oct 31 00:48:47.834015 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.834007 6591 cpu_manager.go:414] "containerMap: removing container" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="storage-initializer" Oct 31 00:48:47.834015 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.834014 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="storage-initializer" Oct 31 00:48:47.834135 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.834063 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="kserve-container" Oct 31 00:48:47.834135 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.834072 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" containerName="kube-rbac-proxy" Oct 31 00:48:47.838612 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.838595 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:48:47.846146 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.846122 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt"] Oct 31 00:48:47.847753 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.847597 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"raw-sklearn-runtime-1ce83-predictor-serving-cert\"" Oct 31 00:48:47.847753 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.847663 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"kube-root-ca.crt\"" Oct 31 00:48:47.847753 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.847694 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"seaweedfs-s3-creds\"" Oct 31 00:48:47.847753 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.847694 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"odh-kserve-custom-ca-bundle\"" Oct 31 00:48:47.847753 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.847714 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"raw-sklearn-runtime-1ce83-kube-rbac-proxy-sar-config\"" Oct 31 00:48:47.848060 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.847793 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"openshift-service-ca.crt\"" Oct 31 00:48:47.848060 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.847799 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"default-dockercfg-84b4v\"" Oct 31 00:48:47.869247 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.869223 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:48:47.877001 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.876981 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt5sn\" (UniqueName: \"kubernetes.io/projected/f8515161-11a2-4299-9935-e373fe201fec-kube-api-access-pt5sn\") pod \"raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt\" (UID: \"f8515161-11a2-4299-9935-e373fe201fec\") " pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:48:47.877103 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.877008 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f8515161-11a2-4299-9935-e373fe201fec-cabundle-cert\") pod \"raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt\" (UID: \"f8515161-11a2-4299-9935-e373fe201fec\") " pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:48:47.877103 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.877034 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f8515161-11a2-4299-9935-e373fe201fec-kserve-provision-location\") pod \"raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt\" (UID: \"f8515161-11a2-4299-9935-e373fe201fec\") " pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:48:47.877208 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.877193 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8515161-11a2-4299-9935-e373fe201fec-proxy-tls\") pod \"raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt\" (UID: \"f8515161-11a2-4299-9935-e373fe201fec\") " pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:48:47.877252 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.877217 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f8515161-11a2-4299-9935-e373fe201fec-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt\" (UID: \"f8515161-11a2-4299-9935-e373fe201fec\") " pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:48:47.978124 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.978094 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8515161-11a2-4299-9935-e373fe201fec-proxy-tls\") pod \"raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt\" (UID: \"f8515161-11a2-4299-9935-e373fe201fec\") " pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:48:47.978124 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.978126 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f8515161-11a2-4299-9935-e373fe201fec-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt\" (UID: \"f8515161-11a2-4299-9935-e373fe201fec\") " pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:48:47.978289 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.978170 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt5sn\" (UniqueName: \"kubernetes.io/projected/f8515161-11a2-4299-9935-e373fe201fec-kube-api-access-pt5sn\") pod \"raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt\" (UID: \"f8515161-11a2-4299-9935-e373fe201fec\") " pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:48:47.978289 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.978189 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f8515161-11a2-4299-9935-e373fe201fec-cabundle-cert\") pod \"raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt\" (UID: \"f8515161-11a2-4299-9935-e373fe201fec\") " pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:48:47.978289 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.978211 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f8515161-11a2-4299-9935-e373fe201fec-kserve-provision-location\") pod \"raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt\" (UID: \"f8515161-11a2-4299-9935-e373fe201fec\") " pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:48:47.978703 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.978682 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f8515161-11a2-4299-9935-e373fe201fec-kserve-provision-location\") pod \"raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt\" (UID: \"f8515161-11a2-4299-9935-e373fe201fec\") " pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:48:47.978967 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.978949 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f8515161-11a2-4299-9935-e373fe201fec-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt\" (UID: \"f8515161-11a2-4299-9935-e373fe201fec\") " pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:48:47.979012 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.978978 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f8515161-11a2-4299-9935-e373fe201fec-cabundle-cert\") pod \"raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt\" (UID: \"f8515161-11a2-4299-9935-e373fe201fec\") " pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:48:47.980840 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.980823 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8515161-11a2-4299-9935-e373fe201fec-proxy-tls\") pod \"raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt\" (UID: \"f8515161-11a2-4299-9935-e373fe201fec\") " pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:48:47.986828 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:47.986807 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt5sn\" (UniqueName: \"kubernetes.io/projected/f8515161-11a2-4299-9935-e373fe201fec-kube-api-access-pt5sn\") pod \"raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt\" (UID: \"f8515161-11a2-4299-9935-e373fe201fec\") " pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:48:48.029697 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:48.029670 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:48:48.156382 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:48.156298 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:48:48.430150 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:48.430079 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt"] Oct 31 00:48:48.433025 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:48:48.432998 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8515161_11a2_4299_9935_e373fe201fec.slice/crio-61fb278f1504d64e8a8d5e3e1fcf35cf9197c07588cf5b10bded52ac5ca36b6c WatchSource:0}: Error finding container 61fb278f1504d64e8a8d5e3e1fcf35cf9197c07588cf5b10bded52ac5ca36b6c: Status 404 returned error can't find the container with id 61fb278f1504d64e8a8d5e3e1fcf35cf9197c07588cf5b10bded52ac5ca36b6c Oct 31 00:48:48.850812 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:48.850780 6591 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1bcf9c3d-f3e2-428a-9cb7-fab58e52e297" path="/var/lib/kubelet/pods/1bcf9c3d-f3e2-428a-9cb7-fab58e52e297/volumes" Oct 31 00:48:48.864666 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:48:48.864632 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:48:49.417826 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:49.417785 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" event={"ID":"f8515161-11a2-4299-9935-e373fe201fec","Type":"ContainerStarted","Data":"eefb3084c046fd602f413c4adf71f8fa70881bea51ec05b6594468c5fd7dd1ba"} Oct 31 00:48:49.417999 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:49.417839 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" event={"ID":"f8515161-11a2-4299-9935-e373fe201fec","Type":"ContainerStarted","Data":"61fb278f1504d64e8a8d5e3e1fcf35cf9197c07588cf5b10bded52ac5ca36b6c"} Oct 31 00:48:52.432015 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:52.431975 6591 generic.go:356] "Generic (PLEG): container finished" podID="f8515161-11a2-4299-9935-e373fe201fec" containerID="eefb3084c046fd602f413c4adf71f8fa70881bea51ec05b6594468c5fd7dd1ba" exitCode=0 Oct 31 00:48:52.432413 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:52.432023 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" event={"ID":"f8515161-11a2-4299-9935-e373fe201fec","Type":"ContainerDied","Data":"eefb3084c046fd602f413c4adf71f8fa70881bea51ec05b6594468c5fd7dd1ba"} Oct 31 00:48:53.438359 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:53.438323 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" event={"ID":"f8515161-11a2-4299-9935-e373fe201fec","Type":"ContainerStarted","Data":"8ba9df4cea9dd3ab29d740979ef9dda6bf78961b9223ec1c11ec8369af958d30"} Oct 31 00:48:53.438882 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:53.438398 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" event={"ID":"f8515161-11a2-4299-9935-e373fe201fec","Type":"ContainerStarted","Data":"703bd5d611b5255c104564331916a3da433e86dc1580c76197ca21cca1de7cf9"} Oct 31 00:48:53.438882 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:53.438639 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:48:53.459304 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:53.459259 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" podStartSLOduration=2.678831343 podStartE2EDuration="6.459246979s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.780415636s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:48:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:48:53.457848331 +0000 UTC m=+1122.719122208" watchObservedRunningTime="2026-10-31 00:48:53.459246979 +0000 UTC m=+1122.720520845" Oct 31 00:48:54.442326 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:54.442295 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:48:54.443650 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:54.443623 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 31 00:48:55.388263 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:55.388227 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:48:55.446105 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:55.446069 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 31 00:48:55.603236 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:48:55.603207 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:49:00.451178 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:49:00.451149 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:49:00.451655 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:49:00.451628 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 31 00:49:10.451961 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:49:10.451921 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 31 00:49:16.933973 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:49:16.933897 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:49:18.864281 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:49:18.864244 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:49:20.452464 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:49:20.452412 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 31 00:49:30.452459 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:49:30.452404 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 31 00:49:40.452131 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:49:40.452082 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 31 00:49:48.865110 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:49:48.865075 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:49:50.452677 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:49:50.452597 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 31 00:50:00.452138 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:00.452094 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 31 00:50:06.951035 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:06.951005 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:50:10.452576 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:10.452549 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:50:10.967471 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:10.967443 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9vvz_c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/ovn-acl-logging/0.log" Oct 31 00:50:10.974278 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:10.974247 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9vvz_c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/ovn-acl-logging/0.log" Oct 31 00:50:16.917621 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:16.917591 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:50:18.588212 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:18.588175 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt"] Oct 31 00:50:18.588650 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:18.588457 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="kserve-container" containerID="cri-o://703bd5d611b5255c104564331916a3da433e86dc1580c76197ca21cca1de7cf9" gracePeriod=30 Oct 31 00:50:18.588650 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:18.588518 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="kube-rbac-proxy" containerID="cri-o://8ba9df4cea9dd3ab29d740979ef9dda6bf78961b9223ec1c11ec8369af958d30" gracePeriod=30 Oct 31 00:50:18.713443 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:18.713396 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:50:18.786868 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:18.786836 6591 generic.go:356] "Generic (PLEG): container finished" podID="f8515161-11a2-4299-9935-e373fe201fec" containerID="8ba9df4cea9dd3ab29d740979ef9dda6bf78961b9223ec1c11ec8369af958d30" exitCode=0 Oct 31 00:50:18.787036 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:18.786914 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" event={"ID":"f8515161-11a2-4299-9935-e373fe201fec","Type":"ContainerDied","Data":"8ba9df4cea9dd3ab29d740979ef9dda6bf78961b9223ec1c11ec8369af958d30"} Oct 31 00:50:18.867684 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:50:18.867603 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:50:20.447023 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:20.446984 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.33:8643/healthz\": dial tcp 10.133.0.33:8643: connect: connection refused" Oct 31 00:50:20.452338 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:20.452312 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 31 00:50:23.530821 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.530795 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:50:23.666204 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.666107 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f8515161-11a2-4299-9935-e373fe201fec-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f8515161-11a2-4299-9935-e373fe201fec-cabundle-cert\") pod \"f8515161-11a2-4299-9935-e373fe201fec\" (UID: \"f8515161-11a2-4299-9935-e373fe201fec\") " Oct 31 00:50:23.666355 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.666211 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f8515161-11a2-4299-9935-e373fe201fec-kube-api-access-pt5sn\" (UniqueName: \"kubernetes.io/projected/f8515161-11a2-4299-9935-e373fe201fec-kube-api-access-pt5sn\") pod \"f8515161-11a2-4299-9935-e373fe201fec\" (UID: \"f8515161-11a2-4299-9935-e373fe201fec\") " Oct 31 00:50:23.666355 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.666242 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8515161-11a2-4299-9935-e373fe201fec-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f8515161-11a2-4299-9935-e373fe201fec-kserve-provision-location\") pod \"f8515161-11a2-4299-9935-e373fe201fec\" (UID: \"f8515161-11a2-4299-9935-e373fe201fec\") " Oct 31 00:50:23.666355 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.666259 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f8515161-11a2-4299-9935-e373fe201fec-proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8515161-11a2-4299-9935-e373fe201fec-proxy-tls\") pod \"f8515161-11a2-4299-9935-e373fe201fec\" (UID: \"f8515161-11a2-4299-9935-e373fe201fec\") " Oct 31 00:50:23.666355 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.666290 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f8515161-11a2-4299-9935-e373fe201fec-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f8515161-11a2-4299-9935-e373fe201fec-kube-rbac-proxy-sar-config\") pod \"f8515161-11a2-4299-9935-e373fe201fec\" (UID: \"f8515161-11a2-4299-9935-e373fe201fec\") " Oct 31 00:50:23.666355 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.666308 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8515161-11a2-4299-9935-e373fe201fec-cabundle-cert" pod "f8515161-11a2-4299-9935-e373fe201fec" (UID: "f8515161-11a2-4299-9935-e373fe201fec"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:50:23.666606 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.666569 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8515161-11a2-4299-9935-e373fe201fec-kserve-provision-location" pod "f8515161-11a2-4299-9935-e373fe201fec" (UID: "f8515161-11a2-4299-9935-e373fe201fec"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:50:23.666699 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.666676 6591 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f8515161-11a2-4299-9935-e373fe201fec-cabundle-cert\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:50:23.666699 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.666698 6591 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f8515161-11a2-4299-9935-e373fe201fec-kserve-provision-location\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:50:23.666841 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.666762 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8515161-11a2-4299-9935-e373fe201fec-kube-rbac-proxy-sar-config" pod "f8515161-11a2-4299-9935-e373fe201fec" (UID: "f8515161-11a2-4299-9935-e373fe201fec"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:50:23.668491 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.668469 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8515161-11a2-4299-9935-e373fe201fec-proxy-tls" pod "f8515161-11a2-4299-9935-e373fe201fec" (UID: "f8515161-11a2-4299-9935-e373fe201fec"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:50:23.668567 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.668490 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8515161-11a2-4299-9935-e373fe201fec-kube-api-access-pt5sn" pod "f8515161-11a2-4299-9935-e373fe201fec" (UID: "f8515161-11a2-4299-9935-e373fe201fec"). InnerVolumeSpecName "kube-api-access-pt5sn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:50:23.768046 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.768010 6591 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt5sn\" (UniqueName: \"kubernetes.io/projected/f8515161-11a2-4299-9935-e373fe201fec-kube-api-access-pt5sn\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:50:23.768046 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.768043 6591 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8515161-11a2-4299-9935-e373fe201fec-proxy-tls\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:50:23.768046 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.768052 6591 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f8515161-11a2-4299-9935-e373fe201fec-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:50:23.809137 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.809101 6591 generic.go:356] "Generic (PLEG): container finished" podID="f8515161-11a2-4299-9935-e373fe201fec" containerID="703bd5d611b5255c104564331916a3da433e86dc1580c76197ca21cca1de7cf9" exitCode=0 Oct 31 00:50:23.809318 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.809146 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" event={"ID":"f8515161-11a2-4299-9935-e373fe201fec","Type":"ContainerDied","Data":"703bd5d611b5255c104564331916a3da433e86dc1580c76197ca21cca1de7cf9"} Oct 31 00:50:23.809318 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.809159 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" Oct 31 00:50:23.809318 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.809207 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt" event={"ID":"f8515161-11a2-4299-9935-e373fe201fec","Type":"ContainerDied","Data":"61fb278f1504d64e8a8d5e3e1fcf35cf9197c07588cf5b10bded52ac5ca36b6c"} Oct 31 00:50:23.809318 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.809242 6591 scope.go:122] "RemoveContainer" containerID="8ba9df4cea9dd3ab29d740979ef9dda6bf78961b9223ec1c11ec8369af958d30" Oct 31 00:50:23.825112 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.825088 6591 scope.go:122] "RemoveContainer" containerID="703bd5d611b5255c104564331916a3da433e86dc1580c76197ca21cca1de7cf9" Oct 31 00:50:23.832632 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.832610 6591 scope.go:122] "RemoveContainer" containerID="eefb3084c046fd602f413c4adf71f8fa70881bea51ec05b6594468c5fd7dd1ba" Oct 31 00:50:23.839178 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.839149 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt"] Oct 31 00:50:23.840366 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.840348 6591 scope.go:122] "RemoveContainer" containerID="8ba9df4cea9dd3ab29d740979ef9dda6bf78961b9223ec1c11ec8369af958d30" Oct 31 00:50:23.840667 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:50:23.840648 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ba9df4cea9dd3ab29d740979ef9dda6bf78961b9223ec1c11ec8369af958d30\": container with ID starting with 8ba9df4cea9dd3ab29d740979ef9dda6bf78961b9223ec1c11ec8369af958d30 not found: ID does not exist" containerID="8ba9df4cea9dd3ab29d740979ef9dda6bf78961b9223ec1c11ec8369af958d30" Oct 31 00:50:23.840714 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.840679 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ba9df4cea9dd3ab29d740979ef9dda6bf78961b9223ec1c11ec8369af958d30"} err="failed to get container status \"8ba9df4cea9dd3ab29d740979ef9dda6bf78961b9223ec1c11ec8369af958d30\": rpc error: code = NotFound desc = could not find container \"8ba9df4cea9dd3ab29d740979ef9dda6bf78961b9223ec1c11ec8369af958d30\": container with ID starting with 8ba9df4cea9dd3ab29d740979ef9dda6bf78961b9223ec1c11ec8369af958d30 not found: ID does not exist" Oct 31 00:50:23.840714 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.840697 6591 scope.go:122] "RemoveContainer" containerID="703bd5d611b5255c104564331916a3da433e86dc1580c76197ca21cca1de7cf9" Oct 31 00:50:23.840923 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:50:23.840905 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"703bd5d611b5255c104564331916a3da433e86dc1580c76197ca21cca1de7cf9\": container with ID starting with 703bd5d611b5255c104564331916a3da433e86dc1580c76197ca21cca1de7cf9 not found: ID does not exist" containerID="703bd5d611b5255c104564331916a3da433e86dc1580c76197ca21cca1de7cf9" Oct 31 00:50:23.840970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.840930 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"703bd5d611b5255c104564331916a3da433e86dc1580c76197ca21cca1de7cf9"} err="failed to get container status \"703bd5d611b5255c104564331916a3da433e86dc1580c76197ca21cca1de7cf9\": rpc error: code = NotFound desc = could not find container \"703bd5d611b5255c104564331916a3da433e86dc1580c76197ca21cca1de7cf9\": container with ID starting with 703bd5d611b5255c104564331916a3da433e86dc1580c76197ca21cca1de7cf9 not found: ID does not exist" Oct 31 00:50:23.840970 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.840946 6591 scope.go:122] "RemoveContainer" containerID="eefb3084c046fd602f413c4adf71f8fa70881bea51ec05b6594468c5fd7dd1ba" Oct 31 00:50:23.841159 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:50:23.841135 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eefb3084c046fd602f413c4adf71f8fa70881bea51ec05b6594468c5fd7dd1ba\": container with ID starting with eefb3084c046fd602f413c4adf71f8fa70881bea51ec05b6594468c5fd7dd1ba not found: ID does not exist" containerID="eefb3084c046fd602f413c4adf71f8fa70881bea51ec05b6594468c5fd7dd1ba" Oct 31 00:50:23.841267 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.841164 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eefb3084c046fd602f413c4adf71f8fa70881bea51ec05b6594468c5fd7dd1ba"} err="failed to get container status \"eefb3084c046fd602f413c4adf71f8fa70881bea51ec05b6594468c5fd7dd1ba\": rpc error: code = NotFound desc = could not find container \"eefb3084c046fd602f413c4adf71f8fa70881bea51ec05b6594468c5fd7dd1ba\": container with ID starting with eefb3084c046fd602f413c4adf71f8fa70881bea51ec05b6594468c5fd7dd1ba not found: ID does not exist" Oct 31 00:50:23.844623 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:23.844604 6591 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c950106202/raw-sklearn-runtime-1ce83-predictor-7c49878bd6-xwxmt"] Oct 31 00:50:24.849232 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:24.849203 6591 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f8515161-11a2-4299-9935-e373fe201fec" path="/var/lib/kubelet/pods/f8515161-11a2-4299-9935-e373fe201fec/volumes" Oct 31 00:50:26.069818 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.069784 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh"] Oct 31 00:50:26.070183 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.070093 6591 cpu_manager.go:414] "containerMap: removing container" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="kube-rbac-proxy" Oct 31 00:50:26.070183 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.070103 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="kube-rbac-proxy" Oct 31 00:50:26.070183 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.070115 6591 cpu_manager.go:414] "containerMap: removing container" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="kserve-container" Oct 31 00:50:26.070183 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.070121 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="kserve-container" Oct 31 00:50:26.070183 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.070141 6591 cpu_manager.go:414] "containerMap: removing container" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="storage-initializer" Oct 31 00:50:26.070183 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.070145 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="storage-initializer" Oct 31 00:50:26.070375 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.070198 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="kube-rbac-proxy" Oct 31 00:50:26.070375 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.070206 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="f8515161-11a2-4299-9935-e373fe201fec" containerName="kserve-container" Oct 31 00:50:26.074912 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.074891 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:50:26.085127 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.085098 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh"] Oct 31 00:50:26.085479 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.085463 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"kube-root-ca.crt\"" Oct 31 00:50:26.086132 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.086115 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"isvc-canary-create-kube-rbac-proxy-sar-config\"" Oct 31 00:50:26.086193 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.086182 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"openshift-service-ca.crt\"" Oct 31 00:50:26.086280 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.086238 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"seaweedfs-s3-creds\"" Oct 31 00:50:26.086343 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.086336 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"isvc-canary-create-v2-predictor-serving-cert\"" Oct 31 00:50:26.086488 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.086413 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"default-dockercfg-84b4v\"" Oct 31 00:50:26.086488 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.086490 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"odh-kserve-custom-ca-bundle\"" Oct 31 00:50:26.087999 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.087978 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9fc9094f-42d0-491a-9298-78bce3b5788d-kserve-provision-location\") pod \"isvc-canary-create-v2-predictor-6d6757748b-n54dh\" (UID: \"9fc9094f-42d0-491a-9298-78bce3b5788d\") " pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:50:26.088099 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.088028 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9fc9094f-42d0-491a-9298-78bce3b5788d-cabundle-cert\") pod \"isvc-canary-create-v2-predictor-6d6757748b-n54dh\" (UID: \"9fc9094f-42d0-491a-9298-78bce3b5788d\") " pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:50:26.088099 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.088085 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j85zc\" (UniqueName: \"kubernetes.io/projected/9fc9094f-42d0-491a-9298-78bce3b5788d-kube-api-access-j85zc\") pod \"isvc-canary-create-v2-predictor-6d6757748b-n54dh\" (UID: \"9fc9094f-42d0-491a-9298-78bce3b5788d\") " pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:50:26.088241 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.088163 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9fc9094f-42d0-491a-9298-78bce3b5788d-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-v2-predictor-6d6757748b-n54dh\" (UID: \"9fc9094f-42d0-491a-9298-78bce3b5788d\") " pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:50:26.088241 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.088216 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9fc9094f-42d0-491a-9298-78bce3b5788d-proxy-tls\") pod \"isvc-canary-create-v2-predictor-6d6757748b-n54dh\" (UID: \"9fc9094f-42d0-491a-9298-78bce3b5788d\") " pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:50:26.118535 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.118499 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:50:26.135223 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.135188 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl"] Oct 31 00:50:26.138714 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.138695 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:50:26.147789 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.147764 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl"] Oct 31 00:50:26.184767 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.184736 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"isvc-canary-create-predictor-serving-cert\"" Oct 31 00:50:26.189305 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.189278 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3d369bba-7906-4273-a534-98bdce30a9e7-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-6b447db959-sbhxl\" (UID: \"3d369bba-7906-4273-a534-98bdce30a9e7\") " pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:50:26.189463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.189321 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9fc9094f-42d0-491a-9298-78bce3b5788d-kserve-provision-location\") pod \"isvc-canary-create-v2-predictor-6d6757748b-n54dh\" (UID: \"9fc9094f-42d0-491a-9298-78bce3b5788d\") " pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:50:26.189463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.189391 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3d369bba-7906-4273-a534-98bdce30a9e7-proxy-tls\") pod \"isvc-canary-create-predictor-6b447db959-sbhxl\" (UID: \"3d369bba-7906-4273-a534-98bdce30a9e7\") " pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:50:26.189463 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.189445 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9fc9094f-42d0-491a-9298-78bce3b5788d-cabundle-cert\") pod \"isvc-canary-create-v2-predictor-6d6757748b-n54dh\" (UID: \"9fc9094f-42d0-491a-9298-78bce3b5788d\") " pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:50:26.189628 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.189464 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j85zc\" (UniqueName: \"kubernetes.io/projected/9fc9094f-42d0-491a-9298-78bce3b5788d-kube-api-access-j85zc\") pod \"isvc-canary-create-v2-predictor-6d6757748b-n54dh\" (UID: \"9fc9094f-42d0-491a-9298-78bce3b5788d\") " pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:50:26.189628 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.189490 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9fc9094f-42d0-491a-9298-78bce3b5788d-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-v2-predictor-6d6757748b-n54dh\" (UID: \"9fc9094f-42d0-491a-9298-78bce3b5788d\") " pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:50:26.189628 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.189590 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3d369bba-7906-4273-a534-98bdce30a9e7-cabundle-cert\") pod \"isvc-canary-create-predictor-6b447db959-sbhxl\" (UID: \"3d369bba-7906-4273-a534-98bdce30a9e7\") " pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:50:26.189784 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.189648 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9fc9094f-42d0-491a-9298-78bce3b5788d-proxy-tls\") pod \"isvc-canary-create-v2-predictor-6d6757748b-n54dh\" (UID: \"9fc9094f-42d0-491a-9298-78bce3b5788d\") " pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:50:26.189784 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.189678 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3d369bba-7906-4273-a534-98bdce30a9e7-kserve-provision-location\") pod \"isvc-canary-create-predictor-6b447db959-sbhxl\" (UID: \"3d369bba-7906-4273-a534-98bdce30a9e7\") " pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:50:26.189784 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.189741 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvt9v\" (UniqueName: \"kubernetes.io/projected/3d369bba-7906-4273-a534-98bdce30a9e7-kube-api-access-cvt9v\") pod \"isvc-canary-create-predictor-6b447db959-sbhxl\" (UID: \"3d369bba-7906-4273-a534-98bdce30a9e7\") " pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:50:26.189934 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.189899 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9fc9094f-42d0-491a-9298-78bce3b5788d-kserve-provision-location\") pod \"isvc-canary-create-v2-predictor-6d6757748b-n54dh\" (UID: \"9fc9094f-42d0-491a-9298-78bce3b5788d\") " pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:50:26.190156 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.190140 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9fc9094f-42d0-491a-9298-78bce3b5788d-cabundle-cert\") pod \"isvc-canary-create-v2-predictor-6d6757748b-n54dh\" (UID: \"9fc9094f-42d0-491a-9298-78bce3b5788d\") " pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:50:26.190254 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.190233 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9fc9094f-42d0-491a-9298-78bce3b5788d-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-v2-predictor-6d6757748b-n54dh\" (UID: \"9fc9094f-42d0-491a-9298-78bce3b5788d\") " pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:50:26.192041 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.192021 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9fc9094f-42d0-491a-9298-78bce3b5788d-proxy-tls\") pod \"isvc-canary-create-v2-predictor-6d6757748b-n54dh\" (UID: \"9fc9094f-42d0-491a-9298-78bce3b5788d\") " pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:50:26.197408 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.197383 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j85zc\" (UniqueName: \"kubernetes.io/projected/9fc9094f-42d0-491a-9298-78bce3b5788d-kube-api-access-j85zc\") pod \"isvc-canary-create-v2-predictor-6d6757748b-n54dh\" (UID: \"9fc9094f-42d0-491a-9298-78bce3b5788d\") " pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:50:26.290481 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.290414 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3d369bba-7906-4273-a534-98bdce30a9e7-kserve-provision-location\") pod \"isvc-canary-create-predictor-6b447db959-sbhxl\" (UID: \"3d369bba-7906-4273-a534-98bdce30a9e7\") " pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:50:26.290481 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.290482 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvt9v\" (UniqueName: \"kubernetes.io/projected/3d369bba-7906-4273-a534-98bdce30a9e7-kube-api-access-cvt9v\") pod \"isvc-canary-create-predictor-6b447db959-sbhxl\" (UID: \"3d369bba-7906-4273-a534-98bdce30a9e7\") " pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:50:26.290740 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.290514 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3d369bba-7906-4273-a534-98bdce30a9e7-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-6b447db959-sbhxl\" (UID: \"3d369bba-7906-4273-a534-98bdce30a9e7\") " pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:50:26.290740 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.290586 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3d369bba-7906-4273-a534-98bdce30a9e7-proxy-tls\") pod \"isvc-canary-create-predictor-6b447db959-sbhxl\" (UID: \"3d369bba-7906-4273-a534-98bdce30a9e7\") " pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:50:26.290740 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.290647 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3d369bba-7906-4273-a534-98bdce30a9e7-cabundle-cert\") pod \"isvc-canary-create-predictor-6b447db959-sbhxl\" (UID: \"3d369bba-7906-4273-a534-98bdce30a9e7\") " pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:50:26.290890 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.290831 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3d369bba-7906-4273-a534-98bdce30a9e7-kserve-provision-location\") pod \"isvc-canary-create-predictor-6b447db959-sbhxl\" (UID: \"3d369bba-7906-4273-a534-98bdce30a9e7\") " pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:50:26.291288 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.291249 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3d369bba-7906-4273-a534-98bdce30a9e7-cabundle-cert\") pod \"isvc-canary-create-predictor-6b447db959-sbhxl\" (UID: \"3d369bba-7906-4273-a534-98bdce30a9e7\") " pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:50:26.291288 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.291278 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3d369bba-7906-4273-a534-98bdce30a9e7-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-6b447db959-sbhxl\" (UID: \"3d369bba-7906-4273-a534-98bdce30a9e7\") " pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:50:26.292164 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.292143 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:50:26.293248 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.293230 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3d369bba-7906-4273-a534-98bdce30a9e7-proxy-tls\") pod \"isvc-canary-create-predictor-6b447db959-sbhxl\" (UID: \"3d369bba-7906-4273-a534-98bdce30a9e7\") " pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:50:26.299136 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.299114 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvt9v\" (UniqueName: \"kubernetes.io/projected/3d369bba-7906-4273-a534-98bdce30a9e7-kube-api-access-cvt9v\") pod \"isvc-canary-create-predictor-6b447db959-sbhxl\" (UID: \"3d369bba-7906-4273-a534-98bdce30a9e7\") " pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:50:26.393673 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.393580 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:50:26.458360 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.458151 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:50:26.664491 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.664466 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh"] Oct 31 00:50:26.666478 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:50:26.666452 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc9094f_42d0_491a_9298_78bce3b5788d.slice/crio-953d6421310b7ad2ec871280d7e03d6bcb937c7c23de33661b25370410c2f092 WatchSource:0}: Error finding container 953d6421310b7ad2ec871280d7e03d6bcb937c7c23de33661b25370410c2f092: Status 404 returned error can't find the container with id 953d6421310b7ad2ec871280d7e03d6bcb937c7c23de33661b25370410c2f092 Oct 31 00:50:26.732899 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.732877 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl"] Oct 31 00:50:26.735614 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:50:26.735588 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d369bba_7906_4273_a534_98bdce30a9e7.slice/crio-dfd0d0948edc8a9acf6f322fba6b215c998eabed547fac1271ec6a381ec58280 WatchSource:0}: Error finding container dfd0d0948edc8a9acf6f322fba6b215c998eabed547fac1271ec6a381ec58280: Status 404 returned error can't find the container with id dfd0d0948edc8a9acf6f322fba6b215c998eabed547fac1271ec6a381ec58280 Oct 31 00:50:26.825355 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.825315 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" event={"ID":"9fc9094f-42d0-491a-9298-78bce3b5788d","Type":"ContainerStarted","Data":"2ea86f16a4678febcf54a252943c7a5a498568a53f8d58f0345857620e35ae9a"} Oct 31 00:50:26.825573 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.825390 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" event={"ID":"9fc9094f-42d0-491a-9298-78bce3b5788d","Type":"ContainerStarted","Data":"953d6421310b7ad2ec871280d7e03d6bcb937c7c23de33661b25370410c2f092"} Oct 31 00:50:26.827063 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.827028 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" event={"ID":"3d369bba-7906-4273-a534-98bdce30a9e7","Type":"ContainerStarted","Data":"676af907e96d314e57c18b743189658136df3ca03a4db0bfd3ad1964cfe05a67"} Oct 31 00:50:26.827201 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:26.827092 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" event={"ID":"3d369bba-7906-4273-a534-98bdce30a9e7","Type":"ContainerStarted","Data":"dfd0d0948edc8a9acf6f322fba6b215c998eabed547fac1271ec6a381ec58280"} Oct 31 00:50:30.844520 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:30.844478 6591 generic.go:356] "Generic (PLEG): container finished" podID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerID="2ea86f16a4678febcf54a252943c7a5a498568a53f8d58f0345857620e35ae9a" exitCode=0 Oct 31 00:50:30.846197 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:30.846162 6591 generic.go:356] "Generic (PLEG): container finished" podID="3d369bba-7906-4273-a534-98bdce30a9e7" containerID="676af907e96d314e57c18b743189658136df3ca03a4db0bfd3ad1964cfe05a67" exitCode=0 Oct 31 00:50:30.848964 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:30.848938 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" event={"ID":"9fc9094f-42d0-491a-9298-78bce3b5788d","Type":"ContainerDied","Data":"2ea86f16a4678febcf54a252943c7a5a498568a53f8d58f0345857620e35ae9a"} Oct 31 00:50:30.849057 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:30.848992 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" event={"ID":"3d369bba-7906-4273-a534-98bdce30a9e7","Type":"ContainerDied","Data":"676af907e96d314e57c18b743189658136df3ca03a4db0bfd3ad1964cfe05a67"} Oct 31 00:50:31.853244 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:31.853203 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" event={"ID":"9fc9094f-42d0-491a-9298-78bce3b5788d","Type":"ContainerStarted","Data":"7d1d2535cdde6bd1cb7ffc813cfac2ba6ccb31868cf78dda15642bf9862fc577"} Oct 31 00:50:31.853687 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:31.853291 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" event={"ID":"9fc9094f-42d0-491a-9298-78bce3b5788d","Type":"ContainerStarted","Data":"e0f476a435e98c4a5322cca6f0f91a5e9fe4a57738850ab58e7aa4f9ceae0f36"} Oct 31 00:50:31.853964 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:31.853902 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:50:31.854087 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:31.853989 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:50:31.855701 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:31.855665 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 31 00:50:31.856123 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:31.856098 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" event={"ID":"3d369bba-7906-4273-a534-98bdce30a9e7","Type":"ContainerStarted","Data":"54baede7686b93e49f60d2568188a53007355522fa09d0d4adbf14766a8aac12"} Oct 31 00:50:31.856217 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:31.856146 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" event={"ID":"3d369bba-7906-4273-a534-98bdce30a9e7","Type":"ContainerStarted","Data":"058257d051d21be1404dc461dae13690c0c174fb99c0cfe846ef62063d6e92fc"} Oct 31 00:50:31.856404 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:31.856389 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:50:31.856480 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:31.856456 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:50:31.857646 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:31.857623 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused" Oct 31 00:50:31.873477 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:31.873430 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" podStartSLOduration=1.9651354890000001 podStartE2EDuration="5.873403423s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.908267934s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:50:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:50:31.872170544 +0000 UTC m=+1221.133444417" watchObservedRunningTime="2026-10-31 00:50:31.873403423 +0000 UTC m=+1221.134677296" Oct 31 00:50:31.889931 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:31.889883 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" podStartSLOduration=1.999733601 podStartE2EDuration="5.88987164s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.890138039s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:50:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:50:31.88897829 +0000 UTC m=+1221.150252164" watchObservedRunningTime="2026-10-31 00:50:31.88987164 +0000 UTC m=+1221.151145513" Oct 31 00:50:32.861771 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:32.861716 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused" Oct 31 00:50:32.862174 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:32.861848 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 31 00:50:33.866019 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:33.865968 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 31 00:50:37.866104 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:37.866075 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:50:37.866566 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:37.866541 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused" Oct 31 00:50:38.870270 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:38.870240 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:50:38.870782 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:38.870756 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 31 00:50:47.866745 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:47.866704 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused" Oct 31 00:50:48.865939 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:50:48.865902 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:50:48.871612 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:48.871578 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 31 00:50:57.866839 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:57.866798 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused" Oct 31 00:50:58.870792 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:50:58.870755 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 31 00:51:07.867000 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:07.866960 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused" Oct 31 00:51:08.871245 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:08.871204 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 31 00:51:17.043613 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:17.043573 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:51:17.866725 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:17.866690 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused" Oct 31 00:51:18.865446 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:51:18.865387 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:51:18.871145 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:18.871116 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 31 00:51:27.867236 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:27.867187 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused" Oct 31 00:51:28.871355 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:28.871317 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 31 00:51:37.866807 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:37.866768 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused" Oct 31 00:51:38.870670 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:38.870631 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 31 00:51:47.367638 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:47.367602 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:51:47.867596 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:47.867557 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:51:48.864337 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:51:48.864299 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:51:48.872297 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:48.872275 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:51:56.296303 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:56.296258 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl"] Oct 31 00:51:56.296848 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:56.296667 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="kserve-container" containerID="cri-o://058257d051d21be1404dc461dae13690c0c174fb99c0cfe846ef62063d6e92fc" gracePeriod=30 Oct 31 00:51:56.297098 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:56.297064 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="kube-rbac-proxy" containerID="cri-o://54baede7686b93e49f60d2568188a53007355522fa09d0d4adbf14766a8aac12" gracePeriod=30 Oct 31 00:51:56.299644 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:56.299605 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh"] Oct 31 00:51:56.299965 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:56.299920 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="kserve-container" containerID="cri-o://e0f476a435e98c4a5322cca6f0f91a5e9fe4a57738850ab58e7aa4f9ceae0f36" gracePeriod=30 Oct 31 00:51:56.300273 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:56.299985 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="kube-rbac-proxy" containerID="cri-o://7d1d2535cdde6bd1cb7ffc813cfac2ba6ccb31868cf78dda15642bf9862fc577" gracePeriod=30 Oct 31 00:51:56.427797 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:56.427770 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:51:56.600373 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:56.600284 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:51:57.217242 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:57.217206 6591 generic.go:356] "Generic (PLEG): container finished" podID="3d369bba-7906-4273-a534-98bdce30a9e7" containerID="54baede7686b93e49f60d2568188a53007355522fa09d0d4adbf14766a8aac12" exitCode=0 Oct 31 00:51:57.217446 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:57.217279 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" event={"ID":"3d369bba-7906-4273-a534-98bdce30a9e7","Type":"ContainerDied","Data":"54baede7686b93e49f60d2568188a53007355522fa09d0d4adbf14766a8aac12"} Oct 31 00:51:57.219457 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:57.219434 6591 generic.go:356] "Generic (PLEG): container finished" podID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerID="7d1d2535cdde6bd1cb7ffc813cfac2ba6ccb31868cf78dda15642bf9862fc577" exitCode=0 Oct 31 00:51:57.219576 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:57.219469 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" event={"ID":"9fc9094f-42d0-491a-9298-78bce3b5788d","Type":"ContainerDied","Data":"7d1d2535cdde6bd1cb7ffc813cfac2ba6ccb31868cf78dda15642bf9862fc577"} Oct 31 00:51:57.862645 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:57.862602 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.35:8643/healthz\": dial tcp 10.133.0.35:8643: connect: connection refused" Oct 31 00:51:57.866934 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:57.866913 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused" Oct 31 00:51:58.866711 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:58.866674 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.34:8643/healthz\": dial tcp 10.133.0.34:8643: connect: connection refused" Oct 31 00:51:58.870947 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:51:58.870925 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 31 00:52:00.696297 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:00.696251 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:01.237786 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.237760 6591 generic.go:356] "Generic (PLEG): container finished" podID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerID="e0f476a435e98c4a5322cca6f0f91a5e9fe4a57738850ab58e7aa4f9ceae0f36" exitCode=0 Oct 31 00:52:01.237913 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.237829 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" event={"ID":"9fc9094f-42d0-491a-9298-78bce3b5788d","Type":"ContainerDied","Data":"e0f476a435e98c4a5322cca6f0f91a5e9fe4a57738850ab58e7aa4f9ceae0f36"} Oct 31 00:52:01.241920 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.241883 6591 generic.go:356] "Generic (PLEG): container finished" podID="3d369bba-7906-4273-a534-98bdce30a9e7" containerID="058257d051d21be1404dc461dae13690c0c174fb99c0cfe846ef62063d6e92fc" exitCode=0 Oct 31 00:52:01.242057 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.241981 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" event={"ID":"3d369bba-7906-4273-a534-98bdce30a9e7","Type":"ContainerDied","Data":"058257d051d21be1404dc461dae13690c0c174fb99c0cfe846ef62063d6e92fc"} Oct 31 00:52:01.372810 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.372788 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:52:01.375654 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.375634 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:52:01.503767 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.503686 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3d369bba-7906-4273-a534-98bdce30a9e7-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3d369bba-7906-4273-a534-98bdce30a9e7-kube-rbac-proxy-sar-config\") pod \"3d369bba-7906-4273-a534-98bdce30a9e7\" (UID: \"3d369bba-7906-4273-a534-98bdce30a9e7\") " Oct 31 00:52:01.503767 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.503760 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9fc9094f-42d0-491a-9298-78bce3b5788d-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9fc9094f-42d0-491a-9298-78bce3b5788d-cabundle-cert\") pod \"9fc9094f-42d0-491a-9298-78bce3b5788d\" (UID: \"9fc9094f-42d0-491a-9298-78bce3b5788d\") " Oct 31 00:52:01.503955 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.503865 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9fc9094f-42d0-491a-9298-78bce3b5788d-kube-api-access-j85zc\" (UniqueName: \"kubernetes.io/projected/9fc9094f-42d0-491a-9298-78bce3b5788d-kube-api-access-j85zc\") pod \"9fc9094f-42d0-491a-9298-78bce3b5788d\" (UID: \"9fc9094f-42d0-491a-9298-78bce3b5788d\") " Oct 31 00:52:01.503955 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.503905 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9fc9094f-42d0-491a-9298-78bce3b5788d-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9fc9094f-42d0-491a-9298-78bce3b5788d-kserve-provision-location\") pod \"9fc9094f-42d0-491a-9298-78bce3b5788d\" (UID: \"9fc9094f-42d0-491a-9298-78bce3b5788d\") " Oct 31 00:52:01.503955 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.503932 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3d369bba-7906-4273-a534-98bdce30a9e7-kube-api-access-cvt9v\" (UniqueName: \"kubernetes.io/projected/3d369bba-7906-4273-a534-98bdce30a9e7-kube-api-access-cvt9v\") pod \"3d369bba-7906-4273-a534-98bdce30a9e7\" (UID: \"3d369bba-7906-4273-a534-98bdce30a9e7\") " Oct 31 00:52:01.504071 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.504004 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9fc9094f-42d0-491a-9298-78bce3b5788d-proxy-tls\" (UniqueName: \"kubernetes.io/secret/9fc9094f-42d0-491a-9298-78bce3b5788d-proxy-tls\") pod \"9fc9094f-42d0-491a-9298-78bce3b5788d\" (UID: \"9fc9094f-42d0-491a-9298-78bce3b5788d\") " Oct 31 00:52:01.504071 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.504034 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3d369bba-7906-4273-a534-98bdce30a9e7-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3d369bba-7906-4273-a534-98bdce30a9e7-cabundle-cert\") pod \"3d369bba-7906-4273-a534-98bdce30a9e7\" (UID: \"3d369bba-7906-4273-a534-98bdce30a9e7\") " Oct 31 00:52:01.504071 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.504048 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d369bba-7906-4273-a534-98bdce30a9e7-kube-rbac-proxy-sar-config" pod "3d369bba-7906-4273-a534-98bdce30a9e7" (UID: "3d369bba-7906-4273-a534-98bdce30a9e7"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:52:01.504236 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.504073 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9fc9094f-42d0-491a-9298-78bce3b5788d-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9fc9094f-42d0-491a-9298-78bce3b5788d-kube-rbac-proxy-sar-config\") pod \"9fc9094f-42d0-491a-9298-78bce3b5788d\" (UID: \"9fc9094f-42d0-491a-9298-78bce3b5788d\") " Oct 31 00:52:01.504236 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.504077 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fc9094f-42d0-491a-9298-78bce3b5788d-cabundle-cert" pod "9fc9094f-42d0-491a-9298-78bce3b5788d" (UID: "9fc9094f-42d0-491a-9298-78bce3b5788d"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:52:01.504236 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.504101 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3d369bba-7906-4273-a534-98bdce30a9e7-proxy-tls\" (UniqueName: \"kubernetes.io/secret/3d369bba-7906-4273-a534-98bdce30a9e7-proxy-tls\") pod \"3d369bba-7906-4273-a534-98bdce30a9e7\" (UID: \"3d369bba-7906-4273-a534-98bdce30a9e7\") " Oct 31 00:52:01.504236 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.504139 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d369bba-7906-4273-a534-98bdce30a9e7-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3d369bba-7906-4273-a534-98bdce30a9e7-kserve-provision-location\") pod \"3d369bba-7906-4273-a534-98bdce30a9e7\" (UID: \"3d369bba-7906-4273-a534-98bdce30a9e7\") " Oct 31 00:52:01.504236 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.504223 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fc9094f-42d0-491a-9298-78bce3b5788d-kserve-provision-location" pod "9fc9094f-42d0-491a-9298-78bce3b5788d" (UID: "9fc9094f-42d0-491a-9298-78bce3b5788d"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:52:01.504531 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.504501 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d369bba-7906-4273-a534-98bdce30a9e7-kserve-provision-location" pod "3d369bba-7906-4273-a534-98bdce30a9e7" (UID: "3d369bba-7906-4273-a534-98bdce30a9e7"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:52:01.504531 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.504509 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fc9094f-42d0-491a-9298-78bce3b5788d-kube-rbac-proxy-sar-config" pod "9fc9094f-42d0-491a-9298-78bce3b5788d" (UID: "9fc9094f-42d0-491a-9298-78bce3b5788d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:52:01.504531 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.504509 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d369bba-7906-4273-a534-98bdce30a9e7-cabundle-cert" pod "3d369bba-7906-4273-a534-98bdce30a9e7" (UID: "3d369bba-7906-4273-a534-98bdce30a9e7"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:52:01.504656 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.504529 6591 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3d369bba-7906-4273-a534-98bdce30a9e7-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:52:01.504656 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.504552 6591 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9fc9094f-42d0-491a-9298-78bce3b5788d-cabundle-cert\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:52:01.504656 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.504568 6591 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9fc9094f-42d0-491a-9298-78bce3b5788d-kserve-provision-location\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:52:01.506264 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.506242 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fc9094f-42d0-491a-9298-78bce3b5788d-proxy-tls" pod "9fc9094f-42d0-491a-9298-78bce3b5788d" (UID: "9fc9094f-42d0-491a-9298-78bce3b5788d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:52:01.506381 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.506364 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d369bba-7906-4273-a534-98bdce30a9e7-proxy-tls" pod "3d369bba-7906-4273-a534-98bdce30a9e7" (UID: "3d369bba-7906-4273-a534-98bdce30a9e7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:52:01.506681 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.506656 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fc9094f-42d0-491a-9298-78bce3b5788d-kube-api-access-j85zc" pod "9fc9094f-42d0-491a-9298-78bce3b5788d" (UID: "9fc9094f-42d0-491a-9298-78bce3b5788d"). InnerVolumeSpecName "kube-api-access-j85zc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:52:01.506681 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.506649 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d369bba-7906-4273-a534-98bdce30a9e7-kube-api-access-cvt9v" pod "3d369bba-7906-4273-a534-98bdce30a9e7" (UID: "3d369bba-7906-4273-a534-98bdce30a9e7"). InnerVolumeSpecName "kube-api-access-cvt9v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:52:01.605297 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.605261 6591 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9fc9094f-42d0-491a-9298-78bce3b5788d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:52:01.605297 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.605294 6591 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3d369bba-7906-4273-a534-98bdce30a9e7-proxy-tls\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:52:01.605297 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.605306 6591 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3d369bba-7906-4273-a534-98bdce30a9e7-kserve-provision-location\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:52:01.605523 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.605316 6591 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j85zc\" (UniqueName: \"kubernetes.io/projected/9fc9094f-42d0-491a-9298-78bce3b5788d-kube-api-access-j85zc\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:52:01.605523 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.605325 6591 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvt9v\" (UniqueName: \"kubernetes.io/projected/3d369bba-7906-4273-a534-98bdce30a9e7-kube-api-access-cvt9v\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:52:01.605523 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.605332 6591 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9fc9094f-42d0-491a-9298-78bce3b5788d-proxy-tls\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:52:01.605523 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:01.605341 6591 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3d369bba-7906-4273-a534-98bdce30a9e7-cabundle-cert\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:52:02.248220 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.248193 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" Oct 31 00:52:02.248759 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.248187 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh" event={"ID":"9fc9094f-42d0-491a-9298-78bce3b5788d","Type":"ContainerDied","Data":"953d6421310b7ad2ec871280d7e03d6bcb937c7c23de33661b25370410c2f092"} Oct 31 00:52:02.248759 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.248345 6591 scope.go:122] "RemoveContainer" containerID="7d1d2535cdde6bd1cb7ffc813cfac2ba6ccb31868cf78dda15642bf9862fc577" Oct 31 00:52:02.250307 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.250279 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" event={"ID":"3d369bba-7906-4273-a534-98bdce30a9e7","Type":"ContainerDied","Data":"dfd0d0948edc8a9acf6f322fba6b215c998eabed547fac1271ec6a381ec58280"} Oct 31 00:52:02.250307 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.250301 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl" Oct 31 00:52:02.257100 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.257081 6591 scope.go:122] "RemoveContainer" containerID="e0f476a435e98c4a5322cca6f0f91a5e9fe4a57738850ab58e7aa4f9ceae0f36" Oct 31 00:52:02.264728 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.264712 6591 scope.go:122] "RemoveContainer" containerID="2ea86f16a4678febcf54a252943c7a5a498568a53f8d58f0345857620e35ae9a" Oct 31 00:52:02.274185 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.274161 6591 scope.go:122] "RemoveContainer" containerID="54baede7686b93e49f60d2568188a53007355522fa09d0d4adbf14766a8aac12" Oct 31 00:52:02.275606 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.275586 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh"] Oct 31 00:52:02.277664 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.277644 6591 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-create-v2-predictor-6d6757748b-n54dh"] Oct 31 00:52:02.282560 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.282540 6591 scope.go:122] "RemoveContainer" containerID="058257d051d21be1404dc461dae13690c0c174fb99c0cfe846ef62063d6e92fc" Oct 31 00:52:02.288605 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.288583 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl"] Oct 31 00:52:02.289898 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.289884 6591 scope.go:122] "RemoveContainer" containerID="676af907e96d314e57c18b743189658136df3ca03a4db0bfd3ad1964cfe05a67" Oct 31 00:52:02.296076 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.296055 6591 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-create-predictor-6b447db959-sbhxl"] Oct 31 00:52:02.849353 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.849315 6591 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" path="/var/lib/kubelet/pods/3d369bba-7906-4273-a534-98bdce30a9e7/volumes" Oct 31 00:52:02.849926 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.849907 6591 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" path="/var/lib/kubelet/pods/9fc9094f-42d0-491a-9298-78bce3b5788d/volumes" Oct 31 00:52:02.899057 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.899029 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt"] Oct 31 00:52:02.899382 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.899369 6591 cpu_manager.go:414] "containerMap: removing container" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="storage-initializer" Oct 31 00:52:02.899449 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.899384 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="storage-initializer" Oct 31 00:52:02.899449 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.899402 6591 cpu_manager.go:414] "containerMap: removing container" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="kube-rbac-proxy" Oct 31 00:52:02.899449 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.899408 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="kube-rbac-proxy" Oct 31 00:52:02.899449 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.899435 6591 cpu_manager.go:414] "containerMap: removing container" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="kube-rbac-proxy" Oct 31 00:52:02.899449 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.899441 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="kube-rbac-proxy" Oct 31 00:52:02.899449 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.899449 6591 cpu_manager.go:414] "containerMap: removing container" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="kserve-container" Oct 31 00:52:02.899633 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.899455 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="kserve-container" Oct 31 00:52:02.899633 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.899470 6591 cpu_manager.go:414] "containerMap: removing container" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="storage-initializer" Oct 31 00:52:02.899633 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.899474 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="storage-initializer" Oct 31 00:52:02.899633 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.899481 6591 cpu_manager.go:414] "containerMap: removing container" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="kserve-container" Oct 31 00:52:02.899633 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.899487 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="kserve-container" Oct 31 00:52:02.899633 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.899547 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="kserve-container" Oct 31 00:52:02.899633 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.899557 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="kube-rbac-proxy" Oct 31 00:52:02.899633 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.899564 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="3d369bba-7906-4273-a534-98bdce30a9e7" containerName="kube-rbac-proxy" Oct 31 00:52:02.899633 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.899571 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="9fc9094f-42d0-491a-9298-78bce3b5788d" containerName="kserve-container" Oct 31 00:52:02.904472 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.904448 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:52:02.913434 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.913398 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt"] Oct 31 00:52:02.935578 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.935549 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"isvc-canary-promote-predictor-serving-cert\"" Oct 31 00:52:02.935578 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.935580 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"seaweedfs-s3-creds\"" Oct 31 00:52:02.935801 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.935663 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"default-dockercfg-84b4v\"" Oct 31 00:52:02.938001 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.937976 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:02.998324 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.998298 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"openshift-service-ca.crt\"" Oct 31 00:52:02.998324 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.998314 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"isvc-canary-promote-kube-rbac-proxy-sar-config\"" Oct 31 00:52:02.998324 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.998319 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"kube-root-ca.crt\"" Oct 31 00:52:02.998561 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:02.998322 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c950106202\"/\"odh-kserve-custom-ca-bundle\"" Oct 31 00:52:03.018033 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:03.018002 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zd6w\" (UniqueName: \"kubernetes.io/projected/fa6cafaa-fcf8-4070-992c-7165d57153be-kube-api-access-2zd6w\") pod \"isvc-canary-promote-predictor-5cdb4c96cc-48tnt\" (UID: \"fa6cafaa-fcf8-4070-992c-7165d57153be\") " pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:52:03.018158 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:03.018045 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fa6cafaa-fcf8-4070-992c-7165d57153be-proxy-tls\") pod \"isvc-canary-promote-predictor-5cdb4c96cc-48tnt\" (UID: \"fa6cafaa-fcf8-4070-992c-7165d57153be\") " pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:52:03.018158 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:03.018060 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fa6cafaa-fcf8-4070-992c-7165d57153be-kserve-provision-location\") pod \"isvc-canary-promote-predictor-5cdb4c96cc-48tnt\" (UID: \"fa6cafaa-fcf8-4070-992c-7165d57153be\") " pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:52:03.018247 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:03.018186 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fa6cafaa-fcf8-4070-992c-7165d57153be-cabundle-cert\") pod \"isvc-canary-promote-predictor-5cdb4c96cc-48tnt\" (UID: \"fa6cafaa-fcf8-4070-992c-7165d57153be\") " pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:52:03.018247 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:03.018210 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fa6cafaa-fcf8-4070-992c-7165d57153be-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-5cdb4c96cc-48tnt\" (UID: \"fa6cafaa-fcf8-4070-992c-7165d57153be\") " pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:52:03.117249 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:03.117178 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:03.119316 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:03.119286 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zd6w\" (UniqueName: \"kubernetes.io/projected/fa6cafaa-fcf8-4070-992c-7165d57153be-kube-api-access-2zd6w\") pod \"isvc-canary-promote-predictor-5cdb4c96cc-48tnt\" (UID: \"fa6cafaa-fcf8-4070-992c-7165d57153be\") " pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:52:03.119494 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:03.119330 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fa6cafaa-fcf8-4070-992c-7165d57153be-proxy-tls\") pod \"isvc-canary-promote-predictor-5cdb4c96cc-48tnt\" (UID: \"fa6cafaa-fcf8-4070-992c-7165d57153be\") " pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:52:03.119494 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:03.119348 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fa6cafaa-fcf8-4070-992c-7165d57153be-kserve-provision-location\") pod \"isvc-canary-promote-predictor-5cdb4c96cc-48tnt\" (UID: \"fa6cafaa-fcf8-4070-992c-7165d57153be\") " pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:52:03.119494 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:03.119409 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fa6cafaa-fcf8-4070-992c-7165d57153be-cabundle-cert\") pod \"isvc-canary-promote-predictor-5cdb4c96cc-48tnt\" (UID: \"fa6cafaa-fcf8-4070-992c-7165d57153be\") " pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:52:03.119494 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:03.119452 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fa6cafaa-fcf8-4070-992c-7165d57153be-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-5cdb4c96cc-48tnt\" (UID: \"fa6cafaa-fcf8-4070-992c-7165d57153be\") " pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:52:03.119869 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:03.119848 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fa6cafaa-fcf8-4070-992c-7165d57153be-kserve-provision-location\") pod \"isvc-canary-promote-predictor-5cdb4c96cc-48tnt\" (UID: \"fa6cafaa-fcf8-4070-992c-7165d57153be\") " pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:52:03.120159 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:03.120142 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fa6cafaa-fcf8-4070-992c-7165d57153be-cabundle-cert\") pod \"isvc-canary-promote-predictor-5cdb4c96cc-48tnt\" (UID: \"fa6cafaa-fcf8-4070-992c-7165d57153be\") " pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:52:03.120256 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:03.120161 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fa6cafaa-fcf8-4070-992c-7165d57153be-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-5cdb4c96cc-48tnt\" (UID: \"fa6cafaa-fcf8-4070-992c-7165d57153be\") " pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:52:03.121982 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:03.121963 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fa6cafaa-fcf8-4070-992c-7165d57153be-proxy-tls\") pod \"isvc-canary-promote-predictor-5cdb4c96cc-48tnt\" (UID: \"fa6cafaa-fcf8-4070-992c-7165d57153be\") " pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:52:03.128917 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:03.128894 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zd6w\" (UniqueName: \"kubernetes.io/projected/fa6cafaa-fcf8-4070-992c-7165d57153be-kube-api-access-2zd6w\") pod \"isvc-canary-promote-predictor-5cdb4c96cc-48tnt\" (UID: \"fa6cafaa-fcf8-4070-992c-7165d57153be\") " pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:52:03.222891 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:03.222859 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:52:03.496446 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:03.496349 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt"] Oct 31 00:52:03.499576 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:52:03.499548 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa6cafaa_fcf8_4070_992c_7165d57153be.slice/crio-52886779fd4e53af95fb0802f4ce5a3f994aefcfba9f8aed7904f30364b349ca WatchSource:0}: Error finding container 52886779fd4e53af95fb0802f4ce5a3f994aefcfba9f8aed7904f30364b349ca: Status 404 returned error can't find the container with id 52886779fd4e53af95fb0802f4ce5a3f994aefcfba9f8aed7904f30364b349ca Oct 31 00:52:04.262328 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:04.262294 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" event={"ID":"fa6cafaa-fcf8-4070-992c-7165d57153be","Type":"ContainerStarted","Data":"01a2505d6a835da9d953283a0d869f16ede51977a4c02df9a1e280bceea54239"} Oct 31 00:52:04.262530 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:04.262349 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" event={"ID":"fa6cafaa-fcf8-4070-992c-7165d57153be","Type":"ContainerStarted","Data":"52886779fd4e53af95fb0802f4ce5a3f994aefcfba9f8aed7904f30364b349ca"} Oct 31 00:52:05.745722 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:05.745685 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:07.276060 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:07.276024 6591 generic.go:356] "Generic (PLEG): container finished" podID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerID="01a2505d6a835da9d953283a0d869f16ede51977a4c02df9a1e280bceea54239" exitCode=0 Oct 31 00:52:07.276551 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:07.276086 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" event={"ID":"fa6cafaa-fcf8-4070-992c-7165d57153be","Type":"ContainerDied","Data":"01a2505d6a835da9d953283a0d869f16ede51977a4c02df9a1e280bceea54239"} Oct 31 00:52:08.285925 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:08.285892 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" event={"ID":"fa6cafaa-fcf8-4070-992c-7165d57153be","Type":"ContainerStarted","Data":"42ff624b96b708eb9cfdc0f36f1d34924ef4b136f68abe3a9e9a011b3a6227a8"} Oct 31 00:52:08.286382 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:08.285954 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" event={"ID":"fa6cafaa-fcf8-4070-992c-7165d57153be","Type":"ContainerStarted","Data":"e945eb7ebe0fad38ef785feaed94aab1c4ec8af1eb797a24b99b6e638c21dbd4"} Oct 31 00:52:08.286382 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:08.286197 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:52:08.286382 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:08.286299 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:52:08.288247 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:08.288216 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused" Oct 31 00:52:08.304345 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:08.304286 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" podStartSLOduration=2.656174118 podStartE2EDuration="6.304269037s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.648094919s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:52:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:52:08.303925744 +0000 UTC m=+1317.565199620" watchObservedRunningTime="2026-10-31 00:52:08.304269037 +0000 UTC m=+1317.565542912" Oct 31 00:52:09.290389 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:09.290352 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused" Oct 31 00:52:14.294650 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:14.294615 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:52:14.295141 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:14.295112 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused" Oct 31 00:52:17.097136 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:17.097106 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:18.865803 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:52:18.865769 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:52:24.295998 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:24.295957 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused" Oct 31 00:52:34.295050 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:34.295011 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused" Oct 31 00:52:44.027980 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:44.027942 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:44.202240 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:44.202189 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:44.295222 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:44.295120 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused" Oct 31 00:52:44.381351 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:44.381316 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:44.557336 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:44.557238 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:44.918071 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:44.917978 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:48.867412 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:52:48.867373 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:52:50.063482 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:50.063412 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:50.232565 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:50.232531 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:52:54.295245 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:52:54.295206 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused" Oct 31 00:53:04.295930 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:04.295890 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused" Oct 31 00:53:14.295200 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:14.295156 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused" Oct 31 00:53:17.139908 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:17.139869 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:53:18.864320 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:53:18.864279 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:53:20.846898 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:20.846845 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused" Oct 31 00:53:29.923725 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:29.923690 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt"] Oct 31 00:53:29.924168 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:29.923957 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="kserve-container" containerID="cri-o://e945eb7ebe0fad38ef785feaed94aab1c4ec8af1eb797a24b99b6e638c21dbd4" gracePeriod=30 Oct 31 00:53:29.924168 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:29.924020 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="kube-rbac-proxy" containerID="cri-o://42ff624b96b708eb9cfdc0f36f1d34924ef4b136f68abe3a9e9a011b3a6227a8" gracePeriod=30 Oct 31 00:53:29.925460 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:29.925438 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:53:30.622090 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:30.622057 6591 generic.go:356] "Generic (PLEG): container finished" podID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerID="42ff624b96b708eb9cfdc0f36f1d34924ef4b136f68abe3a9e9a011b3a6227a8" exitCode=0 Oct 31 00:53:30.622261 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:30.622108 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" event={"ID":"fa6cafaa-fcf8-4070-992c-7165d57153be","Type":"ContainerDied","Data":"42ff624b96b708eb9cfdc0f36f1d34924ef4b136f68abe3a9e9a011b3a6227a8"} Oct 31 00:53:33.227859 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.227823 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz"] Oct 31 00:53:33.233482 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.233458 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:53:33.242730 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.242709 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c950106202\"/\"isvc-canary-promote-v2-predictor-serving-cert\"" Oct 31 00:53:33.243962 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.243941 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz"] Oct 31 00:53:33.368153 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.368119 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-5997987886-jnwdz\" (UID: \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\") " pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:53:33.368357 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.368188 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-5997987886-jnwdz\" (UID: \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\") " pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:53:33.368357 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.368294 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-5997987886-jnwdz\" (UID: \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\") " pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:53:33.368357 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.368316 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4trql\" (UniqueName: \"kubernetes.io/projected/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kube-api-access-4trql\") pod \"isvc-canary-promote-v2-predictor-5997987886-jnwdz\" (UID: \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\") " pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:53:33.368538 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.368405 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-5997987886-jnwdz\" (UID: \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\") " pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:53:33.469391 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.469351 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-5997987886-jnwdz\" (UID: \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\") " pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:53:33.469608 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.469409 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-5997987886-jnwdz\" (UID: \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\") " pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:53:33.469608 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.469467 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4trql\" (UniqueName: \"kubernetes.io/projected/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kube-api-access-4trql\") pod \"isvc-canary-promote-v2-predictor-5997987886-jnwdz\" (UID: \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\") " pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:53:33.469608 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.469503 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-5997987886-jnwdz\" (UID: \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\") " pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:53:33.469608 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.469539 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-5997987886-jnwdz\" (UID: \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\") " pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:53:33.469883 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.469858 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-5997987886-jnwdz\" (UID: \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\") " pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:53:33.470134 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.470110 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-5997987886-jnwdz\" (UID: \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\") " pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:53:33.470242 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.470190 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-5997987886-jnwdz\" (UID: \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\") " pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:53:33.472068 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.472043 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-5997987886-jnwdz\" (UID: \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\") " pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:53:33.478043 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.477990 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4trql\" (UniqueName: \"kubernetes.io/projected/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kube-api-access-4trql\") pod \"isvc-canary-promote-v2-predictor-5997987886-jnwdz\" (UID: \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\") " pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:53:33.550813 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.550778 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:53:33.825663 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:33.825628 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz"] Oct 31 00:53:33.828822 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:53:33.828794 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa3bce2b_079b_4b28_9b16_bdcdf7d66502.slice/crio-9c7597fa873088b219b0c42406c9e1c61df9d95960bd39741fa8caf902f7acae WatchSource:0}: Error finding container 9c7597fa873088b219b0c42406c9e1c61df9d95960bd39741fa8caf902f7acae: Status 404 returned error can't find the container with id 9c7597fa873088b219b0c42406c9e1c61df9d95960bd39741fa8caf902f7acae Oct 31 00:53:34.291628 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.291587 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.36:8643/healthz\": dial tcp 10.133.0.36:8643: connect: connection refused" Oct 31 00:53:34.507856 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.507821 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:53:34.641846 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.641817 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" event={"ID":"fa3bce2b-079b-4b28-9b16-bdcdf7d66502","Type":"ContainerStarted","Data":"3b19267f33c13adf90902a3f69a67cf42fc165c1305cd560eab3265d52c04f66"} Oct 31 00:53:34.642055 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.641885 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" event={"ID":"fa3bce2b-079b-4b28-9b16-bdcdf7d66502","Type":"ContainerStarted","Data":"9c7597fa873088b219b0c42406c9e1c61df9d95960bd39741fa8caf902f7acae"} Oct 31 00:53:34.644128 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.644107 6591 generic.go:356] "Generic (PLEG): container finished" podID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerID="e945eb7ebe0fad38ef785feaed94aab1c4ec8af1eb797a24b99b6e638c21dbd4" exitCode=0 Oct 31 00:53:34.644238 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.644159 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" event={"ID":"fa6cafaa-fcf8-4070-992c-7165d57153be","Type":"ContainerDied","Data":"e945eb7ebe0fad38ef785feaed94aab1c4ec8af1eb797a24b99b6e638c21dbd4"} Oct 31 00:53:34.778038 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.778012 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:53:34.880656 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.880585 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa6cafaa-fcf8-4070-992c-7165d57153be-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fa6cafaa-fcf8-4070-992c-7165d57153be-cabundle-cert\") pod \"fa6cafaa-fcf8-4070-992c-7165d57153be\" (UID: \"fa6cafaa-fcf8-4070-992c-7165d57153be\") " Oct 31 00:53:34.880656 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.880643 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fa6cafaa-fcf8-4070-992c-7165d57153be-proxy-tls\" (UniqueName: \"kubernetes.io/secret/fa6cafaa-fcf8-4070-992c-7165d57153be-proxy-tls\") pod \"fa6cafaa-fcf8-4070-992c-7165d57153be\" (UID: \"fa6cafaa-fcf8-4070-992c-7165d57153be\") " Oct 31 00:53:34.880841 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.880697 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa6cafaa-fcf8-4070-992c-7165d57153be-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fa6cafaa-fcf8-4070-992c-7165d57153be-kserve-provision-location\") pod \"fa6cafaa-fcf8-4070-992c-7165d57153be\" (UID: \"fa6cafaa-fcf8-4070-992c-7165d57153be\") " Oct 31 00:53:34.880841 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.880739 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa6cafaa-fcf8-4070-992c-7165d57153be-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fa6cafaa-fcf8-4070-992c-7165d57153be-kube-rbac-proxy-sar-config\") pod \"fa6cafaa-fcf8-4070-992c-7165d57153be\" (UID: \"fa6cafaa-fcf8-4070-992c-7165d57153be\") " Oct 31 00:53:34.880841 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.880818 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa6cafaa-fcf8-4070-992c-7165d57153be-kube-api-access-2zd6w\" (UniqueName: \"kubernetes.io/projected/fa6cafaa-fcf8-4070-992c-7165d57153be-kube-api-access-2zd6w\") pod \"fa6cafaa-fcf8-4070-992c-7165d57153be\" (UID: \"fa6cafaa-fcf8-4070-992c-7165d57153be\") " Oct 31 00:53:34.881044 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.881018 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa6cafaa-fcf8-4070-992c-7165d57153be-kserve-provision-location" pod "fa6cafaa-fcf8-4070-992c-7165d57153be" (UID: "fa6cafaa-fcf8-4070-992c-7165d57153be"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:53:34.881115 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.881057 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa6cafaa-fcf8-4070-992c-7165d57153be-cabundle-cert" pod "fa6cafaa-fcf8-4070-992c-7165d57153be" (UID: "fa6cafaa-fcf8-4070-992c-7165d57153be"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:53:34.881115 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.881080 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa6cafaa-fcf8-4070-992c-7165d57153be-kube-rbac-proxy-sar-config" pod "fa6cafaa-fcf8-4070-992c-7165d57153be" (UID: "fa6cafaa-fcf8-4070-992c-7165d57153be"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:53:34.882901 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.882882 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa6cafaa-fcf8-4070-992c-7165d57153be-proxy-tls" pod "fa6cafaa-fcf8-4070-992c-7165d57153be" (UID: "fa6cafaa-fcf8-4070-992c-7165d57153be"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:53:34.883097 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.883076 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa6cafaa-fcf8-4070-992c-7165d57153be-kube-api-access-2zd6w" pod "fa6cafaa-fcf8-4070-992c-7165d57153be" (UID: "fa6cafaa-fcf8-4070-992c-7165d57153be"). InnerVolumeSpecName "kube-api-access-2zd6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:53:34.982224 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.982189 6591 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zd6w\" (UniqueName: \"kubernetes.io/projected/fa6cafaa-fcf8-4070-992c-7165d57153be-kube-api-access-2zd6w\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:53:34.982224 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.982213 6591 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fa6cafaa-fcf8-4070-992c-7165d57153be-cabundle-cert\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:53:34.982224 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.982223 6591 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fa6cafaa-fcf8-4070-992c-7165d57153be-proxy-tls\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:53:34.982224 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.982232 6591 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fa6cafaa-fcf8-4070-992c-7165d57153be-kserve-provision-location\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:53:34.982595 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:34.982241 6591 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fa6cafaa-fcf8-4070-992c-7165d57153be-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:53:35.650283 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:35.650249 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" Oct 31 00:53:35.650283 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:35.650265 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt" event={"ID":"fa6cafaa-fcf8-4070-992c-7165d57153be","Type":"ContainerDied","Data":"52886779fd4e53af95fb0802f4ce5a3f994aefcfba9f8aed7904f30364b349ca"} Oct 31 00:53:35.650768 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:35.650325 6591 scope.go:122] "RemoveContainer" containerID="42ff624b96b708eb9cfdc0f36f1d34924ef4b136f68abe3a9e9a011b3a6227a8" Oct 31 00:53:35.658606 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:35.658588 6591 scope.go:122] "RemoveContainer" containerID="e945eb7ebe0fad38ef785feaed94aab1c4ec8af1eb797a24b99b6e638c21dbd4" Oct 31 00:53:35.665924 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:35.665907 6591 scope.go:122] "RemoveContainer" containerID="01a2505d6a835da9d953283a0d869f16ede51977a4c02df9a1e280bceea54239" Oct 31 00:53:35.675559 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:35.675502 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt"] Oct 31 00:53:35.676497 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:35.676476 6591 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-promote-predictor-5cdb4c96cc-48tnt"] Oct 31 00:53:36.434450 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:36.434401 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:53:36.853237 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:36.853196 6591 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" path="/var/lib/kubelet/pods/fa6cafaa-fcf8-4070-992c-7165d57153be/volumes" Oct 31 00:53:38.665973 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:38.665943 6591 generic.go:356] "Generic (PLEG): container finished" podID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerID="3b19267f33c13adf90902a3f69a67cf42fc165c1305cd560eab3265d52c04f66" exitCode=0 Oct 31 00:53:38.666392 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:38.666023 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" event={"ID":"fa3bce2b-079b-4b28-9b16-bdcdf7d66502","Type":"ContainerDied","Data":"3b19267f33c13adf90902a3f69a67cf42fc165c1305cd560eab3265d52c04f66"} Oct 31 00:53:39.672997 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:39.672963 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" event={"ID":"fa3bce2b-079b-4b28-9b16-bdcdf7d66502","Type":"ContainerStarted","Data":"564ce8a5e4e2927564598168b471076f05fcbc91fc252b4f94faefa01e1d2478"} Oct 31 00:53:39.673411 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:39.673022 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" event={"ID":"fa3bce2b-079b-4b28-9b16-bdcdf7d66502","Type":"ContainerStarted","Data":"125b2e9ee8a29e2b5d5a9c3852352113009e772bce793d6abb7b5bc7e7c9cb19"} Oct 31 00:53:39.673411 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:39.673332 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:53:39.673555 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:39.673477 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:53:39.674764 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:39.674743 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused" Oct 31 00:53:39.691562 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:39.691514 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" podStartSLOduration=2.830539568 podStartE2EDuration="6.691503797s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.860964229s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:53:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:53:39.691193918 +0000 UTC m=+1408.952467788" watchObservedRunningTime="2026-10-31 00:53:39.691503797 +0000 UTC m=+1408.952777666" Oct 31 00:53:40.677583 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:40.677543 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused" Oct 31 00:53:45.682700 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:45.682669 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:53:45.683321 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:45.683292 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused" Oct 31 00:53:48.864689 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:53:48.864654 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:53:55.684185 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:53:55.684146 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused" Oct 31 00:54:05.684236 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:54:05.684194 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused" Oct 31 00:54:15.683208 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:54:15.683169 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused" Oct 31 00:54:17.185772 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:54:17.185739 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:54:18.867441 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:54:18.867385 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:54:25.683977 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:54:25.683940 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused" Oct 31 00:54:35.683628 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:54:35.683584 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused" Oct 31 00:54:45.683951 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:54:45.683913 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused" Oct 31 00:54:48.866611 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:54:48.866569 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:54:55.684244 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:54:55.684216 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:55:03.583041 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:03.583008 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz"] Oct 31 00:55:03.583506 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:03.583269 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="kserve-container" containerID="cri-o://125b2e9ee8a29e2b5d5a9c3852352113009e772bce793d6abb7b5bc7e7c9cb19" gracePeriod=30 Oct 31 00:55:03.583506 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:03.583316 6591 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="kube-rbac-proxy" containerID="cri-o://564ce8a5e4e2927564598168b471076f05fcbc91fc252b4f94faefa01e1d2478" gracePeriod=30 Oct 31 00:55:03.718795 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:03.718764 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:55:04.016308 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:04.016280 6591 generic.go:356] "Generic (PLEG): container finished" podID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerID="564ce8a5e4e2927564598168b471076f05fcbc91fc252b4f94faefa01e1d2478" exitCode=0 Oct 31 00:55:04.016512 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:04.016357 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" event={"ID":"fa3bce2b-079b-4b28-9b16-bdcdf7d66502","Type":"ContainerDied","Data":"564ce8a5e4e2927564598168b471076f05fcbc91fc252b4f94faefa01e1d2478"} Oct 31 00:55:05.678125 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:05.678078 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.37:8643/healthz\": dial tcp 10.133.0.37:8643: connect: connection refused" Oct 31 00:55:05.683355 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:05.683335 6591 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused" Oct 31 00:55:08.818650 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:08.818624 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:55:08.869360 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:08.869328 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kube-api-access-4trql\" (UniqueName: \"kubernetes.io/projected/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kube-api-access-4trql\") pod \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\" (UID: \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\") " Oct 31 00:55:08.869545 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:08.869380 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kube-rbac-proxy-sar-config\") pod \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\" (UID: \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\") " Oct 31 00:55:08.869545 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:08.869399 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-cabundle-cert\") pod \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\" (UID: \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\") " Oct 31 00:55:08.869545 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:08.869491 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-proxy-tls\" (UniqueName: \"kubernetes.io/secret/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-proxy-tls\") pod \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\" (UID: \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\") " Oct 31 00:55:08.869686 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:08.869572 6591 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kserve-provision-location\") pod \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\" (UID: \"fa3bce2b-079b-4b28-9b16-bdcdf7d66502\") " Oct 31 00:55:08.869849 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:08.869827 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-cabundle-cert" pod "fa3bce2b-079b-4b28-9b16-bdcdf7d66502" (UID: "fa3bce2b-079b-4b28-9b16-bdcdf7d66502"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:55:08.869912 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:08.869867 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kserve-provision-location" pod "fa3bce2b-079b-4b28-9b16-bdcdf7d66502" (UID: "fa3bce2b-079b-4b28-9b16-bdcdf7d66502"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:55:08.869912 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:08.869874 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kube-rbac-proxy-sar-config" pod "fa3bce2b-079b-4b28-9b16-bdcdf7d66502" (UID: "fa3bce2b-079b-4b28-9b16-bdcdf7d66502"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:55:08.871577 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:08.871556 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kube-api-access-4trql" pod "fa3bce2b-079b-4b28-9b16-bdcdf7d66502" (UID: "fa3bce2b-079b-4b28-9b16-bdcdf7d66502"). InnerVolumeSpecName "kube-api-access-4trql". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:55:08.871696 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:08.871677 6591 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-proxy-tls" pod "fa3bce2b-079b-4b28-9b16-bdcdf7d66502" (UID: "fa3bce2b-079b-4b28-9b16-bdcdf7d66502"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:55:08.971209 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:08.971122 6591 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:55:08.971209 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:08.971155 6591 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-cabundle-cert\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:55:08.971209 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:08.971165 6591 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-proxy-tls\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:55:08.971209 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:08.971174 6591 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kserve-provision-location\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:55:08.971209 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:08.971183 6591 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4trql\" (UniqueName: \"kubernetes.io/projected/fa3bce2b-079b-4b28-9b16-bdcdf7d66502-kube-api-access-4trql\") on node \"ip-10-0-134-145.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:55:09.039850 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:09.039814 6591 generic.go:356] "Generic (PLEG): container finished" podID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerID="125b2e9ee8a29e2b5d5a9c3852352113009e772bce793d6abb7b5bc7e7c9cb19" exitCode=0 Oct 31 00:55:09.039989 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:09.039880 6591 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" Oct 31 00:55:09.039989 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:09.039902 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" event={"ID":"fa3bce2b-079b-4b28-9b16-bdcdf7d66502","Type":"ContainerDied","Data":"125b2e9ee8a29e2b5d5a9c3852352113009e772bce793d6abb7b5bc7e7c9cb19"} Oct 31 00:55:09.039989 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:09.039970 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz" event={"ID":"fa3bce2b-079b-4b28-9b16-bdcdf7d66502","Type":"ContainerDied","Data":"9c7597fa873088b219b0c42406c9e1c61df9d95960bd39741fa8caf902f7acae"} Oct 31 00:55:09.040139 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:09.039996 6591 scope.go:122] "RemoveContainer" containerID="564ce8a5e4e2927564598168b471076f05fcbc91fc252b4f94faefa01e1d2478" Oct 31 00:55:09.053567 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:09.053545 6591 scope.go:122] "RemoveContainer" containerID="125b2e9ee8a29e2b5d5a9c3852352113009e772bce793d6abb7b5bc7e7c9cb19" Oct 31 00:55:09.061991 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:09.061970 6591 scope.go:122] "RemoveContainer" containerID="3b19267f33c13adf90902a3f69a67cf42fc165c1305cd560eab3265d52c04f66" Oct 31 00:55:09.065631 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:09.065604 6591 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz"] Oct 31 00:55:09.070773 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:09.070744 6591 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c950106202/isvc-canary-promote-v2-predictor-5997987886-jnwdz"] Oct 31 00:55:09.070942 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:09.070925 6591 scope.go:122] "RemoveContainer" containerID="564ce8a5e4e2927564598168b471076f05fcbc91fc252b4f94faefa01e1d2478" Oct 31 00:55:09.071244 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:55:09.071223 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"564ce8a5e4e2927564598168b471076f05fcbc91fc252b4f94faefa01e1d2478\": container with ID starting with 564ce8a5e4e2927564598168b471076f05fcbc91fc252b4f94faefa01e1d2478 not found: ID does not exist" containerID="564ce8a5e4e2927564598168b471076f05fcbc91fc252b4f94faefa01e1d2478" Oct 31 00:55:09.071296 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:09.071257 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"564ce8a5e4e2927564598168b471076f05fcbc91fc252b4f94faefa01e1d2478"} err="failed to get container status \"564ce8a5e4e2927564598168b471076f05fcbc91fc252b4f94faefa01e1d2478\": rpc error: code = NotFound desc = could not find container \"564ce8a5e4e2927564598168b471076f05fcbc91fc252b4f94faefa01e1d2478\": container with ID starting with 564ce8a5e4e2927564598168b471076f05fcbc91fc252b4f94faefa01e1d2478 not found: ID does not exist" Oct 31 00:55:09.071296 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:09.071280 6591 scope.go:122] "RemoveContainer" containerID="125b2e9ee8a29e2b5d5a9c3852352113009e772bce793d6abb7b5bc7e7c9cb19" Oct 31 00:55:09.071534 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:55:09.071517 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"125b2e9ee8a29e2b5d5a9c3852352113009e772bce793d6abb7b5bc7e7c9cb19\": container with ID starting with 125b2e9ee8a29e2b5d5a9c3852352113009e772bce793d6abb7b5bc7e7c9cb19 not found: ID does not exist" containerID="125b2e9ee8a29e2b5d5a9c3852352113009e772bce793d6abb7b5bc7e7c9cb19" Oct 31 00:55:09.071586 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:09.071540 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"125b2e9ee8a29e2b5d5a9c3852352113009e772bce793d6abb7b5bc7e7c9cb19"} err="failed to get container status \"125b2e9ee8a29e2b5d5a9c3852352113009e772bce793d6abb7b5bc7e7c9cb19\": rpc error: code = NotFound desc = could not find container \"125b2e9ee8a29e2b5d5a9c3852352113009e772bce793d6abb7b5bc7e7c9cb19\": container with ID starting with 125b2e9ee8a29e2b5d5a9c3852352113009e772bce793d6abb7b5bc7e7c9cb19 not found: ID does not exist" Oct 31 00:55:09.071586 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:09.071557 6591 scope.go:122] "RemoveContainer" containerID="3b19267f33c13adf90902a3f69a67cf42fc165c1305cd560eab3265d52c04f66" Oct 31 00:55:09.071799 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:55:09.071781 6591 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b19267f33c13adf90902a3f69a67cf42fc165c1305cd560eab3265d52c04f66\": container with ID starting with 3b19267f33c13adf90902a3f69a67cf42fc165c1305cd560eab3265d52c04f66 not found: ID does not exist" containerID="3b19267f33c13adf90902a3f69a67cf42fc165c1305cd560eab3265d52c04f66" Oct 31 00:55:09.071845 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:09.071803 6591 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b19267f33c13adf90902a3f69a67cf42fc165c1305cd560eab3265d52c04f66"} err="failed to get container status \"3b19267f33c13adf90902a3f69a67cf42fc165c1305cd560eab3265d52c04f66\": rpc error: code = NotFound desc = could not find container \"3b19267f33c13adf90902a3f69a67cf42fc165c1305cd560eab3265d52c04f66\": container with ID starting with 3b19267f33c13adf90902a3f69a67cf42fc165c1305cd560eab3265d52c04f66 not found: ID does not exist" Oct 31 00:55:10.850016 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:10.849984 6591 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" path="/var/lib/kubelet/pods/fa3bce2b-079b-4b28-9b16-bdcdf7d66502/volumes" Oct 31 00:55:10.995709 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:10.995680 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9vvz_c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/ovn-acl-logging/0.log" Oct 31 00:55:10.998044 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:10.998015 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:55:11.003508 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:11.003487 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9vvz_c3a2cb6c-83e1-41e4-a2a8-11ec1a00b4c3/ovn-acl-logging/0.log" Oct 31 00:55:17.156898 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:17.156870 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:55:18.078339 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:18.078303 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:55:18.250405 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:18.250370 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:55:18.863159 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:55:18.863123 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:55:21.105117 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:21.105075 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:55:21.277636 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:21.277600 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:55:21.916499 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:21.916467 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:55:22.157478 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:22.157443 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:55:32.062410 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:32.062377 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:55:32.239708 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:55:32.239665 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:55:48.863751 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:55:48.863705 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:56:17.313102 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:56:17.313072 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:56:18.864014 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:56:18.863982 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:56:48.863890 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:56:48.863851 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:57:07.402842 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:57:07.402807 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:57:08.172706 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:57:08.172675 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:57:08.359577 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:57:08.359544 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:57:17.334396 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:57:17.334360 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:57:18.863736 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:57:18.863699 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:57:39.647583 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:57:39.647508 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:57:41.414919 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:57:41.414888 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:57:41.621605 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:57:41.621577 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:57:45.669673 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:57:45.669634 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:57:45.862394 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:57:45.862364 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:57:48.863272 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:57:48.863236 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:58:10.007725 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:10.007688 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:58:10.335167 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:10.335132 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:58:10.533876 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:10.533846 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:58:13.341621 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:13.341590 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6rt5w_3b3c9cfb-2fd5-4a88-a938-77f38dd28969/global-pull-secret-syncer/0.log" Oct 31 00:58:13.655328 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:13.655255 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" Oct 31 00:58:13.771751 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:13.771727 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-145.us-east-2.compute.internal_e99a684e1e1866230a776f45fdda194d/haproxy/0.log" Oct 31 00:58:16.064773 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:16.064732 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:58:16.270799 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:16.270749 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:58:17.443036 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:17.443003 6591 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ch4wj_c3c5e8eb-fd22-42ee-a203-7c3077f48084/konnectivity-agent/0.log" limit=1024 Oct 31 00:58:18.863895 ip-10-0-134-145 kubenswrapper[6591]: E1031 00:58:18.863858 6591 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f8msd" containerName="extractor" Oct 31 00:58:19.026041 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:19.026016 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b/alertmanager/0.log" Oct 31 00:58:19.062908 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:19.062882 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b/config-reloader/0.log" Oct 31 00:58:19.105153 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:19.105127 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b/kube-rbac-proxy-web/0.log" Oct 31 00:58:19.140113 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:19.140051 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b/kube-rbac-proxy/0.log" Oct 31 00:58:19.173518 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:19.173495 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b/kube-rbac-proxy-metric/0.log" Oct 31 00:58:19.215179 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:19.215154 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b/prom-label-proxy/0.log" Oct 31 00:58:19.254395 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:19.254376 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cd7aa21-007e-4ccc-8156-0bfb3f1eae4b/init-config-reloader/0.log" Oct 31 00:58:19.442238 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:19.442163 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-98b459ffb-jkn2t_adc9181f-c401-4d7c-bbcb-409b4b6f60e0/metrics-server/0.log" Oct 31 00:58:19.809368 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:19.809338 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zkth8_81ef083c-e93d-4531-949e-22999120731e/node-exporter/0.log" Oct 31 00:58:19.845167 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:19.845135 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zkth8_81ef083c-e93d-4531-949e-22999120731e/kube-rbac-proxy/0.log" Oct 31 00:58:19.882247 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:19.882227 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zkth8_81ef083c-e93d-4531-949e-22999120731e/init-textfile/0.log" Oct 31 00:58:20.296646 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:20.296618 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-2kqbc_1e9c8bc7-67f7-4e30-99a1-09f26b0774c2/prometheus-operator/0.log" Oct 31 00:58:20.326793 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:20.326771 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-2kqbc_1e9c8bc7-67f7-4e30-99a1-09f26b0774c2/kube-rbac-proxy/0.log" Oct 31 00:58:20.405788 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:20.405729 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cfc94d455-4q5tk_beed9c31-8361-45c9-8159-64961ded0b5f/telemeter-client/0.log" Oct 31 00:58:20.438222 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:20.438189 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cfc94d455-4q5tk_beed9c31-8361-45c9-8159-64961ded0b5f/reload/0.log" Oct 31 00:58:20.472550 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:20.472525 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cfc94d455-4q5tk_beed9c31-8361-45c9-8159-64961ded0b5f/kube-rbac-proxy/0.log" Oct 31 00:58:20.513333 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:20.513297 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d95b77fc8-mwt72_7a57dfd1-8cba-4f8e-bdec-908249491197/thanos-query/0.log" Oct 31 00:58:20.544822 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:20.544796 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d95b77fc8-mwt72_7a57dfd1-8cba-4f8e-bdec-908249491197/kube-rbac-proxy-web/0.log" Oct 31 00:58:20.581226 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:20.581159 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d95b77fc8-mwt72_7a57dfd1-8cba-4f8e-bdec-908249491197/kube-rbac-proxy/0.log" Oct 31 00:58:20.619549 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:20.619523 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d95b77fc8-mwt72_7a57dfd1-8cba-4f8e-bdec-908249491197/prom-label-proxy/0.log" Oct 31 00:58:20.655246 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:20.655216 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d95b77fc8-mwt72_7a57dfd1-8cba-4f8e-bdec-908249491197/kube-rbac-proxy-rules/0.log" Oct 31 00:58:20.695768 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:20.695735 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d95b77fc8-mwt72_7a57dfd1-8cba-4f8e-bdec-908249491197/kube-rbac-proxy-metrics/0.log" Oct 31 00:58:21.350733 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.350707 6591 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c"] Oct 31 00:58:21.351096 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.351005 6591 cpu_manager.go:414] "containerMap: removing container" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="kube-rbac-proxy" Oct 31 00:58:21.351096 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.351015 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="kube-rbac-proxy" Oct 31 00:58:21.351096 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.351025 6591 cpu_manager.go:414] "containerMap: removing container" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="kserve-container" Oct 31 00:58:21.351096 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.351030 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="kserve-container" Oct 31 00:58:21.351096 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.351043 6591 cpu_manager.go:414] "containerMap: removing container" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="kube-rbac-proxy" Oct 31 00:58:21.351096 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.351048 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="kube-rbac-proxy" Oct 31 00:58:21.351096 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.351054 6591 cpu_manager.go:414] "containerMap: removing container" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="storage-initializer" Oct 31 00:58:21.351096 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.351059 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="storage-initializer" Oct 31 00:58:21.351096 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.351071 6591 cpu_manager.go:414] "containerMap: removing container" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="kserve-container" Oct 31 00:58:21.351096 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.351075 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="kserve-container" Oct 31 00:58:21.351096 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.351086 6591 cpu_manager.go:414] "containerMap: removing container" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="storage-initializer" Oct 31 00:58:21.351096 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.351091 6591 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="storage-initializer" Oct 31 00:58:21.351478 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.351155 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="kube-rbac-proxy" Oct 31 00:58:21.351478 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.351161 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="kserve-container" Oct 31 00:58:21.351478 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.351169 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa6cafaa-fcf8-4070-992c-7165d57153be" containerName="kube-rbac-proxy" Oct 31 00:58:21.351478 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.351176 6591 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa3bce2b-079b-4b28-9b16-bdcdf7d66502" containerName="kserve-container" Oct 31 00:58:21.354036 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.354020 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" Oct 31 00:58:21.370275 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.370247 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c"] Oct 31 00:58:21.437911 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.437882 6591 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gxz57\"/\"default-dockercfg-plgmx\"" Oct 31 00:58:21.438674 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.438658 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gxz57\"/\"openshift-service-ca.crt\"" Oct 31 00:58:21.438963 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.438948 6591 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gxz57\"/\"kube-root-ca.crt\"" Oct 31 00:58:21.445256 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.445240 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s85fp\" (UniqueName: \"kubernetes.io/projected/804e4180-aa4b-49ba-a7b9-17408ad2af45-kube-api-access-s85fp\") pod \"perf-node-gather-daemonset-4q78c\" (UID: \"804e4180-aa4b-49ba-a7b9-17408ad2af45\") " pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" Oct 31 00:58:21.445331 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.445268 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/804e4180-aa4b-49ba-a7b9-17408ad2af45-proc\") pod \"perf-node-gather-daemonset-4q78c\" (UID: \"804e4180-aa4b-49ba-a7b9-17408ad2af45\") " pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" Oct 31 00:58:21.445331 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.445291 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/804e4180-aa4b-49ba-a7b9-17408ad2af45-podres\") pod \"perf-node-gather-daemonset-4q78c\" (UID: \"804e4180-aa4b-49ba-a7b9-17408ad2af45\") " pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" Oct 31 00:58:21.445439 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.445411 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/804e4180-aa4b-49ba-a7b9-17408ad2af45-lib-modules\") pod \"perf-node-gather-daemonset-4q78c\" (UID: \"804e4180-aa4b-49ba-a7b9-17408ad2af45\") " pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" Oct 31 00:58:21.445487 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.445456 6591 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/804e4180-aa4b-49ba-a7b9-17408ad2af45-sys\") pod \"perf-node-gather-daemonset-4q78c\" (UID: \"804e4180-aa4b-49ba-a7b9-17408ad2af45\") " pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" Oct 31 00:58:21.546009 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.545984 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/804e4180-aa4b-49ba-a7b9-17408ad2af45-lib-modules\") pod \"perf-node-gather-daemonset-4q78c\" (UID: \"804e4180-aa4b-49ba-a7b9-17408ad2af45\") " pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" Oct 31 00:58:21.546153 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.546016 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/804e4180-aa4b-49ba-a7b9-17408ad2af45-sys\") pod \"perf-node-gather-daemonset-4q78c\" (UID: \"804e4180-aa4b-49ba-a7b9-17408ad2af45\") " pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" Oct 31 00:58:21.546153 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.546049 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s85fp\" (UniqueName: \"kubernetes.io/projected/804e4180-aa4b-49ba-a7b9-17408ad2af45-kube-api-access-s85fp\") pod \"perf-node-gather-daemonset-4q78c\" (UID: \"804e4180-aa4b-49ba-a7b9-17408ad2af45\") " pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" Oct 31 00:58:21.546153 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.546103 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/804e4180-aa4b-49ba-a7b9-17408ad2af45-proc\") pod \"perf-node-gather-daemonset-4q78c\" (UID: \"804e4180-aa4b-49ba-a7b9-17408ad2af45\") " pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" Oct 31 00:58:21.546153 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.546122 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/804e4180-aa4b-49ba-a7b9-17408ad2af45-sys\") pod \"perf-node-gather-daemonset-4q78c\" (UID: \"804e4180-aa4b-49ba-a7b9-17408ad2af45\") " pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" Oct 31 00:58:21.546153 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.546139 6591 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/804e4180-aa4b-49ba-a7b9-17408ad2af45-podres\") pod \"perf-node-gather-daemonset-4q78c\" (UID: \"804e4180-aa4b-49ba-a7b9-17408ad2af45\") " pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" Oct 31 00:58:21.546153 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.546124 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/804e4180-aa4b-49ba-a7b9-17408ad2af45-lib-modules\") pod \"perf-node-gather-daemonset-4q78c\" (UID: \"804e4180-aa4b-49ba-a7b9-17408ad2af45\") " pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" Oct 31 00:58:21.546355 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.546200 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/804e4180-aa4b-49ba-a7b9-17408ad2af45-proc\") pod \"perf-node-gather-daemonset-4q78c\" (UID: \"804e4180-aa4b-49ba-a7b9-17408ad2af45\") " pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" Oct 31 00:58:21.546597 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.546200 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/804e4180-aa4b-49ba-a7b9-17408ad2af45-podres\") pod \"perf-node-gather-daemonset-4q78c\" (UID: \"804e4180-aa4b-49ba-a7b9-17408ad2af45\") " pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" Oct 31 00:58:21.557071 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.557045 6591 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s85fp\" (UniqueName: \"kubernetes.io/projected/804e4180-aa4b-49ba-a7b9-17408ad2af45-kube-api-access-s85fp\") pod \"perf-node-gather-daemonset-4q78c\" (UID: \"804e4180-aa4b-49ba-a7b9-17408ad2af45\") " pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" Oct 31 00:58:21.666872 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.666803 6591 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" Oct 31 00:58:21.940264 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:21.940238 6591 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c"] Oct 31 00:58:21.942413 ip-10-0-134-145 kubenswrapper[6591]: W1031 00:58:21.942373 6591 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod804e4180_aa4b_49ba_a7b9_17408ad2af45.slice/crio-819fc7f154b29e5967abc5b8d66936ff3bb89fa8e30e3cd03e71f4563e32e8ca WatchSource:0}: Error finding container 819fc7f154b29e5967abc5b8d66936ff3bb89fa8e30e3cd03e71f4563e32e8ca: Status 404 returned error can't find the container with id 819fc7f154b29e5967abc5b8d66936ff3bb89fa8e30e3cd03e71f4563e32e8ca Oct 31 00:58:22.806019 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:22.805983 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" event={"ID":"804e4180-aa4b-49ba-a7b9-17408ad2af45","Type":"ContainerStarted","Data":"77cbd8b663b1ad19271d6e05c0177865587c182dbceb5cdeabb4b12ad16353e1"} Oct 31 00:58:22.806396 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:22.806043 6591 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" event={"ID":"804e4180-aa4b-49ba-a7b9-17408ad2af45","Type":"ContainerStarted","Data":"819fc7f154b29e5967abc5b8d66936ff3bb89fa8e30e3cd03e71f4563e32e8ca"} Oct 31 00:58:22.806396 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:22.806070 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" Oct 31 00:58:22.826709 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:22.826591 6591 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" podStartSLOduration=1.826574408 podStartE2EDuration="1.826574408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:58:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:58:22.826053897 +0000 UTC m=+1692.087327771" watchObservedRunningTime="2026-10-31 00:58:22.826574408 +0000 UTC m=+1692.087848283" Oct 31 00:58:22.869482 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:22.869458 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-577ff8bcf5-dqdbw_34c8cdd0-2427-43ab-8a65-31c604d52a7e/console/0.log" Oct 31 00:58:24.559714 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:24.559686 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7c822_1df475be-e1fe-4e90-b60f-dc3763a66cc6/dns/0.log" Oct 31 00:58:24.589626 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:24.589602 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7c822_1df475be-e1fe-4e90-b60f-dc3763a66cc6/kube-rbac-proxy/0.log" Oct 31 00:58:24.756023 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:24.755996 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g7phc_a1b304f2-676a-4a6f-bdac-8805188c415f/dns-node-resolver/0.log" Oct 31 00:58:25.385157 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:25.385129 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5nw7t_a4defb35-52f2-46fc-a314-affe5a217a84/node-ca/0.log" Oct 31 00:58:26.763603 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:26.763575 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5f5p7_b1cf311b-c4ed-433e-a582-b4bcfcc402a9/serve-healthcheck-canary/0.log" Oct 31 00:58:27.413676 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:27.413650 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f8msd_a47d5fa6-be34-46e7-93f7-44b23c9e9b89/kube-rbac-proxy/0.log" Oct 31 00:58:27.451012 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:27.450987 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f8msd_a47d5fa6-be34-46e7-93f7-44b23c9e9b89/exporter/0.log" Oct 31 00:58:27.487433 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:27.487399 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f8msd_a47d5fa6-be34-46e7-93f7-44b23c9e9b89/extractor/0.log" Oct 31 00:58:28.819940 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:28.819912 6591 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gxz57/perf-node-gather-daemonset-4q78c" Oct 31 00:58:30.358283 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:30.358252 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-5bbfdbf8df-2wslt_93804cde-52fd-4c5d-ad92-b56500ae32a1/manager/0.log" Oct 31 00:58:30.396216 ip-10-0-134-145 kubenswrapper[6591]: I1031 00:58:30.396190 6591 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-7696d678f8-49q2t_6913e393-6953-4087-af4d-308f14be5311/manager/0.log"