Nov 03 22:50:21.109818 ip-10-0-138-89 systemd[1]: Starting Kubernetes Kubelet... Nov 03 22:50:21.476254 ip-10-0-138-89 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 22:50:21.476254 ip-10-0-138-89 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 03 22:50:21.476254 ip-10-0-138-89 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 22:50:21.476254 ip-10-0-138-89 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 22:50:21.480485 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480376 2568 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:50:21.480485 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480481 2568 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:50:21.480485 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480487 2568 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:50:21.480485 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480492 2568 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:50:21.480753 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480498 2568 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:50:21.480753 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480503 2568 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:50:21.480753 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480507 2568 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:50:21.480753 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480511 2568 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:50:21.480753 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480515 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:50:21.480753 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480519 2568 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:50:21.480753 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480523 2568 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:50:21.480753 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480529 2568 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:50:21.480753 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480533 2568 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:50:21.480753 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480537 2568 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:50:21.480753 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480541 2568 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:50:21.480753 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480546 2568 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:50:21.480753 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480550 2568 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:50:21.480753 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480555 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:50:21.480753 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480560 2568 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:50:21.480753 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480564 2568 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:50:21.480753 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480569 2568 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:50:21.480753 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480574 2568 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:50:21.480753 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480585 2568 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:50:21.480753 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480590 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:50:21.481590 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480595 2568 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:50:21.481590 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480599 2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:50:21.481590 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480603 2568 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:50:21.481590 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480616 2568 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:50:21.481590 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480620 2568 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:50:21.481590 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480627 2568 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:50:21.481590 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480635 2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:50:21.481590 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480640 2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:50:21.481590 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480645 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:50:21.481590 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480651 2568 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:50:21.481590 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480656 2568 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:50:21.481590 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480660 2568 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:50:21.481590 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480665 2568 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:50:21.481590 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480670 2568 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:50:21.481590 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480676 2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:50:21.481590 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480682 2568 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:50:21.481590 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480687 2568 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:50:21.481590 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480693 2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:50:21.481590 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480698 2568 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:50:21.482366 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480702 2568 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:50:21.482366 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480707 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:50:21.482366 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480712 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:50:21.482366 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480717 2568 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:50:21.482366 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480722 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:50:21.482366 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480727 2568 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:50:21.482366 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480732 2568 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:50:21.482366 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480737 2568 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:50:21.482366 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480742 2568 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:50:21.482366 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480747 2568 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:50:21.482366 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480751 2568 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:50:21.482366 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480756 2568 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:50:21.482366 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480760 2568 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:50:21.482366 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480767 2568 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:50:21.482366 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480772 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:50:21.482366 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480777 2568 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:50:21.482366 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480781 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:50:21.482366 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480786 2568 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:50:21.482366 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480791 2568 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:50:21.482366 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480795 2568 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:50:21.483223 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480800 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:50:21.483223 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480805 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:50:21.483223 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480810 2568 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:50:21.483223 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480815 2568 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:50:21.483223 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480819 2568 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:50:21.483223 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480824 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:50:21.483223 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480829 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:50:21.483223 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480834 2568 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:50:21.483223 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480842 2568 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:50:21.483223 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480846 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:50:21.483223 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480851 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:50:21.483223 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480856 2568 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:50:21.483223 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480861 2568 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:50:21.483223 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480866 2568 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:50:21.483223 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480871 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:50:21.483223 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480876 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:50:21.483223 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480881 2568 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:50:21.483223 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480886 2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:50:21.483223 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480891 2568 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:50:21.483223 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480896 2568 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:50:21.484099 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480901 2568 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:50:21.484099 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480905 2568 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:50:21.484099 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480910 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:50:21.484099 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480914 2568 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:50:21.484099 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480919 2568 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:50:21.484099 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480924 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:50:21.484099 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480930 2568 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:50:21.484099 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480934 2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:50:21.484099 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480939 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:50:21.484099 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480944 2568 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:50:21.484099 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480951 2568 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:50:21.484099 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480959 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:50:21.484099 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480964 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:50:21.484099 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480969 2568 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:50:21.484099 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480974 2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:50:21.484099 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480979 2568 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:50:21.484099 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480984 2568 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:50:21.484099 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480991 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:50:21.484882 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.480997 2568 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:50:21.484882 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.481002 2568 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:50:21.484882 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.481006 2568 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:50:21.484882 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.481011 2568 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:50:21.484882 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.481016 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:50:21.484882 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482312 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:50:21.484882 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482323 2568 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:50:21.484882 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482328 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:50:21.484882 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482333 2568 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:50:21.484882 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482339 2568 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:50:21.484882 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482345 2568 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:50:21.484882 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482350 2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:50:21.484882 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482355 2568 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:50:21.484882 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482360 2568 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:50:21.484882 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482364 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:50:21.484882 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482369 2568 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:50:21.484882 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482373 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:50:21.484882 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482378 2568 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:50:21.484882 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482383 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:50:21.484882 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482387 2568 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:50:21.485761 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482392 2568 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:50:21.485761 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482397 2568 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:50:21.485761 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482402 2568 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:50:21.485761 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482407 2568 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:50:21.485761 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482412 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:50:21.485761 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482417 2568 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:50:21.485761 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482422 2568 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:50:21.485761 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482427 2568 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:50:21.485761 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482431 2568 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:50:21.485761 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482436 2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:50:21.485761 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482441 2568 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:50:21.485761 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482446 2568 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:50:21.485761 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482472 2568 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:50:21.485761 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482477 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:50:21.485761 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482482 2568 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:50:21.485761 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482487 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:50:21.485761 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482492 2568 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:50:21.485761 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482496 2568 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:50:21.485761 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482500 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:50:21.486606 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482506 2568 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:50:21.486606 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482510 2568 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:50:21.486606 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482515 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:50:21.486606 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482520 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:50:21.486606 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482525 2568 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:50:21.486606 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482529 2568 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:50:21.486606 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482537 2568 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:50:21.486606 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482543 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:50:21.486606 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482549 2568 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:50:21.486606 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482555 2568 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:50:21.486606 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482559 2568 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:50:21.486606 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482564 2568 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:50:21.486606 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482569 2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:50:21.486606 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482574 2568 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:50:21.486606 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482579 2568 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:50:21.486606 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482591 2568 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:50:21.486606 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482597 2568 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:50:21.486606 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482601 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:50:21.486606 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482606 2568 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:50:21.487203 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482611 2568 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:50:21.487203 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482616 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:50:21.487203 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482621 2568 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:50:21.487203 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482625 2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:50:21.487203 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482630 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:50:21.487203 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482636 2568 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:50:21.487203 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482641 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:50:21.487203 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482646 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:50:21.487203 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482651 2568 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:50:21.487203 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482656 2568 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:50:21.487203 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482660 2568 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:50:21.487203 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482665 2568 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:50:21.487203 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482670 2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:50:21.487203 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482675 2568 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:50:21.487203 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482680 2568 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:50:21.487203 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482685 2568 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:50:21.487203 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482689 2568 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:50:21.487203 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482695 2568 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:50:21.487203 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482700 2568 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:50:21.487885 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482705 2568 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:50:21.487885 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482710 2568 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:50:21.487885 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482714 2568 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:50:21.487885 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482720 2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:50:21.487885 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482724 2568 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:50:21.487885 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482729 2568 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:50:21.487885 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482734 2568 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:50:21.487885 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482738 2568 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:50:21.487885 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482743 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:50:21.487885 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482748 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:50:21.487885 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482753 2568 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:50:21.487885 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482758 2568 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:50:21.487885 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482763 2568 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:50:21.487885 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482768 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:50:21.487885 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482773 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:50:21.487885 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482778 2568 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:50:21.487885 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482782 2568 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:50:21.487885 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482787 2568 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:50:21.487885 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482792 2568 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:50:21.487885 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482796 2568 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:50:21.488554 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482802 2568 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:50:21.488554 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482806 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:50:21.488554 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482811 2568 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:50:21.488554 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482816 2568 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:50:21.488554 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482821 2568 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:50:21.488554 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482826 2568 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:50:21.488554 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482831 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:50:21.488554 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482836 2568 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:50:21.488554 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482840 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:50:21.488554 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482849 2568 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:50:21.488554 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482856 2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:50:21.488554 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482862 2568 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:50:21.488554 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482867 2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:50:21.488554 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.482872 2568 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:50:21.488554 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483714 2568 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:50:21.488554 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483724 2568 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:50:21.488554 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483729 2568 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:50:21.488554 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483734 2568 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:50:21.488554 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483739 2568 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:50:21.489020 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483744 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:50:21.489020 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483749 2568 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:50:21.489020 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483753 2568 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:50:21.489020 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483759 2568 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:50:21.489020 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483765 2568 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:50:21.489020 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483769 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:50:21.489020 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483774 2568 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:50:21.489020 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483779 2568 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:50:21.489020 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483784 2568 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:50:21.489020 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483789 2568 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:50:21.489020 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483794 2568 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:50:21.489020 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483799 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:50:21.489020 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483804 2568 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:50:21.489020 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483808 2568 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:50:21.489020 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483813 2568 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:50:21.489020 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483818 2568 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:50:21.489020 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483823 2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:50:21.489020 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483827 2568 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:50:21.489020 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483832 2568 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:50:21.489020 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483837 2568 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:50:21.489623 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483842 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:50:21.489623 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483847 2568 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:50:21.489623 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483851 2568 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:50:21.489623 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483856 2568 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:50:21.489623 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483861 2568 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:50:21.489623 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483866 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:50:21.489623 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483871 2568 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:50:21.489623 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483876 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:50:21.489623 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483880 2568 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:50:21.489623 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483886 2568 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:50:21.489623 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483890 2568 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:50:21.489623 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483895 2568 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:50:21.489623 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483899 2568 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:50:21.489623 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483904 2568 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:50:21.489623 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483908 2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:50:21.489623 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483913 2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:50:21.489623 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483919 2568 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:50:21.489623 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483924 2568 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:50:21.489623 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483928 2568 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:50:21.490112 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483933 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:50:21.490112 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483938 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:50:21.490112 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483943 2568 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:50:21.490112 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483948 2568 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:50:21.490112 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483952 2568 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:50:21.490112 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483958 2568 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:50:21.490112 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483963 2568 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:50:21.490112 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483968 2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:50:21.490112 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483972 2568 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:50:21.490112 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483977 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:50:21.490112 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483982 2568 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:50:21.490112 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483989 2568 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:50:21.490112 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.483995 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:50:21.490112 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484001 2568 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:50:21.490112 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484006 2568 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:50:21.490112 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484010 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:50:21.490112 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484015 2568 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:50:21.490112 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484019 2568 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:50:21.490112 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484024 2568 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:50:21.490595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484029 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:50:21.490595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484034 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:50:21.490595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484039 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:50:21.490595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484043 2568 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:50:21.490595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484048 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:50:21.490595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484055 2568 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:50:21.490595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484061 2568 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:50:21.490595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484067 2568 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:50:21.490595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484072 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:50:21.490595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484077 2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:50:21.490595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484082 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:50:21.490595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484089 2568 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:50:21.490595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484094 2568 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:50:21.490595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484099 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:50:21.490595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484103 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:50:21.490595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484108 2568 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:50:21.490595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484113 2568 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:50:21.490595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484117 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:50:21.490595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484122 2568 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:50:21.490595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484127 2568 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:50:21.491068 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484132 2568 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:50:21.491068 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484138 2568 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:50:21.491068 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484143 2568 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:50:21.491068 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484147 2568 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:50:21.491068 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484152 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:50:21.491068 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484156 2568 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:50:21.491068 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484161 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:50:21.491068 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484165 2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:50:21.491068 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484170 2568 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:50:21.491068 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484177 2568 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:50:21.491068 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484182 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:50:21.491068 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484187 2568 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:50:21.491068 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484191 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:50:21.491068 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484196 2568 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:50:21.491068 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484201 2568 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:50:21.491068 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484205 2568 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:50:21.491068 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484211 2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:50:21.491068 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484215 2568 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:50:21.491068 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484220 2568 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:50:21.491068 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484225 2568 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484230 2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484234 2568 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.484239 2568 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484385 2568 flags.go:64] FLAG: --address="0.0.0.0" Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484404 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484414 2568 flags.go:64] FLAG: --anonymous-auth="true" Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484422 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484430 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484435 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484443 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484469 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484475 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484480 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484486 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484492 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484497 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484503 2568 flags.go:64] FLAG: --cgroup-root="" Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484508 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484513 2568 flags.go:64] FLAG: --client-ca-file="" Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484518 2568 flags.go:64] FLAG: --cloud-provider="external" Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484523 2568 flags.go:64] FLAG: --cluster-dns="[]" Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484535 2568 flags.go:64] FLAG: --cluster-domain="" Nov 03 22:50:21.491602 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484540 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484545 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484551 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484557 2568 flags.go:64] FLAG: --container-log-max-files="5" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484564 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484569 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484575 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484588 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484593 2568 flags.go:64] FLAG: --contention-profiling="false" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484598 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484604 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484609 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484615 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484623 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484629 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484635 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484641 2568 flags.go:64] FLAG: --enable-load-reader="false" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484647 2568 flags.go:64] FLAG: --enable-server="true" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484652 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484659 2568 flags.go:64] FLAG: --event-burst="100" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484665 2568 flags.go:64] FLAG: --event-qps="50" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484670 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484676 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484681 2568 flags.go:64] FLAG: --eviction-hard="" Nov 03 22:50:21.492141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484689 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484694 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484700 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484706 2568 flags.go:64] FLAG: --eviction-soft="" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484711 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484716 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484721 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484726 2568 flags.go:64] FLAG: --experimental-mounter-path="" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484732 2568 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484737 2568 flags.go:64] FLAG: --fail-swap-on="true" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484742 2568 flags.go:64] FLAG: --feature-gates="" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484749 2568 flags.go:64] FLAG: --file-check-frequency="20s" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484755 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484760 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484766 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484772 2568 flags.go:64] FLAG: --healthz-port="10248" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484777 2568 flags.go:64] FLAG: --help="false" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484782 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484788 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484793 2568 flags.go:64] FLAG: --http-check-frequency="20s" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484799 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484805 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484811 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 03 22:50:21.492835 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484817 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484823 2568 flags.go:64] FLAG: --image-service-endpoint="" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484828 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484833 2568 flags.go:64] FLAG: --kube-api-burst="100" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484838 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484843 2568 flags.go:64] FLAG: --kube-api-qps="50" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484849 2568 flags.go:64] FLAG: --kube-reserved="" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484854 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484859 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484864 2568 flags.go:64] FLAG: --kubelet-cgroups="" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484869 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484874 2568 flags.go:64] FLAG: --lock-file="" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484879 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484884 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484889 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484904 2568 flags.go:64] FLAG: --log-json-split-stream="false" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484909 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484915 2568 flags.go:64] FLAG: --log-text-split-stream="false" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484920 2568 flags.go:64] FLAG: --logging-format="text" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484926 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484931 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484936 2568 flags.go:64] FLAG: --manifest-url="" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484941 2568 flags.go:64] FLAG: --manifest-url-header="" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484949 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484954 2568 flags.go:64] FLAG: --max-open-files="1000000" Nov 03 22:50:21.493400 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484961 2568 flags.go:64] FLAG: --max-pods="110" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484966 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484972 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484977 2568 flags.go:64] FLAG: --memory-manager-policy="None" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484986 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484991 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.484996 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485001 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485013 2568 flags.go:64] FLAG: --node-status-max-images="50" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485020 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485025 2568 flags.go:64] FLAG: --oom-score-adj="-999" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485030 2568 flags.go:64] FLAG: --pod-cidr="" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485035 2568 flags.go:64] FLAG: --pod-manifest-path="" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485041 2568 flags.go:64] FLAG: --pod-max-pids="-1" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485046 2568 flags.go:64] FLAG: --pods-per-core="0" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485052 2568 flags.go:64] FLAG: --port="10250" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485057 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485062 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-076171c4a7edff358" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485068 2568 flags.go:64] FLAG: --qos-reserved="" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485073 2568 flags.go:64] FLAG: --read-only-port="10255" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485078 2568 flags.go:64] FLAG: --register-node="true" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485083 2568 flags.go:64] FLAG: --register-with-taints="" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485091 2568 flags.go:64] FLAG: --registry-burst="10" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485097 2568 flags.go:64] FLAG: --registry-qps="5" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485102 2568 flags.go:64] FLAG: --reserved-cpus="" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485107 2568 flags.go:64] FLAG: --reserved-memory="" Nov 03 22:50:21.494016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485113 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485119 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485124 2568 flags.go:64] FLAG: --rotate-certificates="false" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485129 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485135 2568 flags.go:64] FLAG: --runonce="false" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485140 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485146 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485151 2568 flags.go:64] FLAG: --seccomp-default="false" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485156 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485161 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485169 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485175 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485180 2568 flags.go:64] FLAG: --storage-driver-password="root" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485185 2568 flags.go:64] FLAG: --storage-driver-secure="false" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485191 2568 flags.go:64] FLAG: --storage-driver-table="stats" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485196 2568 flags.go:64] FLAG: --storage-driver-user="root" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485204 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485209 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485215 2568 flags.go:64] FLAG: --system-cgroups="" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485220 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485230 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485234 2568 flags.go:64] FLAG: --tls-cert-file="" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485239 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485248 2568 flags.go:64] FLAG: --tls-min-version="" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485253 2568 flags.go:64] FLAG: --tls-private-key-file="" Nov 03 22:50:21.494648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485258 2568 flags.go:64] FLAG: --topology-manager-policy="none" Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485263 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485268 2568 flags.go:64] FLAG: --topology-manager-scope="container" Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485273 2568 flags.go:64] FLAG: --v="2" Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485281 2568 flags.go:64] FLAG: --version="false" Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485288 2568 flags.go:64] FLAG: --vmodule="" Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485295 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.485301 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485553 2568 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485562 2568 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485567 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485572 2568 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485577 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485582 2568 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485587 2568 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485592 2568 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485597 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485606 2568 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485611 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485616 2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485621 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:50:21.495310 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485626 2568 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:50:21.495912 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485631 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:50:21.495912 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485639 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:50:21.495912 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485645 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:50:21.495912 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485650 2568 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:50:21.495912 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485655 2568 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:50:21.495912 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485659 2568 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:50:21.495912 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485664 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:50:21.495912 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485669 2568 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:50:21.495912 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485674 2568 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:50:21.495912 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485678 2568 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:50:21.495912 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485683 2568 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:50:21.495912 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485688 2568 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:50:21.495912 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485692 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:50:21.495912 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485697 2568 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:50:21.495912 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485702 2568 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:50:21.495912 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485707 2568 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:50:21.495912 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485712 2568 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:50:21.495912 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485716 2568 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:50:21.495912 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485721 2568 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:50:21.496523 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485726 2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:50:21.496523 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485731 2568 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:50:21.496523 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485735 2568 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:50:21.496523 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485740 2568 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:50:21.496523 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485745 2568 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:50:21.496523 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485749 2568 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:50:21.496523 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485754 2568 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:50:21.496523 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485759 2568 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:50:21.496523 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485765 2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:50:21.496523 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485770 2568 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:50:21.496523 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485774 2568 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:50:21.496523 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485779 2568 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:50:21.496523 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485783 2568 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:50:21.496523 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485788 2568 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:50:21.496523 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485795 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:50:21.496523 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485800 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:50:21.496523 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485806 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:50:21.496523 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485811 2568 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:50:21.496523 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485816 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485821 2568 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485825 2568 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485830 2568 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485835 2568 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485840 2568 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485844 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485849 2568 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485854 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485859 2568 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485864 2568 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485869 2568 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485874 2568 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485878 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485883 2568 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485888 2568 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485893 2568 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485898 2568 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485903 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485907 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485912 2568 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:50:21.497183 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485917 2568 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:50:21.497717 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485924 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:50:21.497717 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485929 2568 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:50:21.497717 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485934 2568 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:50:21.497717 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485939 2568 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:50:21.497717 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485944 2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:50:21.497717 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485949 2568 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:50:21.497717 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485955 2568 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:50:21.497717 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485960 2568 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:50:21.497717 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485965 2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:50:21.497717 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485973 2568 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:50:21.497717 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485979 2568 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:50:21.497717 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485985 2568 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:50:21.497717 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485990 2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:50:21.497717 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485995 2568 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:50:21.497717 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.485999 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:50:21.497717 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486004 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:50:21.497717 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486009 2568 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:50:21.497717 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486014 2568 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:50:21.497717 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486018 2568 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:50:21.498190 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486024 2568 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:50:21.498190 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486029 2568 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:50:21.498190 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486036 2568 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:50:21.498190 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486042 2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:50:21.498190 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486048 2568 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:50:21.498190 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486054 2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:50:21.498190 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486059 2568 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:50:21.498190 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486064 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:50:21.498190 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486069 2568 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:50:21.498190 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486074 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:50:21.498190 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486078 2568 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:50:21.498190 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486083 2568 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:50:21.498190 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486088 2568 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:50:21.498190 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486094 2568 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:50:21.498190 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.486138 2568 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 22:50:21.498190 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486196 2568 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:50:21.498595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486204 2568 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:50:21.498595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486210 2568 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:50:21.498595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486218 2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:50:21.498595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486223 2568 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:50:21.498595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486230 2568 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:50:21.498595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486234 2568 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:50:21.498595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486239 2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:50:21.498595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486246 2568 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:50:21.498595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486253 2568 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:50:21.498595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486259 2568 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:50:21.498595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486265 2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:50:21.498595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486269 2568 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:50:21.498595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486274 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:50:21.498595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486279 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:50:21.498595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486284 2568 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:50:21.498595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486288 2568 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:50:21.498595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486293 2568 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:50:21.498595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486299 2568 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:50:21.498595 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486304 2568 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:50:21.499056 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486311 2568 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:50:21.499056 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486317 2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:50:21.499056 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486322 2568 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:50:21.499056 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486327 2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:50:21.499056 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486332 2568 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:50:21.499056 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486337 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:50:21.499056 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486342 2568 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:50:21.499056 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486347 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:50:21.499056 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486352 2568 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:50:21.499056 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486357 2568 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:50:21.499056 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486363 2568 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:50:21.499056 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486368 2568 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:50:21.499056 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486373 2568 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:50:21.499056 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486378 2568 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:50:21.499056 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486383 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:50:21.499056 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486389 2568 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:50:21.499056 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486393 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:50:21.499056 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486400 2568 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:50:21.499056 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486405 2568 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:50:21.499526 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486410 2568 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:50:21.499526 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486414 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:50:21.499526 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486420 2568 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:50:21.499526 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486425 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:50:21.499526 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486430 2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:50:21.499526 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486435 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:50:21.499526 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486439 2568 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:50:21.499526 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486445 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:50:21.499526 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486470 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:50:21.499526 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486475 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:50:21.499526 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486480 2568 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:50:21.499526 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486484 2568 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:50:21.499526 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486489 2568 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:50:21.499526 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486494 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:50:21.499526 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486499 2568 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:50:21.499526 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486504 2568 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:50:21.499526 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486509 2568 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:50:21.499526 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486513 2568 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:50:21.499526 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486518 2568 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:50:21.499526 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486523 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:50:21.499997 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486528 2568 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:50:21.499997 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486533 2568 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:50:21.499997 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486538 2568 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:50:21.499997 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486544 2568 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:50:21.499997 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486549 2568 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:50:21.499997 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486555 2568 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:50:21.499997 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486559 2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:50:21.499997 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486564 2568 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:50:21.499997 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486569 2568 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:50:21.499997 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486573 2568 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:50:21.499997 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486580 2568 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:50:21.499997 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486585 2568 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:50:21.499997 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486590 2568 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:50:21.499997 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486595 2568 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:50:21.499997 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486600 2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:50:21.499997 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486606 2568 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:50:21.499997 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486610 2568 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:50:21.499997 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486615 2568 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:50:21.499997 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486620 2568 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:50:21.500438 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486625 2568 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:50:21.500438 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486629 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:50:21.500438 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486634 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:50:21.500438 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486639 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:50:21.500438 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486644 2568 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:50:21.500438 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486649 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:50:21.500438 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486654 2568 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:50:21.500438 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486658 2568 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:50:21.500438 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486663 2568 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:50:21.500438 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486668 2568 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:50:21.500438 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486673 2568 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:50:21.500438 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486677 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:50:21.500438 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486682 2568 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:50:21.500438 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486687 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:50:21.500438 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486692 2568 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:50:21.500438 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486697 2568 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:50:21.500438 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486703 2568 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:50:21.500438 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486708 2568 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:50:21.500438 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486713 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:50:21.500438 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486718 2568 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:50:21.500978 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486723 2568 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:50:21.500978 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486727 2568 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:50:21.500978 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486732 2568 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:50:21.500978 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486738 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:50:21.500978 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486743 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:50:21.500978 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486748 2568 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:50:21.500978 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486753 2568 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:50:21.500978 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.486758 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:50:21.500978 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.494079 2568 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 03 22:50:21.500978 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.494094 2568 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 03 22:50:21.500978 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.494706 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 03 22:50:21.500978 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.494713 2568 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 03 22:50:21.500978 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494772 2568 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:50:21.500978 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494778 2568 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:50:21.500978 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494783 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:50:21.500978 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494786 2568 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:50:21.500978 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494789 2568 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:50:21.500978 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494791 2568 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:50:21.500978 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494794 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:50:21.501429 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494797 2568 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:50:21.501429 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494800 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:50:21.501429 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494803 2568 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:50:21.501429 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494806 2568 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:50:21.501429 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494809 2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:50:21.501429 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494812 2568 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:50:21.501429 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494814 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:50:21.501429 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494817 2568 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:50:21.501429 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494820 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:50:21.501429 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494823 2568 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:50:21.501429 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494826 2568 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:50:21.501429 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494828 2568 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:50:21.501429 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494831 2568 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:50:21.501429 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494834 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:50:21.501429 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494836 2568 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:50:21.501429 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494839 2568 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:50:21.501429 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494841 2568 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:50:21.501429 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494844 2568 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:50:21.501429 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494847 2568 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:50:21.501429 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494850 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:50:21.502026 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494852 2568 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:50:21.502026 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494855 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:50:21.502026 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494858 2568 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:50:21.502026 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494862 2568 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:50:21.502026 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494865 2568 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:50:21.502026 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494867 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:50:21.502026 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494870 2568 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:50:21.502026 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494872 2568 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:50:21.502026 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494875 2568 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:50:21.502026 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494878 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:50:21.502026 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494880 2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:50:21.502026 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494883 2568 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:50:21.502026 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494885 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:50:21.502026 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494888 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:50:21.502026 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494891 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:50:21.502026 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494893 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:50:21.502026 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494896 2568 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:50:21.502026 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494899 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:50:21.502026 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494901 2568 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:50:21.502511 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494904 2568 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:50:21.502511 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494906 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:50:21.502511 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494909 2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:50:21.502511 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494912 2568 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:50:21.502511 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494914 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:50:21.502511 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494916 2568 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:50:21.502511 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494919 2568 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:50:21.502511 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494922 2568 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:50:21.502511 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494925 2568 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:50:21.502511 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494927 2568 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:50:21.502511 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494930 2568 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:50:21.502511 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494933 2568 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:50:21.502511 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494935 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:50:21.502511 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494938 2568 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:50:21.502511 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494941 2568 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:50:21.502511 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494944 2568 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:50:21.502511 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494947 2568 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:50:21.502511 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494950 2568 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:50:21.502511 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494953 2568 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:50:21.502511 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494956 2568 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:50:21.503040 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494958 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:50:21.503040 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494961 2568 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:50:21.503040 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494963 2568 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:50:21.503040 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494966 2568 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:50:21.503040 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494969 2568 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:50:21.503040 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494971 2568 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:50:21.503040 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494975 2568 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:50:21.503040 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494979 2568 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:50:21.503040 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494982 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:50:21.503040 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494984 2568 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:50:21.503040 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494987 2568 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:50:21.503040 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494990 2568 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:50:21.503040 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494993 2568 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:50:21.503040 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494995 2568 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:50:21.503040 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.494998 2568 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:50:21.503040 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495000 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:50:21.503040 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495003 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:50:21.503040 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495005 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:50:21.503040 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495008 2568 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:50:21.503598 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495011 2568 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:50:21.503598 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495014 2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:50:21.503598 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495016 2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:50:21.503598 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495019 2568 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:50:21.503598 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495022 2568 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:50:21.503598 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495025 2568 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:50:21.503598 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495027 2568 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:50:21.503598 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495030 2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:50:21.503598 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495034 2568 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:50:21.503598 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495038 2568 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:50:21.503598 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495041 2568 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:50:21.503598 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495045 2568 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:50:21.503598 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495048 2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:50:21.503598 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495051 2568 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:50:21.503598 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495054 2568 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:50:21.503598 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495057 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:50:21.503598 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495059 2568 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:50:21.503598 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495062 2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:50:21.503598 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495064 2568 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:50:21.503598 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495067 2568 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:50:21.504082 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.495069 2568 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:50:21.504082 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.495097 2568 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 22:50:21.504082 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497219 2568 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:50:21.504082 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497236 2568 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:50:21.504082 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497240 2568 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:50:21.504082 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497243 2568 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:50:21.504082 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497246 2568 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:50:21.504082 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497249 2568 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:50:21.504082 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497253 2568 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:50:21.504082 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497256 2568 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:50:21.504082 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497259 2568 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:50:21.504082 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497262 2568 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:50:21.504082 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497264 2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:50:21.504082 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497267 2568 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:50:21.504082 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497270 2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:50:21.504082 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497272 2568 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:50:21.504508 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497275 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:50:21.504508 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497278 2568 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:50:21.504508 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497280 2568 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:50:21.504508 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497283 2568 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:50:21.504508 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497286 2568 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:50:21.504508 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497289 2568 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:50:21.504508 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497291 2568 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:50:21.504508 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497294 2568 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:50:21.504508 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497300 2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:50:21.504508 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497303 2568 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:50:21.504508 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497306 2568 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:50:21.504508 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497308 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:50:21.504508 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497311 2568 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:50:21.504508 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497315 2568 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:50:21.504508 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497320 2568 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:50:21.504508 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497323 2568 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:50:21.504508 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497326 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:50:21.504508 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497329 2568 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:50:21.504508 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497332 2568 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:50:21.504972 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497335 2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:50:21.504972 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497338 2568 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:50:21.504972 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497341 2568 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:50:21.504972 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497344 2568 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:50:21.504972 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497347 2568 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:50:21.504972 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497349 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:50:21.504972 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497352 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:50:21.504972 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497355 2568 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:50:21.504972 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497358 2568 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:50:21.504972 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497360 2568 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:50:21.504972 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497363 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:50:21.504972 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497365 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:50:21.504972 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497368 2568 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:50:21.504972 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497371 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:50:21.504972 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497374 2568 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:50:21.504972 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497376 2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:50:21.504972 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497379 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:50:21.504972 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497382 2568 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:50:21.504972 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497384 2568 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:50:21.505727 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497387 2568 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:50:21.505727 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497389 2568 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:50:21.505727 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497392 2568 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:50:21.505727 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497395 2568 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:50:21.505727 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497398 2568 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:50:21.505727 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497400 2568 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:50:21.505727 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497403 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:50:21.505727 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497406 2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:50:21.505727 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497409 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:50:21.505727 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497411 2568 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:50:21.505727 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497414 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:50:21.505727 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497417 2568 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:50:21.505727 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497419 2568 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:50:21.505727 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497423 2568 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:50:21.505727 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497426 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:50:21.505727 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497428 2568 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:50:21.505727 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497431 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:50:21.505727 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497434 2568 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:50:21.505727 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497436 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:50:21.506403 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497439 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:50:21.506403 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497443 2568 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:50:21.506403 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497447 2568 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:50:21.506403 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497468 2568 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:50:21.506403 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497472 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:50:21.506403 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497476 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:50:21.506403 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497478 2568 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:50:21.506403 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497481 2568 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:50:21.506403 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497484 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:50:21.506403 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497487 2568 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:50:21.506403 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497489 2568 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:50:21.506403 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497492 2568 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:50:21.506403 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497496 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:50:21.506403 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497499 2568 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:50:21.506403 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497501 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:50:21.506403 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497504 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:50:21.506403 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497507 2568 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:50:21.506403 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497510 2568 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:50:21.506403 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497512 2568 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:50:21.507069 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497515 2568 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:50:21.507069 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497518 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:50:21.507069 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497521 2568 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:50:21.507069 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497523 2568 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:50:21.507069 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497526 2568 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:50:21.507069 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497529 2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:50:21.507069 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497531 2568 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:50:21.507069 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497534 2568 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:50:21.507069 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497537 2568 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:50:21.507069 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497540 2568 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:50:21.507069 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497543 2568 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:50:21.507069 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497546 2568 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:50:21.507069 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497548 2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:50:21.507069 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497551 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:50:21.507069 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497553 2568 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:50:21.507069 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497556 2568 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:50:21.507509 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.497590 2568 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 22:50:21.507509 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497634 2568 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:50:21.507509 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497639 2568 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:50:21.507509 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497642 2568 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:50:21.507509 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497645 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:50:21.507509 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497647 2568 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:50:21.507509 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497650 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:50:21.507509 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497652 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:50:21.507509 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497655 2568 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:50:21.507509 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497658 2568 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:50:21.507509 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497661 2568 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:50:21.507509 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497664 2568 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:50:21.507509 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497667 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:50:21.507509 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497670 2568 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:50:21.507509 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497672 2568 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:50:21.507509 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497675 2568 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:50:21.507927 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497678 2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:50:21.507927 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497680 2568 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:50:21.507927 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497683 2568 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:50:21.507927 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497686 2568 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:50:21.507927 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497688 2568 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:50:21.507927 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497691 2568 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:50:21.507927 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497693 2568 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:50:21.507927 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497696 2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:50:21.507927 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497699 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:50:21.507927 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497701 2568 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:50:21.507927 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497704 2568 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:50:21.507927 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497706 2568 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:50:21.507927 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497709 2568 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:50:21.507927 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497711 2568 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:50:21.507927 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497714 2568 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:50:21.507927 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497716 2568 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:50:21.507927 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497719 2568 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:50:21.507927 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497722 2568 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:50:21.507927 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497724 2568 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:50:21.507927 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497728 2568 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:50:21.508656 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497730 2568 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:50:21.508656 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497733 2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:50:21.508656 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497736 2568 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:50:21.508656 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497738 2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:50:21.508656 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497741 2568 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:50:21.508656 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497743 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:50:21.508656 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497746 2568 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:50:21.508656 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497749 2568 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:50:21.508656 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497751 2568 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:50:21.508656 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497754 2568 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:50:21.508656 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497757 2568 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:50:21.508656 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497759 2568 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:50:21.508656 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497762 2568 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:50:21.508656 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497764 2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:50:21.508656 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497767 2568 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:50:21.508656 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497770 2568 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:50:21.508656 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497772 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:50:21.508656 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497775 2568 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:50:21.508656 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497779 2568 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:50:21.509148 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497783 2568 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:50:21.509148 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497787 2568 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:50:21.509148 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497790 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:50:21.509148 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497793 2568 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:50:21.509148 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497796 2568 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:50:21.509148 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497799 2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:50:21.509148 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497802 2568 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:50:21.509148 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497805 2568 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:50:21.509148 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497808 2568 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:50:21.509148 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497810 2568 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:50:21.509148 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497813 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:50:21.509148 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497815 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:50:21.509148 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497818 2568 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:50:21.509148 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497821 2568 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:50:21.509148 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497823 2568 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:50:21.509148 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497826 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:50:21.509148 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497828 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:50:21.509148 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497831 2568 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:50:21.509148 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497834 2568 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:50:21.509673 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497837 2568 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:50:21.509673 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497839 2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:50:21.509673 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497842 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:50:21.509673 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497864 2568 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:50:21.509673 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497868 2568 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:50:21.509673 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497871 2568 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:50:21.509673 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497874 2568 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:50:21.509673 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497876 2568 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:50:21.509673 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497879 2568 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:50:21.509673 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497882 2568 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:50:21.509673 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497885 2568 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:50:21.509673 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497890 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:50:21.509673 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497894 2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:50:21.509673 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497896 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:50:21.509673 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497899 2568 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:50:21.509673 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497902 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:50:21.509673 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497905 2568 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:50:21.509673 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497907 2568 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:50:21.509673 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497911 2568 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:50:21.510156 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497913 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:50:21.510156 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497916 2568 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:50:21.510156 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497919 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:50:21.510156 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497921 2568 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:50:21.510156 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497924 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:50:21.510156 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497927 2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:50:21.510156 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497931 2568 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:50:21.510156 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497935 2568 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:50:21.510156 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497938 2568 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:50:21.510156 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497941 2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:50:21.510156 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497945 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:50:21.510156 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497948 2568 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:50:21.510156 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497950 2568 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:50:21.510156 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:21.497953 2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:50:21.510156 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.498009 2568 server.go:957] "Client rotation is on, will bootstrap in background" Nov 03 22:50:21.510156 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.501651 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Nov 03 22:50:21.510156 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.502476 2568 server.go:1014] "Starting client certificate rotation" Nov 03 22:50:21.510156 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.502572 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 03 22:50:21.510609 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.503117 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 03 22:50:21.510609 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.504369 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 22:50:21.510609 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.506352 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 22:50:21.516893 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.516869 2568 log.go:25] "Validated CRI v1 runtime API" Nov 03 22:50:21.522595 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.522576 2568 log.go:25] "Validated CRI v1 image API" Nov 03 22:50:21.523513 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.523485 2568 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 03 22:50:21.526445 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.526424 2568 fs.go:135] Filesystem UUIDs: map[2ca04727-afbf-472c-b610-fd29640f5c48:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a7c3a4a0-ebeb-49e1-9c0f-de7de0c24710:/dev/nvme0n1p4] Nov 03 22:50:21.526504 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.526446 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Nov 03 22:50:21.531066 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.531046 2568 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 03 22:50:21.532207 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.532091 2568 manager.go:217] Machine: {Timestamp:2026-11-03 22:50:21.530836148 +0000 UTC m=+0.311532102 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103434 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2214fe26ce4a9484d0f8e4c313e64a SystemUUID:ec2214fe-26ce-4a94-84d0-f8e4c313e64a BootID:e5160213-4b44-4b9e-98cc-476445cf1d5a Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e8:7a:20:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e8:7a:20:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:37:56:57:d4:d5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 03 22:50:21.532207 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.532207 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 03 22:50:21.532321 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.532295 2568 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 03 22:50:21.535003 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.534977 2568 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 03 22:50:21.535162 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.535004 2568 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-89.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 03 22:50:21.535649 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.535637 2568 topology_manager.go:143] "Creating topology manager with none policy" Nov 03 22:50:21.535681 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.535651 2568 container_manager_linux.go:311] "Creating device plugin manager" Nov 03 22:50:21.535681 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.535679 2568 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 22:50:21.535738 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.535694 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 22:50:21.536767 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.536756 2568 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 03 22:50:21.541256 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.541243 2568 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 03 22:50:21.541736 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.541687 2568 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 03 22:50:21.541828 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.541763 2568 kubelet.go:493] "Attempting to sync node with API server" Nov 03 22:50:21.541828 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.541823 2568 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 03 22:50:21.541912 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.541845 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 03 22:50:21.541912 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.541860 2568 kubelet.go:405] "Adding apiserver pod source" Nov 03 22:50:21.541912 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.541873 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 03 22:50:21.542378 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.542361 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 22:50:21.544799 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.544775 2568 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 03 22:50:21.549780 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.549762 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t98f5" Nov 03 22:50:21.551418 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.551404 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 22:50:21.552317 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.552304 2568 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 03 22:50:21.552366 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.552337 2568 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 03 22:50:21.552548 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.552537 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 03 22:50:21.552617 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.552554 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 03 22:50:21.552617 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.552562 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 03 22:50:21.552617 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.552573 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 03 22:50:21.552617 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.552591 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 03 22:50:21.552617 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.552598 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 03 22:50:21.553076 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.553067 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 03 22:50:21.553107 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.553077 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 03 22:50:21.553107 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.553084 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 03 22:50:21.553107 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.553089 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 03 22:50:21.553107 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.553098 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 03 22:50:21.553107 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.553108 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 03 22:50:21.553737 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.553727 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 03 22:50:21.553774 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.553741 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 03 22:50:21.557209 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.557191 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t98f5" Nov 03 22:50:21.558658 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.558636 2568 server.go:1263] "Started kubelet" Nov 03 22:50:21.558743 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.558686 2568 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 03 22:50:21.558821 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.558749 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 03 22:50:21.558875 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.558843 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 03 22:50:21.559560 ip-10-0-138-89 systemd[1]: Started Kubernetes Kubelet. Nov 03 22:50:21.560174 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.560065 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-89.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Nov 03 22:50:21.560808 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.560785 2568 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 03 22:50:21.560976 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.560962 2568 server.go:317] "Adding debug handlers to kubelet server" Nov 03 22:50:21.561832 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:21.561809 2568 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-89.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Nov 03 22:50:21.562402 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:21.562382 2568 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Nov 03 22:50:21.564299 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:21.564275 2568 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Nov 03 22:50:21.566316 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.566303 2568 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 03 22:50:21.566385 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.566337 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 03 22:50:21.566444 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:21.566406 2568 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-89.us-east-2.compute.internal\" not found" Nov 03 22:50:21.567115 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.566957 2568 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 03 22:50:21.567115 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.566987 2568 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 03 22:50:21.567115 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.566991 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 03 22:50:21.567115 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.567065 2568 reconstruct.go:97] "Volume reconstruction finished" Nov 03 22:50:21.567115 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.567074 2568 reconciler.go:29] "Reconciler: start to sync state" Nov 03 22:50:21.567373 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.567356 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 03 22:50:21.567373 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.567371 2568 factory.go:55] Registering systemd factory Nov 03 22:50:21.567482 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.567380 2568 factory.go:223] Registration of the systemd container factory successfully Nov 03 22:50:21.567645 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.567618 2568 factory.go:153] Registering CRI-O factory Nov 03 22:50:21.567645 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.567636 2568 factory.go:223] Registration of the crio container factory successfully Nov 03 22:50:21.567919 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.567653 2568 factory.go:103] Registering Raw factory Nov 03 22:50:21.567919 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.567693 2568 manager.go:1199] Started watching for new ooms in manager Nov 03 22:50:21.568718 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.568701 2568 manager.go:319] Starting recovery of all containers Nov 03 22:50:21.574622 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.574595 2568 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:50:21.580150 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.580126 2568 manager.go:324] Recovery completed Nov 03 22:50:21.580875 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:21.580850 2568 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-89.us-east-2.compute.internal\" not found" node="ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:21.585498 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.585484 2568 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 22:50:21.591354 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.591334 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 22:50:21.591426 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.591374 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 22:50:21.591426 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.591390 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 22:50:21.592025 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.592012 2568 cpu_manager.go:226] "Starting" policy="none" Nov 03 22:50:21.592025 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.592023 2568 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 03 22:50:21.592124 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.592039 2568 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 03 22:50:21.592124 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.592015 2568 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 22:50:21.592957 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.592943 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 22:50:21.592997 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.592969 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 22:50:21.592997 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.592983 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 22:50:21.594316 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.594304 2568 policy_none.go:50] "Start" Nov 03 22:50:21.594363 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.594320 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 03 22:50:21.594363 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.594330 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 03 22:50:21.596613 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.596601 2568 policy_none.go:44] "Start" Nov 03 22:50:21.652925 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.636080 2568 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 03 22:50:21.652925 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.638537 2568 manager.go:341] "Starting Device Plugin manager" Nov 03 22:50:21.652925 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:21.639128 2568 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 03 22:50:21.652925 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.639143 2568 server.go:87] "Starting device plugin registration server" Nov 03 22:50:21.652925 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.639383 2568 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 03 22:50:21.652925 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.639397 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 03 22:50:21.652925 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.639589 2568 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 03 22:50:21.652925 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.639662 2568 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 03 22:50:21.652925 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.639670 2568 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 03 22:50:21.652925 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:21.640033 2568 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 03 22:50:21.652925 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:21.640074 2568 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-89.us-east-2.compute.internal\" not found" Nov 03 22:50:21.652925 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.643585 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 03 22:50:21.652925 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.645127 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 03 22:50:21.652925 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.645149 2568 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 03 22:50:21.652925 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.645166 2568 kubelet.go:2521] "Starting kubelet main sync loop" Nov 03 22:50:21.652925 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:21.645197 2568 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Nov 03 22:50:21.652925 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.651743 2568 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:50:21.740183 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.740099 2568 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 22:50:21.741118 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.741093 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 22:50:21.741248 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.741161 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 22:50:21.741248 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.741178 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 22:50:21.741248 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.741211 2568 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:21.746281 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.746261 2568 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal"] Nov 03 22:50:21.746357 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.746321 2568 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 22:50:21.747768 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.747752 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 22:50:21.747838 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.747782 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 22:50:21.747838 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.747796 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 22:50:21.749993 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.749981 2568 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 22:50:21.750146 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.750132 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:21.750179 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.750161 2568 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 22:50:21.750930 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.750906 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 22:50:21.750930 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.750920 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 22:50:21.751060 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.750940 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 22:50:21.751060 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.750944 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 22:50:21.751060 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.750954 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 22:50:21.751060 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.750961 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 22:50:21.753075 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.753058 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:21.753156 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.753090 2568 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 22:50:21.753810 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.753797 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 22:50:21.753879 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.753822 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 22:50:21.753879 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.753832 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 22:50:21.755704 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.755690 2568 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:21.755774 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:21.755709 2568 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-89.us-east-2.compute.internal\": node \"ip-10-0-138-89.us-east-2.compute.internal\" not found" Nov 03 22:50:21.768920 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.768900 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90feb0e8f6d254df57c953bffb88632b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal\" (UID: \"90feb0e8f6d254df57c953bffb88632b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:21.769002 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.768923 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90feb0e8f6d254df57c953bffb88632b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal\" (UID: \"90feb0e8f6d254df57c953bffb88632b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:21.769002 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.768949 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d92d59dc723695c8e39db4d586eeb52-config\") pod \"kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal\" (UID: \"9d92d59dc723695c8e39db4d586eeb52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:21.778855 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:21.778836 2568 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-89.us-east-2.compute.internal\" not found" Nov 03 22:50:21.786062 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:21.786041 2568 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-89.us-east-2.compute.internal\" not found" node="ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:21.788648 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:21.788632 2568 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-89.us-east-2.compute.internal\" not found" node="ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:21.869983 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.869957 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90feb0e8f6d254df57c953bffb88632b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal\" (UID: \"90feb0e8f6d254df57c953bffb88632b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:21.870096 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.869986 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d92d59dc723695c8e39db4d586eeb52-config\") pod \"kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal\" (UID: \"9d92d59dc723695c8e39db4d586eeb52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:21.870096 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.870024 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90feb0e8f6d254df57c953bffb88632b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal\" (UID: \"90feb0e8f6d254df57c953bffb88632b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:21.870096 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.870053 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90feb0e8f6d254df57c953bffb88632b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal\" (UID: \"90feb0e8f6d254df57c953bffb88632b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:21.870096 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.870053 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90feb0e8f6d254df57c953bffb88632b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal\" (UID: \"90feb0e8f6d254df57c953bffb88632b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:21.870096 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:21.870077 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d92d59dc723695c8e39db4d586eeb52-config\") pod \"kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal\" (UID: \"9d92d59dc723695c8e39db4d586eeb52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:21.879094 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:21.879059 2568 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-89.us-east-2.compute.internal\" not found" Nov 03 22:50:21.979423 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:21.979395 2568 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-89.us-east-2.compute.internal\" not found" Nov 03 22:50:22.079734 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:22.079518 2568 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-89.us-east-2.compute.internal\" not found" Nov 03 22:50:22.091174 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.091143 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:22.092252 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.092234 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:22.180498 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:22.180472 2568 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-89.us-east-2.compute.internal\" not found" Nov 03 22:50:22.280990 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:22.280959 2568 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-89.us-east-2.compute.internal\" not found" Nov 03 22:50:22.381535 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:22.381466 2568 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-89.us-east-2.compute.internal\" not found" Nov 03 22:50:22.428024 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.427995 2568 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:50:22.467017 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.466990 2568 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:22.502394 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.502372 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Nov 03 22:50:22.502844 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.502502 2568 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 03 22:50:22.502844 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.502535 2568 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 03 22:50:22.502844 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.502553 2568 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 03 22:50:22.502844 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:22.502553 2568 kubelet.go:3370] "Failed creating a mirror pod" err="Post \"https://afebbde6d53c34f2492433af45b6626f-5cf7a6ebce136d4a.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.138.89:49616->3.132.122.89:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:22.502844 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.502597 2568 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:22.517697 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.517675 2568 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 22:50:22.543862 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.543846 2568 apiserver.go:52] "Watching apiserver" Nov 03 22:50:22.549408 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.549390 2568 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 03 22:50:22.549705 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.549688 2568 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-r2kpn","openshift-multus/network-metrics-daemon-qqzlx","kube-system/konnectivity-agent-kpt2c","openshift-cluster-node-tuning-operator/tuned-tbtk5","openshift-image-registry/node-ca-2frcd","kube-system/kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal","openshift-multus/multus-additional-cni-plugins-zkb4f","openshift-multus/multus-mzwfp","openshift-network-diagnostics/network-check-target-kmzch","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw","openshift-dns/node-resolver-mjl2l","openshift-network-operator/iptables-alerter-7hbs4","openshift-ovn-kubernetes/ovnkube-node-95bxf"] Nov 03 22:50:22.552562 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.552546 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.554776 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.554753 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:22.554874 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:22.554837 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:22.555588 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.555571 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7xqrp\"" Nov 03 22:50:22.555741 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.555726 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 03 22:50:22.555814 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.555798 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 03 22:50:22.555848 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.555803 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 03 22:50:22.555899 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.555888 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 03 22:50:22.556032 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.556020 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 03 22:50:22.557382 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.557368 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kpt2c" Nov 03 22:50:22.560098 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.560072 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.562260 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.562217 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-02 22:45:22 +0000 UTC" deadline="2028-08-16 07:13:56.056994306 +0000 UTC" Nov 03 22:50:22.562350 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.562262 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15632h23m33.494736363s" Nov 03 22:50:22.562350 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.562239 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2frcd" Nov 03 22:50:22.564547 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.564529 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:22.564649 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:22.564604 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:50:22.566893 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.566878 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Nov 03 22:50:22.568234 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.568217 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.570414 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.570401 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:22.570505 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:22.570484 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:50:22.573465 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.573428 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-etc-kubernetes\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.573537 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.573483 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a51fb1d-abfd-4803-8489-56e7ec93127f-cnibin\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.574174 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.573851 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7354598a-9d87-4762-9633-da3d96ff063b-kubelet-config\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:22.574174 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.573889 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.574174 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.573915 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-cni-dir\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.574174 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.573948 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-cnibin\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.574174 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.573968 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9cfd418-f163-4b86-896f-fd898cb2ebf6-cni-binary-copy\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.574174 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574009 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-run-netns\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.574174 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574077 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-run-multus-certs\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.574174 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574122 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a51fb1d-abfd-4803-8489-56e7ec93127f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.574174 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574154 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nc4c\" (UniqueName: \"kubernetes.io/projected/7a51fb1d-abfd-4803-8489-56e7ec93127f-kube-api-access-5nc4c\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.574498 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574187 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-system-cni-dir\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.574498 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574222 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-modprobe-d\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.574498 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574265 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-tuned\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.574498 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574290 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a51fb1d-abfd-4803-8489-56e7ec93127f-system-cni-dir\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.574498 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574327 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a51fb1d-abfd-4803-8489-56e7ec93127f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.574498 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574348 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a51fb1d-abfd-4803-8489-56e7ec93127f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.574498 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574369 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-socket-dir-parent\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.574498 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574406 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-var-lib-cni-bin\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.574498 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574431 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/adc37e3e-9f5d-4eba-8b13-6f467c3060d3-agent-certs\") pod \"konnectivity-agent-kpt2c\" (UID: \"adc37e3e-9f5d-4eba-8b13-6f467c3060d3\") " pod="kube-system/konnectivity-agent-kpt2c" Nov 03 22:50:22.574498 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574467 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-host\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.574498 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574496 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-hostroot\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.574923 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574515 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs\") pod \"network-metrics-daemon-qqzlx\" (UID: \"b725cdb0-2fe7-42d6-99b0-1f36d22081af\") " pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:22.574923 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574534 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-conf-dir\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.574923 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574553 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a51fb1d-abfd-4803-8489-56e7ec93127f-cni-binary-copy\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.574923 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574601 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7354598a-9d87-4762-9633-da3d96ff063b-dbus\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:22.574923 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574638 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4stf\" (UniqueName: \"kubernetes.io/projected/a9cfd418-f163-4b86-896f-fd898cb2ebf6-kube-api-access-f4stf\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.574923 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574658 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-sysctl-d\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.574923 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574678 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-sys\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.574923 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574723 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c295fd2-23ab-4994-9ae2-60947f409b62-tmp\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.574923 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574755 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2xgn\" (UniqueName: \"kubernetes.io/projected/6c295fd2-23ab-4994-9ae2-60947f409b62-kube-api-access-m2xgn\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.574923 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574781 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:22.574923 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574871 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-var-lib-kubelet\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.574923 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574900 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-sysctl-conf\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.574923 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574922 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-systemd\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.575533 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574958 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-lib-modules\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.575533 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.574999 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w42mm\" (UniqueName: \"kubernetes.io/projected/c7b36354-ea7c-4f8c-a96e-f9ba840f2036-kube-api-access-w42mm\") pod \"node-ca-2frcd\" (UID: \"c7b36354-ea7c-4f8c-a96e-f9ba840f2036\") " pod="openshift-image-registry/node-ca-2frcd" Nov 03 22:50:22.575533 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.575029 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-run-k8s-cni-cncf-io\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.575533 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.575081 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-var-lib-cni-multus\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.575533 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.575154 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-daemon-config\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.575533 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.575192 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj6zx\" (UniqueName: \"kubernetes.io/projected/b725cdb0-2fe7-42d6-99b0-1f36d22081af-kube-api-access-zj6zx\") pod \"network-metrics-daemon-qqzlx\" (UID: \"b725cdb0-2fe7-42d6-99b0-1f36d22081af\") " pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:22.575533 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.575215 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/adc37e3e-9f5d-4eba-8b13-6f467c3060d3-konnectivity-ca\") pod \"konnectivity-agent-kpt2c\" (UID: \"adc37e3e-9f5d-4eba-8b13-6f467c3060d3\") " pod="kube-system/konnectivity-agent-kpt2c" Nov 03 22:50:22.575533 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.575262 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-sysconfig\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.575533 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.575295 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-var-lib-kubelet\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.575533 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.575339 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7b36354-ea7c-4f8c-a96e-f9ba840f2036-serviceca\") pod \"node-ca-2frcd\" (UID: \"c7b36354-ea7c-4f8c-a96e-f9ba840f2036\") " pod="openshift-image-registry/node-ca-2frcd" Nov 03 22:50:22.575533 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.575368 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-kubernetes\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.575533 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.575399 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-run\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.575533 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.575434 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7b36354-ea7c-4f8c-a96e-f9ba840f2036-host\") pod \"node-ca-2frcd\" (UID: \"c7b36354-ea7c-4f8c-a96e-f9ba840f2036\") " pod="openshift-image-registry/node-ca-2frcd" Nov 03 22:50:22.576199 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.576181 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mjl2l" Nov 03 22:50:22.577631 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.577614 2568 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 03 22:50:22.578594 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.578577 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7hbs4" Nov 03 22:50:22.581215 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.581199 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.594349 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.594333 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tp8fn" Nov 03 22:50:22.601787 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.601771 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tp8fn" Nov 03 22:50:22.656180 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.656003 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 03 22:50:22.656180 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.656052 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 03 22:50:22.656391 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.656283 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 03 22:50:22.656391 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.656317 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 03 22:50:22.656507 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.656389 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 03 22:50:22.656507 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.656416 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 03 22:50:22.656603 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.656557 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 03 22:50:22.656683 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.656661 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-fpn8c\"" Nov 03 22:50:22.657018 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.656932 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 03 22:50:22.657018 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.656955 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4m98w\"" Nov 03 22:50:22.657206 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.657184 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 03 22:50:22.657281 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.657213 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 03 22:50:22.657329 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.657295 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-6ln97\"" Nov 03 22:50:22.657373 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.657352 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 03 22:50:22.657418 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.657401 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qt84f\"" Nov 03 22:50:22.657485 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.657406 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 03 22:50:22.657485 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.657432 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2lq2j\"" Nov 03 22:50:22.657485 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.657447 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-55tt4\"" Nov 03 22:50:22.657485 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.657474 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 03 22:50:22.657662 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.657483 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xz7vt\"" Nov 03 22:50:22.657662 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.657542 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 03 22:50:22.657662 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.657572 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 03 22:50:22.657662 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.657595 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 03 22:50:22.657662 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.657660 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 03 22:50:22.657842 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.657664 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5qb72\"" Nov 03 22:50:22.661824 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.658542 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 03 22:50:22.661824 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.658636 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 03 22:50:22.661824 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.658932 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 03 22:50:22.661824 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.659182 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 03 22:50:22.661824 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.659515 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 03 22:50:22.667746 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.667730 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 03 22:50:22.675652 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.675631 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-run-ovn-kubernetes\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.675788 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.675659 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vf8n\" (UniqueName: \"kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n\") pod \"network-check-target-kmzch\" (UID: \"89db2583-ca69-48db-adf0-1383f53434c1\") " pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:22.675788 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.675675 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-ovnkube-config\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.675788 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.675691 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-registration-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.675788 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.675715 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-etc-kubernetes\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.675788 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.675768 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-cni-dir\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.676032 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.675796 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-etc-kubernetes\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.676032 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.675814 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-cnibin\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.676032 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.675840 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-env-overrides\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.676032 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.675856 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-cnibin\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.676032 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.675865 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-run-multus-certs\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.676032 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.675905 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-run-multus-certs\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.676032 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.675905 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a51fb1d-abfd-4803-8489-56e7ec93127f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.676032 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.675960 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nc4c\" (UniqueName: \"kubernetes.io/projected/7a51fb1d-abfd-4803-8489-56e7ec93127f-kube-api-access-5nc4c\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.676032 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.675964 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-cni-dir\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.676032 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.675993 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-kubelet\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.676032 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676035 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-systemd-units\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.676695 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676060 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-run-openvswitch\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.676695 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676118 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg6k8\" (UniqueName: \"kubernetes.io/projected/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-kube-api-access-mg6k8\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.676695 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676180 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f40c765d-cb44-4835-a41d-8cfb35f73f40-tmp-dir\") pod \"node-resolver-mjl2l\" (UID: \"f40c765d-cb44-4835-a41d-8cfb35f73f40\") " pod="openshift-dns/node-resolver-mjl2l" Nov 03 22:50:22.676695 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676222 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a51fb1d-abfd-4803-8489-56e7ec93127f-system-cni-dir\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.676695 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676255 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a51fb1d-abfd-4803-8489-56e7ec93127f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.676695 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676325 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a51fb1d-abfd-4803-8489-56e7ec93127f-system-cni-dir\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.676695 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676339 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a51fb1d-abfd-4803-8489-56e7ec93127f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.676695 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676394 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-var-lib-cni-bin\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.676695 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676423 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-host\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.676695 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676433 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a51fb1d-abfd-4803-8489-56e7ec93127f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.676695 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676470 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-log-socket\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.676695 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676495 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-hostroot\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.676695 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676502 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-var-lib-cni-bin\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.676695 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676509 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-host\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.676695 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676519 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pnxz\" (UniqueName: \"kubernetes.io/projected/f40c765d-cb44-4835-a41d-8cfb35f73f40-kube-api-access-6pnxz\") pod \"node-resolver-mjl2l\" (UID: \"f40c765d-cb44-4835-a41d-8cfb35f73f40\") " pod="openshift-dns/node-resolver-mjl2l" Nov 03 22:50:22.676695 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676560 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-hostroot\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.676695 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676561 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-conf-dir\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.677416 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676598 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-conf-dir\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.677416 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676605 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a51fb1d-abfd-4803-8489-56e7ec93127f-cni-binary-copy\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.677416 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676709 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4stf\" (UniqueName: \"kubernetes.io/projected/a9cfd418-f163-4b86-896f-fd898cb2ebf6-kube-api-access-f4stf\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.677416 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676745 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c295fd2-23ab-4994-9ae2-60947f409b62-tmp\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.677416 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676772 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/feb1ae85-eef8-4a26-b341-b06161f7210d-host-slash\") pod \"iptables-alerter-7hbs4\" (UID: \"feb1ae85-eef8-4a26-b341-b06161f7210d\") " pod="openshift-network-operator/iptables-alerter-7hbs4" Nov 03 22:50:22.677416 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676795 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-cni-bin\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.677416 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676820 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:22.677416 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676867 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-sysctl-conf\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.677416 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.676927 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-systemd\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.677416 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:22.676957 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:22.677416 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677008 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-systemd\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.677416 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677039 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-sysctl-conf\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.677416 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:22.677106 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret podName:7354598a-9d87-4762-9633-da3d96ff063b nodeName:}" failed. No retries permitted until 2026-11-03 22:50:23.177079246 +0000 UTC m=+1.957775205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret") pod "global-pull-secret-syncer-r2kpn" (UID: "7354598a-9d87-4762-9633-da3d96ff063b") : object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:22.677416 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677122 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-lib-modules\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.677416 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677150 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-run-ovn\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.677416 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677187 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-sys-fs\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.677416 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677196 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-lib-modules\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.678185 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677214 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-run-k8s-cni-cncf-io\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.678185 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677263 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-daemon-config\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.678185 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677299 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj6zx\" (UniqueName: \"kubernetes.io/projected/b725cdb0-2fe7-42d6-99b0-1f36d22081af-kube-api-access-zj6zx\") pod \"network-metrics-daemon-qqzlx\" (UID: \"b725cdb0-2fe7-42d6-99b0-1f36d22081af\") " pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:22.678185 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677321 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-var-lib-kubelet\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.678185 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677324 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a51fb1d-abfd-4803-8489-56e7ec93127f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.678185 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677347 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-var-lib-openvswitch\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.678185 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677388 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtmbf\" (UniqueName: \"kubernetes.io/projected/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-kube-api-access-vtmbf\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.678185 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677412 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.678185 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677439 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-kubernetes\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.678185 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677489 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-run\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.678185 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677491 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a51fb1d-abfd-4803-8489-56e7ec93127f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.678185 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677512 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7b36354-ea7c-4f8c-a96e-f9ba840f2036-host\") pod \"node-ca-2frcd\" (UID: \"c7b36354-ea7c-4f8c-a96e-f9ba840f2036\") " pod="openshift-image-registry/node-ca-2frcd" Nov 03 22:50:22.678185 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677538 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-node-log\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.678185 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677320 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-run-k8s-cni-cncf-io\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.678185 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677656 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-run\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.678185 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677668 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-var-lib-kubelet\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.678185 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677677 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7b36354-ea7c-4f8c-a96e-f9ba840f2036-host\") pod \"node-ca-2frcd\" (UID: \"c7b36354-ea7c-4f8c-a96e-f9ba840f2036\") " pod="openshift-image-registry/node-ca-2frcd" Nov 03 22:50:22.678849 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677678 2568 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 03 22:50:22.678849 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677570 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.678849 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677736 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-ovnkube-script-lib\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.678849 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677748 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-kubernetes\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.678849 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677770 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a51fb1d-abfd-4803-8489-56e7ec93127f-cni-binary-copy\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.678849 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677787 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-etc-selinux\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.678849 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677831 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a51fb1d-abfd-4803-8489-56e7ec93127f-cnibin\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.678849 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677858 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7354598a-9d87-4762-9633-da3d96ff063b-kubelet-config\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:22.678849 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677863 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a51fb1d-abfd-4803-8489-56e7ec93127f-cnibin\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.678849 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677881 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9cfd418-f163-4b86-896f-fd898cb2ebf6-cni-binary-copy\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.678849 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677897 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-run-netns\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.678849 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677900 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7354598a-9d87-4762-9633-da3d96ff063b-kubelet-config\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:22.678849 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677911 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-tuned\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.678849 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677961 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-slash\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.678849 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677985 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-run-netns\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.678849 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.677963 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-run-netns\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.678849 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678012 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-socket-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.679801 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678060 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-system-cni-dir\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.679801 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678083 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-modprobe-d\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.679801 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678099 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-device-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.679801 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678132 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-socket-dir-parent\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.679801 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678155 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/adc37e3e-9f5d-4eba-8b13-6f467c3060d3-agent-certs\") pod \"konnectivity-agent-kpt2c\" (UID: \"adc37e3e-9f5d-4eba-8b13-6f467c3060d3\") " pod="kube-system/konnectivity-agent-kpt2c" Nov 03 22:50:22.679801 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678235 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-modprobe-d\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.679801 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678301 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-system-cni-dir\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.679801 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678294 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f40c765d-cb44-4835-a41d-8cfb35f73f40-hosts-file\") pod \"node-resolver-mjl2l\" (UID: \"f40c765d-cb44-4835-a41d-8cfb35f73f40\") " pod="openshift-dns/node-resolver-mjl2l" Nov 03 22:50:22.679801 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678338 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-daemon-config\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.679801 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678357 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-cni-netd\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.679801 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678365 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9cfd418-f163-4b86-896f-fd898cb2ebf6-cni-binary-copy\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.679801 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678370 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-socket-dir-parent\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.679801 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678384 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-ovn-node-metrics-cert\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.679801 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678433 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs\") pod \"network-metrics-daemon-qqzlx\" (UID: \"b725cdb0-2fe7-42d6-99b0-1f36d22081af\") " pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:22.679801 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678491 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7354598a-9d87-4762-9633-da3d96ff063b-dbus\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:22.679801 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:22.678585 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:22.679801 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678585 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-sysctl-d\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.679801 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678640 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7354598a-9d87-4762-9633-da3d96ff063b-dbus\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:22.680677 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678673 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-sysctl-d\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.680677 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678694 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-sys\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.680677 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:22.678723 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs podName:b725cdb0-2fe7-42d6-99b0-1f36d22081af nodeName:}" failed. No retries permitted until 2026-11-03 22:50:23.178708457 +0000 UTC m=+1.959404406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs") pod "network-metrics-daemon-qqzlx" (UID: "b725cdb0-2fe7-42d6-99b0-1f36d22081af") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:22.680677 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678732 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-sys\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.680677 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678740 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2xgn\" (UniqueName: \"kubernetes.io/projected/6c295fd2-23ab-4994-9ae2-60947f409b62-kube-api-access-m2xgn\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.680677 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678764 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-run-systemd\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.680677 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678796 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-var-lib-kubelet\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.680677 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678830 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w42mm\" (UniqueName: \"kubernetes.io/projected/c7b36354-ea7c-4f8c-a96e-f9ba840f2036-kube-api-access-w42mm\") pod \"node-ca-2frcd\" (UID: \"c7b36354-ea7c-4f8c-a96e-f9ba840f2036\") " pod="openshift-image-registry/node-ca-2frcd" Nov 03 22:50:22.680677 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678902 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-var-lib-kubelet\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.680677 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678920 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/feb1ae85-eef8-4a26-b341-b06161f7210d-iptables-alerter-script\") pod \"iptables-alerter-7hbs4\" (UID: \"feb1ae85-eef8-4a26-b341-b06161f7210d\") " pod="openshift-network-operator/iptables-alerter-7hbs4" Nov 03 22:50:22.680677 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678951 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-var-lib-cni-multus\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.680677 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.678978 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/adc37e3e-9f5d-4eba-8b13-6f467c3060d3-konnectivity-ca\") pod \"konnectivity-agent-kpt2c\" (UID: \"adc37e3e-9f5d-4eba-8b13-6f467c3060d3\") " pod="kube-system/konnectivity-agent-kpt2c" Nov 03 22:50:22.680677 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.679002 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-sysconfig\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.680677 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.679028 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7b36354-ea7c-4f8c-a96e-f9ba840f2036-serviceca\") pod \"node-ca-2frcd\" (UID: \"c7b36354-ea7c-4f8c-a96e-f9ba840f2036\") " pod="openshift-image-registry/node-ca-2frcd" Nov 03 22:50:22.680677 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.679039 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-var-lib-cni-multus\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.680677 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.679053 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pf5c\" (UniqueName: \"kubernetes.io/projected/feb1ae85-eef8-4a26-b341-b06161f7210d-kube-api-access-4pf5c\") pod \"iptables-alerter-7hbs4\" (UID: \"feb1ae85-eef8-4a26-b341-b06161f7210d\") " pod="openshift-network-operator/iptables-alerter-7hbs4" Nov 03 22:50:22.681410 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.679100 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-etc-openvswitch\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.681410 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.679162 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-sysconfig\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.681410 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.679622 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7b36354-ea7c-4f8c-a96e-f9ba840f2036-serviceca\") pod \"node-ca-2frcd\" (UID: \"c7b36354-ea7c-4f8c-a96e-f9ba840f2036\") " pod="openshift-image-registry/node-ca-2frcd" Nov 03 22:50:22.681410 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.679723 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/adc37e3e-9f5d-4eba-8b13-6f467c3060d3-konnectivity-ca\") pod \"konnectivity-agent-kpt2c\" (UID: \"adc37e3e-9f5d-4eba-8b13-6f467c3060d3\") " pod="kube-system/konnectivity-agent-kpt2c" Nov 03 22:50:22.681808 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.681708 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c295fd2-23ab-4994-9ae2-60947f409b62-tmp\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.681954 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.681932 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/adc37e3e-9f5d-4eba-8b13-6f467c3060d3-agent-certs\") pod \"konnectivity-agent-kpt2c\" (UID: \"adc37e3e-9f5d-4eba-8b13-6f467c3060d3\") " pod="kube-system/konnectivity-agent-kpt2c" Nov 03 22:50:22.682049 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.681935 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-tuned\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.683050 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.683030 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nc4c\" (UniqueName: \"kubernetes.io/projected/7a51fb1d-abfd-4803-8489-56e7ec93127f-kube-api-access-5nc4c\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.687520 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.687491 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj6zx\" (UniqueName: \"kubernetes.io/projected/b725cdb0-2fe7-42d6-99b0-1f36d22081af-kube-api-access-zj6zx\") pod \"network-metrics-daemon-qqzlx\" (UID: \"b725cdb0-2fe7-42d6-99b0-1f36d22081af\") " pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:22.687789 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.687772 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4stf\" (UniqueName: \"kubernetes.io/projected/a9cfd418-f163-4b86-896f-fd898cb2ebf6-kube-api-access-f4stf\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.688505 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.688486 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w42mm\" (UniqueName: \"kubernetes.io/projected/c7b36354-ea7c-4f8c-a96e-f9ba840f2036-kube-api-access-w42mm\") pod \"node-ca-2frcd\" (UID: \"c7b36354-ea7c-4f8c-a96e-f9ba840f2036\") " pod="openshift-image-registry/node-ca-2frcd" Nov 03 22:50:22.688660 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.688635 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2xgn\" (UniqueName: \"kubernetes.io/projected/6c295fd2-23ab-4994-9ae2-60947f409b62-kube-api-access-m2xgn\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.746709 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:22.746670 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d92d59dc723695c8e39db4d586eeb52.slice/crio-b06ba18a444ce9770746fe46ce6facf68dab12ee4958eff85eb0ca45dc56c329 WatchSource:0}: Error finding container b06ba18a444ce9770746fe46ce6facf68dab12ee4958eff85eb0ca45dc56c329: Status 404 returned error can't find the container with id b06ba18a444ce9770746fe46ce6facf68dab12ee4958eff85eb0ca45dc56c329 Nov 03 22:50:22.748468 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:22.748430 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90feb0e8f6d254df57c953bffb88632b.slice/crio-db2716a9e46421c1dea6535d456b1f43c0fcea424c2c9a9f27ea31fe2948d78e WatchSource:0}: Error finding container db2716a9e46421c1dea6535d456b1f43c0fcea424c2c9a9f27ea31fe2948d78e: Status 404 returned error can't find the container with id db2716a9e46421c1dea6535d456b1f43c0fcea424c2c9a9f27ea31fe2948d78e Nov 03 22:50:22.751904 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.751886 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 22:50:22.780323 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780290 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-run-systemd\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.780417 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780332 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/feb1ae85-eef8-4a26-b341-b06161f7210d-iptables-alerter-script\") pod \"iptables-alerter-7hbs4\" (UID: \"feb1ae85-eef8-4a26-b341-b06161f7210d\") " pod="openshift-network-operator/iptables-alerter-7hbs4" Nov 03 22:50:22.780417 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780358 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pf5c\" (UniqueName: \"kubernetes.io/projected/feb1ae85-eef8-4a26-b341-b06161f7210d-kube-api-access-4pf5c\") pod \"iptables-alerter-7hbs4\" (UID: \"feb1ae85-eef8-4a26-b341-b06161f7210d\") " pod="openshift-network-operator/iptables-alerter-7hbs4" Nov 03 22:50:22.780417 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780397 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-run-systemd\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.780538 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780482 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-etc-openvswitch\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.780538 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780520 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-run-ovn-kubernetes\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.780538 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780530 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-etc-openvswitch\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.780633 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780540 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vf8n\" (UniqueName: \"kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n\") pod \"network-check-target-kmzch\" (UID: \"89db2583-ca69-48db-adf0-1383f53434c1\") " pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:22.780633 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780561 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-ovnkube-config\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.780633 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780573 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-run-ovn-kubernetes\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.780633 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780603 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-registration-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.780633 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780629 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-env-overrides\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.780815 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780650 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-kubelet\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.780815 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780691 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-systemd-units\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.780815 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780711 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-run-openvswitch\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.780815 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780732 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6k8\" (UniqueName: \"kubernetes.io/projected/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-kube-api-access-mg6k8\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.780815 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780755 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f40c765d-cb44-4835-a41d-8cfb35f73f40-tmp-dir\") pod \"node-resolver-mjl2l\" (UID: \"f40c765d-cb44-4835-a41d-8cfb35f73f40\") " pod="openshift-dns/node-resolver-mjl2l" Nov 03 22:50:22.780815 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780773 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-registration-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.780815 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780776 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-kubelet\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.780815 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780782 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-log-socket\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.780815 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780812 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-log-socket\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.781208 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780821 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-systemd-units\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.781208 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780824 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-run-openvswitch\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.781208 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780825 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pnxz\" (UniqueName: \"kubernetes.io/projected/f40c765d-cb44-4835-a41d-8cfb35f73f40-kube-api-access-6pnxz\") pod \"node-resolver-mjl2l\" (UID: \"f40c765d-cb44-4835-a41d-8cfb35f73f40\") " pod="openshift-dns/node-resolver-mjl2l" Nov 03 22:50:22.781208 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780920 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/feb1ae85-eef8-4a26-b341-b06161f7210d-iptables-alerter-script\") pod \"iptables-alerter-7hbs4\" (UID: \"feb1ae85-eef8-4a26-b341-b06161f7210d\") " pod="openshift-network-operator/iptables-alerter-7hbs4" Nov 03 22:50:22.781208 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.780971 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/feb1ae85-eef8-4a26-b341-b06161f7210d-host-slash\") pod \"iptables-alerter-7hbs4\" (UID: \"feb1ae85-eef8-4a26-b341-b06161f7210d\") " pod="openshift-network-operator/iptables-alerter-7hbs4" Nov 03 22:50:22.781208 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781002 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-cni-bin\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.781208 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781043 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-run-ovn\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.781208 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781090 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/feb1ae85-eef8-4a26-b341-b06161f7210d-host-slash\") pod \"iptables-alerter-7hbs4\" (UID: \"feb1ae85-eef8-4a26-b341-b06161f7210d\") " pod="openshift-network-operator/iptables-alerter-7hbs4" Nov 03 22:50:22.781208 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781089 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-sys-fs\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.781208 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781129 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-var-lib-openvswitch\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.781208 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781144 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-cni-bin\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.781208 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781154 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtmbf\" (UniqueName: \"kubernetes.io/projected/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-kube-api-access-vtmbf\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.781208 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781173 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-env-overrides\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.781208 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781204 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.781856 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781206 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-ovnkube-config\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.781856 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781222 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-sys-fs\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.781856 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781229 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-var-lib-openvswitch\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.781856 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781275 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f40c765d-cb44-4835-a41d-8cfb35f73f40-tmp-dir\") pod \"node-resolver-mjl2l\" (UID: \"f40c765d-cb44-4835-a41d-8cfb35f73f40\") " pod="openshift-dns/node-resolver-mjl2l" Nov 03 22:50:22.781856 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781285 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.781856 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781264 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-run-ovn\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.781856 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781326 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-node-log\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.781856 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781413 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-node-log\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.781856 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781412 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.781856 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781502 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-ovnkube-script-lib\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.781856 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781531 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-etc-selinux\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.781856 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781503 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.781856 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781565 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-slash\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.781856 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781609 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-run-netns\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.781856 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781631 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-etc-selinux\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.781856 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781633 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-socket-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.781856 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781653 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-slash\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.782517 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781659 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-run-netns\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.782517 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781666 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-device-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.782517 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781707 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f40c765d-cb44-4835-a41d-8cfb35f73f40-hosts-file\") pod \"node-resolver-mjl2l\" (UID: \"f40c765d-cb44-4835-a41d-8cfb35f73f40\") " pod="openshift-dns/node-resolver-mjl2l" Nov 03 22:50:22.782517 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781721 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-cni-netd\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.782517 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781739 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-socket-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.782517 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781767 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f40c765d-cb44-4835-a41d-8cfb35f73f40-hosts-file\") pod \"node-resolver-mjl2l\" (UID: \"f40c765d-cb44-4835-a41d-8cfb35f73f40\") " pod="openshift-dns/node-resolver-mjl2l" Nov 03 22:50:22.782517 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781751 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-device-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.782517 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781843 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-ovn-node-metrics-cert\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.782517 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781865 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-cni-netd\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.782517 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.781971 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-ovnkube-script-lib\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.784109 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.784080 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-ovn-node-metrics-cert\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.786253 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:22.786235 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 22:50:22.786342 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:22.786262 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 22:50:22.786342 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:22.786275 2568 projected.go:196] Error preparing data for projected volume kube-api-access-7vf8n for pod openshift-network-diagnostics/network-check-target-kmzch: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:22.786437 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:22.786363 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n podName:89db2583-ca69-48db-adf0-1383f53434c1 nodeName:}" failed. No retries permitted until 2026-11-03 22:50:23.286344695 +0000 UTC m=+2.067040656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7vf8n" (UniqueName: "kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n") pod "network-check-target-kmzch" (UID: "89db2583-ca69-48db-adf0-1383f53434c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:22.789973 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.789443 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pf5c\" (UniqueName: \"kubernetes.io/projected/feb1ae85-eef8-4a26-b341-b06161f7210d-kube-api-access-4pf5c\") pod \"iptables-alerter-7hbs4\" (UID: \"feb1ae85-eef8-4a26-b341-b06161f7210d\") " pod="openshift-network-operator/iptables-alerter-7hbs4" Nov 03 22:50:22.790907 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.790885 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg6k8\" (UniqueName: \"kubernetes.io/projected/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-kube-api-access-mg6k8\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.791166 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.791143 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pnxz\" (UniqueName: \"kubernetes.io/projected/f40c765d-cb44-4835-a41d-8cfb35f73f40-kube-api-access-6pnxz\") pod \"node-resolver-mjl2l\" (UID: \"f40c765d-cb44-4835-a41d-8cfb35f73f40\") " pod="openshift-dns/node-resolver-mjl2l" Nov 03 22:50:22.791815 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.791800 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtmbf\" (UniqueName: \"kubernetes.io/projected/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-kube-api-access-vtmbf\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:22.900217 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.900143 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:50:22.910479 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:22.910438 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a51fb1d_abfd_4803_8489_56e7ec93127f.slice/crio-aa284f0a066d70a183637078ea8db21bf28a8cfd02935f03d52c0e95b92384b4 WatchSource:0}: Error finding container aa284f0a066d70a183637078ea8db21bf28a8cfd02935f03d52c0e95b92384b4: Status 404 returned error can't find the container with id aa284f0a066d70a183637078ea8db21bf28a8cfd02935f03d52c0e95b92384b4 Nov 03 22:50:22.910601 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.910500 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kpt2c" Nov 03 22:50:22.918535 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:22.918511 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc37e3e_9f5d_4eba_8b13_6f467c3060d3.slice/crio-a53b71d42c4c45fbc3b5bbb6521fb8fc77e096b7f4cd53526ad450540ad6b904 WatchSource:0}: Error finding container a53b71d42c4c45fbc3b5bbb6521fb8fc77e096b7f4cd53526ad450540ad6b904: Status 404 returned error can't find the container with id a53b71d42c4c45fbc3b5bbb6521fb8fc77e096b7f4cd53526ad450540ad6b904 Nov 03 22:50:22.926793 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.926773 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:50:22.934392 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:22.934368 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c295fd2_23ab_4994_9ae2_60947f409b62.slice/crio-be38561e6f979c293e2f11d0b19f3a69832f37316fe6d75688c4f0c4cd200cb8 WatchSource:0}: Error finding container be38561e6f979c293e2f11d0b19f3a69832f37316fe6d75688c4f0c4cd200cb8: Status 404 returned error can't find the container with id be38561e6f979c293e2f11d0b19f3a69832f37316fe6d75688c4f0c4cd200cb8 Nov 03 22:50:22.939597 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.939580 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2frcd" Nov 03 22:50:22.947361 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:22.947340 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7b36354_ea7c_4f8c_a96e_f9ba840f2036.slice/crio-f276455788cd61bfe8d0379a7dcf9aace10ab3e97bc1b53552b5f042900b890e WatchSource:0}: Error finding container f276455788cd61bfe8d0379a7dcf9aace10ab3e97bc1b53552b5f042900b890e: Status 404 returned error can't find the container with id f276455788cd61bfe8d0379a7dcf9aace10ab3e97bc1b53552b5f042900b890e Nov 03 22:50:22.957782 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.957765 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mzwfp" Nov 03 22:50:22.965553 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:22.965531 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9cfd418_f163_4b86_896f_fd898cb2ebf6.slice/crio-c68ee02bc5e9766696eb190607f39dfdcf94763f178908d94074e54883442508 WatchSource:0}: Error finding container c68ee02bc5e9766696eb190607f39dfdcf94763f178908d94074e54883442508: Status 404 returned error can't find the container with id c68ee02bc5e9766696eb190607f39dfdcf94763f178908d94074e54883442508 Nov 03 22:50:22.987258 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.987237 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:50:22.995991 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:22.995970 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb99b9ce3_9872_4265_b7e2_26c4851a3ebf.slice/crio-8ee5d7f721db9c84a733e28cba8eb7274a47ba814a1ac6f3f10c1e4921290d6d WatchSource:0}: Error finding container 8ee5d7f721db9c84a733e28cba8eb7274a47ba814a1ac6f3f10c1e4921290d6d: Status 404 returned error can't find the container with id 8ee5d7f721db9c84a733e28cba8eb7274a47ba814a1ac6f3f10c1e4921290d6d Nov 03 22:50:22.999083 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:22.999067 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mjl2l" Nov 03 22:50:23.007790 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:23.007770 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40c765d_cb44_4835_a41d_8cfb35f73f40.slice/crio-7abb60fd0dbd49ed95d56ddc057a615ef4773fcead757435b6a8377f587c7350 WatchSource:0}: Error finding container 7abb60fd0dbd49ed95d56ddc057a615ef4773fcead757435b6a8377f587c7350: Status 404 returned error can't find the container with id 7abb60fd0dbd49ed95d56ddc057a615ef4773fcead757435b6a8377f587c7350 Nov 03 22:50:23.014991 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.014977 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7hbs4" Nov 03 22:50:23.017340 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.017321 2568 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:50:23.023463 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:23.023431 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb1ae85_eef8_4a26_b341_b06161f7210d.slice/crio-f693f3c51671bc6b05a80d85eef83e783968858cbe19d60a1ce62a5cb95670d0 WatchSource:0}: Error finding container f693f3c51671bc6b05a80d85eef83e783968858cbe19d60a1ce62a5cb95670d0: Status 404 returned error can't find the container with id f693f3c51671bc6b05a80d85eef83e783968858cbe19d60a1ce62a5cb95670d0 Nov 03 22:50:23.034772 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.034757 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:23.044832 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:50:23.044813 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5362ce0b_df5e_4bac_9d66_fbebfff0cbb4.slice/crio-5f5365b774847e607f16c0aa930efa27eb63ace8ecd65978574e22b4b3d069c1 WatchSource:0}: Error finding container 5f5365b774847e607f16c0aa930efa27eb63ace8ecd65978574e22b4b3d069c1: Status 404 returned error can't find the container with id 5f5365b774847e607f16c0aa930efa27eb63ace8ecd65978574e22b4b3d069c1 Nov 03 22:50:23.185722 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.185652 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs\") pod \"network-metrics-daemon-qqzlx\" (UID: \"b725cdb0-2fe7-42d6-99b0-1f36d22081af\") " pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:23.185722 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.185717 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:23.185916 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:23.185808 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:23.185916 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:23.185808 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:23.185916 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:23.185870 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret podName:7354598a-9d87-4762-9633-da3d96ff063b nodeName:}" failed. No retries permitted until 2026-11-03 22:50:24.18585285 +0000 UTC m=+2.966548808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret") pod "global-pull-secret-syncer-r2kpn" (UID: "7354598a-9d87-4762-9633-da3d96ff063b") : object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:23.185916 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:23.185887 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs podName:b725cdb0-2fe7-42d6-99b0-1f36d22081af nodeName:}" failed. No retries permitted until 2026-11-03 22:50:24.185878158 +0000 UTC m=+2.966574101 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs") pod "network-metrics-daemon-qqzlx" (UID: "b725cdb0-2fe7-42d6-99b0-1f36d22081af") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:23.286748 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.286715 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vf8n\" (UniqueName: \"kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n\") pod \"network-check-target-kmzch\" (UID: \"89db2583-ca69-48db-adf0-1383f53434c1\") " pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:23.286915 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:23.286838 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 22:50:23.286915 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:23.286851 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 22:50:23.286915 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:23.286868 2568 projected.go:196] Error preparing data for projected volume kube-api-access-7vf8n for pod openshift-network-diagnostics/network-check-target-kmzch: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:23.287030 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:23.286925 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n podName:89db2583-ca69-48db-adf0-1383f53434c1 nodeName:}" failed. No retries permitted until 2026-11-03 22:50:24.286907333 +0000 UTC m=+3.067603288 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7vf8n" (UniqueName: "kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n") pod "network-check-target-kmzch" (UID: "89db2583-ca69-48db-adf0-1383f53434c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:23.335350 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.335324 2568 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:50:23.605431 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.605364 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 22:45:23 +0000 UTC" deadline="2028-07-30 03:11:24.07201795 +0000 UTC" Nov 03 22:50:23.605431 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.605427 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15220h21m0.466596377s" Nov 03 22:50:23.621302 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.621188 2568 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:50:23.649158 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.648636 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:23.649158 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:23.648780 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:23.668135 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.668037 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal" event={"ID":"9d92d59dc723695c8e39db4d586eeb52","Type":"ContainerStarted","Data":"b06ba18a444ce9770746fe46ce6facf68dab12ee4958eff85eb0ca45dc56c329"} Nov 03 22:50:23.684287 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.684248 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" event={"ID":"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4","Type":"ContainerStarted","Data":"5f5365b774847e607f16c0aa930efa27eb63ace8ecd65978574e22b4b3d069c1"} Nov 03 22:50:23.688582 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.688451 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" event={"ID":"b99b9ce3-9872-4265-b7e2-26c4851a3ebf","Type":"ContainerStarted","Data":"8ee5d7f721db9c84a733e28cba8eb7274a47ba814a1ac6f3f10c1e4921290d6d"} Nov 03 22:50:23.702902 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.702780 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2frcd" event={"ID":"c7b36354-ea7c-4f8c-a96e-f9ba840f2036","Type":"ContainerStarted","Data":"f276455788cd61bfe8d0379a7dcf9aace10ab3e97bc1b53552b5f042900b890e"} Nov 03 22:50:23.707571 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.707498 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kpt2c" event={"ID":"adc37e3e-9f5d-4eba-8b13-6f467c3060d3","Type":"ContainerStarted","Data":"a53b71d42c4c45fbc3b5bbb6521fb8fc77e096b7f4cd53526ad450540ad6b904"} Nov 03 22:50:23.714306 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.714223 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zkb4f" event={"ID":"7a51fb1d-abfd-4803-8489-56e7ec93127f","Type":"ContainerStarted","Data":"aa284f0a066d70a183637078ea8db21bf28a8cfd02935f03d52c0e95b92384b4"} Nov 03 22:50:23.719728 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.719641 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7hbs4" event={"ID":"feb1ae85-eef8-4a26-b341-b06161f7210d","Type":"ContainerStarted","Data":"f693f3c51671bc6b05a80d85eef83e783968858cbe19d60a1ce62a5cb95670d0"} Nov 03 22:50:23.736015 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.735785 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mjl2l" event={"ID":"f40c765d-cb44-4835-a41d-8cfb35f73f40","Type":"ContainerStarted","Data":"7abb60fd0dbd49ed95d56ddc057a615ef4773fcead757435b6a8377f587c7350"} Nov 03 22:50:23.740147 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.740118 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mzwfp" event={"ID":"a9cfd418-f163-4b86-896f-fd898cb2ebf6","Type":"ContainerStarted","Data":"c68ee02bc5e9766696eb190607f39dfdcf94763f178908d94074e54883442508"} Nov 03 22:50:23.748817 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.748757 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" event={"ID":"6c295fd2-23ab-4994-9ae2-60947f409b62","Type":"ContainerStarted","Data":"be38561e6f979c293e2f11d0b19f3a69832f37316fe6d75688c4f0c4cd200cb8"} Nov 03 22:50:23.767223 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:23.766681 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" event={"ID":"90feb0e8f6d254df57c953bffb88632b","Type":"ContainerStarted","Data":"db2716a9e46421c1dea6535d456b1f43c0fcea424c2c9a9f27ea31fe2948d78e"} Nov 03 22:50:24.195288 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:24.195241 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:24.195501 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:24.195334 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs\") pod \"network-metrics-daemon-qqzlx\" (UID: \"b725cdb0-2fe7-42d6-99b0-1f36d22081af\") " pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:24.195595 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:24.195523 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:24.195663 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:24.195611 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs podName:b725cdb0-2fe7-42d6-99b0-1f36d22081af nodeName:}" failed. No retries permitted until 2026-11-03 22:50:26.195591161 +0000 UTC m=+4.976287106 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs") pod "network-metrics-daemon-qqzlx" (UID: "b725cdb0-2fe7-42d6-99b0-1f36d22081af") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:24.196461 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:24.196433 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:24.196580 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:24.196502 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret podName:7354598a-9d87-4762-9633-da3d96ff063b nodeName:}" failed. No retries permitted until 2026-11-03 22:50:26.196486201 +0000 UTC m=+4.977182159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret") pod "global-pull-secret-syncer-r2kpn" (UID: "7354598a-9d87-4762-9633-da3d96ff063b") : object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:24.296465 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:24.296411 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vf8n\" (UniqueName: \"kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n\") pod \"network-check-target-kmzch\" (UID: \"89db2583-ca69-48db-adf0-1383f53434c1\") " pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:24.296797 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:24.296756 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 22:50:24.296913 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:24.296804 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 22:50:24.296913 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:24.296819 2568 projected.go:196] Error preparing data for projected volume kube-api-access-7vf8n for pod openshift-network-diagnostics/network-check-target-kmzch: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:24.296913 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:24.296885 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n podName:89db2583-ca69-48db-adf0-1383f53434c1 nodeName:}" failed. No retries permitted until 2026-11-03 22:50:26.296866911 +0000 UTC m=+5.077562855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7vf8n" (UniqueName: "kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n") pod "network-check-target-kmzch" (UID: "89db2583-ca69-48db-adf0-1383f53434c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:24.606028 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:24.605874 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 22:45:23 +0000 UTC" deadline="2028-05-01 08:50:38.626612868 +0000 UTC" Nov 03 22:50:24.606028 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:24.605912 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13066h0m14.02070793s" Nov 03 22:50:24.646502 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:24.645761 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:24.646502 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:24.645920 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:50:24.646502 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:24.646376 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:24.646502 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:24.646469 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:50:25.005748 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:25.005666 2568 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:50:25.652685 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:25.646155 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:25.652685 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:25.646362 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:26.215733 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:26.215689 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs\") pod \"network-metrics-daemon-qqzlx\" (UID: \"b725cdb0-2fe7-42d6-99b0-1f36d22081af\") " pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:26.215912 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:26.215797 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:26.215985 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:26.215944 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:26.216066 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:26.216039 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret podName:7354598a-9d87-4762-9633-da3d96ff063b nodeName:}" failed. No retries permitted until 2026-11-03 22:50:30.216017515 +0000 UTC m=+8.996713475 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret") pod "global-pull-secret-syncer-r2kpn" (UID: "7354598a-9d87-4762-9633-da3d96ff063b") : object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:26.216603 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:26.216581 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:26.216735 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:26.216647 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs podName:b725cdb0-2fe7-42d6-99b0-1f36d22081af nodeName:}" failed. No retries permitted until 2026-11-03 22:50:30.216628939 +0000 UTC m=+8.997324899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs") pod "network-metrics-daemon-qqzlx" (UID: "b725cdb0-2fe7-42d6-99b0-1f36d22081af") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:26.317206 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:26.316466 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vf8n\" (UniqueName: \"kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n\") pod \"network-check-target-kmzch\" (UID: \"89db2583-ca69-48db-adf0-1383f53434c1\") " pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:26.317206 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:26.316680 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 22:50:26.317206 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:26.316703 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 22:50:26.317206 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:26.316716 2568 projected.go:196] Error preparing data for projected volume kube-api-access-7vf8n for pod openshift-network-diagnostics/network-check-target-kmzch: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:26.317206 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:26.316784 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n podName:89db2583-ca69-48db-adf0-1383f53434c1 nodeName:}" failed. No retries permitted until 2026-11-03 22:50:30.316763954 +0000 UTC m=+9.097459920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7vf8n" (UniqueName: "kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n") pod "network-check-target-kmzch" (UID: "89db2583-ca69-48db-adf0-1383f53434c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:26.645628 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:26.645577 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:26.645832 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:26.645728 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:50:26.646301 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:26.646277 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:26.646408 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:26.646374 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:50:27.652357 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:27.651796 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:27.652357 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:27.652177 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:27.805630 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:27.805557 2568 generic.go:356] "Generic (PLEG): container finished" podID="90feb0e8f6d254df57c953bffb88632b" containerID="6a9aa15c1140a9f6efda97c5bcab54b399c459a9a3ffef3415a0bfb91195b2d8" exitCode=0 Nov 03 22:50:27.805806 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:27.805662 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" event={"ID":"90feb0e8f6d254df57c953bffb88632b","Type":"ContainerDied","Data":"6a9aa15c1140a9f6efda97c5bcab54b399c459a9a3ffef3415a0bfb91195b2d8"} Nov 03 22:50:27.805960 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:27.805940 2568 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:50:27.810138 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:27.810102 2568 generic.go:356] "Generic (PLEG): container finished" podID="7a51fb1d-abfd-4803-8489-56e7ec93127f" containerID="dd6889bb026cd325f214655dc91767b4efdd66b14fbd8ec74e812fd17f606887" exitCode=0 Nov 03 22:50:27.810284 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:27.810148 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zkb4f" event={"ID":"7a51fb1d-abfd-4803-8489-56e7ec93127f","Type":"ContainerDied","Data":"dd6889bb026cd325f214655dc91767b4efdd66b14fbd8ec74e812fd17f606887"} Nov 03 22:50:27.820483 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:27.817022 2568 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 22:50:27.820483 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:27.819403 2568 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal"] Nov 03 22:50:28.646200 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:28.645380 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:28.646200 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:28.645549 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:50:28.646200 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:28.646075 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:28.646200 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:28.646194 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:50:28.821429 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:28.820477 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" event={"ID":"90feb0e8f6d254df57c953bffb88632b","Type":"ContainerStarted","Data":"90a4e7ec2d590a97655201d19ef7b1f76842d1a986771fe893a81c86e731ec20"} Nov 03 22:50:28.836851 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:28.836778 2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" podStartSLOduration=1.8367574370000002 podStartE2EDuration="1.836757437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:50:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:28.83586309 +0000 UTC m=+7.616559095" watchObservedRunningTime="2026-11-03 22:50:28.836757437 +0000 UTC m=+7.617453405" Nov 03 22:50:28.838030 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:28.837992 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal" event={"ID":"9d92d59dc723695c8e39db4d586eeb52","Type":"ContainerStarted","Data":"5fe95f2c23788c53fcbf4a27ae4c864a551ff574953d03d48fe0bc0c628da189"} Nov 03 22:50:28.844555 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:28.843894 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kpt2c" event={"ID":"adc37e3e-9f5d-4eba-8b13-6f467c3060d3","Type":"ContainerStarted","Data":"ce379e8b18d59ecfe32421d8dffa1b8e65e105b292a3760fc5de167d0088d5d6"} Nov 03 22:50:28.869052 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:28.868996 2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal" podStartSLOduration=5.868976662 podStartE2EDuration="5.868976662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:50:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:28.856348244 +0000 UTC m=+7.637044211" watchObservedRunningTime="2026-11-03 22:50:28.868976662 +0000 UTC m=+7.649672630" Nov 03 22:50:29.649578 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:29.646327 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:29.650884 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:29.649977 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:29.851675 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:29.851545 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2frcd" event={"ID":"c7b36354-ea7c-4f8c-a96e-f9ba840f2036","Type":"ContainerStarted","Data":"a1e129103286fd8eb78c403315a12a088536ef6a33ac41f87f50ebff634d040d"} Nov 03 22:50:29.867870 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:29.867808 2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kpt2c" podStartSLOduration=3.020214942 podStartE2EDuration="7.867785956s" totalImagesPullingTime="4.847571014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:28.870131182 +0000 UTC m=+7.650827150" watchObservedRunningTime="2026-11-03 22:50:29.867785956 +0000 UTC m=+8.648481926" Nov 03 22:50:30.256281 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:30.256187 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:30.256281 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:30.256261 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs\") pod \"network-metrics-daemon-qqzlx\" (UID: \"b725cdb0-2fe7-42d6-99b0-1f36d22081af\") " pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:30.256566 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:30.256370 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:30.256566 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:30.256373 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:30.256566 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:30.256433 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs podName:b725cdb0-2fe7-42d6-99b0-1f36d22081af nodeName:}" failed. No retries permitted until 2026-11-03 22:50:38.256416061 +0000 UTC m=+17.037112019 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs") pod "network-metrics-daemon-qqzlx" (UID: "b725cdb0-2fe7-42d6-99b0-1f36d22081af") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:30.256566 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:30.256475 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret podName:7354598a-9d87-4762-9633-da3d96ff063b nodeName:}" failed. No retries permitted until 2026-11-03 22:50:38.256443202 +0000 UTC m=+17.037139143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret") pod "global-pull-secret-syncer-r2kpn" (UID: "7354598a-9d87-4762-9633-da3d96ff063b") : object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:30.357576 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:30.357546 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vf8n\" (UniqueName: \"kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n\") pod \"network-check-target-kmzch\" (UID: \"89db2583-ca69-48db-adf0-1383f53434c1\") " pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:30.357741 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:30.357698 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 22:50:30.357741 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:30.357717 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 22:50:30.357741 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:30.357730 2568 projected.go:196] Error preparing data for projected volume kube-api-access-7vf8n for pod openshift-network-diagnostics/network-check-target-kmzch: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:30.357869 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:30.357778 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n podName:89db2583-ca69-48db-adf0-1383f53434c1 nodeName:}" failed. No retries permitted until 2026-11-03 22:50:38.357765883 +0000 UTC m=+17.138461837 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7vf8n" (UniqueName: "kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n") pod "network-check-target-kmzch" (UID: "89db2583-ca69-48db-adf0-1383f53434c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:30.645649 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:30.645569 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:30.645815 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:30.645712 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:50:30.646224 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:30.646200 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:30.646342 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:30.646309 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:50:30.857743 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:30.857706 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" event={"ID":"b99b9ce3-9872-4265-b7e2-26c4851a3ebf","Type":"ContainerStarted","Data":"c648fe609daffb143c7e940c63e5e3426d41fff666dca5bbeb7949e2212edc72"} Nov 03 22:50:31.657483 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:31.657436 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:31.657870 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:31.657840 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:31.754561 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:31.754531 2568 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 03 22:50:31.862290 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:31.862263 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" event={"ID":"b99b9ce3-9872-4265-b7e2-26c4851a3ebf","Type":"ContainerStarted","Data":"ff9cf977a410799fb14d336c4c50150f99ba3e1d3126eab857af4c55505e138f"} Nov 03 22:50:32.646896 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:32.646272 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:32.646896 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:32.646402 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:50:32.646896 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:32.646497 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:32.646896 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:32.646573 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:50:32.652758 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:32.652635 2568 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-03T22:50:31.754556501Z","UUID":"d4772d99-dba7-46e9-9851-5629937cd4dd","Handler":null,"Name":"","Endpoint":""} Nov 03 22:50:32.654496 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:32.654477 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 03 22:50:32.654603 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:32.654507 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 03 22:50:32.866207 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:32.865713 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mjl2l" event={"ID":"f40c765d-cb44-4835-a41d-8cfb35f73f40","Type":"ContainerStarted","Data":"85cb2d01d16b4aae98d5697f87fdae2a06830f616c9c4676aeb13427e53a94da"} Nov 03 22:50:32.868240 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:32.868213 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mzwfp" event={"ID":"a9cfd418-f163-4b86-896f-fd898cb2ebf6","Type":"ContainerStarted","Data":"ef48863bbe551909e4e6b683040c777925eed96247cb47bb05ad1c11d7e365fe"} Nov 03 22:50:32.872415 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:32.872395 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zkb4f" event={"ID":"7a51fb1d-abfd-4803-8489-56e7ec93127f","Type":"ContainerStarted","Data":"3e35cec3289d5bae205f170279f28ddbebefd1cf582b8550d6e30a42c3d9df6f"} Nov 03 22:50:32.879080 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:32.879032 2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-mjl2l" podStartSLOduration=1.798844394 podStartE2EDuration="10.879015619s" totalImagesPullingTime="9.080171225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:32.878939801 +0000 UTC m=+11.659635758" watchObservedRunningTime="2026-11-03 22:50:32.879015619 +0000 UTC m=+11.659711579" Nov 03 22:50:32.879783 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:32.879738 2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2frcd" podStartSLOduration=4.533863276 podStartE2EDuration="10.879724538s" totalImagesPullingTime="6.345861262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:29.868064489 +0000 UTC m=+8.648760458" watchObservedRunningTime="2026-11-03 22:50:32.879724538 +0000 UTC m=+11.660420502" Nov 03 22:50:32.913590 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:32.912558 2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-mzwfp" podStartSLOduration=2.040916636 podStartE2EDuration="10.912538431s" totalImagesPullingTime="8.871621795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:32.912190523 +0000 UTC m=+11.692886513" watchObservedRunningTime="2026-11-03 22:50:32.912538431 +0000 UTC m=+11.693234397" Nov 03 22:50:33.415779 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:33.415743 2568 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kpt2c" Nov 03 22:50:33.416475 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:33.416432 2568 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kpt2c" Nov 03 22:50:33.646021 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:33.645984 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:33.646185 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:33.646103 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:33.877544 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:33.877509 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" event={"ID":"b99b9ce3-9872-4265-b7e2-26c4851a3ebf","Type":"ContainerStarted","Data":"a746c9401917429b567314adbc63918ed4c2fffe67478331f762511b8e05319a"} Nov 03 22:50:33.880413 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:33.880380 2568 generic.go:356] "Generic (PLEG): container finished" podID="7a51fb1d-abfd-4803-8489-56e7ec93127f" containerID="3e35cec3289d5bae205f170279f28ddbebefd1cf582b8550d6e30a42c3d9df6f" exitCode=0 Nov 03 22:50:33.880554 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:33.880447 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zkb4f" event={"ID":"7a51fb1d-abfd-4803-8489-56e7ec93127f","Type":"ContainerDied","Data":"3e35cec3289d5bae205f170279f28ddbebefd1cf582b8550d6e30a42c3d9df6f"} Nov 03 22:50:33.883315 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:33.883289 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7hbs4" event={"ID":"feb1ae85-eef8-4a26-b341-b06161f7210d","Type":"ContainerStarted","Data":"ec95a7b20b36ddafd56e7fdff44c98730fae894cd9c42d4cad5d84bca1bcc388"} Nov 03 22:50:33.892553 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:33.892503 2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" podStartSLOduration=2.436368284 podStartE2EDuration="11.892489398s" totalImagesPullingTime="9.456121114s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:50:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:33.892384805 +0000 UTC m=+12.673080769" watchObservedRunningTime="2026-11-03 22:50:33.892489398 +0000 UTC m=+12.673185364" Nov 03 22:50:33.904240 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:33.904203 2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7hbs4" podStartSLOduration=2.64922565 podStartE2EDuration="11.904192683s" totalImagesPullingTime="9.254967033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:33.903812691 +0000 UTC m=+12.684508655" watchObservedRunningTime="2026-11-03 22:50:33.904192683 +0000 UTC m=+12.684888645" Nov 03 22:50:34.646957 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:34.646373 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:34.646957 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:34.646528 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:50:34.646957 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:34.646383 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:34.646957 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:34.646625 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:50:34.887128 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:34.887039 2568 generic.go:356] "Generic (PLEG): container finished" podID="7a51fb1d-abfd-4803-8489-56e7ec93127f" containerID="82c4a9c2203c73d28a71ce8c2cd9f5ff51158b47b59c036c1768af464ee4718b" exitCode=0 Nov 03 22:50:34.887655 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:34.887125 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zkb4f" event={"ID":"7a51fb1d-abfd-4803-8489-56e7ec93127f","Type":"ContainerDied","Data":"82c4a9c2203c73d28a71ce8c2cd9f5ff51158b47b59c036c1768af464ee4718b"} Nov 03 22:50:34.892301 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:34.888716 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" event={"ID":"6c295fd2-23ab-4994-9ae2-60947f409b62","Type":"ContainerStarted","Data":"68d3b7f63965a831ce4b4049680edd57f4ab1b68d9876ac3496bbc55fd1e4b99"} Nov 03 22:50:34.917655 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:34.917604 2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" podStartSLOduration=1.811068713 podStartE2EDuration="12.917588767s" totalImagesPullingTime="11.106520054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:34.917529437 +0000 UTC m=+13.698225400" watchObservedRunningTime="2026-11-03 22:50:34.917588767 +0000 UTC m=+13.698284732" Nov 03 22:50:35.645699 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:35.645670 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:35.645883 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:35.645825 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:36.645495 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:36.645443 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:36.645495 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:36.645482 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:36.646260 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:36.645593 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:50:36.646260 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:36.645692 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:50:36.897428 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:36.897352 2568 generic.go:356] "Generic (PLEG): container finished" podID="7a51fb1d-abfd-4803-8489-56e7ec93127f" containerID="d5e812769743ac4e2590eab71289f5609729315a81cff88b2342c090e0c76c71" exitCode=0 Nov 03 22:50:36.897428 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:36.897415 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zkb4f" event={"ID":"7a51fb1d-abfd-4803-8489-56e7ec93127f","Type":"ContainerDied","Data":"d5e812769743ac4e2590eab71289f5609729315a81cff88b2342c090e0c76c71"} Nov 03 22:50:37.647678 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:37.647640 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:37.648132 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:37.647778 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:38.324362 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:38.324310 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:38.324566 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:38.324385 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs\") pod \"network-metrics-daemon-qqzlx\" (UID: \"b725cdb0-2fe7-42d6-99b0-1f36d22081af\") " pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:38.324566 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:38.324502 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:38.324566 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:38.324512 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:38.324670 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:38.324576 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret podName:7354598a-9d87-4762-9633-da3d96ff063b nodeName:}" failed. No retries permitted until 2026-11-03 22:50:54.324560201 +0000 UTC m=+33.105256155 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret") pod "global-pull-secret-syncer-r2kpn" (UID: "7354598a-9d87-4762-9633-da3d96ff063b") : object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:38.324670 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:38.324599 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs podName:b725cdb0-2fe7-42d6-99b0-1f36d22081af nodeName:}" failed. No retries permitted until 2026-11-03 22:50:54.32458769 +0000 UTC m=+33.105283646 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs") pod "network-metrics-daemon-qqzlx" (UID: "b725cdb0-2fe7-42d6-99b0-1f36d22081af") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:38.425044 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:38.425002 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vf8n\" (UniqueName: \"kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n\") pod \"network-check-target-kmzch\" (UID: \"89db2583-ca69-48db-adf0-1383f53434c1\") " pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:38.425240 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:38.425152 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 22:50:38.425240 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:38.425179 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 22:50:38.425240 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:38.425194 2568 projected.go:196] Error preparing data for projected volume kube-api-access-7vf8n for pod openshift-network-diagnostics/network-check-target-kmzch: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:38.425378 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:38.425258 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n podName:89db2583-ca69-48db-adf0-1383f53434c1 nodeName:}" failed. No retries permitted until 2026-11-03 22:50:54.425239585 +0000 UTC m=+33.205935526 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7vf8n" (UniqueName: "kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n") pod "network-check-target-kmzch" (UID: "89db2583-ca69-48db-adf0-1383f53434c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:38.645642 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:38.645573 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:38.645800 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:38.645705 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:50:38.645800 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:38.645761 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:38.645913 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:38.645885 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:50:39.646061 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:39.645872 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:39.646477 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:39.646145 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:39.906814 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:39.906787 2568 generic.go:356] "Generic (PLEG): container finished" podID="7a51fb1d-abfd-4803-8489-56e7ec93127f" containerID="397af326a98368ac681bb503bd34607b8090dc0c21707e6ac034a496e17b613c" exitCode=0 Nov 03 22:50:39.906906 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:39.906874 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zkb4f" event={"ID":"7a51fb1d-abfd-4803-8489-56e7ec93127f","Type":"ContainerDied","Data":"397af326a98368ac681bb503bd34607b8090dc0c21707e6ac034a496e17b613c"} Nov 03 22:50:39.909442 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:39.909422 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" event={"ID":"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4","Type":"ContainerStarted","Data":"a339bf500893fbe0e6a1e72413f7d90a4fe5d237e6887c7af9ec637e1c81bfee"} Nov 03 22:50:39.909541 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:39.909515 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" event={"ID":"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4","Type":"ContainerStarted","Data":"34374f7b4722fe3152c65765c1934f1413bc710a20c615b8293e62c212cb0142"} Nov 03 22:50:39.909579 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:39.909567 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" event={"ID":"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4","Type":"ContainerStarted","Data":"8adf32b6cd4811ba8385e48eb9755bccc171b8d099e8e4d7f5d66d68621d3d32"} Nov 03 22:50:39.909629 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:39.909615 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" event={"ID":"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4","Type":"ContainerStarted","Data":"510efd8d0d11c82ba61535fc2294de769c835f8cf03eac4ee95ff12bca9683e4"} Nov 03 22:50:40.645929 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:40.645898 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:40.645929 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:40.645927 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:40.646445 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:40.645990 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:50:40.646445 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:40.646304 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:50:40.914200 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:40.914121 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" event={"ID":"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4","Type":"ContainerStarted","Data":"2f2cfc0e68c6b29f612263b1153b57a864f1b780718bc96c0381b3934825589b"} Nov 03 22:50:40.914200 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:40.914190 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" event={"ID":"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4","Type":"ContainerStarted","Data":"4979dbf304e5f37b8f4440e7767a45686a84b32410ec9f7db62e0f2bb26bf602"} Nov 03 22:50:40.916920 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:40.916894 2568 generic.go:356] "Generic (PLEG): container finished" podID="7a51fb1d-abfd-4803-8489-56e7ec93127f" containerID="9ecbf93fb35eb4a8906aca2abef08fa13300c20c8846bee9b78f73ad104f746c" exitCode=0 Nov 03 22:50:40.917030 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:40.916937 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zkb4f" event={"ID":"7a51fb1d-abfd-4803-8489-56e7ec93127f","Type":"ContainerDied","Data":"9ecbf93fb35eb4a8906aca2abef08fa13300c20c8846bee9b78f73ad104f746c"} Nov 03 22:50:41.646466 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:41.646240 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:41.646841 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:41.646551 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:41.921778 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:41.921698 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zkb4f" event={"ID":"7a51fb1d-abfd-4803-8489-56e7ec93127f","Type":"ContainerStarted","Data":"ea443834b56a18409a1a6aaa08769e153da4c637c3b9e3f4cb81facdc1e0b660"} Nov 03 22:50:41.940223 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:41.940165 2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zkb4f" podStartSLOduration=8.102752477 podStartE2EDuration="19.94015416s" totalImagesPullingTime="11.837401683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:50:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:41.939207895 +0000 UTC m=+20.719903858" watchObservedRunningTime="2026-11-03 22:50:41.94015416 +0000 UTC m=+20.720850123" Nov 03 22:50:42.645909 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:42.645876 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:42.646083 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:42.645973 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:50:42.646083 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:42.646030 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:42.646149 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:42.646113 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:50:42.927945 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:42.927863 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" event={"ID":"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4","Type":"ContainerStarted","Data":"f99939d246cdc12e6ee76f03083eb680f098a171b9d2ec91e351d2dd4307048f"} Nov 03 22:50:43.646180 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:43.646154 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:43.646342 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:43.646256 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:44.646141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:44.646110 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:44.646904 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:44.646115 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:44.646904 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:44.646220 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:50:44.646904 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:44.646311 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:50:44.935947 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:44.935863 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" event={"ID":"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4","Type":"ContainerStarted","Data":"beb0e5661a26dea24d9646e3611bab4a547c565ea0d4a7321fa220d81b7cf791"} Nov 03 22:50:44.936170 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:44.936147 2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:44.952632 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:44.952608 2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:44.962882 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:44.962840 2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" podStartSLOduration=6.313910269 podStartE2EDuration="22.962829126s" totalImagesPullingTime="16.648918857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:44.961726294 +0000 UTC m=+23.742422257" watchObservedRunningTime="2026-11-03 22:50:44.962829126 +0000 UTC m=+23.743525104" Nov 03 22:50:45.646047 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:45.646014 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:45.646219 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:45.646145 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:45.938739 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:45.938425 2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:45.938888 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:45.938762 2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:45.955949 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:45.955923 2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:50:46.023396 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:46.023366 2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r2kpn"] Nov 03 22:50:46.023578 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:46.023504 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:46.023621 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:46.023593 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:50:46.026915 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:46.026888 2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qqzlx"] Nov 03 22:50:46.027105 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:46.027026 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:46.027189 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:46.027152 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:46.027918 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:46.027891 2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kmzch"] Nov 03 22:50:46.028022 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:46.028006 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:46.028125 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:46.028103 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:50:46.453500 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:46.453447 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:46.771073 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:46.770981 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:47.612218 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:47.612182 2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kpt2c" Nov 03 22:50:47.612405 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:47.612314 2568 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 03 22:50:47.612776 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:47.612755 2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kpt2c" Nov 03 22:50:47.645482 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:47.645441 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:47.645482 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:47.645477 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:47.645652 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:47.645540 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:50:47.645652 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:47.645577 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:47.645759 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:47.645651 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:50:47.645759 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:47.645718 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:47.714233 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:47.714211 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:49.296343 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:49.296248 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:49.428755 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:49.428723 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:49.555241 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:49.555173 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:49.645779 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:49.645753 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:49.645956 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:49.645754 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:49.646025 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:49.645877 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:49.646025 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:49.645994 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:50:49.646025 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:49.646010 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:49.646194 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:49.646129 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:50:49.662817 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:49.662784 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:50.053511 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:50.053417 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:50.465745 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:50.465663 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:50.577361 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:50.577327 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:50.752306 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:50.752238 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:51.294183 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:51.294153 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:51.418347 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:51.418311 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:51.548429 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:51.548345 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:51.646514 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:51.646485 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:51.646709 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:51.646570 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:51.646709 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:51.646619 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:51.646709 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:51.646646 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:50:51.646709 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:51.646685 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:50:51.646889 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:51.646773 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:51.673509 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:51.673487 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:51.833227 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:51.833155 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:51.952652 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:51.952622 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:52.630740 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:52.630656 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:52.879417 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:52.879370 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:52.987173 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:52.987056 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:53.100169 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:53.100136 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:53.243041 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:53.242945 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:53.453189 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:53.453158 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:53.645598 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:53.645478 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:53.645598 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:53.645515 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:53.646157 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:53.645624 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:50:53.646157 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:53.645693 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:50:53.646157 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:53.645699 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:53.646157 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:53.645828 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:53.646320 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:53.646203 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:53.764019 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:53.763986 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:54.329674 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:54.329639 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs\") pod \"network-metrics-daemon-qqzlx\" (UID: \"b725cdb0-2fe7-42d6-99b0-1f36d22081af\") " pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:54.329863 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:54.329697 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:54.329863 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:54.329781 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:54.329863 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:54.329782 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:54.329863 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:54.329837 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret podName:7354598a-9d87-4762-9633-da3d96ff063b nodeName:}" failed. No retries permitted until 2026-11-03 22:51:26.329824941 +0000 UTC m=+65.110520896 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret") pod "global-pull-secret-syncer-r2kpn" (UID: "7354598a-9d87-4762-9633-da3d96ff063b") : object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:54.329863 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:54.329851 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs podName:b725cdb0-2fe7-42d6-99b0-1f36d22081af nodeName:}" failed. No retries permitted until 2026-11-03 22:51:26.329844666 +0000 UTC m=+65.110540608 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs") pod "network-metrics-daemon-qqzlx" (UID: "b725cdb0-2fe7-42d6-99b0-1f36d22081af") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:54.430590 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:54.430560 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vf8n\" (UniqueName: \"kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n\") pod \"network-check-target-kmzch\" (UID: \"89db2583-ca69-48db-adf0-1383f53434c1\") " pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:54.430751 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:54.430713 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 22:50:54.430751 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:54.430729 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 22:50:54.430751 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:54.430738 2568 projected.go:196] Error preparing data for projected volume kube-api-access-7vf8n for pod openshift-network-diagnostics/network-check-target-kmzch: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:54.430866 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:54.430790 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n podName:89db2583-ca69-48db-adf0-1383f53434c1 nodeName:}" failed. No retries permitted until 2026-11-03 22:51:26.430774724 +0000 UTC m=+65.211470682 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7vf8n" (UniqueName: "kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n") pod "network-check-target-kmzch" (UID: "89db2583-ca69-48db-adf0-1383f53434c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:54.837940 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:54.837911 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:55.032050 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:55.032012 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:55.132569 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:55.132468 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:55.142201 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:55.142186 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mjl2l_f40c765d-cb44-4835-a41d-8cfb35f73f40/dns-node-resolver/0.log" Nov 03 22:50:55.235179 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:55.235149 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:55.423898 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:55.423798 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:55.633751 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:55.633717 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:55.645886 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:55.645859 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:55.645886 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:55.645887 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:55.646040 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:55.645979 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:50:55.646040 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:55.646024 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:50:55.646099 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:55.646073 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:55.646147 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:55.646133 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:55.742519 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:55.742497 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2frcd_c7b36354-ea7c-4f8c-a96e-f9ba840f2036/node-ca/0.log" Nov 03 22:50:55.946016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:55.945931 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:56.055724 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:56.055696 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:56.498767 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:56.498670 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:56.855542 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:56.855434 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:57.045196 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:57.045167 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:57.237984 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:57.237896 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:57.346939 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:57.346874 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:57.504483 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:57.504373 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:57.646214 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:57.646181 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:57.646406 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:57.646180 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:57.646406 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:57.646290 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:57.646536 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:57.646402 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:50:57.646536 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:57.646421 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:57.646536 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:57.646496 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:50:57.703748 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:57.703696 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:57.838944 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:57.838827 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:57.962241 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:57.962193 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:58.073421 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:58.073393 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:58.634703 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:58.634666 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:58.740718 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:58.740686 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:59.041740 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:59.041659 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:59.240038 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:59.240006 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:59.434248 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:59.434120 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:50:59.646500 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:59.646447 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:50:59.646673 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:59.646470 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:50:59.646673 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:59.646591 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:50:59.646673 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:59.646647 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:50:59.646828 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:59.646765 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:50:59.646884 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:50:59.646843 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:50:59.860166 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:50:59.860070 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:00.634562 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:00.634507 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:01.034020 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:01.033938 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:01.231088 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:01.231041 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:01.426690 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:01.426613 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:01.646581 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:01.646551 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:51:01.647034 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:01.646626 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:51:01.647034 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:51:01.646671 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:51:01.647034 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:51:01.646694 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:51:01.647034 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:01.646716 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:51:01.647034 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:51:01.646767 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:51:01.831741 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:01.831663 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:02.146648 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:02.146559 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:02.262155 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:02.262119 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:02.435970 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:02.435893 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:03.646060 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:03.646012 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:51:03.646060 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:03.646037 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:51:03.646060 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:03.646049 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:51:03.646681 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:51:03.646143 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:51:03.646681 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:51:03.646232 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:51:03.646681 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:51:03.646321 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:51:05.646339 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:05.646311 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:51:05.646892 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:05.646310 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:51:05.646892 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:51:05.646443 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:51:05.646892 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:05.646317 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:51:05.646892 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:51:05.646506 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:51:05.646892 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:51:05.646600 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:51:07.381345 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:07.381293 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:07.497052 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:07.497013 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:07.612986 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:07.612940 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:07.645959 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:07.645869 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:51:07.645959 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:07.645896 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:51:07.646178 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:07.646014 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:51:07.646178 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:51:07.646035 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:51:07.646178 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:51:07.646081 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:51:07.646178 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:51:07.646148 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:51:07.719016 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:07.718983 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:07.880070 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:07.880015 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:07.992216 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:07.992187 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:08.273884 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:08.273805 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:08.380209 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:08.380173 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:08.501490 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:08.501440 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:09.645376 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:09.645344 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:51:09.645376 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:09.645359 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:51:09.645953 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:09.645344 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:51:09.645953 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:51:09.645490 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:51:09.645953 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:51:09.645528 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:51:09.645953 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:51:09.645575 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:51:11.646847 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:11.646815 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:51:11.647270 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:51:11.646897 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqzlx" podUID="b725cdb0-2fe7-42d6-99b0-1f36d22081af" Nov 03 22:51:11.647270 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:11.646992 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:51:11.647270 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:11.647108 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:51:11.647270 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:51:11.647108 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2kpn" podUID="7354598a-9d87-4762-9633-da3d96ff063b" Nov 03 22:51:11.647270 ip-10-0-138-89 kubenswrapper[2568]: E1103 22:51:11.647183 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmzch" podUID="89db2583-ca69-48db-adf0-1383f53434c1" Nov 03 22:51:12.552229 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:12.552196 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:12.686180 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:12.686147 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:13.503430 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.503352 2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeReady" Nov 03 22:51:13.503597 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.503514 2568 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Nov 03 22:51:13.549949 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.549918 2568 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xl9vv"] Nov 03 22:51:13.551626 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.551612 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xl9vv" Nov 03 22:51:13.553445 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.553423 2568 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-krm6s"] Nov 03 22:51:13.555516 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.555500 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:13.561665 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.561645 2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xl9vv"] Nov 03 22:51:13.565002 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.564981 2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-krm6s"] Nov 03 22:51:13.571764 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.571737 2568 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jqh5x"] Nov 03 22:51:13.574788 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.574769 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:13.578629 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.578610 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 03 22:51:13.578730 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.578667 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 03 22:51:13.578730 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.578716 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 03 22:51:13.578730 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.578724 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 03 22:51:13.578864 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.578742 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 03 22:51:13.578864 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.578818 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 03 22:51:13.578969 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.578959 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 03 22:51:13.579022 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.578970 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-w6v9t\"" Nov 03 22:51:13.579022 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.578976 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xvtdb\"" Nov 03 22:51:13.581777 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.581754 2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jqh5x"] Nov 03 22:51:13.645764 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.645728 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:51:13.645948 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.645877 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:51:13.645948 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.645735 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:51:13.662023 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.662000 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-data-volume\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:13.662130 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.662061 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:13.662130 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.662123 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvv2f\" (UniqueName: \"kubernetes.io/projected/8ed2871d-bcc6-4319-a486-e68c0969a292-kube-api-access-mvv2f\") pod \"ingress-canary-xl9vv\" (UID: \"8ed2871d-bcc6-4319-a486-e68c0969a292\") " pod="openshift-ingress-canary/ingress-canary-xl9vv" Nov 03 22:51:13.662210 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.662169 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqrnr\" (UniqueName: \"kubernetes.io/projected/858089de-9bce-4497-bf0a-9c756f0aa702-kube-api-access-vqrnr\") pod \"dns-default-jqh5x\" (UID: \"858089de-9bce-4497-bf0a-9c756f0aa702\") " pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:13.662210 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.662196 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsctv\" (UniqueName: \"kubernetes.io/projected/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-kube-api-access-vsctv\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:13.662269 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.662212 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/858089de-9bce-4497-bf0a-9c756f0aa702-metrics-tls\") pod \"dns-default-jqh5x\" (UID: \"858089de-9bce-4497-bf0a-9c756f0aa702\") " pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:13.662269 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.662236 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:13.662269 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.662254 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-crio-socket\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:13.662353 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.662278 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/858089de-9bce-4497-bf0a-9c756f0aa702-config-volume\") pod \"dns-default-jqh5x\" (UID: \"858089de-9bce-4497-bf0a-9c756f0aa702\") " pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:13.662353 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.662311 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/858089de-9bce-4497-bf0a-9c756f0aa702-tmp-dir\") pod \"dns-default-jqh5x\" (UID: \"858089de-9bce-4497-bf0a-9c756f0aa702\") " pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:13.662353 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.662334 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ed2871d-bcc6-4319-a486-e68c0969a292-cert\") pod \"ingress-canary-xl9vv\" (UID: \"8ed2871d-bcc6-4319-a486-e68c0969a292\") " pod="openshift-ingress-canary/ingress-canary-xl9vv" Nov 03 22:51:13.678221 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.678198 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 03 22:51:13.678221 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.678217 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 03 22:51:13.678500 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.678486 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fq4pb\"" Nov 03 22:51:13.678601 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.678583 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 03 22:51:13.678679 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.678636 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-k9x8r\"" Nov 03 22:51:13.678767 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.678752 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dgw9c\"" Nov 03 22:51:13.678814 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.678756 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 03 22:51:13.678814 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.678796 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 03 22:51:13.678868 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.678841 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-l7l8c\"" Nov 03 22:51:13.679037 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.679026 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 03 22:51:13.762810 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.762746 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsctv\" (UniqueName: \"kubernetes.io/projected/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-kube-api-access-vsctv\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:13.762810 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.762776 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/858089de-9bce-4497-bf0a-9c756f0aa702-metrics-tls\") pod \"dns-default-jqh5x\" (UID: \"858089de-9bce-4497-bf0a-9c756f0aa702\") " pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:13.762810 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.762804 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:13.763303 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.762832 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-crio-socket\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:13.763303 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.762854 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/858089de-9bce-4497-bf0a-9c756f0aa702-config-volume\") pod \"dns-default-jqh5x\" (UID: \"858089de-9bce-4497-bf0a-9c756f0aa702\") " pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:13.763303 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.762900 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/858089de-9bce-4497-bf0a-9c756f0aa702-tmp-dir\") pod \"dns-default-jqh5x\" (UID: \"858089de-9bce-4497-bf0a-9c756f0aa702\") " pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:13.763303 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.762932 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ed2871d-bcc6-4319-a486-e68c0969a292-cert\") pod \"ingress-canary-xl9vv\" (UID: \"8ed2871d-bcc6-4319-a486-e68c0969a292\") " pod="openshift-ingress-canary/ingress-canary-xl9vv" Nov 03 22:51:13.763303 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.762961 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-data-volume\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:13.763303 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.763011 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:13.763303 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.763023 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-crio-socket\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:13.763303 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.763038 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvv2f\" (UniqueName: \"kubernetes.io/projected/8ed2871d-bcc6-4319-a486-e68c0969a292-kube-api-access-mvv2f\") pod \"ingress-canary-xl9vv\" (UID: \"8ed2871d-bcc6-4319-a486-e68c0969a292\") " pod="openshift-ingress-canary/ingress-canary-xl9vv" Nov 03 22:51:13.763303 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.763097 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqrnr\" (UniqueName: \"kubernetes.io/projected/858089de-9bce-4497-bf0a-9c756f0aa702-kube-api-access-vqrnr\") pod \"dns-default-jqh5x\" (UID: \"858089de-9bce-4497-bf0a-9c756f0aa702\") " pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:13.763761 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.763583 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-data-volume\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:13.763815 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.763765 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:13.763981 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.763925 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/858089de-9bce-4497-bf0a-9c756f0aa702-tmp-dir\") pod \"dns-default-jqh5x\" (UID: \"858089de-9bce-4497-bf0a-9c756f0aa702\") " pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:13.764153 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.764116 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/858089de-9bce-4497-bf0a-9c756f0aa702-config-volume\") pod \"dns-default-jqh5x\" (UID: \"858089de-9bce-4497-bf0a-9c756f0aa702\") " pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:13.766511 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.766490 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:13.766611 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.766597 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/858089de-9bce-4497-bf0a-9c756f0aa702-metrics-tls\") pod \"dns-default-jqh5x\" (UID: \"858089de-9bce-4497-bf0a-9c756f0aa702\") " pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:13.766712 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.766697 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ed2871d-bcc6-4319-a486-e68c0969a292-cert\") pod \"ingress-canary-xl9vv\" (UID: \"8ed2871d-bcc6-4319-a486-e68c0969a292\") " pod="openshift-ingress-canary/ingress-canary-xl9vv" Nov 03 22:51:13.770300 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.770274 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvv2f\" (UniqueName: \"kubernetes.io/projected/8ed2871d-bcc6-4319-a486-e68c0969a292-kube-api-access-mvv2f\") pod \"ingress-canary-xl9vv\" (UID: \"8ed2871d-bcc6-4319-a486-e68c0969a292\") " pod="openshift-ingress-canary/ingress-canary-xl9vv" Nov 03 22:51:13.770300 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.770294 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsctv\" (UniqueName: \"kubernetes.io/projected/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-kube-api-access-vsctv\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:13.770446 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.770399 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqrnr\" (UniqueName: \"kubernetes.io/projected/858089de-9bce-4497-bf0a-9c756f0aa702-kube-api-access-vqrnr\") pod \"dns-default-jqh5x\" (UID: \"858089de-9bce-4497-bf0a-9c756f0aa702\") " pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:13.864604 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.864564 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xl9vv" Nov 03 22:51:13.873105 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.873083 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:13.885373 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:13.885350 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:14.150176 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:14.150090 2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xl9vv"] Nov 03 22:51:14.152214 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:14.152189 2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-krm6s"] Nov 03 22:51:14.155352 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:51:14.155325 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed2871d_bcc6_4319_a486_e68c0969a292.slice/crio-7fe58bbfdb21bd36b13bc6b221cd10e00a3cd945386e524c5b9a1cb3da3fba45 WatchSource:0}: Error finding container 7fe58bbfdb21bd36b13bc6b221cd10e00a3cd945386e524c5b9a1cb3da3fba45: Status 404 returned error can't find the container with id 7fe58bbfdb21bd36b13bc6b221cd10e00a3cd945386e524c5b9a1cb3da3fba45 Nov 03 22:51:14.155784 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:51:14.155764 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72a6a07a_05f8_45ae_b5ff_0dfa4cbb8ddd.slice/crio-427bb8ac67a9d4074e5ccbf77fbd4e9986396233d62ca78a75e8780745d322e0 WatchSource:0}: Error finding container 427bb8ac67a9d4074e5ccbf77fbd4e9986396233d62ca78a75e8780745d322e0: Status 404 returned error can't find the container with id 427bb8ac67a9d4074e5ccbf77fbd4e9986396233d62ca78a75e8780745d322e0 Nov 03 22:51:14.165932 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:14.165909 2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jqh5x"] Nov 03 22:51:14.168848 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:51:14.168825 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod858089de_9bce_4497_bf0a_9c756f0aa702.slice/crio-72fc2408d3fd5411ca362728059687e550d3cbe41629053f45b18afcd79948a4 WatchSource:0}: Error finding container 72fc2408d3fd5411ca362728059687e550d3cbe41629053f45b18afcd79948a4: Status 404 returned error can't find the container with id 72fc2408d3fd5411ca362728059687e550d3cbe41629053f45b18afcd79948a4 Nov 03 22:51:14.502879 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:14.502849 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:14.615074 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:14.615042 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:15.002522 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:15.002482 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jqh5x" event={"ID":"858089de-9bce-4497-bf0a-9c756f0aa702","Type":"ContainerStarted","Data":"72fc2408d3fd5411ca362728059687e550d3cbe41629053f45b18afcd79948a4"} Nov 03 22:51:15.004438 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:15.004408 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-krm6s" event={"ID":"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd","Type":"ContainerStarted","Data":"417617ad63c53d26564bd6277c50f38da46d4265e46f869a0d421a3220ea8970"} Nov 03 22:51:15.004594 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:15.004491 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-krm6s" event={"ID":"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd","Type":"ContainerStarted","Data":"e553c049d63ede87ab6cf0664c08913429f4f9fd8d64cf808f1c6d075594818a"} Nov 03 22:51:15.004594 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:15.004523 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-krm6s" event={"ID":"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd","Type":"ContainerStarted","Data":"427bb8ac67a9d4074e5ccbf77fbd4e9986396233d62ca78a75e8780745d322e0"} Nov 03 22:51:15.005701 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:15.005680 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xl9vv" event={"ID":"8ed2871d-bcc6-4319-a486-e68c0969a292","Type":"ContainerStarted","Data":"7fe58bbfdb21bd36b13bc6b221cd10e00a3cd945386e524c5b9a1cb3da3fba45"} Nov 03 22:51:15.123224 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:15.123144 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:15.235724 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:15.235692 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:15.429081 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:15.429001 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mjl2l_f40c765d-cb44-4835-a41d-8cfb35f73f40/dns-node-resolver/0.log" Nov 03 22:51:16.089035 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.088994 2568 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw"] Nov 03 22:51:16.091391 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.091366 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:16.097761 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.097722 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-x7fkt\"" Nov 03 22:51:16.099689 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.099642 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Nov 03 22:51:16.099689 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.099668 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Nov 03 22:51:16.104403 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.101662 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 03 22:51:16.104403 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.101919 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 03 22:51:16.104403 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.102070 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 03 22:51:16.104403 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.102928 2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw"] Nov 03 22:51:16.105542 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.105362 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:16.184140 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.184100 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8adef5d4-9a99-4a16-a052-aca39fc961b3-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-qxbqw\" (UID: \"8adef5d4-9a99-4a16-a052-aca39fc961b3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:16.184312 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.184160 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8adef5d4-9a99-4a16-a052-aca39fc961b3-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-qxbqw\" (UID: \"8adef5d4-9a99-4a16-a052-aca39fc961b3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:16.184312 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.184203 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8adef5d4-9a99-4a16-a052-aca39fc961b3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-qxbqw\" (UID: \"8adef5d4-9a99-4a16-a052-aca39fc961b3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:16.184312 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.184231 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6fqk\" (UniqueName: \"kubernetes.io/projected/8adef5d4-9a99-4a16-a052-aca39fc961b3-kube-api-access-c6fqk\") pod \"prometheus-operator-9cd89b74c-qxbqw\" (UID: \"8adef5d4-9a99-4a16-a052-aca39fc961b3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:16.215967 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.215928 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:16.229073 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.229049 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2frcd_c7b36354-ea7c-4f8c-a96e-f9ba840f2036/node-ca/0.log" Nov 03 22:51:16.284597 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.284563 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8adef5d4-9a99-4a16-a052-aca39fc961b3-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-qxbqw\" (UID: \"8adef5d4-9a99-4a16-a052-aca39fc961b3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:16.284778 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.284629 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8adef5d4-9a99-4a16-a052-aca39fc961b3-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-qxbqw\" (UID: \"8adef5d4-9a99-4a16-a052-aca39fc961b3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:16.284778 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.284677 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8adef5d4-9a99-4a16-a052-aca39fc961b3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-qxbqw\" (UID: \"8adef5d4-9a99-4a16-a052-aca39fc961b3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:16.284778 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.284723 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6fqk\" (UniqueName: \"kubernetes.io/projected/8adef5d4-9a99-4a16-a052-aca39fc961b3-kube-api-access-c6fqk\") pod \"prometheus-operator-9cd89b74c-qxbqw\" (UID: \"8adef5d4-9a99-4a16-a052-aca39fc961b3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:16.285427 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.285397 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8adef5d4-9a99-4a16-a052-aca39fc961b3-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-qxbqw\" (UID: \"8adef5d4-9a99-4a16-a052-aca39fc961b3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:16.288172 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.288151 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8adef5d4-9a99-4a16-a052-aca39fc961b3-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-qxbqw\" (UID: \"8adef5d4-9a99-4a16-a052-aca39fc961b3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:16.289713 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.289687 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8adef5d4-9a99-4a16-a052-aca39fc961b3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-qxbqw\" (UID: \"8adef5d4-9a99-4a16-a052-aca39fc961b3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:16.295245 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.295222 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6fqk\" (UniqueName: \"kubernetes.io/projected/8adef5d4-9a99-4a16-a052-aca39fc961b3-kube-api-access-c6fqk\") pod \"prometheus-operator-9cd89b74c-qxbqw\" (UID: \"8adef5d4-9a99-4a16-a052-aca39fc961b3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:16.411021 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.410942 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:16.687613 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:16.687592 2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw"] Nov 03 22:51:16.690763 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:51:16.690737 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8adef5d4_9a99_4a16_a052_aca39fc961b3.slice/crio-e9316516e3ca232334b2ac02d840cb2794583f9f1b1bcdef532bea596cf6bea5 WatchSource:0}: Error finding container e9316516e3ca232334b2ac02d840cb2794583f9f1b1bcdef532bea596cf6bea5: Status 404 returned error can't find the container with id e9316516e3ca232334b2ac02d840cb2794583f9f1b1bcdef532bea596cf6bea5 Nov 03 22:51:17.013530 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:17.013489 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" event={"ID":"8adef5d4-9a99-4a16-a052-aca39fc961b3","Type":"ContainerStarted","Data":"e9316516e3ca232334b2ac02d840cb2794583f9f1b1bcdef532bea596cf6bea5"} Nov 03 22:51:17.015924 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:17.015889 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jqh5x" event={"ID":"858089de-9bce-4497-bf0a-9c756f0aa702","Type":"ContainerStarted","Data":"b1cfb0d14d6150516cd5e22d76f50f908fc4833babe413acad908aa95375039a"} Nov 03 22:51:17.016065 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:17.015946 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jqh5x" event={"ID":"858089de-9bce-4497-bf0a-9c756f0aa702","Type":"ContainerStarted","Data":"025f5cb2054be5bd04f686b10769e936adf37a75b6efa89fe7a897d2902e4cc0"} Nov 03 22:51:17.016065 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:17.016015 2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:17.018272 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:17.018247 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-krm6s" event={"ID":"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd","Type":"ContainerStarted","Data":"81068ad4949f00d93f13296cb42cc298dbec65d9365bc7f5d87c37879bfa25c5"} Nov 03 22:51:17.032060 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:17.032004 2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-jqh5x" podStartSLOduration=1.586917711 podStartE2EDuration="4.031987107s" totalImagesPullingTime="2.445069396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:17.03094887 +0000 UTC m=+55.811644832" watchObservedRunningTime="2026-11-03 22:51:17.031987107 +0000 UTC m=+55.812683071" Nov 03 22:51:17.048928 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:17.048884 2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-krm6s" podStartSLOduration=1.711278746 podStartE2EDuration="4.048868351s" totalImagesPullingTime="2.337589605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:51:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:17.048675152 +0000 UTC m=+55.829371115" watchObservedRunningTime="2026-11-03 22:51:17.048868351 +0000 UTC m=+55.829564315" Nov 03 22:51:17.952541 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:17.952520 2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:18.023022 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:18.022991 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" event={"ID":"8adef5d4-9a99-4a16-a052-aca39fc961b3","Type":"ContainerStarted","Data":"2b8f6f2032f58856f4861cc7615e3b64536d3537963d4cd06e02dde7396d7b09"} Nov 03 22:51:18.024512 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:18.024480 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xl9vv" event={"ID":"8ed2871d-bcc6-4319-a486-e68c0969a292","Type":"ContainerStarted","Data":"a761e8c1b23c9ed5de39d1c8fb3e7fe85e52056524f1542870d23aa8a8789438"} Nov 03 22:51:18.039175 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:18.039133 2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xl9vv" podStartSLOduration=1.889841221 podStartE2EDuration="5.03911916s" totalImagesPullingTime="3.149277939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:18.038100865 +0000 UTC m=+56.818796847" watchObservedRunningTime="2026-11-03 22:51:18.03911916 +0000 UTC m=+56.819815123" Nov 03 22:51:18.284419 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:18.284378 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:19.028980 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:19.028945 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" event={"ID":"8adef5d4-9a99-4a16-a052-aca39fc961b3","Type":"ContainerStarted","Data":"30cc5d988fd0a7747c143a8d725b62a4cced279d98de8e2a88f2a639bbc1348f"} Nov 03 22:51:19.043917 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:19.043873 2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" podStartSLOduration=1.7922516179999999 podStartE2EDuration="3.043860675s" totalImagesPullingTime="1.251609057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:19.043245261 +0000 UTC m=+57.823941225" watchObservedRunningTime="2026-11-03 22:51:19.043860675 +0000 UTC m=+57.824556637" Nov 03 22:51:20.268573 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.268523 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:20.403467 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.403429 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:20.464216 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.464176 2568 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs"] Nov 03 22:51:20.466198 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.466182 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:20.474557 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.474533 2568 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bzt6m"] Nov 03 22:51:20.476472 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.476434 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.480175 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.480149 2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs"] Nov 03 22:51:20.489825 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.489792 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Nov 03 22:51:20.489947 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.489877 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Nov 03 22:51:20.489947 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.489880 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 03 22:51:20.489947 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.489911 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4lzq6\"" Nov 03 22:51:20.489947 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.489913 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 03 22:51:20.490163 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.489975 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xbgw4\"" Nov 03 22:51:20.543869 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.543800 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:20.560390 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.560366 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Nov 03 22:51:20.560524 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.560413 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 03 22:51:20.616722 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.616689 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0128a08f-b777-40e1-bf05-f79d772fd926-sys\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.616722 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.616726 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:20.616918 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.616749 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.616918 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.616770 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-textfile\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.616918 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.616856 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft7jh\" (UniqueName: \"kubernetes.io/projected/0128a08f-b777-40e1-bf05-f79d772fd926-kube-api-access-ft7jh\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.617040 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.616940 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0128a08f-b777-40e1-bf05-f79d772fd926-root\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.617040 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.616967 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:20.617040 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.616984 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-wtmp\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.617040 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.617000 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8b1a575-54e2-46d5-b23a-4ad16eab259a-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:20.617040 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.617018 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgcn8\" (UniqueName: \"kubernetes.io/projected/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-api-access-rgcn8\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:20.617217 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.617172 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:20.617217 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.617204 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-tls\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.617306 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.617224 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0128a08f-b777-40e1-bf05-f79d772fd926-metrics-client-ca\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.617306 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.617239 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-accelerators-collector-config\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.617405 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.617347 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d8b1a575-54e2-46d5-b23a-4ad16eab259a-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:20.666557 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.666527 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:20.718654 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.718630 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0128a08f-b777-40e1-bf05-f79d772fd926-metrics-client-ca\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.718732 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.718657 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-accelerators-collector-config\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.718732 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.718680 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d8b1a575-54e2-46d5-b23a-4ad16eab259a-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:20.718812 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.718792 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0128a08f-b777-40e1-bf05-f79d772fd926-sys\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.718846 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.718822 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:20.718846 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.718841 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.718929 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.718863 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-textfile\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.718929 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.718885 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft7jh\" (UniqueName: \"kubernetes.io/projected/0128a08f-b777-40e1-bf05-f79d772fd926-kube-api-access-ft7jh\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.719018 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.718955 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0128a08f-b777-40e1-bf05-f79d772fd926-sys\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.719018 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.719003 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0128a08f-b777-40e1-bf05-f79d772fd926-root\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.719168 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.719147 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d8b1a575-54e2-46d5-b23a-4ad16eab259a-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:20.719307 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.719215 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0128a08f-b777-40e1-bf05-f79d772fd926-root\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.719307 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.719293 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-textfile\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.719397 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.719320 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:20.719397 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.719337 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0128a08f-b777-40e1-bf05-f79d772fd926-metrics-client-ca\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.719397 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.719350 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-accelerators-collector-config\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.719397 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.719378 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-wtmp\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.719590 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.719402 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8b1a575-54e2-46d5-b23a-4ad16eab259a-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:20.719590 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.719433 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgcn8\" (UniqueName: \"kubernetes.io/projected/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-api-access-rgcn8\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:20.719590 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.719490 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:20.719590 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.719515 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-tls\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.719590 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.719555 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-wtmp\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.719829 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.719657 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:20.720059 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.720037 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8b1a575-54e2-46d5-b23a-4ad16eab259a-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:20.721601 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.721574 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.722024 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.721999 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:20.722313 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.722293 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-tls\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.722355 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.722298 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:20.725503 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.725482 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft7jh\" (UniqueName: \"kubernetes.io/projected/0128a08f-b777-40e1-bf05-f79d772fd926-kube-api-access-ft7jh\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.726526 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.726509 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgcn8\" (UniqueName: \"kubernetes.io/projected/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-api-access-rgcn8\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:20.767716 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.767688 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:20.779318 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.779290 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:20.792181 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.792160 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:20.807608 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:51:20.807556 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0128a08f_b777_40e1_bf05_f79d772fd926.slice/crio-7954856cc02ae53a08b344ead52a831e054d4c9c65bf92a5335a5666467030cb WatchSource:0}: Error finding container 7954856cc02ae53a08b344ead52a831e054d4c9c65bf92a5335a5666467030cb: Status 404 returned error can't find the container with id 7954856cc02ae53a08b344ead52a831e054d4c9c65bf92a5335a5666467030cb Nov 03 22:51:20.878426 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.878399 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:20.988492 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:20.988439 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:21.037687 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:21.037654 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bzt6m" event={"ID":"0128a08f-b777-40e1-bf05-f79d772fd926","Type":"ContainerStarted","Data":"7954856cc02ae53a08b344ead52a831e054d4c9c65bf92a5335a5666467030cb"} Nov 03 22:51:21.050725 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:21.050661 2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs"] Nov 03 22:51:21.053139 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:51:21.053117 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b1a575_54e2_46d5_b23a_4ad16eab259a.slice/crio-76258750ef3079753405770429b6371fa04f8c732127c168c89fd5971151b7a9 WatchSource:0}: Error finding container 76258750ef3079753405770429b6371fa04f8c732127c168c89fd5971151b7a9: Status 404 returned error can't find the container with id 76258750ef3079753405770429b6371fa04f8c732127c168c89fd5971151b7a9 Nov 03 22:51:21.486927 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:21.486893 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:21.601234 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:21.601206 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:22.042599 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:22.042555 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" event={"ID":"d8b1a575-54e2-46d5-b23a-4ad16eab259a","Type":"ContainerStarted","Data":"76258750ef3079753405770429b6371fa04f8c732127c168c89fd5971151b7a9"} Nov 03 22:51:22.881619 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:22.881586 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:22.984272 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:22.984232 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:23.048445 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:23.048410 2568 generic.go:356] "Generic (PLEG): container finished" podID="0128a08f-b777-40e1-bf05-f79d772fd926" containerID="b90b369aa03716b7d8cca7534718723c24ead2263823bb04f7edba0fa9d5ad53" exitCode=0 Nov 03 22:51:23.048593 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:23.048500 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bzt6m" event={"ID":"0128a08f-b777-40e1-bf05-f79d772fd926","Type":"ContainerDied","Data":"b90b369aa03716b7d8cca7534718723c24ead2263823bb04f7edba0fa9d5ad53"} Nov 03 22:51:23.051070 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:23.051033 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" event={"ID":"d8b1a575-54e2-46d5-b23a-4ad16eab259a","Type":"ContainerStarted","Data":"b9cfadd2f3f5aefeb6871db3203b409a0e4641e8f279cb35260ba8e31bebde4e"} Nov 03 22:51:23.051190 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:23.051089 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" event={"ID":"d8b1a575-54e2-46d5-b23a-4ad16eab259a","Type":"ContainerStarted","Data":"5bd8ec4c1d812bd580057142514618407d3402d65fa7b45457fd3a85c62508fb"} Nov 03 22:51:23.051190 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:23.051119 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" event={"ID":"d8b1a575-54e2-46d5-b23a-4ad16eab259a","Type":"ContainerStarted","Data":"b99260a2875ab800ad02c655aaae96c84c67d2622cf21a80b87c34b0e2c715d0"} Nov 03 22:51:23.078981 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:23.078896 2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" podStartSLOduration=1.467304051 podStartE2EDuration="3.078877176s" totalImagesPullingTime="1.611573125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:23.077515064 +0000 UTC m=+61.858211027" watchObservedRunningTime="2026-11-03 22:51:23.078877176 +0000 UTC m=+61.859573140" Nov 03 22:51:23.485068 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:23.485032 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:23.598998 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:23.598964 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:23.710314 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:23.710282 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:24.056577 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:24.056534 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bzt6m" event={"ID":"0128a08f-b777-40e1-bf05-f79d772fd926","Type":"ContainerStarted","Data":"b980466beb73892a5a10c7bfb1bb4c509819a3b48422fdd47551aacb2d1b59a8"} Nov 03 22:51:24.056947 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:24.056605 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bzt6m" event={"ID":"0128a08f-b777-40e1-bf05-f79d772fd926","Type":"ContainerStarted","Data":"a62d06d6efa32a028f1f2d85c95d8de57ef7ad24b2a2dc6e138671169e84ddcd"} Nov 03 22:51:24.073180 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:24.073128 2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bzt6m" podStartSLOduration=2.234440486 podStartE2EDuration="4.07311463s" totalImagesPullingTime="1.759308672s" totalInitContainerRuntime="79.365472ms" isStatefulPod=true podCreationTimestamp="2026-11-03 22:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:24.071587306 +0000 UTC m=+62.852283269" watchObservedRunningTime="2026-11-03 22:51:24.07311463 +0000 UTC m=+62.853810594" Nov 03 22:51:25.303859 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:25.303823 2568 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-htd5b"] Nov 03 22:51:25.305737 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:25.305722 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-htd5b" Nov 03 22:51:25.313548 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:25.313528 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-9nm4c\"" Nov 03 22:51:25.316881 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:25.316861 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Nov 03 22:51:25.319006 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:25.318979 2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-htd5b"] Nov 03 22:51:25.359047 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:25.359019 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78ad8bbb-3cb2-431c-aa87-a77ff23792c4-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-htd5b\" (UID: \"78ad8bbb-3cb2-431c-aa87-a77ff23792c4\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-htd5b" Nov 03 22:51:25.359180 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:25.359077 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld956\" (UniqueName: \"kubernetes.io/projected/78ad8bbb-3cb2-431c-aa87-a77ff23792c4-kube-api-access-ld956\") pod \"monitoring-plugin-77f4f76594-htd5b\" (UID: \"78ad8bbb-3cb2-431c-aa87-a77ff23792c4\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-htd5b" Nov 03 22:51:25.428244 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:25.428212 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:25.461008 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:25.460972 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78ad8bbb-3cb2-431c-aa87-a77ff23792c4-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-htd5b\" (UID: \"78ad8bbb-3cb2-431c-aa87-a77ff23792c4\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-htd5b" Nov 03 22:51:25.461167 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:25.461043 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld956\" (UniqueName: \"kubernetes.io/projected/78ad8bbb-3cb2-431c-aa87-a77ff23792c4-kube-api-access-ld956\") pod \"monitoring-plugin-77f4f76594-htd5b\" (UID: \"78ad8bbb-3cb2-431c-aa87-a77ff23792c4\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-htd5b" Nov 03 22:51:25.463547 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:25.463524 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78ad8bbb-3cb2-431c-aa87-a77ff23792c4-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-htd5b\" (UID: \"78ad8bbb-3cb2-431c-aa87-a77ff23792c4\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-htd5b" Nov 03 22:51:25.469418 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:25.469375 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld956\" (UniqueName: \"kubernetes.io/projected/78ad8bbb-3cb2-431c-aa87-a77ff23792c4-kube-api-access-ld956\") pod \"monitoring-plugin-77f4f76594-htd5b\" (UID: \"78ad8bbb-3cb2-431c-aa87-a77ff23792c4\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-htd5b" Nov 03 22:51:25.547774 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:25.547739 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:25.615870 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:25.615791 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-htd5b" Nov 03 22:51:25.886784 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:25.886711 2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-htd5b"] Nov 03 22:51:25.890083 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:51:25.890059 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78ad8bbb_3cb2_431c_aa87_a77ff23792c4.slice/crio-87a06b6210ad91821dabb243d465fbbc0aa779fb11e949fd6b86459a1eeba8fc WatchSource:0}: Error finding container 87a06b6210ad91821dabb243d465fbbc0aa779fb11e949fd6b86459a1eeba8fc: Status 404 returned error can't find the container with id 87a06b6210ad91821dabb243d465fbbc0aa779fb11e949fd6b86459a1eeba8fc Nov 03 22:51:26.064976 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.064944 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-htd5b" event={"ID":"78ad8bbb-3cb2-431c-aa87-a77ff23792c4","Type":"ContainerStarted","Data":"87a06b6210ad91821dabb243d465fbbc0aa779fb11e949fd6b86459a1eeba8fc"} Nov 03 22:51:26.368553 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.368517 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:51:26.369038 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.368565 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs\") pod \"network-metrics-daemon-qqzlx\" (UID: \"b725cdb0-2fe7-42d6-99b0-1f36d22081af\") " pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:51:26.370783 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.370761 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 03 22:51:26.370783 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.370781 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 03 22:51:26.381141 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.381113 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:51:26.381230 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.381163 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs\") pod \"network-metrics-daemon-qqzlx\" (UID: \"b725cdb0-2fe7-42d6-99b0-1f36d22081af\") " pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:51:26.469327 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.469254 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vf8n\" (UniqueName: \"kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n\") pod \"network-check-target-kmzch\" (UID: \"89db2583-ca69-48db-adf0-1383f53434c1\") " pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:51:26.471288 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.471266 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 03 22:51:26.482181 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.482155 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 03 22:51:26.499394 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.499369 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vf8n\" (UniqueName: \"kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n\") pod \"network-check-target-kmzch\" (UID: \"89db2583-ca69-48db-adf0-1383f53434c1\") " pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:51:26.559505 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.559446 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dgw9c\"" Nov 03 22:51:26.564043 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.564010 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-k9x8r\"" Nov 03 22:51:26.567793 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.567770 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:51:26.568435 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.568417 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-l7l8c\"" Nov 03 22:51:26.572534 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.572501 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:51:26.576891 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.576865 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:51:26.881920 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.881890 2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kmzch"] Nov 03 22:51:26.887892 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:51:26.887868 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89db2583_ca69_48db_adf0_1383f53434c1.slice/crio-86e94ee765ed543768adda871613e396a1030cae850e535b8f5bcfec0532714b WatchSource:0}: Error finding container 86e94ee765ed543768adda871613e396a1030cae850e535b8f5bcfec0532714b: Status 404 returned error can't find the container with id 86e94ee765ed543768adda871613e396a1030cae850e535b8f5bcfec0532714b Nov 03 22:51:26.899274 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.899253 2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r2kpn"] Nov 03 22:51:26.903617 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:51:26.903566 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7354598a_9d87_4762_9633_da3d96ff063b.slice/crio-71b31757b3eae23865f0f39ffca585219c5615b8c5825f1fa9ac96da70b77af8 WatchSource:0}: Error finding container 71b31757b3eae23865f0f39ffca585219c5615b8c5825f1fa9ac96da70b77af8: Status 404 returned error can't find the container with id 71b31757b3eae23865f0f39ffca585219c5615b8c5825f1fa9ac96da70b77af8 Nov 03 22:51:26.973266 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.973232 2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qqzlx"] Nov 03 22:51:26.973479 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.973301 2568 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 03 22:51:26.978185 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.978155 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:26.986986 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:51:26.986957 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb725cdb0_2fe7_42d6_99b0_1f36d22081af.slice/crio-fd84467f3ae280dc7969821e92f28a665f14808e05c9c200d73bbb717ffe7239 WatchSource:0}: Error finding container fd84467f3ae280dc7969821e92f28a665f14808e05c9c200d73bbb717ffe7239: Status 404 returned error can't find the container with id fd84467f3ae280dc7969821e92f28a665f14808e05c9c200d73bbb717ffe7239 Nov 03 22:51:26.998420 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:26.998398 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Nov 03 22:51:27.008977 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.008948 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Nov 03 22:51:27.009222 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.009095 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Nov 03 22:51:27.009222 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.009126 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Nov 03 22:51:27.009222 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.009170 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Nov 03 22:51:27.010974 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.010951 2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 03 22:51:27.011956 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.011922 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Nov 03 22:51:27.012117 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.012089 2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Nov 03 22:51:27.029254 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.029222 2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:27.057889 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.057844 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:27.070268 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.070230 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qqzlx" event={"ID":"b725cdb0-2fe7-42d6-99b0-1f36d22081af","Type":"ContainerStarted","Data":"fd84467f3ae280dc7969821e92f28a665f14808e05c9c200d73bbb717ffe7239"} Nov 03 22:51:27.071918 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.071888 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r2kpn" event={"ID":"7354598a-9d87-4762-9633-da3d96ff063b","Type":"ContainerStarted","Data":"71b31757b3eae23865f0f39ffca585219c5615b8c5825f1fa9ac96da70b77af8"} Nov 03 22:51:27.073423 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.073399 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kmzch" event={"ID":"89db2583-ca69-48db-adf0-1383f53434c1","Type":"ContainerStarted","Data":"86e94ee765ed543768adda871613e396a1030cae850e535b8f5bcfec0532714b"} Nov 03 22:51:27.077752 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.077726 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.077857 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.077763 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.077918 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.077863 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.077918 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.077910 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.078010 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.077964 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljhkl\" (UniqueName: \"kubernetes.io/projected/428c38a6-e709-454e-984e-034ec6402558-kube-api-access-ljhkl\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.078010 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.077998 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.078067 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.078018 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.078127 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.078113 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-config\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.078162 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.078134 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.078162 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.078153 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/428c38a6-e709-454e-984e-034ec6402558-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.078236 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.078199 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.078288 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.078272 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.078504 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.078483 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.078610 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.078517 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.078610 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.078542 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-web-config\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.078694 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.078617 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/428c38a6-e709-454e-984e-034ec6402558-config-out\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.078747 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.078733 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.078784 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.078759 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.078784 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.078776 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.078853 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.078802 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.098442 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.098415 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Nov 03 22:51:27.098442 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.098433 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Nov 03 22:51:27.098610 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.098510 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Nov 03 22:51:27.098610 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.098558 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Nov 03 22:51:27.098742 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.098641 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Nov 03 22:51:27.098742 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.098686 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Nov 03 22:51:27.098742 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.098695 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1c5i59msea8be\"" Nov 03 22:51:27.098742 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.098737 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Nov 03 22:51:27.098924 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.098792 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xr88k\"" Nov 03 22:51:27.098924 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.098669 2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Nov 03 22:51:27.179573 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.179503 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.179711 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.179585 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.179711 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.179624 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.179711 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.179651 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.179711 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.179674 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-web-config\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.179711 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.179709 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/428c38a6-e709-454e-984e-034ec6402558-config-out\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.179892 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.179730 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.179892 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.179764 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.179892 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.179819 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.179892 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.179855 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.179892 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.179885 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.180114 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.179915 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.180114 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.179939 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.180114 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.179969 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.180114 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.179990 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljhkl\" (UniqueName: \"kubernetes.io/projected/428c38a6-e709-454e-984e-034ec6402558-kube-api-access-ljhkl\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.180114 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.180025 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.180114 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.180055 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.180114 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.180091 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-config\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.180114 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.180114 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.180697 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.180147 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/428c38a6-e709-454e-984e-034ec6402558-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.182249 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.181254 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.182249 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.181265 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.182249 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.181594 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.185509 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.183095 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.185509 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.183600 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.185509 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.184256 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.185509 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.184579 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.185509 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.184722 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.185509 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.184789 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.185509 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.185204 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.187043 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.187015 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.187190 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.187169 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/428c38a6-e709-454e-984e-034ec6402558-config-out\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.187312 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.187288 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.188863 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.188824 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-config\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.189336 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.189312 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.189440 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.189324 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/428c38a6-e709-454e-984e-034ec6402558-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.190531 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.190487 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.190947 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.190927 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.191737 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.191716 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-web-config\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.200000 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.199971 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljhkl\" (UniqueName: \"kubernetes.io/projected/428c38a6-e709-454e-984e-034ec6402558-kube-api-access-ljhkl\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.314150 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.313774 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:27.617393 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:27.617290 2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 03 22:51:27.620702 ip-10-0-138-89 kubenswrapper[2568]: W1103 22:51:27.620668 2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod428c38a6_e709_454e_984e_034ec6402558.slice/crio-474079cb9525c11eba9d6092133949e08ddaba71b9769a6c9d9ced125ada6548 WatchSource:0}: Error finding container 474079cb9525c11eba9d6092133949e08ddaba71b9769a6c9d9ced125ada6548: Status 404 returned error can't find the container with id 474079cb9525c11eba9d6092133949e08ddaba71b9769a6c9d9ced125ada6548 Nov 03 22:51:28.080147 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:28.080101 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-htd5b" event={"ID":"78ad8bbb-3cb2-431c-aa87-a77ff23792c4","Type":"ContainerStarted","Data":"5776848bba5d0d9fadfc5dc89b528eb5cb73e1244605556a42683e03ced71f0e"} Nov 03 22:51:28.080723 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:28.080614 2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-htd5b" Nov 03 22:51:28.082534 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:28.082421 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"428c38a6-e709-454e-984e-034ec6402558","Type":"ContainerStarted","Data":"474079cb9525c11eba9d6092133949e08ddaba71b9769a6c9d9ced125ada6548"} Nov 03 22:51:28.087094 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:28.087072 2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-htd5b" Nov 03 22:51:28.097999 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:28.097952 2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-htd5b" podStartSLOduration=1.571859603 podStartE2EDuration="3.097939797s" totalImagesPullingTime="1.526080194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:28.097010773 +0000 UTC m=+66.877706737" watchObservedRunningTime="2026-11-03 22:51:28.097939797 +0000 UTC m=+66.878635801" Nov 03 22:51:29.089298 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:29.089263 2568 generic.go:356] "Generic (PLEG): container finished" podID="428c38a6-e709-454e-984e-034ec6402558" containerID="7131d83439dd85a2b4a9d25fd4e8a04596f95bc0230038c8b4f64657602bbfff" exitCode=0 Nov 03 22:51:29.089776 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:29.089414 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"428c38a6-e709-454e-984e-034ec6402558","Type":"ContainerDied","Data":"7131d83439dd85a2b4a9d25fd4e8a04596f95bc0230038c8b4f64657602bbfff"} Nov 03 22:51:29.094310 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:29.094286 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qqzlx" event={"ID":"b725cdb0-2fe7-42d6-99b0-1f36d22081af","Type":"ContainerStarted","Data":"66d73c5af083cf54447dac02989c1f25b08b7b9dc78066996852df383726d9d4"} Nov 03 22:51:29.094434 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:29.094326 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qqzlx" event={"ID":"b725cdb0-2fe7-42d6-99b0-1f36d22081af","Type":"ContainerStarted","Data":"8f3cf262965d4475826c756878cb928b0f9970972dc6e9e5c8ff6d1596173eb1"} Nov 03 22:51:29.139045 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:29.138993 2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qqzlx" podStartSLOduration=65.924661117 podStartE2EDuration="1m7.138978689s" totalImagesPullingTime="1.214317572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:29.137271612 +0000 UTC m=+67.917967576" watchObservedRunningTime="2026-11-03 22:51:29.138978689 +0000 UTC m=+67.919674654" Nov 03 22:51:29.179663 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:29.179617 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:29.287448 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:29.287336 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:30.739415 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:30.739376 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:30.843286 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:30.843236 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:31.104356 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:31.104271 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kmzch" event={"ID":"89db2583-ca69-48db-adf0-1383f53434c1","Type":"ContainerStarted","Data":"54c0ed2525b5a2b756e1fa25a1c7536891024e6003045ca5ca10db791ba5f0bc"} Nov 03 22:51:31.104526 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:31.104399 2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:51:31.120044 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:31.119359 2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kmzch" podStartSLOduration=65.650287868 podStartE2EDuration="1m9.119339011s" totalImagesPullingTime="3.469051143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:31.118196982 +0000 UTC m=+69.898892946" watchObservedRunningTime="2026-11-03 22:51:31.119339011 +0000 UTC m=+69.900034975" Nov 03 22:51:31.960545 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:31.960511 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:32.081360 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:32.081321 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:32.186235 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:32.186201 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:32.706080 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:32.706042 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:32.816012 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:32.815982 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:33.114326 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:33.114255 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"428c38a6-e709-454e-984e-034ec6402558","Type":"ContainerStarted","Data":"eb4b709a8973dfd5c9284fe44deade307c055fbe4dd61a5bcce9eea797d04249"} Nov 03 22:51:33.114326 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:33.114318 2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"428c38a6-e709-454e-984e-034ec6402558","Type":"ContainerStarted","Data":"1786ebf25d038173d1739097b9d96e19f9a9d253b7bb6e1526ad44d93a6ca979"} Nov 03 22:51:33.417162 ip-10-0-138-89 kubenswrapper[2568]: I1103 22:51:33.417062 2568 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 22:51:33.417232 ip-10-0-138-89 systemd[1]: Stopping Kubernetes Kubelet... Nov 03 22:51:33.428986 ip-10-0-138-89 systemd[1]: kubelet.service: Deactivated successfully. Nov 03 22:51:33.429230 ip-10-0-138-89 systemd[1]: Stopped Kubernetes Kubelet. Nov 03 22:51:33.429293 ip-10-0-138-89 systemd[1]: kubelet.service: Consumed 4.073s CPU time. Nov 03 22:51:33.438211 ip-10-0-138-89 systemd[1]: Starting Kubernetes Kubelet... Nov 03 22:51:33.500522 ip-10-0-138-89 kubenswrapper[5332]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 22:51:33.500522 ip-10-0-138-89 kubenswrapper[5332]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 03 22:51:33.500522 ip-10-0-138-89 kubenswrapper[5332]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 22:51:33.500522 ip-10-0-138-89 kubenswrapper[5332]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 22:51:33.502574 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502493 5332 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:51:33.502574 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502573 5332 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:51:33.502574 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502578 5332 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:51:33.502669 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502582 5332 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:51:33.502669 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502585 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:51:33.502669 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502588 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:51:33.502669 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502592 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:51:33.502669 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502595 5332 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:51:33.502669 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502598 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:51:33.502669 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502601 5332 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:51:33.502669 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502603 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:51:33.502669 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502606 5332 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:51:33.502669 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502609 5332 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:51:33.502669 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502613 5332 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:51:33.502669 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502617 5332 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:51:33.502669 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502620 5332 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:51:33.502669 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502623 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:51:33.502669 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502626 5332 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:51:33.502669 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502629 5332 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:51:33.502669 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502632 5332 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:51:33.502669 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502634 5332 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:51:33.502669 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502637 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:51:33.503122 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502647 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:51:33.503122 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502650 5332 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:51:33.503122 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502653 5332 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:51:33.503122 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502656 5332 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:51:33.503122 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502658 5332 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:51:33.503122 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502661 5332 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:51:33.503122 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502664 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:51:33.503122 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502667 5332 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:51:33.503122 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502669 5332 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:51:33.503122 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502672 5332 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:51:33.503122 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502675 5332 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:51:33.503122 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502678 5332 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:51:33.503122 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502681 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:51:33.503122 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502684 5332 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:51:33.503122 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502687 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:51:33.503122 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502690 5332 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:51:33.503122 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502692 5332 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:51:33.503122 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502695 5332 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:51:33.503122 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502697 5332 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:51:33.503737 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502700 5332 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:51:33.503737 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502703 5332 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:51:33.503737 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502705 5332 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:51:33.503737 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502708 5332 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:51:33.503737 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502710 5332 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:51:33.503737 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502713 5332 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:51:33.503737 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502716 5332 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:51:33.503737 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502719 5332 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:51:33.503737 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502722 5332 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:51:33.503737 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502725 5332 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:51:33.503737 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502728 5332 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:51:33.503737 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502730 5332 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:51:33.503737 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502734 5332 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:51:33.503737 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502738 5332 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:51:33.503737 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502742 5332 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:51:33.503737 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502744 5332 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:51:33.503737 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502747 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:51:33.503737 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502750 5332 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:51:33.503737 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502752 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:51:33.504380 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502755 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:51:33.504380 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502758 5332 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:51:33.504380 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502761 5332 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:51:33.504380 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502763 5332 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:51:33.504380 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502766 5332 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:51:33.504380 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502769 5332 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:51:33.504380 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502772 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:51:33.504380 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502775 5332 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:51:33.504380 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502777 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:51:33.504380 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502780 5332 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:51:33.504380 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502783 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:51:33.504380 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502786 5332 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:51:33.504380 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502789 5332 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:51:33.504380 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502792 5332 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:51:33.504380 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502795 5332 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:51:33.504380 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502797 5332 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:51:33.504380 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502800 5332 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:51:33.504380 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502802 5332 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:51:33.504380 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502805 5332 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:51:33.504380 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502808 5332 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:51:33.504958 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502810 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:51:33.504958 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502813 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:51:33.504958 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502816 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:51:33.504958 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502818 5332 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:51:33.504958 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502821 5332 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:51:33.504958 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502823 5332 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:51:33.504958 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502826 5332 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:51:33.504958 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502828 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:51:33.504958 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502830 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:51:33.504958 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502833 5332 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:51:33.504958 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502835 5332 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:51:33.504958 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502838 5332 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:51:33.504958 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502841 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:51:33.504958 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502844 5332 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:51:33.504958 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502847 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:51:33.504958 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502850 5332 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:51:33.504958 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502852 5332 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:51:33.504958 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502855 5332 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:51:33.504958 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502858 5332 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:51:33.504958 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502862 5332 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:51:33.505626 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502865 5332 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:51:33.505626 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502867 5332 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:51:33.505626 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502870 5332 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:51:33.505626 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502873 5332 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:51:33.505626 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502875 5332 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:51:33.505626 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.502879 5332 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:51:33.505626 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503662 5332 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:51:33.505626 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503670 5332 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:51:33.505626 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503674 5332 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:51:33.505626 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503676 5332 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:51:33.505626 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503679 5332 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:51:33.505626 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503682 5332 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:51:33.505626 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503684 5332 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:51:33.505626 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503687 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:51:33.505626 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503690 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:51:33.505626 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503693 5332 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:51:33.505626 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503696 5332 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:51:33.505626 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503698 5332 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:51:33.505626 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503701 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:51:33.505626 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503704 5332 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:51:33.506405 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503706 5332 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:51:33.506405 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503709 5332 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:51:33.506405 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503712 5332 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:51:33.506405 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503714 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:51:33.506405 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503717 5332 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:51:33.506405 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503721 5332 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:51:33.506405 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503724 5332 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:51:33.506405 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503726 5332 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:51:33.506405 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503729 5332 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:51:33.506405 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503731 5332 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:51:33.506405 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503734 5332 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:51:33.506405 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503739 5332 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:51:33.506405 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503742 5332 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:51:33.506405 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503745 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:51:33.506405 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503748 5332 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:51:33.506405 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503750 5332 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:51:33.506405 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503753 5332 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:51:33.506405 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503756 5332 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:51:33.506405 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503759 5332 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:51:33.506405 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503762 5332 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:51:33.506939 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503765 5332 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:51:33.506939 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503768 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:51:33.506939 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503771 5332 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:51:33.506939 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503775 5332 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:51:33.506939 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503779 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:51:33.506939 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503783 5332 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:51:33.506939 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503787 5332 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:51:33.506939 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503791 5332 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:51:33.506939 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503795 5332 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:51:33.506939 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503799 5332 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:51:33.506939 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503804 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:51:33.506939 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503808 5332 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:51:33.506939 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503811 5332 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:51:33.506939 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503815 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:51:33.506939 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503820 5332 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:51:33.506939 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503824 5332 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:51:33.506939 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503828 5332 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:51:33.506939 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503832 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:51:33.506939 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503845 5332 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:51:33.507495 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503849 5332 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:51:33.507495 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503853 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:51:33.507495 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503857 5332 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:51:33.507495 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503861 5332 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:51:33.507495 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503866 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:51:33.507495 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503870 5332 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:51:33.507495 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503874 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:51:33.507495 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503881 5332 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:51:33.507495 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503889 5332 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:51:33.507495 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503894 5332 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:51:33.507495 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503899 5332 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:51:33.507495 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503906 5332 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:51:33.507495 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503918 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:51:33.507495 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503924 5332 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:51:33.507495 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503928 5332 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:51:33.507495 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503933 5332 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:51:33.507495 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503937 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:51:33.507495 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503941 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:51:33.507495 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503945 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:51:33.507957 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503949 5332 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:51:33.507957 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503961 5332 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:51:33.507957 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503967 5332 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:51:33.507957 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503974 5332 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:51:33.507957 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503978 5332 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:51:33.507957 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503983 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:51:33.507957 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503987 5332 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:51:33.507957 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503992 5332 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:51:33.507957 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.503996 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:51:33.507957 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504001 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:51:33.507957 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504005 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:51:33.507957 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504010 5332 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:51:33.507957 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504014 5332 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:51:33.507957 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504018 5332 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:51:33.507957 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504023 5332 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:51:33.507957 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504027 5332 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:51:33.507957 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504032 5332 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:51:33.507957 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504036 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:51:33.507957 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504040 5332 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:51:33.508414 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504044 5332 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:51:33.508414 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504048 5332 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:51:33.508414 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504051 5332 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:51:33.508414 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504055 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:51:33.508414 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504059 5332 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:51:33.508414 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504063 5332 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:51:33.508414 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504067 5332 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:51:33.508414 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504079 5332 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:51:33.508414 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504083 5332 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:51:33.508414 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504088 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:51:33.508414 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504092 5332 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:51:33.508414 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504096 5332 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:51:33.508414 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504100 5332 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:51:33.508414 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504104 5332 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:51:33.508414 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504110 5332 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:51:33.508414 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504762 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:51:33.508414 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504771 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:51:33.508414 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504775 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:51:33.508414 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504778 5332 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:51:33.508879 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504781 5332 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:51:33.508879 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504784 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:51:33.508879 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504787 5332 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:51:33.508879 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504790 5332 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:51:33.508879 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504793 5332 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:51:33.508879 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504796 5332 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:51:33.508879 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504799 5332 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:51:33.508879 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504802 5332 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:51:33.508879 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504805 5332 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:51:33.508879 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504809 5332 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:51:33.508879 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504813 5332 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:51:33.508879 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504816 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:51:33.508879 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504819 5332 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:51:33.508879 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504822 5332 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:51:33.508879 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504825 5332 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:51:33.508879 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504827 5332 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:51:33.508879 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504830 5332 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:51:33.508879 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504833 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:51:33.508879 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504835 5332 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:51:33.509371 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504838 5332 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:51:33.509371 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504841 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:51:33.509371 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504844 5332 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:51:33.509371 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504846 5332 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:51:33.509371 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504849 5332 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:51:33.509371 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504852 5332 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:51:33.509371 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504854 5332 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:51:33.509371 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504860 5332 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:51:33.509371 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504862 5332 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:51:33.509371 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504865 5332 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:51:33.509371 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504868 5332 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:51:33.509371 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504870 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:51:33.509371 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504873 5332 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:51:33.509371 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504876 5332 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:51:33.509371 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504878 5332 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:51:33.509371 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504882 5332 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:51:33.509371 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504885 5332 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:51:33.509371 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504887 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:51:33.509371 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504891 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:51:33.509371 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504893 5332 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:51:33.509997 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504896 5332 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:51:33.509997 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504899 5332 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:51:33.509997 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504901 5332 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:51:33.509997 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504904 5332 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:51:33.509997 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504906 5332 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:51:33.509997 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504909 5332 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:51:33.509997 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504912 5332 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:51:33.509997 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504914 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:51:33.509997 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504917 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:51:33.509997 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504920 5332 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:51:33.509997 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504923 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:51:33.509997 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504925 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:51:33.509997 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504928 5332 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:51:33.509997 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504930 5332 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:51:33.509997 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504933 5332 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:51:33.509997 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504936 5332 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:51:33.509997 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504938 5332 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:51:33.509997 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504941 5332 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:51:33.509997 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504944 5332 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:51:33.509997 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504948 5332 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:51:33.510886 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504950 5332 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:51:33.510886 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504953 5332 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:51:33.510886 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504957 5332 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:51:33.510886 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504959 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:51:33.510886 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504963 5332 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:51:33.510886 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504966 5332 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:51:33.510886 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504968 5332 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:51:33.510886 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504971 5332 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:51:33.510886 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504974 5332 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:51:33.510886 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504977 5332 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:51:33.510886 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504979 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:51:33.510886 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504982 5332 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:51:33.510886 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504984 5332 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:51:33.510886 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504987 5332 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:51:33.510886 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504990 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:51:33.510886 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504992 5332 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:51:33.510886 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504995 5332 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:51:33.510886 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.504997 5332 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:51:33.510886 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505000 5332 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:51:33.510886 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505002 5332 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:51:33.511479 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505005 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:51:33.511479 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505008 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:51:33.511479 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505010 5332 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:51:33.511479 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505013 5332 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:51:33.511479 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505015 5332 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:51:33.511479 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505018 5332 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:51:33.511479 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505021 5332 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:51:33.511479 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505024 5332 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:51:33.511479 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505026 5332 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:51:33.511479 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505029 5332 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:51:33.511479 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505032 5332 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:51:33.511479 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505036 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:51:33.511479 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505038 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:51:33.511479 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505041 5332 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:51:33.511479 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505045 5332 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:51:33.511479 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505049 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:51:33.511479 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505053 5332 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:51:33.511479 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505056 5332 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:51:33.511479 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505059 5332 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505062 5332 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505065 5332 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505068 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505071 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505161 5332 flags.go:64] FLAG: --address="0.0.0.0" Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505169 5332 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505180 5332 flags.go:64] FLAG: --anonymous-auth="true" Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505185 5332 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505189 5332 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505193 5332 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505197 5332 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505201 5332 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505205 5332 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505208 5332 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505211 5332 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505215 5332 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505218 5332 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505221 5332 flags.go:64] FLAG: --cgroup-root="" Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505224 5332 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505227 5332 flags.go:64] FLAG: --client-ca-file="" Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505230 5332 flags.go:64] FLAG: --cloud-provider="external" Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505234 5332 flags.go:64] FLAG: --cluster-dns="[]" Nov 03 22:51:33.512005 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505238 5332 flags.go:64] FLAG: --cluster-domain="" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505241 5332 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505245 5332 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505249 5332 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505252 5332 flags.go:64] FLAG: --container-log-max-files="5" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505256 5332 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505259 5332 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505264 5332 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505267 5332 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505270 5332 flags.go:64] FLAG: --contention-profiling="false" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505274 5332 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505277 5332 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505280 5332 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505283 5332 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505288 5332 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505291 5332 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505294 5332 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505297 5332 flags.go:64] FLAG: --enable-load-reader="false" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505300 5332 flags.go:64] FLAG: --enable-server="true" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505302 5332 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505307 5332 flags.go:64] FLAG: --event-burst="100" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505310 5332 flags.go:64] FLAG: --event-qps="50" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505313 5332 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505316 5332 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 03 22:51:33.512613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505319 5332 flags.go:64] FLAG: --eviction-hard="" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505323 5332 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505326 5332 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505330 5332 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505333 5332 flags.go:64] FLAG: --eviction-soft="" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505336 5332 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505338 5332 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505341 5332 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505346 5332 flags.go:64] FLAG: --experimental-mounter-path="" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505349 5332 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505354 5332 flags.go:64] FLAG: --fail-swap-on="true" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505357 5332 flags.go:64] FLAG: --feature-gates="" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505361 5332 flags.go:64] FLAG: --file-check-frequency="20s" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505364 5332 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505367 5332 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505371 5332 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505375 5332 flags.go:64] FLAG: --healthz-port="10248" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505378 5332 flags.go:64] FLAG: --help="false" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505381 5332 flags.go:64] FLAG: --hostname-override="ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505384 5332 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505387 5332 flags.go:64] FLAG: --http-check-frequency="20s" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505390 5332 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505393 5332 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 03 22:51:33.513511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505397 5332 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505400 5332 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505403 5332 flags.go:64] FLAG: --image-service-endpoint="" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505406 5332 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505409 5332 flags.go:64] FLAG: --kube-api-burst="100" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505412 5332 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505415 5332 flags.go:64] FLAG: --kube-api-qps="50" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505418 5332 flags.go:64] FLAG: --kube-reserved="" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505422 5332 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505424 5332 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505427 5332 flags.go:64] FLAG: --kubelet-cgroups="" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505430 5332 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505433 5332 flags.go:64] FLAG: --lock-file="" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505436 5332 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505439 5332 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505442 5332 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505447 5332 flags.go:64] FLAG: --log-json-split-stream="false" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505464 5332 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505468 5332 flags.go:64] FLAG: --log-text-split-stream="false" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505474 5332 flags.go:64] FLAG: --logging-format="text" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505477 5332 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505480 5332 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505483 5332 flags.go:64] FLAG: --manifest-url="" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505486 5332 flags.go:64] FLAG: --manifest-url-header="" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505492 5332 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 03 22:51:33.514363 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505495 5332 flags.go:64] FLAG: --max-open-files="1000000" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505499 5332 flags.go:64] FLAG: --max-pods="110" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505502 5332 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505505 5332 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505508 5332 flags.go:64] FLAG: --memory-manager-policy="None" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505511 5332 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505514 5332 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505517 5332 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505520 5332 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505531 5332 flags.go:64] FLAG: --node-status-max-images="50" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505536 5332 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505540 5332 flags.go:64] FLAG: --oom-score-adj="-999" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505545 5332 flags.go:64] FLAG: --pod-cidr="" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505550 5332 flags.go:64] FLAG: --pod-manifest-path="" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505554 5332 flags.go:64] FLAG: --pod-max-pids="-1" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505559 5332 flags.go:64] FLAG: --pods-per-core="0" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505563 5332 flags.go:64] FLAG: --port="10250" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505568 5332 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505572 5332 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-076171c4a7edff358" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505577 5332 flags.go:64] FLAG: --qos-reserved="" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505581 5332 flags.go:64] FLAG: --read-only-port="10255" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505585 5332 flags.go:64] FLAG: --register-node="true" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505591 5332 flags.go:64] FLAG: --register-with-taints="" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505597 5332 flags.go:64] FLAG: --registry-burst="10" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505602 5332 flags.go:64] FLAG: --registry-qps="5" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505606 5332 flags.go:64] FLAG: --reserved-cpus="" Nov 03 22:51:33.515032 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505613 5332 flags.go:64] FLAG: --reserved-memory="" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505620 5332 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505625 5332 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505630 5332 flags.go:64] FLAG: --rotate-certificates="false" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505634 5332 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505638 5332 flags.go:64] FLAG: --runonce="false" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505641 5332 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505645 5332 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505648 5332 flags.go:64] FLAG: --seccomp-default="false" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505651 5332 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505654 5332 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505657 5332 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505660 5332 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505663 5332 flags.go:64] FLAG: --storage-driver-password="root" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505666 5332 flags.go:64] FLAG: --storage-driver-secure="false" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505669 5332 flags.go:64] FLAG: --storage-driver-table="stats" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505672 5332 flags.go:64] FLAG: --storage-driver-user="root" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505677 5332 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505682 5332 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505687 5332 flags.go:64] FLAG: --system-cgroups="" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505691 5332 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505700 5332 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505703 5332 flags.go:64] FLAG: --tls-cert-file="" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505706 5332 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505711 5332 flags.go:64] FLAG: --tls-min-version="" Nov 03 22:51:33.515899 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505714 5332 flags.go:64] FLAG: --tls-private-key-file="" Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505717 5332 flags.go:64] FLAG: --topology-manager-policy="none" Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505722 5332 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505726 5332 flags.go:64] FLAG: --topology-manager-scope="container" Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505731 5332 flags.go:64] FLAG: --v="2" Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505737 5332 flags.go:64] FLAG: --version="false" Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505743 5332 flags.go:64] FLAG: --vmodule="" Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505751 5332 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.505758 5332 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505940 5332 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505947 5332 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505950 5332 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505955 5332 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505959 5332 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505961 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505964 5332 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505967 5332 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505970 5332 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505973 5332 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505975 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505978 5332 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:51:33.516719 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505982 5332 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:51:33.517214 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505984 5332 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:51:33.517214 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505987 5332 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:51:33.517214 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505991 5332 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:51:33.517214 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.505996 5332 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:51:33.517214 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506000 5332 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:51:33.517214 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506004 5332 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:51:33.517214 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506008 5332 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:51:33.517214 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506013 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:51:33.517214 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506017 5332 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:51:33.517214 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506022 5332 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:51:33.517214 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506026 5332 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:51:33.517214 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506031 5332 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:51:33.517214 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506034 5332 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:51:33.517214 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506037 5332 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:51:33.517214 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506040 5332 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:51:33.517214 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506043 5332 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:51:33.517214 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506045 5332 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:51:33.517214 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506050 5332 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:51:33.517214 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506053 5332 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:51:33.517214 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506056 5332 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:51:33.517925 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506059 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:51:33.517925 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506062 5332 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:51:33.517925 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506066 5332 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:51:33.517925 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506069 5332 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:51:33.517925 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506071 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:51:33.517925 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506074 5332 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:51:33.517925 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506077 5332 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:51:33.517925 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506081 5332 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:51:33.517925 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506085 5332 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:51:33.517925 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506088 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:51:33.517925 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506091 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:51:33.517925 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506094 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:51:33.517925 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506097 5332 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:51:33.517925 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506100 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:51:33.517925 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506102 5332 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:51:33.517925 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506105 5332 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:51:33.517925 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506108 5332 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:51:33.517925 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506110 5332 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:51:33.517925 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506113 5332 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:51:33.518490 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506116 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:51:33.518490 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506118 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:51:33.518490 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506121 5332 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:51:33.518490 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506123 5332 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:51:33.518490 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506126 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:51:33.518490 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506129 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:51:33.518490 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506131 5332 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:51:33.518490 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506134 5332 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:51:33.518490 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506137 5332 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:51:33.518490 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506139 5332 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:51:33.518490 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506143 5332 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:51:33.518490 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506146 5332 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:51:33.518490 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506148 5332 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:51:33.518490 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506151 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:51:33.518490 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506154 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:51:33.518490 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506158 5332 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:51:33.518490 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506160 5332 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:51:33.518490 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506163 5332 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:51:33.518490 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506166 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:51:33.519082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506168 5332 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:51:33.519082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506171 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:51:33.519082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506174 5332 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:51:33.519082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506176 5332 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:51:33.519082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506179 5332 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:51:33.519082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506182 5332 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:51:33.519082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506186 5332 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:51:33.519082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506190 5332 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:51:33.519082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506194 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:51:33.519082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506199 5332 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:51:33.519082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506203 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:51:33.519082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506207 5332 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:51:33.519082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506209 5332 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:51:33.519082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506212 5332 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:51:33.519082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506214 5332 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:51:33.519082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506217 5332 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:51:33.519082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506219 5332 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:51:33.519082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506222 5332 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:51:33.519082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506225 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:51:33.519832 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506227 5332 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:51:33.519832 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506230 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:51:33.519832 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506232 5332 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:51:33.519832 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506235 5332 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:51:33.519832 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506239 5332 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:51:33.519832 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506241 5332 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:51:33.519832 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506244 5332 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:51:33.519832 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506247 5332 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:51:33.519832 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506252 5332 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:51:33.519832 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506259 5332 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:51:33.519832 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506263 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:51:33.519832 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506268 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:51:33.519832 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506272 5332 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:51:33.519832 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506276 5332 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:51:33.519832 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506279 5332 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:51:33.519832 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506282 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:51:33.520592 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.506312 5332 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 22:51:33.520592 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506349 5332 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:51:33.520592 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506354 5332 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:51:33.520592 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506357 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:51:33.520592 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506360 5332 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:51:33.520592 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506362 5332 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:51:33.520592 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506365 5332 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:51:33.520592 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506368 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:51:33.520592 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506371 5332 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:51:33.520592 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506373 5332 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:51:33.520592 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506377 5332 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:51:33.520592 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506381 5332 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:51:33.520592 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506385 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:51:33.520592 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506388 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:51:33.520592 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506391 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:51:33.521061 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506394 5332 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:51:33.521061 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506397 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:51:33.521061 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506399 5332 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:51:33.521061 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506402 5332 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:51:33.521061 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506405 5332 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:51:33.521061 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506407 5332 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:51:33.521061 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506412 5332 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:51:33.521061 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506414 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:51:33.521061 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506417 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:51:33.521061 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506420 5332 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:51:33.521061 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506424 5332 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:51:33.521061 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506427 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:51:33.521061 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506431 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:51:33.521061 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506433 5332 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:51:33.521061 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506436 5332 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:51:33.521061 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506438 5332 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:51:33.521061 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506441 5332 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:51:33.521061 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506444 5332 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:51:33.521061 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506446 5332 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:51:33.521637 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506464 5332 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:51:33.521637 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506467 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:51:33.521637 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506470 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:51:33.521637 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506472 5332 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:51:33.521637 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506475 5332 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:51:33.521637 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506477 5332 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:51:33.521637 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506480 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:51:33.521637 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506483 5332 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:51:33.521637 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506485 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:51:33.521637 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506488 5332 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:51:33.521637 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506491 5332 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:51:33.521637 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506493 5332 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:51:33.521637 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506496 5332 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:51:33.521637 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506499 5332 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:51:33.521637 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506501 5332 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:51:33.521637 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506505 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:51:33.521637 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506507 5332 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:51:33.521637 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506510 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:51:33.521637 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506512 5332 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:51:33.522167 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506517 5332 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:51:33.522167 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506519 5332 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:51:33.522167 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506522 5332 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:51:33.522167 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506525 5332 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:51:33.522167 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506529 5332 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:51:33.522167 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506532 5332 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:51:33.522167 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506534 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:51:33.522167 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506537 5332 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:51:33.522167 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506539 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:51:33.522167 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506542 5332 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:51:33.522167 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506545 5332 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:51:33.522167 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506547 5332 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:51:33.522167 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506550 5332 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:51:33.522167 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506552 5332 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:51:33.522167 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506555 5332 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:51:33.522167 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506558 5332 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:51:33.522167 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506560 5332 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:51:33.522167 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506580 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:51:33.522167 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506584 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:51:33.522167 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506588 5332 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:51:33.522685 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506593 5332 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:51:33.522685 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506596 5332 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:51:33.522685 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506599 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:51:33.522685 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506603 5332 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:51:33.522685 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506606 5332 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:51:33.522685 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506608 5332 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:51:33.522685 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506611 5332 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:51:33.522685 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506614 5332 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:51:33.522685 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506616 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:51:33.522685 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506619 5332 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:51:33.522685 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506621 5332 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:51:33.522685 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506624 5332 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:51:33.522685 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506627 5332 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:51:33.522685 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506630 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:51:33.522685 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506633 5332 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:51:33.522685 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506636 5332 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:51:33.522685 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506640 5332 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:51:33.522685 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506642 5332 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:51:33.522685 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506645 5332 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:51:33.522685 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506648 5332 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:51:33.524118 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506651 5332 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:51:33.524118 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506653 5332 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:51:33.524118 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506656 5332 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:51:33.524118 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506659 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:51:33.524118 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506661 5332 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:51:33.524118 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506664 5332 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:51:33.524118 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506667 5332 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:51:33.524118 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506670 5332 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:51:33.524118 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506673 5332 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:51:33.524118 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506675 5332 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:51:33.524118 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506678 5332 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:51:33.524118 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506680 5332 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:51:33.524118 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506683 5332 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:51:33.524118 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.506685 5332 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:51:33.524118 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.511006 5332 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 03 22:51:33.524118 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.511022 5332 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 03 22:51:33.524118 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.511045 5332 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 03 22:51:33.524118 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.511052 5332 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 03 22:51:33.524118 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511136 5332 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:51:33.524118 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511143 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:51:33.524627 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511148 5332 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:51:33.524627 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511153 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:51:33.524627 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511157 5332 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:51:33.524627 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511161 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:51:33.524627 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511165 5332 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:51:33.524627 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511169 5332 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:51:33.524627 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511173 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:51:33.524627 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511177 5332 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:51:33.524627 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511181 5332 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:51:33.524627 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511185 5332 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:51:33.524627 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511189 5332 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:51:33.524627 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511193 5332 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:51:33.524627 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511197 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:51:33.524627 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511201 5332 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:51:33.524627 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511205 5332 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:51:33.524627 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511209 5332 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:51:33.524627 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511213 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:51:33.524627 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511218 5332 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:51:33.524627 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511222 5332 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:51:33.525082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511226 5332 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:51:33.525082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511230 5332 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:51:33.525082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511234 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:51:33.525082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511240 5332 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:51:33.525082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511246 5332 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:51:33.525082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511250 5332 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:51:33.525082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511255 5332 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:51:33.525082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511259 5332 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:51:33.525082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511262 5332 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:51:33.525082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511268 5332 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:51:33.525082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511273 5332 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:51:33.525082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511277 5332 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:51:33.525082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511281 5332 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:51:33.525082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511286 5332 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:51:33.525082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511290 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:51:33.525082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511293 5332 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:51:33.525082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511297 5332 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:51:33.525082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511301 5332 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:51:33.525082 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511305 5332 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:51:33.525552 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511310 5332 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:51:33.525552 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511314 5332 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:51:33.525552 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511317 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:51:33.525552 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511321 5332 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:51:33.525552 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511325 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:51:33.525552 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511329 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:51:33.525552 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511333 5332 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:51:33.525552 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511337 5332 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:51:33.525552 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511342 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:51:33.525552 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511346 5332 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:51:33.525552 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511350 5332 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:51:33.525552 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511354 5332 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:51:33.525552 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511358 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:51:33.525552 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511362 5332 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:51:33.525552 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511366 5332 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:51:33.525552 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511370 5332 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:51:33.525552 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511374 5332 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:51:33.525552 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511378 5332 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:51:33.525552 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511382 5332 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:51:33.525552 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511387 5332 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:51:33.526045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511391 5332 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:51:33.526045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511395 5332 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:51:33.526045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511399 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:51:33.526045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511403 5332 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:51:33.526045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511407 5332 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:51:33.526045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511412 5332 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:51:33.526045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511416 5332 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:51:33.526045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511421 5332 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:51:33.526045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511425 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:51:33.526045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511429 5332 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:51:33.526045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511433 5332 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:51:33.526045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511438 5332 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:51:33.526045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511442 5332 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:51:33.526045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511446 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:51:33.526045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511471 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:51:33.526045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511476 5332 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:51:33.526045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511480 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:51:33.526045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511484 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:51:33.526045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511489 5332 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:51:33.526568 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511494 5332 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:51:33.526568 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511498 5332 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:51:33.526568 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511502 5332 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:51:33.526568 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511506 5332 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:51:33.526568 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511511 5332 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:51:33.526568 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511515 5332 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:51:33.526568 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511520 5332 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:51:33.526568 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511524 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:51:33.526568 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511528 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:51:33.526568 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511544 5332 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:51:33.526568 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511549 5332 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:51:33.526568 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511554 5332 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:51:33.526568 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511558 5332 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:51:33.526568 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511562 5332 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:51:33.526568 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511566 5332 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:51:33.526568 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511571 5332 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:51:33.526568 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511575 5332 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:51:33.526568 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511580 5332 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:51:33.526568 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511584 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:51:33.526568 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511588 5332 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:51:33.527045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511593 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:51:33.527045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511597 5332 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:51:33.527045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511602 5332 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:51:33.527045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511606 5332 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:51:33.527045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511610 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:51:33.527045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511614 5332 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:51:33.527045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511618 5332 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:51:33.527045 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.511661 5332 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 22:51:33.527045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511877 5332 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:51:33.527045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511884 5332 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:51:33.527045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511890 5332 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:51:33.527045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511894 5332 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:51:33.527045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511900 5332 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:51:33.527045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511905 5332 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:51:33.527045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511909 5332 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:51:33.527045 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511914 5332 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:51:33.527427 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511919 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:51:33.527427 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511923 5332 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:51:33.527427 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511928 5332 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:51:33.527427 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511932 5332 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:51:33.527427 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511937 5332 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:51:33.527427 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511941 5332 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:51:33.527427 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511945 5332 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:51:33.527427 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511950 5332 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:51:33.527427 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511954 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:51:33.527427 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511958 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:51:33.527427 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511962 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:51:33.527427 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511966 5332 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:51:33.527427 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511971 5332 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:51:33.527427 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511975 5332 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:51:33.527427 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511979 5332 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:51:33.527427 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511983 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:51:33.527427 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511988 5332 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:51:33.527427 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511992 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:51:33.527427 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.511996 5332 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:51:33.527427 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512000 5332 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:51:33.527951 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512005 5332 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:51:33.527951 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512009 5332 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:51:33.527951 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512014 5332 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:51:33.527951 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512018 5332 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:51:33.527951 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512022 5332 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:51:33.527951 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512027 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:51:33.527951 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512031 5332 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:51:33.527951 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512036 5332 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:51:33.527951 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512041 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:51:33.527951 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512045 5332 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:51:33.527951 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512050 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:51:33.527951 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512054 5332 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:51:33.527951 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512058 5332 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:51:33.527951 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512062 5332 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:51:33.527951 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512068 5332 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:51:33.527951 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512074 5332 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:51:33.527951 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512079 5332 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:51:33.527951 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512083 5332 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:51:33.527951 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512087 5332 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:51:33.527951 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512091 5332 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:51:33.528430 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512095 5332 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:51:33.528430 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512099 5332 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:51:33.528430 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512103 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:51:33.528430 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512107 5332 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:51:33.528430 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512111 5332 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:51:33.528430 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512115 5332 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:51:33.528430 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512119 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:51:33.528430 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512123 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:51:33.528430 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512127 5332 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:51:33.528430 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512131 5332 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:51:33.528430 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512135 5332 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:51:33.528430 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512139 5332 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:51:33.528430 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512144 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:51:33.528430 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512148 5332 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:51:33.528430 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512152 5332 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:51:33.528430 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512156 5332 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:51:33.528430 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512160 5332 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:51:33.528430 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512164 5332 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:51:33.528430 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512168 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:51:33.528430 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512172 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:51:33.528923 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512176 5332 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:51:33.528923 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512180 5332 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:51:33.528923 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512185 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:51:33.528923 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512189 5332 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:51:33.528923 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512193 5332 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:51:33.528923 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512197 5332 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:51:33.528923 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512202 5332 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:51:33.528923 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512206 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:51:33.528923 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512210 5332 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:51:33.528923 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512215 5332 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:51:33.528923 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512219 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:51:33.528923 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512223 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:51:33.528923 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512227 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:51:33.528923 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512231 5332 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:51:33.528923 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512235 5332 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:51:33.528923 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512239 5332 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:51:33.528923 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512243 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:51:33.528923 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512248 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:51:33.528923 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512252 5332 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:51:33.529403 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512256 5332 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:51:33.529403 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512260 5332 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:51:33.529403 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512265 5332 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:51:33.529403 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512269 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:51:33.529403 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512273 5332 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:51:33.529403 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512278 5332 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:51:33.529403 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512282 5332 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:51:33.529403 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512287 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:51:33.529403 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512291 5332 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:51:33.529403 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512295 5332 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:51:33.529403 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512299 5332 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:51:33.529403 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512304 5332 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:51:33.529403 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512308 5332 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:51:33.529403 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512312 5332 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:51:33.529403 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512316 5332 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:51:33.529403 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512320 5332 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:51:33.529403 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512325 5332 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:51:33.529403 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512332 5332 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:51:33.529403 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512337 5332 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:51:33.529893 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.512380 5332 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 22:51:33.529893 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512427 5332 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:51:33.529893 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512433 5332 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:51:33.529893 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512437 5332 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:51:33.529893 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512442 5332 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:51:33.529893 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512446 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:51:33.529893 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512469 5332 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:51:33.529893 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512474 5332 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:51:33.529893 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512478 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:51:33.529893 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512482 5332 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:51:33.529893 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512486 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:51:33.529893 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512490 5332 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:51:33.529893 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512494 5332 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:51:33.529893 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512498 5332 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:51:33.529893 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512504 5332 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:51:33.529893 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512511 5332 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:51:33.530350 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512516 5332 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:51:33.530350 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512520 5332 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:51:33.530350 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512525 5332 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:51:33.530350 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512529 5332 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:51:33.530350 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512533 5332 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:51:33.530350 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512537 5332 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:51:33.530350 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512541 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:51:33.530350 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512545 5332 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:51:33.530350 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512549 5332 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:51:33.530350 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512553 5332 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:51:33.530350 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512557 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:51:33.530350 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512561 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:51:33.530350 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512565 5332 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:51:33.530350 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512569 5332 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:51:33.530350 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512575 5332 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:51:33.530350 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512579 5332 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:51:33.530350 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512583 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:51:33.530350 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512588 5332 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:51:33.530350 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512592 5332 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:51:33.530350 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512596 5332 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:51:33.530855 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512600 5332 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:51:33.530855 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512604 5332 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:51:33.530855 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512608 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:51:33.530855 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512612 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:51:33.530855 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512616 5332 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:51:33.530855 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512621 5332 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:51:33.530855 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512625 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:51:33.530855 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512628 5332 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:51:33.530855 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512632 5332 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:51:33.530855 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512636 5332 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:51:33.530855 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512640 5332 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:51:33.530855 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512645 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:51:33.530855 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512649 5332 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:51:33.530855 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512652 5332 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:51:33.530855 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512656 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:51:33.530855 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512660 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:51:33.530855 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512664 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:51:33.530855 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512669 5332 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:51:33.530855 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512673 5332 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:51:33.531569 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512677 5332 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:51:33.531569 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512681 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:51:33.531569 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512686 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:51:33.531569 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512690 5332 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:51:33.531569 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512694 5332 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:51:33.531569 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512698 5332 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:51:33.531569 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512702 5332 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:51:33.531569 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512707 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:51:33.531569 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512711 5332 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:51:33.531569 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512716 5332 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:51:33.531569 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512720 5332 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:51:33.531569 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512724 5332 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:51:33.531569 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512728 5332 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:51:33.531569 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512732 5332 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:51:33.531569 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512736 5332 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:51:33.531569 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512740 5332 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:51:33.531569 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512744 5332 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:51:33.531569 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512748 5332 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:51:33.531569 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512753 5332 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:51:33.531569 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512757 5332 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:51:33.532389 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512762 5332 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:51:33.532389 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512769 5332 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:51:33.532389 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512775 5332 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:51:33.532389 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512779 5332 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:51:33.532389 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512784 5332 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:51:33.532389 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512789 5332 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:51:33.532389 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512793 5332 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:51:33.532389 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512797 5332 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:51:33.532389 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512801 5332 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:51:33.532389 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512804 5332 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:51:33.532389 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512807 5332 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:51:33.532389 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512810 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:51:33.532389 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512815 5332 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:51:33.532389 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512818 5332 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:51:33.532389 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512820 5332 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:51:33.532389 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512823 5332 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:51:33.532389 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512826 5332 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:51:33.532389 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512829 5332 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:51:33.532389 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512831 5332 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:51:33.533162 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512834 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:51:33.533162 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512837 5332 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:51:33.533162 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512841 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:51:33.533162 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512843 5332 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:51:33.533162 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512846 5332 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:51:33.533162 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512849 5332 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:51:33.533162 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512851 5332 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:51:33.533162 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512854 5332 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:51:33.533162 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512857 5332 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:51:33.533162 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512859 5332 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:51:33.533162 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512862 5332 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:51:33.533162 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512864 5332 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:51:33.533162 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:51:33.512868 5332 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:51:33.533162 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.512936 5332 server.go:957] "Client rotation is on, will bootstrap in background" Nov 03 22:51:33.533162 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.514051 5332 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Nov 03 22:51:33.533162 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.514129 5332 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Nov 03 22:51:33.533162 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.514350 5332 server.go:1014] "Starting client certificate rotation" Nov 03 22:51:33.533162 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.514647 5332 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 03 22:51:33.533924 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.515212 5332 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-02 22:45:22 +0000 UTC" deadline="2028-07-11 00:41:54.473559749 +0000 UTC" Nov 03 22:51:33.533924 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.515253 5332 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14761h50m20.958310592s" Nov 03 22:51:33.533924 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.515560 5332 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 22:51:33.533924 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.517357 5332 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 22:51:33.533924 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.518708 5332 log.go:25] "Validated CRI v1 runtime API" Nov 03 22:51:33.533924 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.520539 5332 log.go:25] "Validated CRI v1 image API" Nov 03 22:51:33.533924 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.521406 5332 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 03 22:51:33.533924 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.523573 5332 fs.go:135] Filesystem UUIDs: map[2ca04727-afbf-472c-b610-fd29640f5c48:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a7c3a4a0-ebeb-49e1-9c0f-de7de0c24710:/dev/nvme0n1p4] Nov 03 22:51:33.534263 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.523595 5332 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/427bb8ac67a9d4074e5ccbf77fbd4e9986396233d62ca78a75e8780745d322e0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/427bb8ac67a9d4074e5ccbf77fbd4e9986396233d62ca78a75e8780745d322e0/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/474079cb9525c11eba9d6092133949e08ddaba71b9769a6c9d9ced125ada6548/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/474079cb9525c11eba9d6092133949e08ddaba71b9769a6c9d9ced125ada6548/userdata/shm major:0 minor:341 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5f5365b774847e607f16c0aa930efa27eb63ace8ecd65978574e22b4b3d069c1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5f5365b774847e607f16c0aa930efa27eb63ace8ecd65978574e22b4b3d069c1/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/71b31757b3eae23865f0f39ffca585219c5615b8c5825f1fa9ac96da70b77af8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/71b31757b3eae23865f0f39ffca585219c5615b8c5825f1fa9ac96da70b77af8/userdata/shm major:0 minor:321 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/72fc2408d3fd5411ca362728059687e550d3cbe41629053f45b18afcd79948a4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/72fc2408d3fd5411ca362728059687e550d3cbe41629053f45b18afcd79948a4/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/76258750ef3079753405770429b6371fa04f8c732127c168c89fd5971151b7a9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/76258750ef3079753405770429b6371fa04f8c732127c168c89fd5971151b7a9/userdata/shm major:0 minor:274 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7954856cc02ae53a08b344ead52a831e054d4c9c65bf92a5335a5666467030cb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7954856cc02ae53a08b344ead52a831e054d4c9c65bf92a5335a5666467030cb/userdata/shm major:0 minor:276 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7abb60fd0dbd49ed95d56ddc057a615ef4773fcead757435b6a8377f587c7350/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7abb60fd0dbd49ed95d56ddc057a615ef4773fcead757435b6a8377f587c7350/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7fe58bbfdb21bd36b13bc6b221cd10e00a3cd945386e524c5b9a1cb3da3fba45/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7fe58bbfdb21bd36b13bc6b221cd10e00a3cd945386e524c5b9a1cb3da3fba45/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/86e94ee765ed543768adda871613e396a1030cae850e535b8f5bcfec0532714b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/86e94ee765ed543768adda871613e396a1030cae850e535b8f5bcfec0532714b/userdata/shm major:0 minor:318 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/87a06b6210ad91821dabb243d465fbbc0aa779fb11e949fd6b86459a1eeba8fc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/87a06b6210ad91821dabb243d465fbbc0aa779fb11e949fd6b86459a1eeba8fc/userdata/shm major:0 minor:310 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8ee5d7f721db9c84a733e28cba8eb7274a47ba814a1ac6f3f10c1e4921290d6d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8ee5d7f721db9c84a733e28cba8eb7274a47ba814a1ac6f3f10c1e4921290d6d/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a53b71d42c4c45fbc3b5bbb6521fb8fc77e096b7f4cd53526ad450540ad6b904/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a53b71d42c4c45fbc3b5bbb6521fb8fc77e096b7f4cd53526ad450540ad6b904/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/aa284f0a066d70a183637078ea8db21bf28a8cfd02935f03d52c0e95b92384b4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/aa284f0a066d70a183637078ea8db21bf28a8cfd02935f03d52c0e95b92384b4/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b06ba18a444ce9770746fe46ce6facf68dab12ee4958eff85eb0ca45dc56c329/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b06ba18a444ce9770746fe46ce6facf68dab12ee4958eff85eb0ca45dc56c329/userdata/shm major:0 minor:55 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c68ee02bc5e9766696eb190607f39dfdcf94763f178908d94074e54883442508/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c68ee02bc5e9766696eb190607f39dfdcf94763f178908d94074e54883442508/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/db2716a9e46421c1dea6535d456b1f43c0fcea424c2c9a9f27ea31fe2948d78e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/db2716a9e46421c1dea6535d456b1f43c0fcea424c2c9a9f27ea31fe2948d78e/userdata/shm major:0 minor:57 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e9316516e3ca232334b2ac02d840cb2794583f9f1b1bcdef532bea596cf6bea5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e9316516e3ca232334b2ac02d840cb2794583f9f1b1bcdef532bea596cf6bea5/userdata/shm major:0 minor:231 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f276455788cd61bfe8d0379a7dcf9aace10ab3e97bc1b53552b5f042900b890e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f276455788cd61bfe8d0379a7dcf9aace10ab3e97bc1b53552b5f042900b890e/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f693f3c51671bc6b05a80d85eef83e783968858cbe19d60a1ce62a5cb95670d0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f693f3c51671bc6b05a80d85eef83e783968858cbe19d60a1ce62a5cb95670d0/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fd84467f3ae280dc7969821e92f28a665f14808e05c9c200d73bbb717ffe7239/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fd84467f3ae280dc7969821e92f28a665f14808e05c9c200d73bbb717ffe7239/userdata/shm major:0 minor:317 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0128a08f-b777-40e1-bf05-f79d772fd926/volumes/kubernetes.io~projected/kube-api-access-ft7jh:{mountpoint:/var/lib/kubelet/pods/0128a08f-b777-40e1-bf05-f79d772fd926/volumes/kubernetes.io~projected/kube-api-access-ft7jh major:0 minor:272 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0128a08f-b777-40e1-bf05-f79d772fd926/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/0128a08f-b777-40e1-bf05-f79d772fd926/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:265 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0128a08f-b777-40e1-bf05-f79d772fd926/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/0128a08f-b777-40e1-bf05-f79d772fd926/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:271 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volume-subpaths/web-config/config-reloader/2:{mountpoint:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volume-subpaths/web-config/config-reloader/2 major:0 minor:339 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:339 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volume-subpaths/web-config/prometheus/15:{mountpoint:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volume-subpaths/web-config/prometheus/15 major:0 minor:339 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~empty-dir/config-out major:0 minor:330 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~projected/kube-api-access-ljhkl:{mountpoint:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~projected/kube-api-access-ljhkl major:0 minor:340 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~projected/tls-assets major:0 minor:335 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/config major:0 minor:336 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:331 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:334 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:338 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:329 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:332 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:337 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/web-config major:0 minor:339 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4/volumes/kubernetes.io~projected/kube-api-access-vtmbf:{mountpoint:/var/lib/kubelet/pods/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4/volumes/kubernetes.io~projected/kube-api-access-vtmbf major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6c295fd2-23ab-4994-9ae2-60947f409b62/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/6c295fd2-23ab-4994-9ae2-60947f409b62/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6c295fd2-23ab-4994-9ae2-60947f409b62/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/6c295fd2-23ab-4994-9ae2-60947f409b62/volumes/kubernetes.io~empty-dir/tmp major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6c295fd2-23ab-4994-9ae2-60947f409b62/volumes/kubernetes.io~projected/kube-api-access-m2xgn:{mountpoint:/var/lib/kubelet/pods/6c295fd2-23ab-4994-9ae2-60947f409b62/volumes/kubernetes.io~projected/kube-api-access-m2xgn major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd/volumes/kubernetes.io~projected/kube-api-access-vsctv:{mountpoint:/var/lib/kubelet/pods/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd/volumes/kubernetes.io~projected/kube-api-access-vsctv major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7354598a-9d87-4762-9633-da3d96ff063b/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/7354598a-9d87-4762-9633-da3d96ff063b/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/78ad8bbb-3cb2-431c-aa87-a77ff23792c4/volumes/kubernetes.io~projected/kube-api-access-ld956:{mountpoint:/var/lib/kubelet/pods/78ad8bbb-3cb2-431c-aa87-a77ff23792c4/volumes/kubernetes.io~projected/kube-api-access-ld956 major:0 minor:309 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/78ad8bbb-3cb2-431c-aa87-a77ff23792c4/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/78ad8bbb-3cb2-431c-aa87-a77ff23792c4/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:305 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7a51fb1d-abfd-4803-8489-56e7ec93127f/volumes/kubernetes.io~projected/kube-api-access-5nc4c:{mountpoint:/var/lib/kubelet/pods/7a51fb1d-abfd-4803-8489-56e7ec93127f/volumes/kubernetes.io~projected/kube-api-access-5nc4c major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/858089de-9bce-4497-bf0a-9c756f0aa702/volumes/kubernetes.io~projected/kube-api-access-vqrnr:{mountpoint:/var/lib/kubelet/pods/858089de-9bce-4497-bf0a-9c756f0aa702/volumes/kubernetes.io~projected/kube-api-access-vqrnr major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/858089de-9bce-4497-bf0a-9c756f0aa702/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/858089de-9bce-4497-bf0a-9c756f0aa702/volumes/kubernetes.io~secret/metrics-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/89db2583-ca69-48db-adf0-1383f53434c1/volumes/kubernetes.io~projected/kube-api-access-7vf8n:{mountpoint:/var/lib/kubelet/pods/89db2583-ca69-48db-adf0-1383f53434c1/volumes/kubernetes.io~projected/kube-api-access-7vf8n major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8adef5d4-9a99-4a16-a052-aca39fc961b3/volumes/kubernetes.io~projected/kube-api-access-c6fqk:{mountpoint:/var/lib/kubelet/pods/8adef5d4-9a99-4a16-a052-aca39fc961b3/volumes/kubernetes.io~projected/kube-api-access-c6fqk major:0 minor:230 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8adef5d4-9a99-4a16-a052-aca39fc961b3/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/8adef5d4-9a99-4a16-a052-aca39fc961b3/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:229 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8adef5d4-9a99-4a16-a052-aca39fc961b3/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/8adef5d4-9a99-4a16-a052-aca39fc961b3/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8ed2871d-bcc6-4319-a486-e68c0969a292/volumes/kubernetes.io~projected/kube-api-access-mvv2f:{mountpoint:/var/lib/kubelet/pods/8ed2871d-bcc6-4319-a486-e68c0969a292/volumes/kubernetes.io~projected/kube-api-access-mvv2f major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8ed2871d-bcc6-4319-a486-e68c0969a292/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/8ed2871d-bcc6-4319-a486-e68c0969a292/volumes/kubernetes.io~secret/cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a9cfd418-f163-4b86-896f-fd898cb2ebf6/volumes/kubernetes.io~projected/kube-api-access-f4stf:{mountpoint:/var/lib/kubelet/pods/a9cfd418-f163-4b86-896f-fd898cb2ebf6/volumes/kubernetes.io~projected/kube-api-access-f4stf major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/adc37e3e-9f5d-4eba-8b13-6f467c3060d3/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/adc37e3e-9f5d-4eba-8b13-6f467c3060d3/volumes/kubernetes.io~secret/agent-certs major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b725cdb0-2fe7-42d6-99b0-1f36d22081af/volumes/kubernetes.io~projected/kube-api-access-zj6zx:{mountpoint:/var/lib/kubelet/pods/b725cdb0-2fe7-42d6-99b0-1f36d22081af/volumes/kubernetes.io~projected/kube-api-access-zj6zx major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b725cdb0-2fe7-42d6-99b0-1f36d22081af/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/b725cdb0-2fe7-42d6-99b0-1f36d22081af/volumes/kubernetes.io~secret/metrics-certs major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b99b9ce3-9872-4265-b7e2-26c4851a3ebf/volumes/kubernetes.io~projected/kube-api-access-mg6k8:{mountpoint:/var/lib/kubelet/pods/b99b9ce3-9872-4265-b7e2-26c4851a3ebf/volumes/kubernetes.io~projected/kube-api-access-mg6k8 major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c7b36354-ea7c-4f8c-a96e-f9ba840f2036/volumes/kubernetes.io~projected/kube-api-access-w42mm:{mountpoint:/var/lib/kubelet/pods/c7b36354-ea7c-4f8c-a96e-f9ba840f2036/volumes/kubernetes.io~projected/kube-api-access-w42mm major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d8b1a575-54e2-46d5-b23a-4ad16eab259a/volumes/kubernetes.io~projected/kube-api-access-rgcn8:{mountpoint:/var/lib/kubelet/pods/d8b1a575-54e2-46d5-b23a-4ad16eab259a/volumes/kubernetes.io~projected/kube-api-access-rgcn8 major:0 minor:273 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d8b1a575-54e2-46d5-b23a-4ad16eab259a/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/d8b1a575-54e2-46d5-b23a-4ad16eab259a/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:270 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d8b1a575-54e2-46d5-b23a-4ad16eab259a/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/d8b1a575-54e2-46d5-b23a-4ad16eab259a/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:269 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f40c765d-cb44-4835-a41d-8cfb35f73f40/volumes/kubernetes.io~projected/kube-api-access-6pnxz:{mountpoint:/var/lib/kubelet/pods/f40c765d-cb44-4835-a41d-8cfb35f73f40/volumes/kubernetes.io~projected/kube-api-access-6pnxz major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/feb1ae85-eef8-4a26-b341-b06161f7210d/volumes/kubernetes.io~projected/kube-api-access-4pf5c:{mountpoint:/var/lib/kubelet/pods/feb1ae85-eef8-4a26-b341-b06161f7210d/volumes/kubernetes.io~projected/kube-api-access-4pf5c major:0 minor:65 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/27f8f24251d43b61baf457ae921e61e123c73236be6fdae2f697bd2e353f86fb/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/8e2686b4cb36bb2f42485f47e82324df112fc3ff16485dd1dd8ea7ec737e8b4a/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/2a2e8c1480178a8821638ad3bbddf42d510a8931f9a5ef47cf7228f8b1fc8409/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/bc1a8bcf49558d461c8522d1a044209e23ee403a3b0bae5a741392f79e38df08/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/b0991410bed41471b41ae2fe827da15122331cbed83b1362e99e9d2a0ba11ac3/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/d5d57a275c4d3039940f33e1b5b2926a42aeb4892b4def9dcdfb074b7a61b73a/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/5fc38c536a66fef11f762e41e8b45af426d21d72f14b706e3ecb7ffb52486734/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/39cae70c5d645d49e227d7b309bc57537a8aa2ed2a2b2f3cb0249f24d265a554/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/c0621af7039ca958056af01dc06f5ba4417a76d2beb928eff780b510111ae0e9/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/ac6fea0131213e0fde30b012d3caba2cd273995babe716dc8ca922234f424ef4/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-142:{mountpoint:/var/lib/containers/storage/overlay/cc496ce6f0e7b5b54001cd559a8123702547d93bd97de744d87cab7ab413ec30/merged major:0 minor:142 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/bd9557dc6d3573b435cd2e7c7de58179cb84e33da9c4679f081adc2c20354d09/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/00bb67ffa9f4df45d960883a4e6662762a2578917eb951723e089184343338b7/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/abaa834a5ac3b78ae97f803baa3e8b92e022767bfbacd83f4a61ab39ae5ee204/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/b2741707250360e3cafbd6a4ee70f4dae70c5caa6a38f21f4ee88741f9943e38/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/ededa1b288946b2b6c60e22363ecbd52441e55fceb9c14351b98b6d3ee713833/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/efe308023d7cda97e8f186dbc225480518d22eb5be6452079aa8066b5b63630b/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/d9c6ebe2800305c1a9db86e01e012633e798633a292fdb8e644035cf180baa8d/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-179:{mountpoint:/var/lib/containers/storage/overlay/ce009f6328cf292e447f876e495e115c524575c5f7500ccd76ee22403aaac62e/merged major:0 minor:179 fsType:overlay blockSize:0} overlay_0-184:{mountpoint:/var/lib/containers/storage/overlay/b289b565749d838bb51b284bd1b7d1f156e70a2067c756e4e4315accb2b0d797/merged major:0 minor:184 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/9b738f125b12d21cbce54867a24b9b31f706d2026e92fa3bf4aa52e2015942c8/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/05478aafb8c9053ed4471868334961f87b2410667460368c41d0c2cd00fa3bc7/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/939bf4bc1b3df31d00ee012fec8d9caa66439506990af75971c40571180f5d7e/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/18d927e8e37df6e24c5dfe3cd4772052d6140bb203d49373c9d02df21ebdbce7/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/7d065366939891296c724054e0636ee077f4b62aa220caa5a15f2083128f0948/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/991804dee9acb5e7c265b4cb5f382309ee28cd544c4afbc1f57948c9a24948ba/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-233:{mountpoint:/var/lib/containers/storage/overlay/3505eb6b0912b96c71847265906172f3f58c18d31571ec2f07d85eac9b45ffbc/merged major:0 minor:233 fsType:overlay blockSize:0} overlay_0-235:{mountpoint:/var/lib/containers/storage/overlay/6b895cec2a2418e319d4a8b35e5f7b643ccc16a987aeeba62f5e10e20b0996b6/merged major:0 minor:235 fsType:overlay blockSize:0} overlay_0-237:{mountpoint:/var/lib/containers/storage/overlay/74e6313a6cccaec86f4785a7166ce42a187e2ff5e0530319972a86dc64d73725/merged major:0 minor:237 fsType:overlay blockSize:0} overlay_0-241:{mountpoint:/var/lib/containers/storage/overlay/2fe7ac4d445bdb8680214648f8d7dcfbae439db88116fabce3edced2ff45deb4/merged major:0 minor:241 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/23fe01e6519b7df0682b88f895db4f650ebf8380b828f2b705db99e608ae3a59/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/cb131f90f2377d4bac7a44b35077465f3e7b4db214de34eb9e88ff8a5d7940d7/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-259:{mountpoint:/var/lib/containers/storage/overlay/304541c4fdabc4c91d7508377f2b78cf46a208622148db1655895bfd32f79a96/merged major:0 minor:259 fsType:overlay blockSize:0} overlay_0-278:{mountpoint:/var/lib/containers/storage/overlay/5009171f2d5f2b0e512d8e56552c576a6ce3546cee4c35e91a9330fb49e55de5/merged major:0 minor:278 fsType:overlay blockSize:0} overlay_0-280:{mountpoint:/var/lib/containers/storage/overlay/4487d57d70d1a45b390bbc2fdc3ce7796ea4678022323273e8a2af323600352c/merged major:0 minor:280 fsType:overlay blockSize:0} overlay_0-284:{mountpoint:/var/lib/containers/storage/overlay/9d50578cbd40cd0a868783dfdf846052a56c09028520e6bebefd3b74585021da/merged major:0 minor:284 fsType:overlay blockSize:0} overlay_0-287:{mountpoint:/var/lib/containers/storage/overlay/368801de94360ca716a30d98cfa02a36bbd6aba7c92a1c1b8226b245149f5dbf/merged major:0 minor:287 fsType:overlay blockSize:0} overlay_0-290:{mountpoint:/var/lib/containers/storage/overlay/393b7d83df6330f081723020fe001412b2b9e57540e7e712892b011ca15927b1/merged major:0 minor:290 fsType:overlay blockSize:0} overlay_0-295:{mountpoint:/var/lib/containers/storage/overlay/e3ba0484edba85605d4b8bab688bb31083cce14096defde76b96e87eae64aa8e/merged major:0 minor:295 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/3d09ae7d853b4653961bda29d4808903ae6c66f46f4ce298f21dc5c30299b48f/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-312:{mountpoint:/var/lib/containers/storage/overlay/b023536fe92ea88177e2b9f9ebe3ee6fb69ae1dfbc07f4b488d7cded26ee0e7d/merged major:0 minor:312 fsType:overlay blockSize:0} overlay_0-323:{mountpoint:/var/lib/containers/storage/overlay/ab7ba3102a478914d88a5b69e1e04238c2984207965b47e0131939fb2362d778/merged major:0 minor:323 fsType:overlay blockSize:0} overlay_0-325:{mountpoint:/var/lib/containers/storage/overlay/6defe622f568302b6f2ff53f871fa297db60fe2543895f398cb3bbdc4b261983/merged major:0 minor:325 fsType:overlay blockSize:0} overlay_0-327:{mountpoint:/var/lib/containers/storage/overlay/3f6a3db639f2f5d732b9d65b49b574a9cc788465cb43e8a4dd0fde2b3ee996fa/merged major:0 minor:327 fsType:overlay blockSize:0} overlay_0-343:{mountpoint:/var/lib/containers/storage/overlay/9a3b69d1355a6ebf4327f164a7c4b0f58d57d2092a445639747c392297d8fc61/merged major:0 minor:343 fsType:overlay blockSize:0} overlay_0-345:{mountpoint:/var/lib/containers/storage/overlay/1a47b1e79dd864daa4585458b04e70072d22dd44d931b719a143de8d57b2f3e9/merged major:0 minor:345 fsType:overlay blockSize:0} overlay_0-351:{mountpoint:/var/lib/containers/storage/overlay/1919ee930ee74ec291bacfe97696d4afa3608175121eccb22e1202006f80df11/merged major:0 minor:351 fsType:overlay blockSize:0} overlay_0-353:{mountpoint:/var/lib/containers/storage/overlay/d947dcb9e13655c54ff09c09963a6855796f3047980298e94ba422c5887faab9/merged major:0 minor:353 fsType:overlay blockSize:0} overlay_0-359:{mountpoint:/var/lib/containers/storage/overlay/e2b5c5f94fdebf8944f7e18dbf24ee658408f31e0fab25476524a5b6b5eca0ef/merged major:0 minor:359 fsType:overlay blockSize:0} overlay_0-364:{mountpoint:/var/lib/containers/storage/overlay/caf07cb18f15b3a38bc5088e6a55e7322ed6af3072a20fd9e49039c8f93634f1/merged major:0 minor:364 fsType:overlay blockSize:0} overlay_0-370:{mountpoint:/var/lib/containers/storage/overlay/749a7ba02603dc7366bed74eb173b2a53a0081be6fccddc329379d9c97b8ded7/merged major:0 minor:370 fsType:overlay blockSize:0} overlay_0-376:{mountpoint:/var/lib/containers/storage/overlay/318c2913bca14e7ac94b545bc3bed0eefd9cce2bf1897d553f06f51c0102b1a4/merged major:0 minor:376 fsType:overlay blockSize:0} overlay_0-58:{mountpoint:/var/lib/containers/storage/overlay/602e7032e17fe4b3c7e0903f55169771c89fde5c93a4283954b8ae72ca78a395/merged major:0 minor:58 fsType:overlay blockSize:0} overlay_0-61:{mountpoint:/var/lib/containers/storage/overlay/734330c72b428ad57e87b4727986dd3785b4a758583779ba78d89e33e130c733/merged major:0 minor:61 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/8d829700ad00222368d11b41b2298bb31f19d21271734e81de1b88ac645efbac/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/ce2dede19d34137c338279756c59755b722d973f4537b4557754c94abe32417c/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/14e5a95d3c8bf2043bfc93417b542b15ba0006b727ce9f57beba20336610533d/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/3f99331368dd43e275baaf9864e9ed0e72239843d51141d3077e1d033475ea0b/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/384405a82c0562d8897f748547a8ab9099aa9819e3e84456436d1acb1568e700/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/1276046c3dabc102a4eefbbb514920ef269c147805772369863299246e7d4c68/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/e470c5796911d2efbf78d67ab2f6462d2413a35818083b7415f18a366c38f551/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/e1ff6bbc054d433edea9e7d166b3a4bb2e28841a82dddb93cb354d0dd9ccac79/merged major:0 minor:96 fsType:overlay blockSize:0}] Nov 03 22:51:33.534655 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.530439 5332 manager.go:217] Machine: {Timestamp:2026-11-03 22:51:33.529987119 +0000 UTC m=+0.060094297 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098212 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2214fe26ce4a9484d0f8e4c313e64a SystemUUID:ec2214fe-26ce-4a94-84d0-f8e4c313e64a BootID:e5160213-4b44-4b9e-98cc-476445cf1d5a Filesystems:[{Device:/run/containers/storage/overlay-containers/db2716a9e46421c1dea6535d456b1f43c0fcea424c2c9a9f27ea31fe2948d78e/userdata/shm DeviceMajor:0 DeviceMinor:57 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:334 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:333 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6c295fd2-23ab-4994-9ae2-60947f409b62/volumes/kubernetes.io~projected/kube-api-access-m2xgn DeviceMajor:0 DeviceMinor:54 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f276455788cd61bfe8d0379a7dcf9aace10ab3e97bc1b53552b5f042900b890e/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-241 DeviceMajor:0 DeviceMinor:241 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/feb1ae85-eef8-4a26-b341-b06161f7210d/volumes/kubernetes.io~projected/kube-api-access-4pf5c DeviceMajor:0 DeviceMinor:65 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-179 DeviceMajor:0 DeviceMinor:179 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:338 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-351 DeviceMajor:0 DeviceMinor:351 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5f5365b774847e607f16c0aa930efa27eb63ace8ecd65978574e22b4b3d069c1/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/8adef5d4-9a99-4a16-a052-aca39fc961b3/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:229 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/86e94ee765ed543768adda871613e396a1030cae850e535b8f5bcfec0532714b/userdata/shm DeviceMajor:0 DeviceMinor:318 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e9316516e3ca232334b2ac02d840cb2794583f9f1b1bcdef532bea596cf6bea5/userdata/shm DeviceMajor:0 DeviceMinor:231 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:337 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-284 DeviceMajor:0 DeviceMinor:284 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-290 DeviceMajor:0 DeviceMinor:290 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-376 DeviceMajor:0 DeviceMinor:376 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-237 DeviceMajor:0 DeviceMinor:237 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:336 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8ed2871d-bcc6-4319-a486-e68c0969a292/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:201 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/427bb8ac67a9d4074e5ccbf77fbd4e9986396233d62ca78a75e8780745d322e0/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-323 DeviceMajor:0 DeviceMinor:323 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-343 DeviceMajor:0 DeviceMinor:343 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-364 DeviceMajor:0 DeviceMinor:364 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:63 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0128a08f-b777-40e1-bf05-f79d772fd926/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:271 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/78ad8bbb-3cb2-431c-aa87-a77ff23792c4/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:305 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-312 DeviceMajor:0 DeviceMinor:312 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fd84467f3ae280dc7969821e92f28a665f14808e05c9c200d73bbb717ffe7239/userdata/shm DeviceMajor:0 DeviceMinor:317 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:335 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/72fc2408d3fd5411ca362728059687e550d3cbe41629053f45b18afcd79948a4/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:329 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:339 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-353 DeviceMajor:0 DeviceMinor:353 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/858089de-9bce-4497-bf0a-9c756f0aa702/volumes/kubernetes.io~projected/kube-api-access-vqrnr DeviceMajor:0 DeviceMinor:204 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d8b1a575-54e2-46d5-b23a-4ad16eab259a/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:270 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/89db2583-ca69-48db-adf0-1383f53434c1/volumes/kubernetes.io~projected/kube-api-access-7vf8n DeviceMajor:0 DeviceMinor:316 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/6c295fd2-23ab-4994-9ae2-60947f409b62/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:48 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:45 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-278 DeviceMajor:0 DeviceMinor:278 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/474079cb9525c11eba9d6092133949e08ddaba71b9769a6c9d9ced125ada6548/userdata/shm DeviceMajor:0 DeviceMinor:341 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/71b31757b3eae23865f0f39ffca585219c5615b8c5825f1fa9ac96da70b77af8/userdata/shm DeviceMajor:0 DeviceMinor:321 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7a51fb1d-abfd-4803-8489-56e7ec93127f/volumes/kubernetes.io~projected/kube-api-access-5nc4c DeviceMajor:0 DeviceMinor:50 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a9cfd418-f163-4b86-896f-fd898cb2ebf6/volumes/kubernetes.io~projected/kube-api-access-f4stf DeviceMajor:0 DeviceMinor:52 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7abb60fd0dbd49ed95d56ddc057a615ef4773fcead757435b6a8377f587c7350/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b725cdb0-2fe7-42d6-99b0-1f36d22081af/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:315 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0128a08f-b777-40e1-bf05-f79d772fd926/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:265 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d8b1a575-54e2-46d5-b23a-4ad16eab259a/volumes/kubernetes.io~projected/kube-api-access-rgcn8 DeviceMajor:0 DeviceMinor:273 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/76258750ef3079753405770429b6371fa04f8c732127c168c89fd5971151b7a9/userdata/shm DeviceMajor:0 DeviceMinor:274 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7954856cc02ae53a08b344ead52a831e054d4c9c65bf92a5335a5666467030cb/userdata/shm DeviceMajor:0 DeviceMinor:276 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:330 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f693f3c51671bc6b05a80d85eef83e783968858cbe19d60a1ce62a5cb95670d0/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/858089de-9bce-4497-bf0a-9c756f0aa702/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:197 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-345 DeviceMajor:0 DeviceMinor:345 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:339 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b06ba18a444ce9770746fe46ce6facf68dab12ee4958eff85eb0ca45dc56c329/userdata/shm DeviceMajor:0 DeviceMinor:55 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-61 DeviceMajor:0 DeviceMinor:61 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8ed2871d-bcc6-4319-a486-e68c0969a292/volumes/kubernetes.io~projected/kube-api-access-mvv2f DeviceMajor:0 DeviceMinor:202 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-259 DeviceMajor:0 DeviceMinor:259 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-280 DeviceMajor:0 DeviceMinor:280 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-287 DeviceMajor:0 DeviceMinor:287 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-295 DeviceMajor:0 DeviceMinor:295 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/78ad8bbb-3cb2-431c-aa87-a77ff23792c4/volumes/kubernetes.io~projected/kube-api-access-ld956 DeviceMajor:0 DeviceMinor:309 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d8b1a575-54e2-46d5-b23a-4ad16eab259a/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:269 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volume-subpaths/web-config/config-reloader/2 DeviceMajor:0 DeviceMinor:339 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6c295fd2-23ab-4994-9ae2-60947f409b62/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:47 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-184 DeviceMajor:0 DeviceMinor:184 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-370 DeviceMajor:0 DeviceMinor:370 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-58 DeviceMajor:0 DeviceMinor:58 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7fe58bbfdb21bd36b13bc6b221cd10e00a3cd945386e524c5b9a1cb3da3fba45/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-233 DeviceMajor:0 DeviceMinor:233 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/87a06b6210ad91821dabb243d465fbbc0aa779fb11e949fd6b86459a1eeba8fc/userdata/shm DeviceMajor:0 DeviceMinor:310 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8ee5d7f721db9c84a733e28cba8eb7274a47ba814a1ac6f3f10c1e4921290d6d/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f40c765d-cb44-4835-a41d-8cfb35f73f40/volumes/kubernetes.io~projected/kube-api-access-6pnxz DeviceMajor:0 DeviceMinor:66 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-142 DeviceMajor:0 DeviceMinor:142 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b99b9ce3-9872-4265-b7e2-26c4851a3ebf/volumes/kubernetes.io~projected/kube-api-access-mg6k8 DeviceMajor:0 DeviceMinor:64 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-325 DeviceMajor:0 DeviceMinor:325 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b725cdb0-2fe7-42d6-99b0-1f36d22081af/volumes/kubernetes.io~projected/kube-api-access-zj6zx DeviceMajor:0 DeviceMinor:51 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c68ee02bc5e9766696eb190607f39dfdcf94763f178908d94074e54883442508/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-235 DeviceMajor:0 DeviceMinor:235 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~projected/kube-api-access-ljhkl DeviceMajor:0 DeviceMinor:340 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4/volumes/kubernetes.io~projected/kube-api-access-vtmbf DeviceMajor:0 DeviceMinor:67 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8adef5d4-9a99-4a16-a052-aca39fc961b3/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:225 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0128a08f-b777-40e1-bf05-f79d772fd926/volumes/kubernetes.io~projected/kube-api-access-ft7jh DeviceMajor:0 DeviceMinor:272 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-327 DeviceMajor:0 DeviceMinor:327 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/adc37e3e-9f5d-4eba-8b13-6f467c3060d3/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:49 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7354598a-9d87-4762-9633-da3d96ff063b/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:314 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:331 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volume-subpaths/web-config/prometheus/15 DeviceMajor:0 DeviceMinor:339 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c7b36354-ea7c-4f8c-a96e-f9ba840f2036/volumes/kubernetes.io~projected/kube-api-access-w42mm DeviceMajor:0 DeviceMinor:53 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/run/containers/storage/overlay-containers/aa284f0a066d70a183637078ea8db21bf28a8cfd02935f03d52c0e95b92384b4/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a53b71d42c4c45fbc3b5bbb6521fb8fc77e096b7f4cd53526ad450540ad6b904/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-359 DeviceMajor:0 DeviceMinor:359 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd/volumes/kubernetes.io~projected/kube-api-access-vsctv DeviceMajor:0 DeviceMinor:203 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/8adef5d4-9a99-4a16-a052-aca39fc961b3/volumes/kubernetes.io~projected/kube-api-access-c6fqk DeviceMajor:0 DeviceMinor:230 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:332 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:427bb8ac67a9d40 MacAddress:a2:6d:36:9d:9c:04 Speed:10000 Mtu:8901} {Name:474079cb9525c11 MacAddress:ea:42:42:98:2e:bd Speed:10000 Mtu:8901} {Name:71b31757b3eae23 MacAddress:92:05:6e:e1:bd:ed Speed:10000 Mtu:8901} {Name:72fc2408d3fd541 MacAddress:32:07:19:7e:28:50 Speed:10000 Mtu:8901} {Name:76258750ef30797 MacAddress:4a:23:3d:7e:d9:35 Speed:10000 Mtu:8901} {Name:7fe58bbfdb21bd3 MacAddress:ca:02:9c:b2:77:c7 Speed:10000 Mtu:8901} {Name:86e94ee765ed543 MacAddress:32:f4:a3:81:c7:52 Speed:10000 Mtu:8901} {Name:87a06b6210ad918 MacAddress:e2:74:58:cf:7b:dc Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:e8:7a:20:75 Speed:0 Mtu:9001} {Name:br-int MacAddress:62:73:ac:c8:63:30 Speed:0 Mtu:8901} {Name:e9316516e3ca232 MacAddress:4a:de:d8:a3:5e:43 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:e8:7a:20:75 Speed:0 Mtu:9001} {Name:fd84467f3ae280d MacAddress:36:8f:68:15:47:a3 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:a6:c2:11:f8:7a:a2 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:7a:37:56:57:d4:d5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 03 22:51:33.534655 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.530805 5332 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 03 22:51:33.534655 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.530852 5332 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 03 22:51:33.534655 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.531365 5332 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 03 22:51:33.534655 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.531401 5332 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-89.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 03 22:51:33.534655 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.531772 5332 topology_manager.go:143] "Creating topology manager with none policy" Nov 03 22:51:33.534655 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.531786 5332 container_manager_linux.go:311] "Creating device plugin manager" Nov 03 22:51:33.534655 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.531807 5332 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 22:51:33.534655 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.531834 5332 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 22:51:33.534655 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.531933 5332 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 03 22:51:33.534655 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.532197 5332 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 03 22:51:33.534655 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.532350 5332 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 03 22:51:33.534655 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.532534 5332 kubelet.go:493] "Attempting to sync node with API server" Nov 03 22:51:33.534655 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.532568 5332 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 03 22:51:33.534655 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.532587 5332 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 03 22:51:33.534655 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.532602 5332 kubelet.go:405] "Adding apiserver pod source" Nov 03 22:51:33.534655 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.532615 5332 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 03 22:51:33.534655 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.533841 5332 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 03 22:51:33.534655 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.533852 5332 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 22:51:33.534655 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.534385 5332 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 03 22:51:33.543782 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.543765 5332 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:51:33.545294 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.545271 5332 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:51:33.547583 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.547568 5332 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 03 22:51:33.547583 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.547583 5332 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 22:51:33.547706 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.547695 5332 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Nov 03 22:51:33.547890 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.547879 5332 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 03 22:51:33.547919 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.547908 5332 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 03 22:51:33.548016 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.548007 5332 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 03 22:51:33.548052 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.548023 5332 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 03 22:51:33.548052 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.548030 5332 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 03 22:51:33.548052 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.548036 5332 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 03 22:51:33.548052 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.548041 5332 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 03 22:51:33.548052 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.548048 5332 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 03 22:51:33.548191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.548055 5332 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 03 22:51:33.548191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.548065 5332 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 03 22:51:33.548191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.548073 5332 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 03 22:51:33.548191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.548079 5332 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 03 22:51:33.548191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.548088 5332 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 03 22:51:33.548191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.548098 5332 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 03 22:51:33.548191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.548133 5332 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 03 22:51:33.548191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.548143 5332 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 03 22:51:33.551743 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.551724 5332 server.go:1263] "Started kubelet" Nov 03 22:51:33.551861 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.551812 5332 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 03 22:51:33.551925 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.551833 5332 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 03 22:51:33.551925 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.551907 5332 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 03 22:51:33.552239 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.552222 5332 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 03 22:51:33.552241 ip-10-0-138-89 systemd[1]: Started Kubernetes Kubelet. Nov 03 22:51:33.553194 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.553177 5332 server.go:317] "Adding debug handlers to kubelet server" Nov 03 22:51:33.560152 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.560136 5332 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 03 22:51:33.560791 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.560482 5332 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 03 22:51:33.560791 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.560498 5332 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 03 22:51:33.560791 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.560527 5332 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 03 22:51:33.560791 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.560625 5332 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 03 22:51:33.560791 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.560702 5332 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 22:45:23 +0000 UTC" deadline="2028-06-28 14:32:25.454370299 +0000 UTC" Nov 03 22:51:33.560791 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.560762 5332 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14463h40m51.893612459s" Nov 03 22:51:33.563904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.563883 5332 factory.go:153] Registering CRI-O factory Nov 03 22:51:33.564027 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.563909 5332 factory.go:223] Registration of the crio container factory successfully Nov 03 22:51:33.564027 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.563911 5332 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:51:33.564027 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.563989 5332 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 03 22:51:33.564027 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.563999 5332 factory.go:55] Registering systemd factory Nov 03 22:51:33.564027 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564008 5332 factory.go:223] Registration of the systemd container factory successfully Nov 03 22:51:33.564027 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564026 5332 factory.go:103] Registering Raw factory Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564039 5332 manager.go:1199] Started watching for new ooms in manager Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564101 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5362ce0b-df5e-4bac-9d66-fbebfff0cbb4" volumeName="kubernetes.io/configmap/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-ovnkube-config" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564142 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d8b1a575-54e2-46d5-b23a-4ad16eab259a" volumeName="kubernetes.io/secret/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564152 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="feb1ae85-eef8-4a26-b341-b06161f7210d" volumeName="kubernetes.io/configmap/feb1ae85-eef8-4a26-b341-b06161f7210d-iptables-alerter-script" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564163 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="428c38a6-e709-454e-984e-034ec6402558" volumeName="kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-2" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564171 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5362ce0b-df5e-4bac-9d66-fbebfff0cbb4" volumeName="kubernetes.io/projected/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-kube-api-access-vtmbf" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564180 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b725cdb0-2fe7-42d6-99b0-1f36d22081af" volumeName="kubernetes.io/projected/b725cdb0-2fe7-42d6-99b0-1f36d22081af-kube-api-access-zj6zx" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564188 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d8b1a575-54e2-46d5-b23a-4ad16eab259a" volumeName="kubernetes.io/projected/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-api-access-rgcn8" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564195 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5362ce0b-df5e-4bac-9d66-fbebfff0cbb4" volumeName="kubernetes.io/configmap/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-env-overrides" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564206 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd" volumeName="kubernetes.io/configmap/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-kube-rbac-proxy-cm" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564214 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="78ad8bbb-3cb2-431c-aa87-a77ff23792c4" volumeName="kubernetes.io/secret/78ad8bbb-3cb2-431c-aa87-a77ff23792c4-monitoring-plugin-cert" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564222 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="858089de-9bce-4497-bf0a-9c756f0aa702" volumeName="kubernetes.io/projected/858089de-9bce-4497-bf0a-9c756f0aa702-kube-api-access-vqrnr" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564229 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f40c765d-cb44-4835-a41d-8cfb35f73f40" volumeName="kubernetes.io/empty-dir/f40c765d-cb44-4835-a41d-8cfb35f73f40-tmp-dir" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564249 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="428c38a6-e709-454e-984e-034ec6402558" volumeName="kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-metrics-client-certs" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564257 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5362ce0b-df5e-4bac-9d66-fbebfff0cbb4" volumeName="kubernetes.io/configmap/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-ovnkube-script-lib" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564265 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="adc37e3e-9f5d-4eba-8b13-6f467c3060d3" volumeName="kubernetes.io/configmap/adc37e3e-9f5d-4eba-8b13-6f467c3060d3-konnectivity-ca" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564285 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="428c38a6-e709-454e-984e-034ec6402558" volumeName="kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-grpc-tls" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564292 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6c295fd2-23ab-4994-9ae2-60947f409b62" volumeName="kubernetes.io/empty-dir/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-tuned" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564299 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd" volumeName="kubernetes.io/empty-dir/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-data-volume" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564306 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd" volumeName="kubernetes.io/secret/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-insights-runtime-extractor-tls" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564314 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0128a08f-b777-40e1-bf05-f79d772fd926" volumeName="kubernetes.io/empty-dir/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-textfile" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564321 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6c295fd2-23ab-4994-9ae2-60947f409b62" volumeName="kubernetes.io/empty-dir/6c295fd2-23ab-4994-9ae2-60947f409b62-tmp" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564328 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="feb1ae85-eef8-4a26-b341-b06161f7210d" volumeName="kubernetes.io/projected/feb1ae85-eef8-4a26-b341-b06161f7210d-kube-api-access-4pf5c" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564336 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0128a08f-b777-40e1-bf05-f79d772fd926" volumeName="kubernetes.io/secret/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-kube-rbac-proxy-config" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564342 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a9cfd418-f163-4b86-896f-fd898cb2ebf6" volumeName="kubernetes.io/projected/a9cfd418-f163-4b86-896f-fd898cb2ebf6-kube-api-access-f4stf" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564350 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="428c38a6-e709-454e-984e-034ec6402558" volumeName="kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-metrics-client-ca" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564358 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd" volumeName="kubernetes.io/projected/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-kube-api-access-vsctv" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564365 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7354598a-9d87-4762-9633-da3d96ff063b" volumeName="kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564373 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a9cfd418-f163-4b86-896f-fd898cb2ebf6" volumeName="kubernetes.io/configmap/a9cfd418-f163-4b86-896f-fd898cb2ebf6-cni-binary-copy" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564388 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d8b1a575-54e2-46d5-b23a-4ad16eab259a" volumeName="kubernetes.io/empty-dir/d8b1a575-54e2-46d5-b23a-4ad16eab259a-volume-directive-shadow" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564395 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0128a08f-b777-40e1-bf05-f79d772fd926" volumeName="kubernetes.io/projected/0128a08f-b777-40e1-bf05-f79d772fd926-kube-api-access-ft7jh" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564407 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8adef5d4-9a99-4a16-a052-aca39fc961b3" volumeName="kubernetes.io/secret/8adef5d4-9a99-4a16-a052-aca39fc961b3-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext="" Nov 03 22:51:33.564390 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564414 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c7b36354-ea7c-4f8c-a96e-f9ba840f2036" volumeName="kubernetes.io/configmap/c7b36354-ea7c-4f8c-a96e-f9ba840f2036-serviceca" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564421 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d8b1a575-54e2-46d5-b23a-4ad16eab259a" volumeName="kubernetes.io/configmap/d8b1a575-54e2-46d5-b23a-4ad16eab259a-metrics-client-ca" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564437 5332 manager.go:319] Starting recovery of all containers Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564438 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d8b1a575-54e2-46d5-b23a-4ad16eab259a" volumeName="kubernetes.io/secret/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-state-metrics-tls" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564934 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="428c38a6-e709-454e-984e-034ec6402558" volumeName="kubernetes.io/projected/428c38a6-e709-454e-984e-034ec6402558-kube-api-access-ljhkl" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564960 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a51fb1d-abfd-4803-8489-56e7ec93127f" volumeName="kubernetes.io/configmap/7a51fb1d-abfd-4803-8489-56e7ec93127f-cni-binary-copy" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564974 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ed2871d-bcc6-4319-a486-e68c0969a292" volumeName="kubernetes.io/secret/8ed2871d-bcc6-4319-a486-e68c0969a292-cert" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.564989 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="adc37e3e-9f5d-4eba-8b13-6f467c3060d3" volumeName="kubernetes.io/secret/adc37e3e-9f5d-4eba-8b13-6f467c3060d3-agent-certs" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565000 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0128a08f-b777-40e1-bf05-f79d772fd926" volumeName="kubernetes.io/configmap/0128a08f-b777-40e1-bf05-f79d772fd926-metrics-client-ca" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565013 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="428c38a6-e709-454e-984e-034ec6402558" volumeName="kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-1" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565027 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="428c38a6-e709-454e-984e-034ec6402558" volumeName="kubernetes.io/empty-dir/428c38a6-e709-454e-984e-034ec6402558-config-out" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565039 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="428c38a6-e709-454e-984e-034ec6402558" volumeName="kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565052 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="428c38a6-e709-454e-984e-034ec6402558" volumeName="kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-web-config" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565065 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5362ce0b-df5e-4bac-9d66-fbebfff0cbb4" volumeName="kubernetes.io/secret/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-ovn-node-metrics-cert" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565076 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a9cfd418-f163-4b86-896f-fd898cb2ebf6" volumeName="kubernetes.io/configmap/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-daemon-config" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565088 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="89db2583-ca69-48db-adf0-1383f53434c1" volumeName="kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565102 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8adef5d4-9a99-4a16-a052-aca39fc961b3" volumeName="kubernetes.io/projected/8adef5d4-9a99-4a16-a052-aca39fc961b3-kube-api-access-c6fqk" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565113 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ed2871d-bcc6-4319-a486-e68c0969a292" volumeName="kubernetes.io/projected/8ed2871d-bcc6-4319-a486-e68c0969a292-kube-api-access-mvv2f" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565125 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="428c38a6-e709-454e-984e-034ec6402558" volumeName="kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-0" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565139 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="428c38a6-e709-454e-984e-034ec6402558" volumeName="kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-tls" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565152 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="78ad8bbb-3cb2-431c-aa87-a77ff23792c4" volumeName="kubernetes.io/projected/78ad8bbb-3cb2-431c-aa87-a77ff23792c4-kube-api-access-ld956" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565166 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="858089de-9bce-4497-bf0a-9c756f0aa702" volumeName="kubernetes.io/secret/858089de-9bce-4497-bf0a-9c756f0aa702-metrics-tls" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565178 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0128a08f-b777-40e1-bf05-f79d772fd926" volumeName="kubernetes.io/secret/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-tls" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565191 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="428c38a6-e709-454e-984e-034ec6402558" volumeName="kubernetes.io/empty-dir/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-db" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565204 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6c295fd2-23ab-4994-9ae2-60947f409b62" volumeName="kubernetes.io/projected/6c295fd2-23ab-4994-9ae2-60947f409b62-kube-api-access-m2xgn" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565217 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="858089de-9bce-4497-bf0a-9c756f0aa702" volumeName="kubernetes.io/configmap/858089de-9bce-4497-bf0a-9c756f0aa702-config-volume" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565240 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8adef5d4-9a99-4a16-a052-aca39fc961b3" volumeName="kubernetes.io/secret/8adef5d4-9a99-4a16-a052-aca39fc961b3-prometheus-operator-tls" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565252 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="428c38a6-e709-454e-984e-034ec6402558" volumeName="kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-trusted-ca-bundle" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565295 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="428c38a6-e709-454e-984e-034ec6402558" volumeName="kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-kube-rbac-proxy" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565312 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a51fb1d-abfd-4803-8489-56e7ec93127f" volumeName="kubernetes.io/configmap/7a51fb1d-abfd-4803-8489-56e7ec93127f-cni-sysctl-allowlist" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565324 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="858089de-9bce-4497-bf0a-9c756f0aa702" volumeName="kubernetes.io/empty-dir/858089de-9bce-4497-bf0a-9c756f0aa702-tmp-dir" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565337 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b99b9ce3-9872-4265-b7e2-26c4851a3ebf" volumeName="kubernetes.io/projected/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-kube-api-access-mg6k8" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565352 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d8b1a575-54e2-46d5-b23a-4ad16eab259a" volumeName="kubernetes.io/configmap/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565364 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0128a08f-b777-40e1-bf05-f79d772fd926" volumeName="kubernetes.io/configmap/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-accelerators-collector-config" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565377 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="428c38a6-e709-454e-984e-034ec6402558" volumeName="kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-kubelet-serving-ca-bundle" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565390 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="428c38a6-e709-454e-984e-034ec6402558" volumeName="kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-serving-certs-ca-bundle" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565402 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="428c38a6-e709-454e-984e-034ec6402558" volumeName="kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565415 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="428c38a6-e709-454e-984e-034ec6402558" volumeName="kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-config" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565427 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a51fb1d-abfd-4803-8489-56e7ec93127f" volumeName="kubernetes.io/projected/7a51fb1d-abfd-4803-8489-56e7ec93127f-kube-api-access-5nc4c" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565438 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8adef5d4-9a99-4a16-a052-aca39fc961b3" volumeName="kubernetes.io/configmap/8adef5d4-9a99-4a16-a052-aca39fc961b3-metrics-client-ca" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565484 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c7b36354-ea7c-4f8c-a96e-f9ba840f2036" volumeName="kubernetes.io/projected/c7b36354-ea7c-4f8c-a96e-f9ba840f2036-kube-api-access-w42mm" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565497 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="428c38a6-e709-454e-984e-034ec6402558" volumeName="kubernetes.io/projected/428c38a6-e709-454e-984e-034ec6402558-tls-assets" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565509 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="428c38a6-e709-454e-984e-034ec6402558" volumeName="kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-thanos-prometheus-http-client-file" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565521 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a51fb1d-abfd-4803-8489-56e7ec93127f" volumeName="kubernetes.io/configmap/7a51fb1d-abfd-4803-8489-56e7ec93127f-whereabouts-flatfile-configmap" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565534 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b725cdb0-2fe7-42d6-99b0-1f36d22081af" volumeName="kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565546 5332 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f40c765d-cb44-4835-a41d-8cfb35f73f40" volumeName="kubernetes.io/projected/f40c765d-cb44-4835-a41d-8cfb35f73f40-kube-api-access-6pnxz" seLinuxMountContext="" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565557 5332 reconstruct.go:97] "Volume reconstruction finished" Nov 03 22:51:33.565904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.565565 5332 reconciler.go:29] "Reconciler: start to sync state" Nov 03 22:51:33.569896 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.569870 5332 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Nov 03 22:51:33.587850 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.587815 5332 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 03 22:51:33.590328 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.589517 5332 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 03 22:51:33.590328 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.589541 5332 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 03 22:51:33.590328 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.589563 5332 kubelet.go:2521] "Starting kubelet main sync loop" Nov 03 22:51:33.590328 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:51:33.589603 5332 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 03 22:51:33.592636 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.592620 5332 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:51:33.598942 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.598919 5332 generic.go:356] "Generic (PLEG): container finished" podID="428c38a6-e709-454e-984e-034ec6402558" containerID="7131d83439dd85a2b4a9d25fd4e8a04596f95bc0230038c8b4f64657602bbfff" exitCode=0 Nov 03 22:51:33.615275 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.615250 5332 generic.go:356] "Generic (PLEG): container finished" podID="7a51fb1d-abfd-4803-8489-56e7ec93127f" containerID="9ecbf93fb35eb4a8906aca2abef08fa13300c20c8846bee9b78f73ad104f746c" exitCode=0 Nov 03 22:51:33.615275 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.615272 5332 generic.go:356] "Generic (PLEG): container finished" podID="7a51fb1d-abfd-4803-8489-56e7ec93127f" containerID="397af326a98368ac681bb503bd34607b8090dc0c21707e6ac034a496e17b613c" exitCode=0 Nov 03 22:51:33.615275 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.615279 5332 generic.go:356] "Generic (PLEG): container finished" podID="7a51fb1d-abfd-4803-8489-56e7ec93127f" containerID="d5e812769743ac4e2590eab71289f5609729315a81cff88b2342c090e0c76c71" exitCode=0 Nov 03 22:51:33.615490 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.615287 5332 generic.go:356] "Generic (PLEG): container finished" podID="7a51fb1d-abfd-4803-8489-56e7ec93127f" containerID="82c4a9c2203c73d28a71ce8c2cd9f5ff51158b47b59c036c1768af464ee4718b" exitCode=0 Nov 03 22:51:33.615490 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.615293 5332 generic.go:356] "Generic (PLEG): container finished" podID="7a51fb1d-abfd-4803-8489-56e7ec93127f" containerID="3e35cec3289d5bae205f170279f28ddbebefd1cf582b8550d6e30a42c3d9df6f" exitCode=0 Nov 03 22:51:33.615490 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.615301 5332 generic.go:356] "Generic (PLEG): container finished" podID="7a51fb1d-abfd-4803-8489-56e7ec93127f" containerID="dd6889bb026cd325f214655dc91767b4efdd66b14fbd8ec74e812fd17f606887" exitCode=0 Nov 03 22:51:33.621587 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.621567 5332 generic.go:356] "Generic (PLEG): container finished" podID="0128a08f-b777-40e1-bf05-f79d772fd926" containerID="b90b369aa03716b7d8cca7534718723c24ead2263823bb04f7edba0fa9d5ad53" exitCode=0 Nov 03 22:51:33.633934 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.633901 5332 generic.go:356] "Generic (PLEG): container finished" podID="90feb0e8f6d254df57c953bffb88632b" containerID="6a9aa15c1140a9f6efda97c5bcab54b399c459a9a3ffef3415a0bfb91195b2d8" exitCode=0 Nov 03 22:51:33.653811 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.653795 5332 manager.go:324] Recovery completed Nov 03 22:51:33.675854 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.675801 5332 cpu_manager.go:226] "Starting" policy="none" Nov 03 22:51:33.675854 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.675819 5332 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 03 22:51:33.675854 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.675839 5332 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 03 22:51:33.676005 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.675987 5332 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Nov 03 22:51:33.676036 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.676002 5332 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Nov 03 22:51:33.676036 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.676026 5332 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Nov 03 22:51:33.676036 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.676035 5332 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Nov 03 22:51:33.676116 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.676043 5332 policy_none.go:50] "Start" Nov 03 22:51:33.676116 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.676056 5332 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 03 22:51:33.676116 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.676067 5332 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 03 22:51:33.676210 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.676198 5332 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Nov 03 22:51:33.676242 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.676211 5332 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Nov 03 22:51:33.676242 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.676217 5332 policy_none.go:44] "Start" Nov 03 22:51:33.681004 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.680573 5332 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 03 22:51:33.686256 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.686243 5332 manager.go:341] "Starting Device Plugin manager" Nov 03 22:51:33.686326 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:51:33.686272 5332 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 03 22:51:33.686326 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.686281 5332 server.go:87] "Starting device plugin registration server" Nov 03 22:51:33.686572 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.686560 5332 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 03 22:51:33.686626 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.686573 5332 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 03 22:51:33.686703 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.686684 5332 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 03 22:51:33.686989 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.686789 5332 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 03 22:51:33.686989 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.686840 5332 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 03 22:51:33.686989 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.686846 5332 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 03 22:51:33.686989 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.686881 5332 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-03T22:51:33.686822897Z","UUID":"0a4fc314-c9e6-442d-830b-7244703fb186","Handler":null,"Name":"","Endpoint":""} Nov 03 22:51:33.688422 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:51:33.688398 5332 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 03 22:51:33.688831 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.688813 5332 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 03 22:51:33.688924 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.688858 5332 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 03 22:51:33.689860 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.689664 5332 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal"] Nov 03 22:51:33.691605 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.690804 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal" event={"ID":"9d92d59dc723695c8e39db4d586eeb52","Type":"ContainerStarted","Data":"5fe95f2c23788c53fcbf4a27ae4c864a551ff574953d03d48fe0bc0c628da189"} Nov 03 22:51:33.691605 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.690872 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal" event={"ID":"9d92d59dc723695c8e39db4d586eeb52","Type":"ContainerStarted","Data":"b06ba18a444ce9770746fe46ce6facf68dab12ee4958eff85eb0ca45dc56c329"} Nov 03 22:51:33.691605 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.691018 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" event={"ID":"90feb0e8f6d254df57c953bffb88632b","Type":"ContainerStarted","Data":"90a4e7ec2d590a97655201d19ef7b1f76842d1a986771fe893a81c86e731ec20"} Nov 03 22:51:33.691605 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.690874 5332 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:51:33.691605 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.691053 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" event={"ID":"90feb0e8f6d254df57c953bffb88632b","Type":"ContainerDied","Data":"6a9aa15c1140a9f6efda97c5bcab54b399c459a9a3ffef3415a0bfb91195b2d8"} Nov 03 22:51:33.691605 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.691079 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" event={"ID":"90feb0e8f6d254df57c953bffb88632b","Type":"ContainerStarted","Data":"db2716a9e46421c1dea6535d456b1f43c0fcea424c2c9a9f27ea31fe2948d78e"} Nov 03 22:51:33.691605 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.691271 5332 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:51:33.702721 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.702702 5332 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 22:51:33.702793 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:51:33.702751 5332 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:51:33.703109 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.703096 5332 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 22:51:33.703142 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:51:33.703128 5332 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:51:33.770812 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.770787 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90feb0e8f6d254df57c953bffb88632b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal\" (UID: \"90feb0e8f6d254df57c953bffb88632b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:51:33.770931 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.770817 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90feb0e8f6d254df57c953bffb88632b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal\" (UID: \"90feb0e8f6d254df57c953bffb88632b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:51:33.770931 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.770835 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d92d59dc723695c8e39db4d586eeb52-config\") pod \"kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal\" (UID: \"9d92d59dc723695c8e39db4d586eeb52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:51:33.787922 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.787897 5332 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 22:51:33.789915 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.789898 5332 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 22:51:33.789915 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.789928 5332 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 22:51:33.790049 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.789939 5332 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-89.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 22:51:33.790049 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.789982 5332 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:51:33.802539 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.802521 5332 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:51:33.802600 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.802579 5332 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:51:33.871597 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.871565 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90feb0e8f6d254df57c953bffb88632b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal\" (UID: \"90feb0e8f6d254df57c953bffb88632b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:51:33.871760 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.871595 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90feb0e8f6d254df57c953bffb88632b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal\" (UID: \"90feb0e8f6d254df57c953bffb88632b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:51:33.871760 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.871664 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d92d59dc723695c8e39db4d586eeb52-config\") pod \"kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal\" (UID: \"9d92d59dc723695c8e39db4d586eeb52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:51:33.871760 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.871685 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90feb0e8f6d254df57c953bffb88632b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal\" (UID: \"90feb0e8f6d254df57c953bffb88632b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:51:33.871760 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.871719 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90feb0e8f6d254df57c953bffb88632b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal\" (UID: \"90feb0e8f6d254df57c953bffb88632b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:51:33.871925 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:33.871774 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d92d59dc723695c8e39db4d586eeb52-config\") pod \"kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal\" (UID: \"9d92d59dc723695c8e39db4d586eeb52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:51:34.533380 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.533351 5332 apiserver.go:52] "Watching apiserver" Nov 03 22:51:34.539937 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.539907 5332 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 03 22:51:34.540682 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.540656 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-htd5b","openshift-monitoring/node-exporter-bzt6m","openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs","openshift-cluster-node-tuning-operator/tuned-tbtk5","openshift-dns/dns-default-jqh5x","openshift-multus/network-metrics-daemon-qqzlx","openshift-dns/node-resolver-mjl2l","openshift-network-diagnostics/network-check-target-kmzch","openshift-network-operator/iptables-alerter-7hbs4","openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw","openshift-multus/multus-mzwfp","openshift-monitoring/prometheus-k8s-0","openshift-ovn-kubernetes/ovnkube-node-95bxf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal","kube-system/global-pull-secret-syncer-r2kpn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw","kube-system/konnectivity-agent-kpt2c","openshift-ingress-canary/ingress-canary-xl9vv","openshift-insights/insights-runtime-extractor-krm6s","openshift-multus/multus-additional-cni-plugins-zkb4f","openshift-image-registry/node-ca-2frcd","kube-system/kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal"] Nov 03 22:51:34.547023 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.546991 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 03 22:51:34.547181 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.547153 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 03 22:51:34.547600 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.547577 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 03 22:51:34.547937 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.547920 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2lq2j\"" Nov 03 22:51:34.548011 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.547924 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 03 22:51:34.548076 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.548055 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 03 22:51:34.548126 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.548110 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dgw9c\"" Nov 03 22:51:34.548537 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.548517 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7xqrp\"" Nov 03 22:51:34.548694 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.548675 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qt84f\"" Nov 03 22:51:34.548766 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.548752 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 03 22:51:34.548819 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.548791 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 03 22:51:34.548889 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.548871 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-6ln97\"" Nov 03 22:51:34.548962 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.548946 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-fpn8c\"" Nov 03 22:51:34.549061 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.549048 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 03 22:51:34.549118 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.549073 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 03 22:51:34.549118 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.549103 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 03 22:51:34.549434 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.549416 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 03 22:51:34.550021 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.549992 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4m98w\"" Nov 03 22:51:34.552800 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.552776 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 03 22:51:34.563586 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.563566 5332 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574118 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-run-ovn-kubernetes\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574160 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6k8\" (UniqueName: \"kubernetes.io/projected/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-kube-api-access-mg6k8\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574188 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-sysctl-d\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574211 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/feb1ae85-eef8-4a26-b341-b06161f7210d-iptables-alerter-script\") pod \"iptables-alerter-7hbs4\" (UID: \"feb1ae85-eef8-4a26-b341-b06161f7210d\") " pod="openshift-network-operator/iptables-alerter-7hbs4" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574241 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/feb1ae85-eef8-4a26-b341-b06161f7210d-host-slash\") pod \"iptables-alerter-7hbs4\" (UID: \"feb1ae85-eef8-4a26-b341-b06161f7210d\") " pod="openshift-network-operator/iptables-alerter-7hbs4" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574263 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-wtmp\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574294 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-run-k8s-cni-cncf-io\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574317 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-systemd-units\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574341 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574372 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4stf\" (UniqueName: \"kubernetes.io/projected/a9cfd418-f163-4b86-896f-fd898cb2ebf6-kube-api-access-f4stf\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574394 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f40c765d-cb44-4835-a41d-8cfb35f73f40-tmp-dir\") pod \"node-resolver-mjl2l\" (UID: \"f40c765d-cb44-4835-a41d-8cfb35f73f40\") " pod="openshift-dns/node-resolver-mjl2l" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574416 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/adc37e3e-9f5d-4eba-8b13-6f467c3060d3-agent-certs\") pod \"konnectivity-agent-kpt2c\" (UID: \"adc37e3e-9f5d-4eba-8b13-6f467c3060d3\") " pod="kube-system/konnectivity-agent-kpt2c" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574438 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-slash\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574490 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-sys-fs\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574510 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-run\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574528 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-sys\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574551 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs\") pod \"network-metrics-daemon-qqzlx\" (UID: \"b725cdb0-2fe7-42d6-99b0-1f36d22081af\") " pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574579 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78ad8bbb-3cb2-431c-aa87-a77ff23792c4-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-htd5b\" (UID: \"78ad8bbb-3cb2-431c-aa87-a77ff23792c4\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-htd5b" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574602 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-var-lib-cni-bin\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574634 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574656 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvv2f\" (UniqueName: \"kubernetes.io/projected/8ed2871d-bcc6-4319-a486-e68c0969a292-kube-api-access-mvv2f\") pod \"ingress-canary-xl9vv\" (UID: \"8ed2871d-bcc6-4319-a486-e68c0969a292\") " pod="openshift-ingress-canary/ingress-canary-xl9vv" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574685 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d8b1a575-54e2-46d5-b23a-4ad16eab259a-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574709 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574737 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-log-socket\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574759 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-ovn-node-metrics-cert\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574782 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-socket-dir-parent\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574804 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-tuned\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574830 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-accelerators-collector-config\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574851 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9cfd418-f163-4b86-896f-fd898cb2ebf6-cni-binary-copy\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574879 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-conf-dir\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574902 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8adef5d4-9a99-4a16-a052-aca39fc961b3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-qxbqw\" (UID: \"8adef5d4-9a99-4a16-a052-aca39fc961b3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574924 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-lib-modules\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.574984 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nc4c\" (UniqueName: \"kubernetes.io/projected/7a51fb1d-abfd-4803-8489-56e7ec93127f-kube-api-access-5nc4c\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575031 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0128a08f-b777-40e1-bf05-f79d772fd926-metrics-client-ca\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575059 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft7jh\" (UniqueName: \"kubernetes.io/projected/0128a08f-b777-40e1-bf05-f79d772fd926-kube-api-access-ft7jh\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575104 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a51fb1d-abfd-4803-8489-56e7ec93127f-system-cni-dir\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575138 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a51fb1d-abfd-4803-8489-56e7ec93127f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575177 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-cni-dir\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575200 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-etc-kubernetes\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575222 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7354598a-9d87-4762-9633-da3d96ff063b-dbus\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575264 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a51fb1d-abfd-4803-8489-56e7ec93127f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575290 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj6zx\" (UniqueName: \"kubernetes.io/projected/b725cdb0-2fe7-42d6-99b0-1f36d22081af-kube-api-access-zj6zx\") pod \"network-metrics-daemon-qqzlx\" (UID: \"b725cdb0-2fe7-42d6-99b0-1f36d22081af\") " pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575333 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575359 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575383 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-var-lib-openvswitch\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575425 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-ovnkube-config\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575474 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w42mm\" (UniqueName: \"kubernetes.io/projected/c7b36354-ea7c-4f8c-a96e-f9ba840f2036-kube-api-access-w42mm\") pod \"node-ca-2frcd\" (UID: \"c7b36354-ea7c-4f8c-a96e-f9ba840f2036\") " pod="openshift-image-registry/node-ca-2frcd" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575502 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-kubelet\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575573 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-etc-selinux\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575601 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575625 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-node-log\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575668 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-env-overrides\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575695 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-systemd\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575738 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/858089de-9bce-4497-bf0a-9c756f0aa702-metrics-tls\") pod \"dns-default-jqh5x\" (UID: \"858089de-9bce-4497-bf0a-9c756f0aa702\") " pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575762 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-data-volume\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575785 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575826 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-run-netns\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575849 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7354598a-9d87-4762-9633-da3d96ff063b-kubelet-config\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575869 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-kubernetes\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575912 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575939 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.575990 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ed2871d-bcc6-4319-a486-e68c0969a292-cert\") pod \"ingress-canary-xl9vv\" (UID: \"8ed2871d-bcc6-4319-a486-e68c0969a292\") " pod="openshift-ingress-canary/ingress-canary-xl9vv" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.576008 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-run-ovn\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.576030 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-cni-bin\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.576052 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-cnibin\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.576073 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-run-multus-certs\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.576108 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.576133 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/858089de-9bce-4497-bf0a-9c756f0aa702-config-volume\") pod \"dns-default-jqh5x\" (UID: \"858089de-9bce-4497-bf0a-9c756f0aa702\") " pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.576163 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld956\" (UniqueName: \"kubernetes.io/projected/78ad8bbb-3cb2-431c-aa87-a77ff23792c4-kube-api-access-ld956\") pod \"monitoring-plugin-77f4f76594-htd5b\" (UID: \"78ad8bbb-3cb2-431c-aa87-a77ff23792c4\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-htd5b" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.576187 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-daemon-config\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.576212 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsctv\" (UniqueName: \"kubernetes.io/projected/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-kube-api-access-vsctv\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.576238 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.576282 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-web-config\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.576312 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-etc-openvswitch\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.576342 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-socket-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.576370 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pf5c\" (UniqueName: \"kubernetes.io/projected/feb1ae85-eef8-4a26-b341-b06161f7210d-kube-api-access-4pf5c\") pod \"iptables-alerter-7hbs4\" (UID: \"feb1ae85-eef8-4a26-b341-b06161f7210d\") " pod="openshift-network-operator/iptables-alerter-7hbs4" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.576395 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-run-netns\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.577059 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f40c765d-cb44-4835-a41d-8cfb35f73f40-tmp-dir\") pod \"node-resolver-mjl2l\" (UID: \"f40c765d-cb44-4835-a41d-8cfb35f73f40\") " pod="openshift-dns/node-resolver-mjl2l" Nov 03 22:51:34.577191 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.577162 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-tuned\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.577638 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9cfd418-f163-4b86-896f-fd898cb2ebf6-cni-binary-copy\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.577705 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b725cdb0-2fe7-42d6-99b0-1f36d22081af-metrics-certs\") pod \"network-metrics-daemon-qqzlx\" (UID: \"b725cdb0-2fe7-42d6-99b0-1f36d22081af\") " pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.577779 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-crio-socket\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.577814 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.577853 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a51fb1d-abfd-4803-8489-56e7ec93127f-cnibin\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.577888 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6fqk\" (UniqueName: \"kubernetes.io/projected/8adef5d4-9a99-4a16-a052-aca39fc961b3-kube-api-access-c6fqk\") pod \"prometheus-operator-9cd89b74c-qxbqw\" (UID: \"8adef5d4-9a99-4a16-a052-aca39fc961b3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.577915 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-cni-netd\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.577944 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-modprobe-d\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.577971 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-sysctl-conf\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578001 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2xgn\" (UniqueName: \"kubernetes.io/projected/6c295fd2-23ab-4994-9ae2-60947f409b62-kube-api-access-m2xgn\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578029 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-tls\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578057 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8b1a575-54e2-46d5-b23a-4ad16eab259a-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578086 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgcn8\" (UniqueName: \"kubernetes.io/projected/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-api-access-rgcn8\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578114 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-system-cni-dir\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578143 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578176 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pnxz\" (UniqueName: \"kubernetes.io/projected/f40c765d-cb44-4835-a41d-8cfb35f73f40-kube-api-access-6pnxz\") pod \"node-resolver-mjl2l\" (UID: \"f40c765d-cb44-4835-a41d-8cfb35f73f40\") " pod="openshift-dns/node-resolver-mjl2l" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578206 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/428c38a6-e709-454e-984e-034ec6402558-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578236 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578268 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578296 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/428c38a6-e709-454e-984e-034ec6402558-config-out\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578325 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578352 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtmbf\" (UniqueName: \"kubernetes.io/projected/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-kube-api-access-vtmbf\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578698 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/adc37e3e-9f5d-4eba-8b13-6f467c3060d3-agent-certs\") pod \"konnectivity-agent-kpt2c\" (UID: \"adc37e3e-9f5d-4eba-8b13-6f467c3060d3\") " pod="kube-system/konnectivity-agent-kpt2c" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578806 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d8b1a575-54e2-46d5-b23a-4ad16eab259a-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578845 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8adef5d4-9a99-4a16-a052-aca39fc961b3-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-qxbqw\" (UID: \"8adef5d4-9a99-4a16-a052-aca39fc961b3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578874 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c295fd2-23ab-4994-9ae2-60947f409b62-tmp\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578903 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578934 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-var-lib-cni-multus\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578962 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-config\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.578988 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.579015 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-var-lib-kubelet\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.579055 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-hostroot\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.579081 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/adc37e3e-9f5d-4eba-8b13-6f467c3060d3-konnectivity-ca\") pod \"konnectivity-agent-kpt2c\" (UID: \"adc37e3e-9f5d-4eba-8b13-6f467c3060d3\") " pod="kube-system/konnectivity-agent-kpt2c" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.579105 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-run-openvswitch\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.579129 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-device-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.579154 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-var-lib-kubelet\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.579186 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.579213 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/858089de-9bce-4497-bf0a-9c756f0aa702-tmp-dir\") pod \"dns-default-jqh5x\" (UID: \"858089de-9bce-4497-bf0a-9c756f0aa702\") " pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.579241 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-sysconfig\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.579266 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0128a08f-b777-40e1-bf05-f79d772fd926-root\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.579292 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljhkl\" (UniqueName: \"kubernetes.io/projected/428c38a6-e709-454e-984e-034ec6402558-kube-api-access-ljhkl\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.579318 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vf8n\" (UniqueName: \"kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n\") pod \"network-check-target-kmzch\" (UID: \"89db2583-ca69-48db-adf0-1383f53434c1\") " pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.579346 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.579378 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqrnr\" (UniqueName: \"kubernetes.io/projected/858089de-9bce-4497-bf0a-9c756f0aa702-kube-api-access-vqrnr\") pod \"dns-default-jqh5x\" (UID: \"858089de-9bce-4497-bf0a-9c756f0aa702\") " pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.579406 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-registration-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.579433 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a51fb1d-abfd-4803-8489-56e7ec93127f-cni-binary-copy\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.579642 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c295fd2-23ab-4994-9ae2-60947f409b62-tmp\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.579734 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/428c38a6-e709-454e-984e-034ec6402558-config-out\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.579868 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.579955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.579963 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/adc37e3e-9f5d-4eba-8b13-6f467c3060d3-konnectivity-ca\") pod \"konnectivity-agent-kpt2c\" (UID: \"adc37e3e-9f5d-4eba-8b13-6f467c3060d3\") " pod="kube-system/konnectivity-agent-kpt2c" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.580337 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-data-volume\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.580552 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/858089de-9bce-4497-bf0a-9c756f0aa702-tmp-dir\") pod \"dns-default-jqh5x\" (UID: \"858089de-9bce-4497-bf0a-9c756f0aa702\") " pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.580677 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f40c765d-cb44-4835-a41d-8cfb35f73f40-hosts-file\") pod \"node-resolver-mjl2l\" (UID: \"f40c765d-cb44-4835-a41d-8cfb35f73f40\") " pod="openshift-dns/node-resolver-mjl2l" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.580739 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8adef5d4-9a99-4a16-a052-aca39fc961b3-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-qxbqw\" (UID: \"8adef5d4-9a99-4a16-a052-aca39fc961b3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.580811 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.580839 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7b36354-ea7c-4f8c-a96e-f9ba840f2036-host\") pod \"node-ca-2frcd\" (UID: \"c7b36354-ea7c-4f8c-a96e-f9ba840f2036\") " pod="openshift-image-registry/node-ca-2frcd" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.580862 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-host\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.581040 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.581048 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a51fb1d-abfd-4803-8489-56e7ec93127f-cni-binary-copy\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.581076 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.581157 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a51fb1d-abfd-4803-8489-56e7ec93127f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.581235 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0128a08f-b777-40e1-bf05-f79d772fd926-sys\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.581372 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-textfile\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.581380 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a51fb1d-abfd-4803-8489-56e7ec93127f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.581408 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-ovnkube-script-lib\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.581525 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7b36354-ea7c-4f8c-a96e-f9ba840f2036-serviceca\") pod \"node-ca-2frcd\" (UID: \"c7b36354-ea7c-4f8c-a96e-f9ba840f2036\") " pod="openshift-image-registry/node-ca-2frcd" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.581650 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-textfile\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.581704 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.581757 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-run-systemd\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.582022 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7b36354-ea7c-4f8c-a96e-f9ba840f2036-serviceca\") pod \"node-ca-2frcd\" (UID: \"c7b36354-ea7c-4f8c-a96e-f9ba840f2036\") " pod="openshift-image-registry/node-ca-2frcd" Nov 03 22:51:34.584302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.583435 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w42mm\" (UniqueName: \"kubernetes.io/projected/c7b36354-ea7c-4f8c-a96e-f9ba840f2036-kube-api-access-w42mm\") pod \"node-ca-2frcd\" (UID: \"c7b36354-ea7c-4f8c-a96e-f9ba840f2036\") " pod="openshift-image-registry/node-ca-2frcd" Nov 03 22:51:34.585423 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.584436 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4stf\" (UniqueName: \"kubernetes.io/projected/a9cfd418-f163-4b86-896f-fd898cb2ebf6-kube-api-access-f4stf\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.585423 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.584488 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj6zx\" (UniqueName: \"kubernetes.io/projected/b725cdb0-2fe7-42d6-99b0-1f36d22081af-kube-api-access-zj6zx\") pod \"network-metrics-daemon-qqzlx\" (UID: \"b725cdb0-2fe7-42d6-99b0-1f36d22081af\") " pod="openshift-multus/network-metrics-daemon-qqzlx" Nov 03 22:51:34.585423 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.584907 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nc4c\" (UniqueName: \"kubernetes.io/projected/7a51fb1d-abfd-4803-8489-56e7ec93127f-kube-api-access-5nc4c\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:51:34.585423 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.585413 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2xgn\" (UniqueName: \"kubernetes.io/projected/6c295fd2-23ab-4994-9ae2-60947f409b62-kube-api-access-m2xgn\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.647821 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.647789 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Nov 03 22:51:34.659585 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.648752 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 03 22:51:34.659739 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.649243 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 03 22:51:34.659739 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.650122 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 03 22:51:34.659739 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.650301 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 03 22:51:34.659739 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.650482 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 03 22:51:34.659739 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.650599 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 03 22:51:34.659739 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.651206 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 03 22:51:34.659739 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.651183 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Nov 03 22:51:34.659739 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.651908 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-x7fkt\"" Nov 03 22:51:34.659739 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.652486 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 03 22:51:34.659739 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.652591 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Nov 03 22:51:34.659739 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.652732 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 03 22:51:34.659739 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.652977 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.653038 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-l7l8c\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.653254 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-w6v9t\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.653333 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xvtdb\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.653381 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.653521 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqrnr\" (UniqueName: \"kubernetes.io/projected/858089de-9bce-4497-bf0a-9c756f0aa702-kube-api-access-vqrnr\") pod \"dns-default-jqh5x\" (UID: \"858089de-9bce-4497-bf0a-9c756f0aa702\") " pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.653599 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fq4pb\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.653647 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.653699 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.653798 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xbgw4\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.654000 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.654061 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-k9x8r\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.654046 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.654150 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.654253 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4lzq6\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.654325 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.654554 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5qb72\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.654574 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-9nm4c\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.654711 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.654754 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.655100 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.655217 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.655353 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.655491 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.655637 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pf5c\" (UniqueName: \"kubernetes.io/projected/feb1ae85-eef8-4a26-b341-b06161f7210d-kube-api-access-4pf5c\") pod \"iptables-alerter-7hbs4\" (UID: \"feb1ae85-eef8-4a26-b341-b06161f7210d\") " pod="openshift-network-operator/iptables-alerter-7hbs4" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.655696 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.655845 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xz7vt\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.655930 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.656051 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.656166 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.656408 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.656504 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.656728 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.656784 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvv2f\" (UniqueName: \"kubernetes.io/projected/8ed2871d-bcc6-4319-a486-e68c0969a292-kube-api-access-mvv2f\") pod \"ingress-canary-xl9vv\" (UID: \"8ed2871d-bcc6-4319-a486-e68c0969a292\") " pod="openshift-ingress-canary/ingress-canary-xl9vv" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.656812 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.656927 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.657133 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.657170 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.657554 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtmbf\" (UniqueName: \"kubernetes.io/projected/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-kube-api-access-vtmbf\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.657585 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.657716 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.656170 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.657734 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.657759 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pnxz\" (UniqueName: \"kubernetes.io/projected/f40c765d-cb44-4835-a41d-8cfb35f73f40-kube-api-access-6pnxz\") pod \"node-resolver-mjl2l\" (UID: \"f40c765d-cb44-4835-a41d-8cfb35f73f40\") " pod="openshift-dns/node-resolver-mjl2l" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.657806 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Nov 03 22:51:34.660258 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.657828 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Nov 03 22:51:34.661799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.657864 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Nov 03 22:51:34.661799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.657864 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-55tt4\"" Nov 03 22:51:34.661799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.657939 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xr88k\"" Nov 03 22:51:34.661799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.657902 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.661799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.657960 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 03 22:51:34.661799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.657990 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 03 22:51:34.661799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.658042 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 03 22:51:34.661799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.658061 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Nov 03 22:51:34.661799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.658177 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Nov 03 22:51:34.661799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.658255 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 03 22:51:34.661799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.658381 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-ovnkube-script-lib\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.661799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.658530 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsctv\" (UniqueName: \"kubernetes.io/projected/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-kube-api-access-vsctv\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:34.661799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.658547 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1c5i59msea8be\"" Nov 03 22:51:34.661799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.658616 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-ovnkube-config\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.661799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.658823 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-tls\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.661799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.658901 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Nov 03 22:51:34.661799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.659011 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:34.661799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.659036 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 03 22:51:34.661799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.659211 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 03 22:51:34.661799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.659510 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:34.662431 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.661914 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg6k8\" (UniqueName: \"kubernetes.io/projected/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-kube-api-access-mg6k8\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:51:34.664159 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.664135 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/428c38a6-e709-454e-984e-034ec6402558-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.664284 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.664197 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.664284 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.664202 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/858089de-9bce-4497-bf0a-9c756f0aa702-config-volume\") pod \"dns-default-jqh5x\" (UID: \"858089de-9bce-4497-bf0a-9c756f0aa702\") " pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:34.664284 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.664247 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-env-overrides\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.664284 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.664276 5332 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:51:34.664527 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.664396 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.664527 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.664430 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.664527 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.664444 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7354598a-9d87-4762-9633-da3d96ff063b-original-pull-secret\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:51:34.664679 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.664622 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.664679 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.664665 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:34.664780 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.664683 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.664835 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.664784 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-daemon-config\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.664888 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.664831 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a51fb1d-abfd-4803-8489-56e7ec93127f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:51:34.664974 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.664954 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/858089de-9bce-4497-bf0a-9c756f0aa702-metrics-tls\") pod \"dns-default-jqh5x\" (UID: \"858089de-9bce-4497-bf0a-9c756f0aa702\") " pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:34.665034 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.665010 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-config\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.665163 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.665144 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-accelerators-collector-config\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.665340 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.665318 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld956\" (UniqueName: \"kubernetes.io/projected/78ad8bbb-3cb2-431c-aa87-a77ff23792c4-kube-api-access-ld956\") pod \"monitoring-plugin-77f4f76594-htd5b\" (UID: \"78ad8bbb-3cb2-431c-aa87-a77ff23792c4\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-htd5b" Nov 03 22:51:34.665405 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.665354 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:34.665471 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.665416 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgcn8\" (UniqueName: \"kubernetes.io/projected/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-api-access-rgcn8\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:34.665535 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.665521 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 03 22:51:34.665535 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.665526 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6fqk\" (UniqueName: \"kubernetes.io/projected/8adef5d4-9a99-4a16-a052-aca39fc961b3-kube-api-access-c6fqk\") pod \"prometheus-operator-9cd89b74c-qxbqw\" (UID: \"8adef5d4-9a99-4a16-a052-aca39fc961b3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:34.665668 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.665647 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vf8n\" (UniqueName: \"kubernetes.io/projected/89db2583-ca69-48db-adf0-1383f53434c1-kube-api-access-7vf8n\") pod \"network-check-target-kmzch\" (UID: \"89db2583-ca69-48db-adf0-1383f53434c1\") " pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:51:34.665728 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.665715 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-web-config\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.665782 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.665737 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8adef5d4-9a99-4a16-a052-aca39fc961b3-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-qxbqw\" (UID: \"8adef5d4-9a99-4a16-a052-aca39fc961b3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:34.665782 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.665757 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljhkl\" (UniqueName: \"kubernetes.io/projected/428c38a6-e709-454e-984e-034ec6402558-kube-api-access-ljhkl\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.666409 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.665922 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.666409 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.665991 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78ad8bbb-3cb2-431c-aa87-a77ff23792c4-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-htd5b\" (UID: \"78ad8bbb-3cb2-431c-aa87-a77ff23792c4\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-htd5b" Nov 03 22:51:34.666409 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.666134 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8adef5d4-9a99-4a16-a052-aca39fc961b3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-qxbqw\" (UID: \"8adef5d4-9a99-4a16-a052-aca39fc961b3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:34.666409 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.666157 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/feb1ae85-eef8-4a26-b341-b06161f7210d-iptables-alerter-script\") pod \"iptables-alerter-7hbs4\" (UID: \"feb1ae85-eef8-4a26-b341-b06161f7210d\") " pod="openshift-network-operator/iptables-alerter-7hbs4" Nov 03 22:51:34.666409 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.666192 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.666409 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.666240 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Nov 03 22:51:34.666409 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.666274 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.666409 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.666352 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft7jh\" (UniqueName: \"kubernetes.io/projected/0128a08f-b777-40e1-bf05-f79d772fd926-kube-api-access-ft7jh\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.666409 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.666355 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.666409 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.666395 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.666903 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.666486 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ed2871d-bcc6-4319-a486-e68c0969a292-cert\") pod \"ingress-canary-xl9vv\" (UID: \"8ed2871d-bcc6-4319-a486-e68c0969a292\") " pod="openshift-ingress-canary/ingress-canary-xl9vv" Nov 03 22:51:34.666903 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.666576 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8b1a575-54e2-46d5-b23a-4ad16eab259a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:34.666903 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.666622 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-ovn-node-metrics-cert\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.666903 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.666645 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.668394 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.668372 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0128a08f-b777-40e1-bf05-f79d772fd926-metrics-client-ca\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.670246 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.670221 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8b1a575-54e2-46d5-b23a-4ad16eab259a-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-sw2xs\" (UID: \"d8b1a575-54e2-46d5-b23a-4ad16eab259a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-sw2xs" Nov 03 22:51:34.670343 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.670273 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8adef5d4-9a99-4a16-a052-aca39fc961b3-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-qxbqw\" (UID: \"8adef5d4-9a99-4a16-a052-aca39fc961b3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qxbqw" Nov 03 22:51:34.670402 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.670356 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.671762 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.671494 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.671762 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.671708 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:34.673205 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.673187 5332 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 22:51:34.673292 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:51:34.673226 5332 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.us-east-2.compute.internal" Nov 03 22:51:34.682908 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.682875 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a51fb1d-abfd-4803-8489-56e7ec93127f-system-cni-dir\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:51:34.683016 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.682918 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a51fb1d-abfd-4803-8489-56e7ec93127f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:51:34.683016 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.682969 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-cni-dir\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.683016 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.682980 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a51fb1d-abfd-4803-8489-56e7ec93127f-system-cni-dir\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:51:34.683016 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.682992 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-etc-kubernetes\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.683016 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683015 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7354598a-9d87-4762-9633-da3d96ff063b-dbus\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:51:34.683221 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683042 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-var-lib-openvswitch\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.683221 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683050 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a51fb1d-abfd-4803-8489-56e7ec93127f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:51:34.683221 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683063 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-cni-dir\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.683221 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683064 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-etc-kubernetes\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.683221 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683066 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-kubelet\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.683221 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683099 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-var-lib-openvswitch\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.683221 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683105 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7354598a-9d87-4762-9633-da3d96ff063b-dbus\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:51:34.683221 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683106 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-kubelet\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.683221 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683141 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-etc-selinux\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:51:34.683221 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683159 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-node-log\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.683221 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683174 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-systemd\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.683221 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683195 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-run-netns\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.683221 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683220 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7354598a-9d87-4762-9633-da3d96ff063b-kubelet-config\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:51:34.683221 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683221 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-node-log\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683240 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-systemd\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683244 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-kubernetes\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683249 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-etc-selinux\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683250 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-run-netns\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683270 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-run-ovn\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683280 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7354598a-9d87-4762-9633-da3d96ff063b-kubelet-config\") pod \"global-pull-secret-syncer-r2kpn\" (UID: \"7354598a-9d87-4762-9633-da3d96ff063b\") " pod="kube-system/global-pull-secret-syncer-r2kpn" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683289 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-cni-bin\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683314 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-cni-bin\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683287 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-kubernetes\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683334 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-run-ovn\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683339 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-cnibin\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683370 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-run-multus-certs\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683391 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-etc-openvswitch\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683405 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-socket-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683420 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-run-netns\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683424 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-cnibin\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683431 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-run-multus-certs\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683441 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-crio-socket\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683448 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-etc-openvswitch\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683485 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-run-netns\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683497 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-socket-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683500 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683502 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd-crio-socket\") pod \"insights-runtime-extractor-krm6s\" (UID: \"72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd\") " pod="openshift-insights/insights-runtime-extractor-krm6s" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683516 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683526 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a51fb1d-abfd-4803-8489-56e7ec93127f-cnibin\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683560 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-cni-netd\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683574 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-modprobe-d\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683585 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a51fb1d-abfd-4803-8489-56e7ec93127f-cnibin\") pod \"multus-additional-cni-plugins-zkb4f\" (UID: \"7a51fb1d-abfd-4803-8489-56e7ec93127f\") " pod="openshift-multus/multus-additional-cni-plugins-zkb4f" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683608 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-sysctl-conf\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683631 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-system-cni-dir\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683643 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-cni-netd\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.683646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683652 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-var-lib-cni-multus\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683693 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-var-lib-cni-multus\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683700 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-var-lib-kubelet\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683721 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-system-cni-dir\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683726 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-hostroot\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683733 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-sysctl-conf\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683733 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-modprobe-d\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683754 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-var-lib-kubelet\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683757 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-run-openvswitch\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683777 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-device-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683790 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-run-openvswitch\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683791 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-var-lib-kubelet\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683812 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-var-lib-kubelet\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683758 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-hostroot\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683838 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-sysconfig\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683854 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0128a08f-b777-40e1-bf05-f79d772fd926-root\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683855 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-device-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683872 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-registration-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683887 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f40c765d-cb44-4835-a41d-8cfb35f73f40-hosts-file\") pod \"node-resolver-mjl2l\" (UID: \"f40c765d-cb44-4835-a41d-8cfb35f73f40\") " pod="openshift-dns/node-resolver-mjl2l" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683895 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-sysconfig\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683908 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683923 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0128a08f-b777-40e1-bf05-f79d772fd926-root\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683936 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7b36354-ea7c-4f8c-a96e-f9ba840f2036-host\") pod \"node-ca-2frcd\" (UID: \"c7b36354-ea7c-4f8c-a96e-f9ba840f2036\") " pod="openshift-image-registry/node-ca-2frcd" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683942 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f40c765d-cb44-4835-a41d-8cfb35f73f40-hosts-file\") pod \"node-resolver-mjl2l\" (UID: \"f40c765d-cb44-4835-a41d-8cfb35f73f40\") " pod="openshift-dns/node-resolver-mjl2l" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683943 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-registration-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683947 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683958 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-host\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683974 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0128a08f-b777-40e1-bf05-f79d772fd926-sys\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.683992 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-run-systemd\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684011 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-run-ovn-kubernetes\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684022 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7b36354-ea7c-4f8c-a96e-f9ba840f2036-host\") pod \"node-ca-2frcd\" (UID: \"c7b36354-ea7c-4f8c-a96e-f9ba840f2036\") " pod="openshift-image-registry/node-ca-2frcd" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684036 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-host\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684041 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0128a08f-b777-40e1-bf05-f79d772fd926-sys\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684051 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-run-ovn-kubernetes\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684054 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-run-systemd\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684037 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-sysctl-d\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684088 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/feb1ae85-eef8-4a26-b341-b06161f7210d-host-slash\") pod \"iptables-alerter-7hbs4\" (UID: \"feb1ae85-eef8-4a26-b341-b06161f7210d\") " pod="openshift-network-operator/iptables-alerter-7hbs4" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684104 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-wtmp\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684110 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-etc-sysctl-d\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684129 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-run-k8s-cni-cncf-io\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684146 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-run-k8s-cni-cncf-io\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684148 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/feb1ae85-eef8-4a26-b341-b06161f7210d-host-slash\") pod \"iptables-alerter-7hbs4\" (UID: \"feb1ae85-eef8-4a26-b341-b06161f7210d\") " pod="openshift-network-operator/iptables-alerter-7hbs4" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684164 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-systemd-units\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684184 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0128a08f-b777-40e1-bf05-f79d772fd926-node-exporter-wtmp\") pod \"node-exporter-bzt6m\" (UID: \"0128a08f-b777-40e1-bf05-f79d772fd926\") " pod="openshift-monitoring/node-exporter-bzt6m" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684206 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-systemd-units\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684212 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-slash\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684186 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-host-slash\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684243 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-sys-fs\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684258 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-run\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684271 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-sys\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684285 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-var-lib-cni-bin\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684309 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-log-socket\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684329 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-run\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684332 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-socket-dir-parent\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684348 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-sys\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684346 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-host-var-lib-cni-bin\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684364 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-conf-dir\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684367 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b99b9ce3-9872-4265-b7e2-26c4851a3ebf-sys-fs\") pod \"aws-ebs-csi-driver-node-qqckw\" (UID: \"b99b9ce3-9872-4265-b7e2-26c4851a3ebf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqckw" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684372 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-socket-dir-parent\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684367 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5362ce0b-df5e-4bac-9d66-fbebfff0cbb4-log-socket\") pod \"ovnkube-node-95bxf\" (UID: \"5362ce0b-df5e-4bac-9d66-fbebfff0cbb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684388 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-lib-modules\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684443 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9cfd418-f163-4b86-896f-fd898cb2ebf6-multus-conf-dir\") pod \"multus-mzwfp\" (UID: \"a9cfd418-f163-4b86-896f-fd898cb2ebf6\") " pod="openshift-multus/multus-mzwfp" Nov 03 22:51:34.684529 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.684490 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c295fd2-23ab-4994-9ae2-60947f409b62-lib-modules\") pod \"tuned-tbtk5\" (UID: \"6c295fd2-23ab-4994-9ae2-60947f409b62\") " pod="openshift-cluster-node-tuning-operator/tuned-tbtk5" Nov 03 22:51:34.871333 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:34.871224 5332 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 22:51:35.742047 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:35.742017 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:36.184189 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:36.184103 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:36.286522 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:36.286486 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:36.510633 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:36.510597 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:36.617303 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:36.617264 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:37.008692 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:37.008664 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jqh5x" Nov 03 22:51:37.672311 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:37.672275 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"428c38a6-e709-454e-984e-034ec6402558","Type":"ContainerStarted","Data":"c25382547ae6fb1f800371ed9f280f469c7961f27af2bde37c4fabd6e5856904"} Nov 03 22:51:37.672492 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:37.672352 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"428c38a6-e709-454e-984e-034ec6402558","Type":"ContainerStarted","Data":"37195f6b5c44c2113697628ad553df4d03cf97ceb7843208923fd7726f570550"} Nov 03 22:51:37.672492 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:37.672379 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"428c38a6-e709-454e-984e-034ec6402558","Type":"ContainerStarted","Data":"846b97ce65c132d0af950ebbca8a77a117512df15bfcd2e050e539b52ccac48f"} Nov 03 22:51:37.672492 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:37.672403 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"428c38a6-e709-454e-984e-034ec6402558","Type":"ContainerStarted","Data":"8cd8e688a3c29d366392c21ec554ddcb3c7099251bd256da69deb425fd56abe9"} Nov 03 22:51:37.863984 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:37.863946 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:37.970010 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:37.969972 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:38.823648 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:38.823620 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:38.824041 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:38.823833 5332 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 03 22:51:39.494242 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:51:39.494200 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 22:51:39.509635 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:39.509595 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:39.509799 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:39.509791 5332 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 03 22:51:39.525397 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:39.525376 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:41.774159 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:41.774130 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-95bxf" Nov 03 22:51:43.265823 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:43.265741 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:43.412947 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:43.412912 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:44.120801 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:44.120774 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:51:44.817608 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:44.817563 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-htd5b" Nov 03 22:51:44.821764 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:44.821742 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-htd5b" Nov 03 22:51:49.449692 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:49.449658 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:49.548508 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:49.548477 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:51.168274 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:51.168238 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:51:52.879944 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:52.879904 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:52.990405 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:52.990370 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:55.524839 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:55.524811 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kpt2c" Nov 03 22:51:59.469085 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:59.469046 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:51:59.571126 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:51:59.571094 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:04.124146 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:04.124118 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kmzch" Nov 03 22:52:05.631659 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:05.631617 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:05.747936 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:05.747904 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:09.240935 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:09.240897 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:09.373260 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:09.373191 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:09.494743 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:52:09.494661 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 22:52:14.678386 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:14.678350 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 03 22:52:14.678794 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:14.678728 5332 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="prometheus" containerID="cri-o://1786ebf25d038173d1739097b9d96e19f9a9d253b7bb6e1526ad44d93a6ca979" gracePeriod=600 Nov 03 22:52:14.679068 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:14.679047 5332 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c25382547ae6fb1f800371ed9f280f469c7961f27af2bde37c4fabd6e5856904" gracePeriod=600 Nov 03 22:52:14.679152 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:14.679138 5332 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="kube-rbac-proxy" containerID="cri-o://37195f6b5c44c2113697628ad553df4d03cf97ceb7843208923fd7726f570550" gracePeriod=600 Nov 03 22:52:14.679220 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:14.679193 5332 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="kube-rbac-proxy-web" containerID="cri-o://846b97ce65c132d0af950ebbca8a77a117512df15bfcd2e050e539b52ccac48f" gracePeriod=600 Nov 03 22:52:14.679271 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:14.679260 5332 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="thanos-sidecar" containerID="cri-o://8cd8e688a3c29d366392c21ec554ddcb3c7099251bd256da69deb425fd56abe9" gracePeriod=600 Nov 03 22:52:14.679319 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:14.679308 5332 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="config-reloader" containerID="cri-o://eb4b709a8973dfd5c9284fe44deade307c055fbe4dd61a5bcce9eea797d04249" gracePeriod=600 Nov 03 22:52:14.803187 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:14.803160 5332 generic.go:356] "Generic (PLEG): container finished" podID="428c38a6-e709-454e-984e-034ec6402558" containerID="c25382547ae6fb1f800371ed9f280f469c7961f27af2bde37c4fabd6e5856904" exitCode=0 Nov 03 22:52:14.803252 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:14.803189 5332 generic.go:356] "Generic (PLEG): container finished" podID="428c38a6-e709-454e-984e-034ec6402558" containerID="37195f6b5c44c2113697628ad553df4d03cf97ceb7843208923fd7726f570550" exitCode=0 Nov 03 22:52:14.803252 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:14.803198 5332 generic.go:356] "Generic (PLEG): container finished" podID="428c38a6-e709-454e-984e-034ec6402558" containerID="846b97ce65c132d0af950ebbca8a77a117512df15bfcd2e050e539b52ccac48f" exitCode=0 Nov 03 22:52:14.803252 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:14.803204 5332 generic.go:356] "Generic (PLEG): container finished" podID="428c38a6-e709-454e-984e-034ec6402558" containerID="8cd8e688a3c29d366392c21ec554ddcb3c7099251bd256da69deb425fd56abe9" exitCode=0 Nov 03 22:52:14.803252 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:14.803210 5332 generic.go:356] "Generic (PLEG): container finished" podID="428c38a6-e709-454e-984e-034ec6402558" containerID="eb4b709a8973dfd5c9284fe44deade307c055fbe4dd61a5bcce9eea797d04249" exitCode=0 Nov 03 22:52:14.803252 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:14.803240 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"428c38a6-e709-454e-984e-034ec6402558","Type":"ContainerDied","Data":"c25382547ae6fb1f800371ed9f280f469c7961f27af2bde37c4fabd6e5856904"} Nov 03 22:52:14.803464 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:14.803315 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"428c38a6-e709-454e-984e-034ec6402558","Type":"ContainerDied","Data":"37195f6b5c44c2113697628ad553df4d03cf97ceb7843208923fd7726f570550"} Nov 03 22:52:14.803464 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:14.803359 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"428c38a6-e709-454e-984e-034ec6402558","Type":"ContainerDied","Data":"846b97ce65c132d0af950ebbca8a77a117512df15bfcd2e050e539b52ccac48f"} Nov 03 22:52:14.803464 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:14.803398 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"428c38a6-e709-454e-984e-034ec6402558","Type":"ContainerDied","Data":"8cd8e688a3c29d366392c21ec554ddcb3c7099251bd256da69deb425fd56abe9"} Nov 03 22:52:14.803464 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:14.803437 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"428c38a6-e709-454e-984e-034ec6402558","Type":"ContainerDied","Data":"eb4b709a8973dfd5c9284fe44deade307c055fbe4dd61a5bcce9eea797d04249"} Nov 03 22:52:14.932379 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:14.932313 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:15.103707 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.103676 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-grpc-tls\") pod \"428c38a6-e709-454e-984e-034ec6402558\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " Nov 03 22:52:15.103882 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.103725 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-2\") pod \"428c38a6-e709-454e-984e-034ec6402558\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " Nov 03 22:52:15.103882 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.103755 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-kubelet-serving-ca-bundle\") pod \"428c38a6-e709-454e-984e-034ec6402558\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " Nov 03 22:52:15.103882 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.103776 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"428c38a6-e709-454e-984e-034ec6402558\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " Nov 03 22:52:15.103882 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.103807 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-tls\") pod \"428c38a6-e709-454e-984e-034ec6402558\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " Nov 03 22:52:15.103882 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.103831 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-web-config\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-web-config\") pod \"428c38a6-e709-454e-984e-034ec6402558\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " Nov 03 22:52:15.103882 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.103865 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"428c38a6-e709-454e-984e-034ec6402558\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " Nov 03 22:52:15.104216 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.103905 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-thanos-prometheus-http-client-file\") pod \"428c38a6-e709-454e-984e-034ec6402558\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " Nov 03 22:52:15.104216 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.103936 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-serving-certs-ca-bundle\") pod \"428c38a6-e709-454e-984e-034ec6402558\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " Nov 03 22:52:15.104216 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.103974 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/428c38a6-e709-454e-984e-034ec6402558-kube-api-access-ljhkl\" (UniqueName: \"kubernetes.io/projected/428c38a6-e709-454e-984e-034ec6402558-kube-api-access-ljhkl\") pod \"428c38a6-e709-454e-984e-034ec6402558\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " Nov 03 22:52:15.104216 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.104004 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/428c38a6-e709-454e-984e-034ec6402558-tls-assets\" (UniqueName: \"kubernetes.io/projected/428c38a6-e709-454e-984e-034ec6402558-tls-assets\") pod \"428c38a6-e709-454e-984e-034ec6402558\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " Nov 03 22:52:15.104216 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.104039 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-trusted-ca-bundle\") pod \"428c38a6-e709-454e-984e-034ec6402558\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " Nov 03 22:52:15.104216 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.104068 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-0\") pod \"428c38a6-e709-454e-984e-034ec6402558\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " Nov 03 22:52:15.104216 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.104115 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-metrics-client-certs\") pod \"428c38a6-e709-454e-984e-034ec6402558\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " Nov 03 22:52:15.104216 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.104107 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-2" pod "428c38a6-e709-454e-984e-034ec6402558" (UID: "428c38a6-e709-454e-984e-034ec6402558"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:52:15.104216 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.104149 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-config\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-config\") pod \"428c38a6-e709-454e-984e-034ec6402558\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " Nov 03 22:52:15.104216 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.104183 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-db\") pod \"428c38a6-e709-454e-984e-034ec6402558\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " Nov 03 22:52:15.104216 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.104188 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-kubelet-serving-ca-bundle" pod "428c38a6-e709-454e-984e-034ec6402558" (UID: "428c38a6-e709-454e-984e-034ec6402558"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:52:15.104992 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.104226 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/428c38a6-e709-454e-984e-034ec6402558-config-out\" (UniqueName: \"kubernetes.io/empty-dir/428c38a6-e709-454e-984e-034ec6402558-config-out\") pod \"428c38a6-e709-454e-984e-034ec6402558\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " Nov 03 22:52:15.104992 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.104260 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-kube-rbac-proxy\") pod \"428c38a6-e709-454e-984e-034ec6402558\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " Nov 03 22:52:15.104992 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.104297 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-metrics-client-ca\") pod \"428c38a6-e709-454e-984e-034ec6402558\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " Nov 03 22:52:15.104992 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.104327 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-1\") pod \"428c38a6-e709-454e-984e-034ec6402558\" (UID: \"428c38a6-e709-454e-984e-034ec6402558\") " Nov 03 22:52:15.104992 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.104569 5332 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:15.104992 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.104589 5332 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:15.105281 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.105090 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-1" pod "428c38a6-e709-454e-984e-034ec6402558" (UID: "428c38a6-e709-454e-984e-034ec6402558"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:52:15.105478 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.105430 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-trusted-ca-bundle" pod "428c38a6-e709-454e-984e-034ec6402558" (UID: "428c38a6-e709-454e-984e-034ec6402558"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:52:15.106086 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.105814 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-0" pod "428c38a6-e709-454e-984e-034ec6402558" (UID: "428c38a6-e709-454e-984e-034ec6402558"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:52:15.107705 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.107249 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-thanos-sidecar-tls" pod "428c38a6-e709-454e-984e-034ec6402558" (UID: "428c38a6-e709-454e-984e-034ec6402558"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:15.107705 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.107639 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-grpc-tls" pod "428c38a6-e709-454e-984e-034ec6402558" (UID: "428c38a6-e709-454e-984e-034ec6402558"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:15.107978 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.107952 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-serving-certs-ca-bundle" pod "428c38a6-e709-454e-984e-034ec6402558" (UID: "428c38a6-e709-454e-984e-034ec6402558"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:52:15.108084 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.108029 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-metrics-client-ca" pod "428c38a6-e709-454e-984e-034ec6402558" (UID: "428c38a6-e709-454e-984e-034ec6402558"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:52:15.108513 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.108489 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-metrics-client-certs" pod "428c38a6-e709-454e-984e-034ec6402558" (UID: "428c38a6-e709-454e-984e-034ec6402558"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:15.108748 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.108700 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-db" pod "428c38a6-e709-454e-984e-034ec6402558" (UID: "428c38a6-e709-454e-984e-034ec6402558"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:52:15.108975 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.108947 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-tls" pod "428c38a6-e709-454e-984e-034ec6402558" (UID: "428c38a6-e709-454e-984e-034ec6402558"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:15.109094 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.109003 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/428c38a6-e709-454e-984e-034ec6402558-kube-api-access-ljhkl" pod "428c38a6-e709-454e-984e-034ec6402558" (UID: "428c38a6-e709-454e-984e-034ec6402558"). InnerVolumeSpecName "kube-api-access-ljhkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 22:52:15.109094 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.109086 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/428c38a6-e709-454e-984e-034ec6402558-config-out" pod "428c38a6-e709-454e-984e-034ec6402558" (UID: "428c38a6-e709-454e-984e-034ec6402558"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:52:15.109408 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.109386 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/428c38a6-e709-454e-984e-034ec6402558-tls-assets" pod "428c38a6-e709-454e-984e-034ec6402558" (UID: "428c38a6-e709-454e-984e-034ec6402558"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 22:52:15.109408 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.109402 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-kube-rbac-proxy" pod "428c38a6-e709-454e-984e-034ec6402558" (UID: "428c38a6-e709-454e-984e-034ec6402558"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:15.109575 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.109480 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-thanos-prometheus-http-client-file" pod "428c38a6-e709-454e-984e-034ec6402558" (UID: "428c38a6-e709-454e-984e-034ec6402558"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:15.110256 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.110238 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-kube-rbac-proxy-web" pod "428c38a6-e709-454e-984e-034ec6402558" (UID: "428c38a6-e709-454e-984e-034ec6402558"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:15.110341 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.110301 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-config" pod "428c38a6-e709-454e-984e-034ec6402558" (UID: "428c38a6-e709-454e-984e-034ec6402558"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:15.118047 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.118025 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-web-config" pod "428c38a6-e709-454e-984e-034ec6402558" (UID: "428c38a6-e709-454e-984e-034ec6402558"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:15.205400 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.205370 5332 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-grpc-tls\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:15.205400 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.205401 5332 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:15.205601 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.205412 5332 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:15.205601 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.205422 5332 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-web-config\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:15.205601 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.205432 5332 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:15.205601 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.205442 5332 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:15.205601 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.205471 5332 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:15.205601 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.205480 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljhkl\" (UniqueName: \"kubernetes.io/projected/428c38a6-e709-454e-984e-034ec6402558-kube-api-access-ljhkl\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:15.205601 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.205489 5332 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/428c38a6-e709-454e-984e-034ec6402558-tls-assets\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:15.205601 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.205497 5332 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:15.205601 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.205506 5332 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:15.205601 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.205514 5332 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-metrics-client-certs\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:15.205601 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.205522 5332 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-config\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:15.205601 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.205530 5332 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-db\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:15.205601 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.205538 5332 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/428c38a6-e709-454e-984e-034ec6402558-config-out\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:15.205601 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.205546 5332 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/428c38a6-e709-454e-984e-034ec6402558-secret-kube-rbac-proxy\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:15.205601 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.205555 5332 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-configmap-metrics-client-ca\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:15.205601 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.205564 5332 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/428c38a6-e709-454e-984e-034ec6402558-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:15.810087 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.810047 5332 generic.go:356] "Generic (PLEG): container finished" podID="428c38a6-e709-454e-984e-034ec6402558" containerID="1786ebf25d038173d1739097b9d96e19f9a9d253b7bb6e1526ad44d93a6ca979" exitCode=0 Nov 03 22:52:15.810445 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.810138 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:15.810445 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.810136 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"428c38a6-e709-454e-984e-034ec6402558","Type":"ContainerDied","Data":"1786ebf25d038173d1739097b9d96e19f9a9d253b7bb6e1526ad44d93a6ca979"} Nov 03 22:52:15.810445 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.810294 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"428c38a6-e709-454e-984e-034ec6402558","Type":"ContainerDied","Data":"474079cb9525c11eba9d6092133949e08ddaba71b9769a6c9d9ced125ada6548"} Nov 03 22:52:15.810445 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.810344 5332 scope.go:122] "RemoveContainer" containerID="c25382547ae6fb1f800371ed9f280f469c7961f27af2bde37c4fabd6e5856904" Nov 03 22:52:15.818244 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.818227 5332 scope.go:122] "RemoveContainer" containerID="37195f6b5c44c2113697628ad553df4d03cf97ceb7843208923fd7726f570550" Nov 03 22:52:15.824795 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.824775 5332 scope.go:122] "RemoveContainer" containerID="846b97ce65c132d0af950ebbca8a77a117512df15bfcd2e050e539b52ccac48f" Nov 03 22:52:15.828828 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.828808 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 03 22:52:15.832912 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.832411 5332 scope.go:122] "RemoveContainer" containerID="8cd8e688a3c29d366392c21ec554ddcb3c7099251bd256da69deb425fd56abe9" Nov 03 22:52:15.833181 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.833158 5332 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 03 22:52:15.839137 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.839114 5332 scope.go:122] "RemoveContainer" containerID="eb4b709a8973dfd5c9284fe44deade307c055fbe4dd61a5bcce9eea797d04249" Nov 03 22:52:15.845223 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.845207 5332 scope.go:122] "RemoveContainer" containerID="1786ebf25d038173d1739097b9d96e19f9a9d253b7bb6e1526ad44d93a6ca979" Nov 03 22:52:15.852665 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.852648 5332 scope.go:122] "RemoveContainer" containerID="7131d83439dd85a2b4a9d25fd4e8a04596f95bc0230038c8b4f64657602bbfff" Nov 03 22:52:15.857639 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.857580 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 03 22:52:15.857926 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.857906 5332 cpu_manager.go:414] "containerMap: removing container" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="kube-rbac-proxy-thanos" Nov 03 22:52:15.858063 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.857927 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="kube-rbac-proxy-thanos" Nov 03 22:52:15.858063 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.857942 5332 cpu_manager.go:414] "containerMap: removing container" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="init-config-reloader" Nov 03 22:52:15.858063 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.857950 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="init-config-reloader" Nov 03 22:52:15.858063 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.857975 5332 cpu_manager.go:414] "containerMap: removing container" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="kube-rbac-proxy" Nov 03 22:52:15.858063 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.857981 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="kube-rbac-proxy" Nov 03 22:52:15.858063 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.857991 5332 cpu_manager.go:414] "containerMap: removing container" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="config-reloader" Nov 03 22:52:15.858063 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.857997 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="config-reloader" Nov 03 22:52:15.858063 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.858008 5332 cpu_manager.go:414] "containerMap: removing container" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="kube-rbac-proxy-web" Nov 03 22:52:15.858063 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.858015 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="kube-rbac-proxy-web" Nov 03 22:52:15.858063 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.858027 5332 cpu_manager.go:414] "containerMap: removing container" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="thanos-sidecar" Nov 03 22:52:15.858063 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.858033 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="thanos-sidecar" Nov 03 22:52:15.858063 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.858045 5332 cpu_manager.go:414] "containerMap: removing container" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="prometheus" Nov 03 22:52:15.858063 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.858051 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="prometheus" Nov 03 22:52:15.858506 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.858109 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="prometheus" Nov 03 22:52:15.858506 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.858121 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="kube-rbac-proxy-thanos" Nov 03 22:52:15.858506 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.858131 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="kube-rbac-proxy" Nov 03 22:52:15.858506 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.858139 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="config-reloader" Nov 03 22:52:15.858506 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.858147 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="kube-rbac-proxy-web" Nov 03 22:52:15.858506 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.858155 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="428c38a6-e709-454e-984e-034ec6402558" containerName="thanos-sidecar" Nov 03 22:52:15.859987 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.859969 5332 scope.go:122] "RemoveContainer" containerID="c25382547ae6fb1f800371ed9f280f469c7961f27af2bde37c4fabd6e5856904" Nov 03 22:52:15.860272 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:52:15.860249 5332 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c25382547ae6fb1f800371ed9f280f469c7961f27af2bde37c4fabd6e5856904\": container with ID starting with c25382547ae6fb1f800371ed9f280f469c7961f27af2bde37c4fabd6e5856904 not found: ID does not exist" containerID="c25382547ae6fb1f800371ed9f280f469c7961f27af2bde37c4fabd6e5856904" Nov 03 22:52:15.860347 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.860284 5332 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c25382547ae6fb1f800371ed9f280f469c7961f27af2bde37c4fabd6e5856904"} err="failed to get container status \"c25382547ae6fb1f800371ed9f280f469c7961f27af2bde37c4fabd6e5856904\": rpc error: code = NotFound desc = could not find container \"c25382547ae6fb1f800371ed9f280f469c7961f27af2bde37c4fabd6e5856904\": container with ID starting with c25382547ae6fb1f800371ed9f280f469c7961f27af2bde37c4fabd6e5856904 not found: ID does not exist" Nov 03 22:52:15.860347 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.860326 5332 scope.go:122] "RemoveContainer" containerID="37195f6b5c44c2113697628ad553df4d03cf97ceb7843208923fd7726f570550" Nov 03 22:52:15.860638 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:52:15.860620 5332 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37195f6b5c44c2113697628ad553df4d03cf97ceb7843208923fd7726f570550\": container with ID starting with 37195f6b5c44c2113697628ad553df4d03cf97ceb7843208923fd7726f570550 not found: ID does not exist" containerID="37195f6b5c44c2113697628ad553df4d03cf97ceb7843208923fd7726f570550" Nov 03 22:52:15.860684 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.860645 5332 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37195f6b5c44c2113697628ad553df4d03cf97ceb7843208923fd7726f570550"} err="failed to get container status \"37195f6b5c44c2113697628ad553df4d03cf97ceb7843208923fd7726f570550\": rpc error: code = NotFound desc = could not find container \"37195f6b5c44c2113697628ad553df4d03cf97ceb7843208923fd7726f570550\": container with ID starting with 37195f6b5c44c2113697628ad553df4d03cf97ceb7843208923fd7726f570550 not found: ID does not exist" Nov 03 22:52:15.860684 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.860661 5332 scope.go:122] "RemoveContainer" containerID="846b97ce65c132d0af950ebbca8a77a117512df15bfcd2e050e539b52ccac48f" Nov 03 22:52:15.860904 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:52:15.860885 5332 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"846b97ce65c132d0af950ebbca8a77a117512df15bfcd2e050e539b52ccac48f\": container with ID starting with 846b97ce65c132d0af950ebbca8a77a117512df15bfcd2e050e539b52ccac48f not found: ID does not exist" containerID="846b97ce65c132d0af950ebbca8a77a117512df15bfcd2e050e539b52ccac48f" Nov 03 22:52:15.860970 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.860914 5332 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"846b97ce65c132d0af950ebbca8a77a117512df15bfcd2e050e539b52ccac48f"} err="failed to get container status \"846b97ce65c132d0af950ebbca8a77a117512df15bfcd2e050e539b52ccac48f\": rpc error: code = NotFound desc = could not find container \"846b97ce65c132d0af950ebbca8a77a117512df15bfcd2e050e539b52ccac48f\": container with ID starting with 846b97ce65c132d0af950ebbca8a77a117512df15bfcd2e050e539b52ccac48f not found: ID does not exist" Nov 03 22:52:15.860970 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.860935 5332 scope.go:122] "RemoveContainer" containerID="8cd8e688a3c29d366392c21ec554ddcb3c7099251bd256da69deb425fd56abe9" Nov 03 22:52:15.861175 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:52:15.861159 5332 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cd8e688a3c29d366392c21ec554ddcb3c7099251bd256da69deb425fd56abe9\": container with ID starting with 8cd8e688a3c29d366392c21ec554ddcb3c7099251bd256da69deb425fd56abe9 not found: ID does not exist" containerID="8cd8e688a3c29d366392c21ec554ddcb3c7099251bd256da69deb425fd56abe9" Nov 03 22:52:15.861212 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.861181 5332 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cd8e688a3c29d366392c21ec554ddcb3c7099251bd256da69deb425fd56abe9"} err="failed to get container status \"8cd8e688a3c29d366392c21ec554ddcb3c7099251bd256da69deb425fd56abe9\": rpc error: code = NotFound desc = could not find container \"8cd8e688a3c29d366392c21ec554ddcb3c7099251bd256da69deb425fd56abe9\": container with ID starting with 8cd8e688a3c29d366392c21ec554ddcb3c7099251bd256da69deb425fd56abe9 not found: ID does not exist" Nov 03 22:52:15.861212 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.861194 5332 scope.go:122] "RemoveContainer" containerID="eb4b709a8973dfd5c9284fe44deade307c055fbe4dd61a5bcce9eea797d04249" Nov 03 22:52:15.861422 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:52:15.861407 5332 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb4b709a8973dfd5c9284fe44deade307c055fbe4dd61a5bcce9eea797d04249\": container with ID starting with eb4b709a8973dfd5c9284fe44deade307c055fbe4dd61a5bcce9eea797d04249 not found: ID does not exist" containerID="eb4b709a8973dfd5c9284fe44deade307c055fbe4dd61a5bcce9eea797d04249" Nov 03 22:52:15.861503 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.861426 5332 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb4b709a8973dfd5c9284fe44deade307c055fbe4dd61a5bcce9eea797d04249"} err="failed to get container status \"eb4b709a8973dfd5c9284fe44deade307c055fbe4dd61a5bcce9eea797d04249\": rpc error: code = NotFound desc = could not find container \"eb4b709a8973dfd5c9284fe44deade307c055fbe4dd61a5bcce9eea797d04249\": container with ID starting with eb4b709a8973dfd5c9284fe44deade307c055fbe4dd61a5bcce9eea797d04249 not found: ID does not exist" Nov 03 22:52:15.861503 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.861439 5332 scope.go:122] "RemoveContainer" containerID="1786ebf25d038173d1739097b9d96e19f9a9d253b7bb6e1526ad44d93a6ca979" Nov 03 22:52:15.861734 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:52:15.861719 5332 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1786ebf25d038173d1739097b9d96e19f9a9d253b7bb6e1526ad44d93a6ca979\": container with ID starting with 1786ebf25d038173d1739097b9d96e19f9a9d253b7bb6e1526ad44d93a6ca979 not found: ID does not exist" containerID="1786ebf25d038173d1739097b9d96e19f9a9d253b7bb6e1526ad44d93a6ca979" Nov 03 22:52:15.861776 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.861738 5332 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1786ebf25d038173d1739097b9d96e19f9a9d253b7bb6e1526ad44d93a6ca979"} err="failed to get container status \"1786ebf25d038173d1739097b9d96e19f9a9d253b7bb6e1526ad44d93a6ca979\": rpc error: code = NotFound desc = could not find container \"1786ebf25d038173d1739097b9d96e19f9a9d253b7bb6e1526ad44d93a6ca979\": container with ID starting with 1786ebf25d038173d1739097b9d96e19f9a9d253b7bb6e1526ad44d93a6ca979 not found: ID does not exist" Nov 03 22:52:15.861776 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.861752 5332 scope.go:122] "RemoveContainer" containerID="7131d83439dd85a2b4a9d25fd4e8a04596f95bc0230038c8b4f64657602bbfff" Nov 03 22:52:15.861910 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.861895 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:15.861985 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:52:15.861968 5332 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7131d83439dd85a2b4a9d25fd4e8a04596f95bc0230038c8b4f64657602bbfff\": container with ID starting with 7131d83439dd85a2b4a9d25fd4e8a04596f95bc0230038c8b4f64657602bbfff not found: ID does not exist" containerID="7131d83439dd85a2b4a9d25fd4e8a04596f95bc0230038c8b4f64657602bbfff" Nov 03 22:52:15.862028 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.861991 5332 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7131d83439dd85a2b4a9d25fd4e8a04596f95bc0230038c8b4f64657602bbfff"} err="failed to get container status \"7131d83439dd85a2b4a9d25fd4e8a04596f95bc0230038c8b4f64657602bbfff\": rpc error: code = NotFound desc = could not find container \"7131d83439dd85a2b4a9d25fd4e8a04596f95bc0230038c8b4f64657602bbfff\": container with ID starting with 7131d83439dd85a2b4a9d25fd4e8a04596f95bc0230038c8b4f64657602bbfff not found: ID does not exist" Nov 03 22:52:15.866677 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.865970 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Nov 03 22:52:15.866677 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.865993 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Nov 03 22:52:15.866677 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.866040 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Nov 03 22:52:15.866677 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.866068 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Nov 03 22:52:15.866677 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.866079 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Nov 03 22:52:15.866677 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.866204 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Nov 03 22:52:15.866677 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.866265 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xr88k\"" Nov 03 22:52:15.866677 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.866320 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Nov 03 22:52:15.866677 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.866361 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Nov 03 22:52:15.866677 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.866415 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Nov 03 22:52:15.866677 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.866417 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Nov 03 22:52:15.866677 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.866511 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1c5i59msea8be\"" Nov 03 22:52:15.866677 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.866611 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Nov 03 22:52:15.866677 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.866631 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Nov 03 22:52:15.866677 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.866646 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Nov 03 22:52:15.868309 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.868286 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Nov 03 22:52:15.868398 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.868377 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Nov 03 22:52:15.882558 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:15.882531 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 03 22:52:16.010707 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.010677 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.010707 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.010710 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-web-config\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.010933 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.010729 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsqpd\" (UniqueName: \"kubernetes.io/projected/c1c2bfa9-24cc-4052-a655-2a97131d5503-kube-api-access-tsqpd\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.010933 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.010748 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c1c2bfa9-24cc-4052-a655-2a97131d5503-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.010933 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.010844 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.010933 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.010894 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.010933 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.010915 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.010933 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.010931 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c1c2bfa9-24cc-4052-a655-2a97131d5503-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.011136 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.011010 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.011136 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.011038 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c1c2bfa9-24cc-4052-a655-2a97131d5503-config-out\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.011136 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.011058 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.011136 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.011074 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.011136 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.011110 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.011354 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.011152 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-config\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.011354 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.011185 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.011354 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.011237 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.011354 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.011266 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.011354 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.011281 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.011354 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.011327 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.011564 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.011358 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.112157 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112081 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.112157 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112116 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.112157 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112140 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.112157 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112159 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.112489 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112298 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.112489 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112342 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-web-config\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.112489 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112385 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsqpd\" (UniqueName: \"kubernetes.io/projected/c1c2bfa9-24cc-4052-a655-2a97131d5503-kube-api-access-tsqpd\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.112489 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112421 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c1c2bfa9-24cc-4052-a655-2a97131d5503-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.112489 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112446 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.112753 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112502 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.112753 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112527 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.112753 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112537 5332 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 03 22:52:16.112753 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112550 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c1c2bfa9-24cc-4052-a655-2a97131d5503-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.112753 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112584 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.112753 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112613 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c1c2bfa9-24cc-4052-a655-2a97131d5503-config-out\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.112753 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112645 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.112753 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112673 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.112753 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112699 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.112753 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112722 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-config\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.112753 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112741 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.113272 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.112800 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.113272 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.113253 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.113643 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.113561 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.114479 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.114141 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.115692 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.115663 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c1c2bfa9-24cc-4052-a655-2a97131d5503-config-out\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.115797 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.115702 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c1c2bfa9-24cc-4052-a655-2a97131d5503-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.115859 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.115841 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.115916 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.115859 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.116154 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.116005 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.116437 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.116296 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.117104 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.116588 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c1c2bfa9-24cc-4052-a655-2a97131d5503-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.117104 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.117042 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.117223 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.117199 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.117310 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.117286 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.117534 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.117493 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c1c2bfa9-24cc-4052-a655-2a97131d5503-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.117910 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.117892 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-config\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.118652 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.118590 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.118868 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.118770 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.118868 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.118773 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.119264 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.119243 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c1c2bfa9-24cc-4052-a655-2a97131d5503-web-config\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.120325 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.120298 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsqpd\" (UniqueName: \"kubernetes.io/projected/c1c2bfa9-24cc-4052-a655-2a97131d5503-kube-api-access-tsqpd\") pod \"prometheus-k8s-0\" (UID: \"c1c2bfa9-24cc-4052-a655-2a97131d5503\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.178183 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.178139 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:16.457860 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.457833 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 03 22:52:16.461188 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:52:16.461160 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1c2bfa9_24cc_4052_a655_2a97131d5503.slice/crio-bee6e15666be3a9b7778d403411708b66438186d55fbe64e1a03e47430f8ffcc WatchSource:0}: Error finding container bee6e15666be3a9b7778d403411708b66438186d55fbe64e1a03e47430f8ffcc: Status 404 returned error can't find the container with id bee6e15666be3a9b7778d403411708b66438186d55fbe64e1a03e47430f8ffcc Nov 03 22:52:16.814851 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.814756 5332 generic.go:356] "Generic (PLEG): container finished" podID="c1c2bfa9-24cc-4052-a655-2a97131d5503" containerID="18d7e9596a8d81f6b0a6695b5e5ff395ed880e94c776cbfb2343121aab8524e2" exitCode=0 Nov 03 22:52:16.814851 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.814838 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c1c2bfa9-24cc-4052-a655-2a97131d5503","Type":"ContainerDied","Data":"18d7e9596a8d81f6b0a6695b5e5ff395ed880e94c776cbfb2343121aab8524e2"} Nov 03 22:52:16.815344 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:16.814925 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c1c2bfa9-24cc-4052-a655-2a97131d5503","Type":"ContainerStarted","Data":"bee6e15666be3a9b7778d403411708b66438186d55fbe64e1a03e47430f8ffcc"} Nov 03 22:52:17.596105 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:17.596071 5332 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="428c38a6-e709-454e-984e-034ec6402558" path="/var/lib/kubelet/pods/428c38a6-e709-454e-984e-034ec6402558/volumes" Nov 03 22:52:17.773416 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:17.773380 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:17.822882 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:17.822850 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c1c2bfa9-24cc-4052-a655-2a97131d5503","Type":"ContainerStarted","Data":"81a74a0e4b8906c81c1e24927577311ef557e3829b129ffd9b4f89e0f4b3cf98"} Nov 03 22:52:17.823347 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:17.822907 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c1c2bfa9-24cc-4052-a655-2a97131d5503","Type":"ContainerStarted","Data":"3dfa93a665f67a84bd886f53a201b46f30c7863e787b560586cb59d6f1bccc83"} Nov 03 22:52:17.823347 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:17.822936 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c1c2bfa9-24cc-4052-a655-2a97131d5503","Type":"ContainerStarted","Data":"a3706dd5c107585ecfe529e0aebd0aa667e33700a36123b3dd08ceee5916bd4e"} Nov 03 22:52:17.823347 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:17.822959 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c1c2bfa9-24cc-4052-a655-2a97131d5503","Type":"ContainerStarted","Data":"969becd189a007d9b83a32532adb0b68d92644286d7762dcf2e55fa9002b6091"} Nov 03 22:52:17.823347 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:17.822982 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c1c2bfa9-24cc-4052-a655-2a97131d5503","Type":"ContainerStarted","Data":"43f20867de6e85fc4257019d74e881edc3b3cca94b6d89328140e4bd64dc2ee3"} Nov 03 22:52:17.823347 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:17.823003 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c1c2bfa9-24cc-4052-a655-2a97131d5503","Type":"ContainerStarted","Data":"e65c372b3b38f5ef20d4b91b564dfed77cb67334704f2203d7900f9de24659f4"} Nov 03 22:52:17.851141 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:17.851042 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.835182118 podStartE2EDuration="2.851027324s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.845206ms" isStatefulPod=false podCreationTimestamp="2026-11-03 22:52:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:52:17.849583573 +0000 UTC m=+44.379690741" watchObservedRunningTime="2026-11-03 22:52:17.851027324 +0000 UTC m=+44.381134486" Nov 03 22:52:18.380073 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:18.380028 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:18.491798 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:18.491767 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:19.710590 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:19.710553 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:21.179018 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:21.178985 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:26.410727 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:26.410691 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:26.426739 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:26.426714 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:26.870798 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:26.870767 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 22:52:34.503095 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:34.503054 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:34.613505 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:34.613463 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:34.873929 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:34.873830 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:34.982525 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:34.982496 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:35.246657 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:35.246621 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:35.343509 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:35.343481 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:39.495524 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:52:39.495487 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 22:52:43.309940 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:43.309893 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:47.114700 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:47.114655 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:47.224114 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:47.224075 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:50.812752 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:50.812680 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:52.877287 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:52.877250 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:52.981979 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:52.981936 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:52:53.073247 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:52:53.073206 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:53:09.493958 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:53:09.493916 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 22:53:39.493046 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:53:39.492962 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 22:53:43.365296 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:53:43.365259 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:54:09.493013 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:54:09.492978 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 22:54:33.241541 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:33.241503 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:54:33.382976 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:33.382937 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:54:33.519391 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:33.519288 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:54:34.670330 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:34.670294 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:54:34.780289 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:34.780247 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:54:35.222602 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.222569 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5"] Nov 03 22:54:35.224857 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.224833 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5" Nov 03 22:54:35.228854 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.228832 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-zt6s2\"" Nov 03 22:54:35.229002 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.228853 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Nov 03 22:54:35.229002 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.228869 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Nov 03 22:54:35.233568 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.233537 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5"] Nov 03 22:54:35.316904 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.316872 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl"] Nov 03 22:54:35.319117 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.319095 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl" Nov 03 22:54:35.321611 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.321589 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-vk9m6\"" Nov 03 22:54:35.326672 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.326655 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl"] Nov 03 22:54:35.333507 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.333483 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mgrf\" (UniqueName: \"kubernetes.io/projected/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-kube-api-access-5mgrf\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5\" (UID: \"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5" Nov 03 22:54:35.333605 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.333556 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5\" (UID: \"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5" Nov 03 22:54:35.333605 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.333584 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5\" (UID: \"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5" Nov 03 22:54:35.419039 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.418999 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2"] Nov 03 22:54:35.421192 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.421173 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2" Nov 03 22:54:35.429271 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.429248 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2"] Nov 03 22:54:35.429393 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.429324 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-ckwfz\"" Nov 03 22:54:35.434336 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.434318 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5\" (UID: \"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5" Nov 03 22:54:35.434438 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.434355 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5\" (UID: \"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5" Nov 03 22:54:35.434438 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.434382 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e53eb93-3f10-41c5-8d25-08ed8e158e77-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl\" (UID: \"0e53eb93-3f10-41c5-8d25-08ed8e158e77\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl" Nov 03 22:54:35.434438 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.434417 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2trnd\" (UniqueName: \"kubernetes.io/projected/0e53eb93-3f10-41c5-8d25-08ed8e158e77-kube-api-access-2trnd\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl\" (UID: \"0e53eb93-3f10-41c5-8d25-08ed8e158e77\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl" Nov 03 22:54:35.434708 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.434438 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mgrf\" (UniqueName: \"kubernetes.io/projected/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-kube-api-access-5mgrf\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5\" (UID: \"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5" Nov 03 22:54:35.434708 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.434549 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e53eb93-3f10-41c5-8d25-08ed8e158e77-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl\" (UID: \"0e53eb93-3f10-41c5-8d25-08ed8e158e77\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl" Nov 03 22:54:35.434817 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.434769 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5\" (UID: \"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5" Nov 03 22:54:35.434853 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.434814 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5\" (UID: \"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5" Nov 03 22:54:35.441480 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.441439 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mgrf\" (UniqueName: \"kubernetes.io/projected/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-kube-api-access-5mgrf\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5\" (UID: \"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5" Nov 03 22:54:35.519669 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.519593 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn"] Nov 03 22:54:35.521829 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.521813 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn" Nov 03 22:54:35.524439 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.524417 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-wjxbh\"" Nov 03 22:54:35.530065 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.530045 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn"] Nov 03 22:54:35.534968 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.534946 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2trnd\" (UniqueName: \"kubernetes.io/projected/0e53eb93-3f10-41c5-8d25-08ed8e158e77-kube-api-access-2trnd\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl\" (UID: \"0e53eb93-3f10-41c5-8d25-08ed8e158e77\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl" Nov 03 22:54:35.535067 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.534985 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e53eb93-3f10-41c5-8d25-08ed8e158e77-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl\" (UID: \"0e53eb93-3f10-41c5-8d25-08ed8e158e77\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl" Nov 03 22:54:35.535067 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.535011 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12d13784-79f6-4629-9da2-ac94037cd337-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2\" (UID: \"12d13784-79f6-4629-9da2-ac94037cd337\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2" Nov 03 22:54:35.535067 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.535036 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dvft\" (UniqueName: \"kubernetes.io/projected/12d13784-79f6-4629-9da2-ac94037cd337-kube-api-access-5dvft\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2\" (UID: \"12d13784-79f6-4629-9da2-ac94037cd337\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2" Nov 03 22:54:35.535067 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.535054 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12d13784-79f6-4629-9da2-ac94037cd337-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2\" (UID: \"12d13784-79f6-4629-9da2-ac94037cd337\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2" Nov 03 22:54:35.535225 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.535074 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e53eb93-3f10-41c5-8d25-08ed8e158e77-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl\" (UID: \"0e53eb93-3f10-41c5-8d25-08ed8e158e77\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl" Nov 03 22:54:35.535381 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.535367 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e53eb93-3f10-41c5-8d25-08ed8e158e77-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl\" (UID: \"0e53eb93-3f10-41c5-8d25-08ed8e158e77\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl" Nov 03 22:54:35.535417 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.535368 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e53eb93-3f10-41c5-8d25-08ed8e158e77-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl\" (UID: \"0e53eb93-3f10-41c5-8d25-08ed8e158e77\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl" Nov 03 22:54:35.538042 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.538020 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5" Nov 03 22:54:35.543723 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.543697 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2trnd\" (UniqueName: \"kubernetes.io/projected/0e53eb93-3f10-41c5-8d25-08ed8e158e77-kube-api-access-2trnd\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl\" (UID: \"0e53eb93-3f10-41c5-8d25-08ed8e158e77\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl" Nov 03 22:54:35.632324 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.632288 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl" Nov 03 22:54:35.635589 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.635567 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12d13784-79f6-4629-9da2-ac94037cd337-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2\" (UID: \"12d13784-79f6-4629-9da2-ac94037cd337\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2" Nov 03 22:54:35.635683 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.635610 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn\" (UID: \"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn" Nov 03 22:54:35.635683 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.635643 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fk95\" (UniqueName: \"kubernetes.io/projected/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-kube-api-access-2fk95\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn\" (UID: \"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn" Nov 03 22:54:35.635683 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.635677 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn\" (UID: \"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn" Nov 03 22:54:35.635820 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.635707 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dvft\" (UniqueName: \"kubernetes.io/projected/12d13784-79f6-4629-9da2-ac94037cd337-kube-api-access-5dvft\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2\" (UID: \"12d13784-79f6-4629-9da2-ac94037cd337\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2" Nov 03 22:54:35.635908 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.635887 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12d13784-79f6-4629-9da2-ac94037cd337-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2\" (UID: \"12d13784-79f6-4629-9da2-ac94037cd337\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2" Nov 03 22:54:35.635955 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.635911 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12d13784-79f6-4629-9da2-ac94037cd337-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2\" (UID: \"12d13784-79f6-4629-9da2-ac94037cd337\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2" Nov 03 22:54:35.636138 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.636122 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12d13784-79f6-4629-9da2-ac94037cd337-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2\" (UID: \"12d13784-79f6-4629-9da2-ac94037cd337\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2" Nov 03 22:54:35.644553 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.644509 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:54:35.645236 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.645213 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dvft\" (UniqueName: \"kubernetes.io/projected/12d13784-79f6-4629-9da2-ac94037cd337-kube-api-access-5dvft\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2\" (UID: \"12d13784-79f6-4629-9da2-ac94037cd337\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2" Nov 03 22:54:35.734215 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.734182 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2" Nov 03 22:54:35.736516 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.736492 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn\" (UID: \"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn" Nov 03 22:54:35.736571 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.736532 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fk95\" (UniqueName: \"kubernetes.io/projected/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-kube-api-access-2fk95\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn\" (UID: \"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn" Nov 03 22:54:35.736571 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.736563 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn\" (UID: \"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn" Nov 03 22:54:35.736912 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.736876 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn\" (UID: \"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn" Nov 03 22:54:35.736954 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.736920 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn\" (UID: \"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn" Nov 03 22:54:35.743857 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.743789 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fk95\" (UniqueName: \"kubernetes.io/projected/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-kube-api-access-2fk95\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn\" (UID: \"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn" Nov 03 22:54:35.809613 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.809584 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5"] Nov 03 22:54:35.812051 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:54:35.812027 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe7f84dc_9566_49a4_93bd_6ad0edb0cec0.slice/crio-b7795383d9a79417c6f5ddfa220f0f7f0e22f88f9a8eca6429bc949d6cb097a6 WatchSource:0}: Error finding container b7795383d9a79417c6f5ddfa220f0f7f0e22f88f9a8eca6429bc949d6cb097a6: Status 404 returned error can't find the container with id b7795383d9a79417c6f5ddfa220f0f7f0e22f88f9a8eca6429bc949d6cb097a6 Nov 03 22:54:35.835183 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.835165 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn" Nov 03 22:54:35.899579 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:35.899427 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl"] Nov 03 22:54:35.902117 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:54:35.902085 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e53eb93_3f10_41c5_8d25_08ed8e158e77.slice/crio-37b75212d532cdb2bfcec3059f271d2395c78d7f0f116a182dea55f996e1b242 WatchSource:0}: Error finding container 37b75212d532cdb2bfcec3059f271d2395c78d7f0f116a182dea55f996e1b242: Status 404 returned error can't find the container with id 37b75212d532cdb2bfcec3059f271d2395c78d7f0f116a182dea55f996e1b242 Nov 03 22:54:36.000175 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:36.000142 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2"] Nov 03 22:54:36.002936 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:54:36.002912 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12d13784_79f6_4629_9da2_ac94037cd337.slice/crio-99fbc68812f1e5265df091d1eb15acc1ad6ce779eb755c8ff4186d7a628d6b82 WatchSource:0}: Error finding container 99fbc68812f1e5265df091d1eb15acc1ad6ce779eb755c8ff4186d7a628d6b82: Status 404 returned error can't find the container with id 99fbc68812f1e5265df091d1eb15acc1ad6ce779eb755c8ff4186d7a628d6b82 Nov 03 22:54:36.098563 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:36.098468 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn"] Nov 03 22:54:36.101702 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:54:36.101670 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa57a7ff_c2c8_45a1_b8b6_564c8f522b59.slice/crio-6ffc6f4608c99f051ad436c9a9e0e900f7dba3b2b8f07f9165e7a68859195c33 WatchSource:0}: Error finding container 6ffc6f4608c99f051ad436c9a9e0e900f7dba3b2b8f07f9165e7a68859195c33: Status 404 returned error can't find the container with id 6ffc6f4608c99f051ad436c9a9e0e900f7dba3b2b8f07f9165e7a68859195c33 Nov 03 22:54:36.286609 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:36.286571 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2" event={"ID":"12d13784-79f6-4629-9da2-ac94037cd337","Type":"ContainerStarted","Data":"99fbc68812f1e5265df091d1eb15acc1ad6ce779eb755c8ff4186d7a628d6b82"} Nov 03 22:54:36.287654 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:36.287631 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn" event={"ID":"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59","Type":"ContainerStarted","Data":"6ffc6f4608c99f051ad436c9a9e0e900f7dba3b2b8f07f9165e7a68859195c33"} Nov 03 22:54:36.288813 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:36.288791 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5" event={"ID":"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0","Type":"ContainerStarted","Data":"b7795383d9a79417c6f5ddfa220f0f7f0e22f88f9a8eca6429bc949d6cb097a6"} Nov 03 22:54:36.289898 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:36.289879 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl" event={"ID":"0e53eb93-3f10-41c5-8d25-08ed8e158e77","Type":"ContainerStarted","Data":"37b75212d532cdb2bfcec3059f271d2395c78d7f0f116a182dea55f996e1b242"} Nov 03 22:54:37.709909 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:37.709868 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x"] Nov 03 22:54:37.712315 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:37.712291 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x" Nov 03 22:54:37.716163 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:37.716137 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-25bnq\"" Nov 03 22:54:37.719322 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:37.719278 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x"] Nov 03 22:54:37.855473 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:37.855418 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7td5\" (UniqueName: \"kubernetes.io/projected/d091f0a9-af0a-409f-8166-433fc10e7666-kube-api-access-h7td5\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x\" (UID: \"d091f0a9-af0a-409f-8166-433fc10e7666\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x" Nov 03 22:54:37.855473 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:37.855498 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d091f0a9-af0a-409f-8166-433fc10e7666-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x\" (UID: \"d091f0a9-af0a-409f-8166-433fc10e7666\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x" Nov 03 22:54:37.855473 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:37.855536 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d091f0a9-af0a-409f-8166-433fc10e7666-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x\" (UID: \"d091f0a9-af0a-409f-8166-433fc10e7666\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x" Nov 03 22:54:37.956708 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:37.956666 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d091f0a9-af0a-409f-8166-433fc10e7666-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x\" (UID: \"d091f0a9-af0a-409f-8166-433fc10e7666\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x" Nov 03 22:54:37.956708 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:37.956737 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7td5\" (UniqueName: \"kubernetes.io/projected/d091f0a9-af0a-409f-8166-433fc10e7666-kube-api-access-h7td5\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x\" (UID: \"d091f0a9-af0a-409f-8166-433fc10e7666\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x" Nov 03 22:54:37.957007 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:37.956784 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d091f0a9-af0a-409f-8166-433fc10e7666-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x\" (UID: \"d091f0a9-af0a-409f-8166-433fc10e7666\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x" Nov 03 22:54:37.957211 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:37.957189 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d091f0a9-af0a-409f-8166-433fc10e7666-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x\" (UID: \"d091f0a9-af0a-409f-8166-433fc10e7666\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x" Nov 03 22:54:37.957886 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:37.957828 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d091f0a9-af0a-409f-8166-433fc10e7666-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x\" (UID: \"d091f0a9-af0a-409f-8166-433fc10e7666\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x" Nov 03 22:54:37.974225 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:37.974151 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7td5\" (UniqueName: \"kubernetes.io/projected/d091f0a9-af0a-409f-8166-433fc10e7666-kube-api-access-h7td5\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x\" (UID: \"d091f0a9-af0a-409f-8166-433fc10e7666\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x" Nov 03 22:54:38.031009 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:38.030771 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x" Nov 03 22:54:38.031185 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:38.031166 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw"] Nov 03 22:54:38.033720 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:38.033698 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw" Nov 03 22:54:38.039624 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:38.039590 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-6nrr9\"" Nov 03 22:54:38.041776 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:38.041220 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw"] Nov 03 22:54:38.159063 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:38.159030 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64d291b4-6b66-42f7-9401-057d2fa30955-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw\" (UID: \"64d291b4-6b66-42f7-9401-057d2fa30955\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw" Nov 03 22:54:38.159219 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:38.159072 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7psb\" (UniqueName: \"kubernetes.io/projected/64d291b4-6b66-42f7-9401-057d2fa30955-kube-api-access-n7psb\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw\" (UID: \"64d291b4-6b66-42f7-9401-057d2fa30955\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw" Nov 03 22:54:38.159219 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:38.159101 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64d291b4-6b66-42f7-9401-057d2fa30955-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw\" (UID: \"64d291b4-6b66-42f7-9401-057d2fa30955\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw" Nov 03 22:54:38.260410 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:38.260314 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64d291b4-6b66-42f7-9401-057d2fa30955-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw\" (UID: \"64d291b4-6b66-42f7-9401-057d2fa30955\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw" Nov 03 22:54:38.260410 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:38.260367 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7psb\" (UniqueName: \"kubernetes.io/projected/64d291b4-6b66-42f7-9401-057d2fa30955-kube-api-access-n7psb\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw\" (UID: \"64d291b4-6b66-42f7-9401-057d2fa30955\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw" Nov 03 22:54:38.260410 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:38.260396 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64d291b4-6b66-42f7-9401-057d2fa30955-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw\" (UID: \"64d291b4-6b66-42f7-9401-057d2fa30955\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw" Nov 03 22:54:38.260959 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:38.260890 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64d291b4-6b66-42f7-9401-057d2fa30955-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw\" (UID: \"64d291b4-6b66-42f7-9401-057d2fa30955\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw" Nov 03 22:54:38.260959 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:38.260898 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64d291b4-6b66-42f7-9401-057d2fa30955-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw\" (UID: \"64d291b4-6b66-42f7-9401-057d2fa30955\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw" Nov 03 22:54:38.269028 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:38.268979 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7psb\" (UniqueName: \"kubernetes.io/projected/64d291b4-6b66-42f7-9401-057d2fa30955-kube-api-access-n7psb\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw\" (UID: \"64d291b4-6b66-42f7-9401-057d2fa30955\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw" Nov 03 22:54:38.330851 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:38.330767 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x"] Nov 03 22:54:38.372622 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:38.372332 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw" Nov 03 22:54:38.654259 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:38.654191 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw"] Nov 03 22:54:38.658847 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:54:38.658823 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64d291b4_6b66_42f7_9401_057d2fa30955.slice/crio-f053e5cbb00d953b7ddef8f5cc0841b538b5e68c3f490bdf812459805ebf9747 WatchSource:0}: Error finding container f053e5cbb00d953b7ddef8f5cc0841b538b5e68c3f490bdf812459805ebf9747: Status 404 returned error can't find the container with id f053e5cbb00d953b7ddef8f5cc0841b538b5e68c3f490bdf812459805ebf9747 Nov 03 22:54:39.311304 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:39.311214 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x" event={"ID":"d091f0a9-af0a-409f-8166-433fc10e7666","Type":"ContainerStarted","Data":"8a110ace1878f5f4309460f897ae2c0e7ea0c901440e2d78eb6925f09433910b"} Nov 03 22:54:39.313758 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:39.313730 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw" event={"ID":"64d291b4-6b66-42f7-9401-057d2fa30955","Type":"ContainerStarted","Data":"f053e5cbb00d953b7ddef8f5cc0841b538b5e68c3f490bdf812459805ebf9747"} Nov 03 22:54:39.515947 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:54:39.515872 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 22:54:43.419627 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:43.419414 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:54:46.361732 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:46.361690 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5" event={"ID":"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0","Type":"ContainerStarted","Data":"98cddda6bb8b51356957b684c016b6c2cfaa7a40345014b912a9f2cb45751923"} Nov 03 22:54:46.364001 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:46.363958 5332 generic.go:356] "Generic (PLEG): container finished" podID="64d291b4-6b66-42f7-9401-057d2fa30955" containerID="c7a8adc36c8e16cfd2254955134807c7d2652e2992e4e82e3af76d07d1e0db5a" exitCode=0 Nov 03 22:54:46.364147 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:46.364048 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw" event={"ID":"64d291b4-6b66-42f7-9401-057d2fa30955","Type":"ContainerDied","Data":"c7a8adc36c8e16cfd2254955134807c7d2652e2992e4e82e3af76d07d1e0db5a"} Nov 03 22:54:46.367165 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:46.367138 5332 generic.go:356] "Generic (PLEG): container finished" podID="0e53eb93-3f10-41c5-8d25-08ed8e158e77" containerID="4f4cf82e1e528567c1bac678e84b0ce3a5e21f24cef909d930598a4cb5d290c4" exitCode=0 Nov 03 22:54:46.367277 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:46.367213 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl" event={"ID":"0e53eb93-3f10-41c5-8d25-08ed8e158e77","Type":"ContainerDied","Data":"4f4cf82e1e528567c1bac678e84b0ce3a5e21f24cef909d930598a4cb5d290c4"} Nov 03 22:54:47.371762 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:47.371724 5332 generic.go:356] "Generic (PLEG): container finished" podID="aa57a7ff-c2c8-45a1-b8b6-564c8f522b59" containerID="17001af7ae1a134848e381ac5760af75b75f8ed407314eb9c88a2c126a88dec1" exitCode=0 Nov 03 22:54:47.372186 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:47.371815 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn" event={"ID":"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59","Type":"ContainerDied","Data":"17001af7ae1a134848e381ac5760af75b75f8ed407314eb9c88a2c126a88dec1"} Nov 03 22:54:47.373276 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:47.373250 5332 generic.go:356] "Generic (PLEG): container finished" podID="fe7f84dc-9566-49a4-93bd-6ad0edb0cec0" containerID="98cddda6bb8b51356957b684c016b6c2cfaa7a40345014b912a9f2cb45751923" exitCode=0 Nov 03 22:54:47.373440 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:47.373384 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5" event={"ID":"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0","Type":"ContainerDied","Data":"98cddda6bb8b51356957b684c016b6c2cfaa7a40345014b912a9f2cb45751923"} Nov 03 22:54:47.375278 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:47.375203 5332 generic.go:356] "Generic (PLEG): container finished" podID="12d13784-79f6-4629-9da2-ac94037cd337" containerID="b7e415701025a7b07ac8a4967dd7038d0c3845dff412a991a4e7eea4c5e2178e" exitCode=0 Nov 03 22:54:47.375278 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:47.375266 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2" event={"ID":"12d13784-79f6-4629-9da2-ac94037cd337","Type":"ContainerDied","Data":"b7e415701025a7b07ac8a4967dd7038d0c3845dff412a991a4e7eea4c5e2178e"} Nov 03 22:54:47.376912 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:47.376893 5332 generic.go:356] "Generic (PLEG): container finished" podID="d091f0a9-af0a-409f-8166-433fc10e7666" containerID="d4611ffdb17e989133a00cb1db22b19556af95191f34831e728d06d57a80dda8" exitCode=0 Nov 03 22:54:47.376988 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:47.376922 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x" event={"ID":"d091f0a9-af0a-409f-8166-433fc10e7666","Type":"ContainerDied","Data":"d4611ffdb17e989133a00cb1db22b19556af95191f34831e728d06d57a80dda8"} Nov 03 22:54:48.383109 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:48.383067 5332 generic.go:356] "Generic (PLEG): container finished" podID="aa57a7ff-c2c8-45a1-b8b6-564c8f522b59" containerID="70582cbc12d586a241e1dffe3f5bbb615d36ab72222822b1b3d30aad4aa42382" exitCode=0 Nov 03 22:54:48.383598 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:48.383167 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn" event={"ID":"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59","Type":"ContainerDied","Data":"70582cbc12d586a241e1dffe3f5bbb615d36ab72222822b1b3d30aad4aa42382"} Nov 03 22:54:48.385247 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:48.385224 5332 generic.go:356] "Generic (PLEG): container finished" podID="fe7f84dc-9566-49a4-93bd-6ad0edb0cec0" containerID="1758566fc143b0f7159ca9da3e06537506a418bea0822afc9f19bc4f6d39789f" exitCode=0 Nov 03 22:54:48.385328 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:48.385302 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5" event={"ID":"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0","Type":"ContainerDied","Data":"1758566fc143b0f7159ca9da3e06537506a418bea0822afc9f19bc4f6d39789f"} Nov 03 22:54:48.387495 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:48.387447 5332 generic.go:356] "Generic (PLEG): container finished" podID="0e53eb93-3f10-41c5-8d25-08ed8e158e77" containerID="7236e8802241c08b816d234d19b5cb87ef6d3e62e1ed3b3da33125ed52e444e4" exitCode=0 Nov 03 22:54:48.387586 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:48.387556 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl" event={"ID":"0e53eb93-3f10-41c5-8d25-08ed8e158e77","Type":"ContainerDied","Data":"7236e8802241c08b816d234d19b5cb87ef6d3e62e1ed3b3da33125ed52e444e4"} Nov 03 22:54:48.390404 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:48.390379 5332 generic.go:356] "Generic (PLEG): container finished" podID="d091f0a9-af0a-409f-8166-433fc10e7666" containerID="b2c01d737e08a0684ab4dc8726135e33fca9a0638d549e632768ad3b5baa5203" exitCode=0 Nov 03 22:54:48.390523 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:48.390429 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x" event={"ID":"d091f0a9-af0a-409f-8166-433fc10e7666","Type":"ContainerDied","Data":"b2c01d737e08a0684ab4dc8726135e33fca9a0638d549e632768ad3b5baa5203"} Nov 03 22:54:49.399540 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:49.399505 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw" event={"ID":"64d291b4-6b66-42f7-9401-057d2fa30955","Type":"ContainerStarted","Data":"d9aada91263b5f33b65c65377020e4ff398e97469a58029e2d186e232a2372cc"} Nov 03 22:54:49.405265 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:49.404303 5332 generic.go:356] "Generic (PLEG): container finished" podID="12d13784-79f6-4629-9da2-ac94037cd337" containerID="15c3c21bad83bfe56f9bfe009d4cb47b1e709aae9bedefba6b6ac6cc44c24fa7" exitCode=0 Nov 03 22:54:49.405265 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:49.404390 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2" event={"ID":"12d13784-79f6-4629-9da2-ac94037cd337","Type":"ContainerDied","Data":"15c3c21bad83bfe56f9bfe009d4cb47b1e709aae9bedefba6b6ac6cc44c24fa7"} Nov 03 22:54:50.412784 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:50.412593 5332 generic.go:356] "Generic (PLEG): container finished" podID="64d291b4-6b66-42f7-9401-057d2fa30955" containerID="d9aada91263b5f33b65c65377020e4ff398e97469a58029e2d186e232a2372cc" exitCode=0 Nov 03 22:54:50.412784 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:50.412715 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw" event={"ID":"64d291b4-6b66-42f7-9401-057d2fa30955","Type":"ContainerDied","Data":"d9aada91263b5f33b65c65377020e4ff398e97469a58029e2d186e232a2372cc"} Nov 03 22:54:53.270296 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.270188 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:54:53.369322 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.369286 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:54:53.500504 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.500471 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f"] Nov 03 22:54:53.503721 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.503677 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.513161 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.512500 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Nov 03 22:54:53.513161 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.512630 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Nov 03 22:54:53.513161 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.512747 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2wg6b\"" Nov 03 22:54:53.513161 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.512844 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Nov 03 22:54:53.518083 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.517965 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f"] Nov 03 22:54:53.572210 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.572138 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b"] Nov 03 22:54:53.574827 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.574801 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.578446 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.578418 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:54:53.587329 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.587299 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b"] Nov 03 22:54:53.606567 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.606043 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e954b77-1065-4605-9acc-4dadcc4c42ad-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.606567 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.606086 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e954b77-1065-4605-9acc-4dadcc4c42ad-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.606567 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.606113 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knfss\" (UniqueName: \"kubernetes.io/projected/0e954b77-1065-4605-9acc-4dadcc4c42ad-kube-api-access-knfss\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.606567 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.606143 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e954b77-1065-4605-9acc-4dadcc4c42ad-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.606567 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.606209 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e954b77-1065-4605-9acc-4dadcc4c42ad-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.606567 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.606264 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e954b77-1065-4605-9acc-4dadcc4c42ad-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.606567 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.606290 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e954b77-1065-4605-9acc-4dadcc4c42ad-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.606567 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.606319 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e954b77-1065-4605-9acc-4dadcc4c42ad-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.606567 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.606384 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e954b77-1065-4605-9acc-4dadcc4c42ad-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.611469 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.611430 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-6qbt2\"" Nov 03 22:54:53.687282 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.687159 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:54:53.708557 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.707431 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.708557 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.707502 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e954b77-1065-4605-9acc-4dadcc4c42ad-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.708557 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.707555 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e954b77-1065-4605-9acc-4dadcc4c42ad-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.708557 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.707582 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e954b77-1065-4605-9acc-4dadcc4c42ad-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.708557 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.707609 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knfss\" (UniqueName: \"kubernetes.io/projected/0e954b77-1065-4605-9acc-4dadcc4c42ad-kube-api-access-knfss\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.708557 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.707638 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e954b77-1065-4605-9acc-4dadcc4c42ad-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.708557 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.707669 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.708557 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.707704 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.708557 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.707732 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.708557 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.707770 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.708557 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.707809 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.708557 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.707840 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e954b77-1065-4605-9acc-4dadcc4c42ad-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.708557 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.707867 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.708557 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.707895 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.708557 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.707935 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e954b77-1065-4605-9acc-4dadcc4c42ad-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.708557 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.707960 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e954b77-1065-4605-9acc-4dadcc4c42ad-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.708557 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.707989 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e954b77-1065-4605-9acc-4dadcc4c42ad-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.708557 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.708021 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbtxh\" (UniqueName: \"kubernetes.io/projected/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-kube-api-access-pbtxh\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.710819 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.708797 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e954b77-1065-4605-9acc-4dadcc4c42ad-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.710819 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.709948 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e954b77-1065-4605-9acc-4dadcc4c42ad-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.710819 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.710392 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e954b77-1065-4605-9acc-4dadcc4c42ad-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.710819 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.710653 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e954b77-1065-4605-9acc-4dadcc4c42ad-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.710819 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.710659 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e954b77-1065-4605-9acc-4dadcc4c42ad-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.722708 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.722661 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knfss\" (UniqueName: \"kubernetes.io/projected/0e954b77-1065-4605-9acc-4dadcc4c42ad-kube-api-access-knfss\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.724909 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.723580 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e954b77-1065-4605-9acc-4dadcc4c42ad-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.729715 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.729663 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e954b77-1065-4605-9acc-4dadcc4c42ad-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.740968 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.740881 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e954b77-1065-4605-9acc-4dadcc4c42ad-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-jtf6f\" (UID: \"0e954b77-1065-4605-9acc-4dadcc4c42ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.791923 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.791781 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:54:53.809413 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.809380 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.809582 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.809429 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.809582 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.809479 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.809582 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.809522 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbtxh\" (UniqueName: \"kubernetes.io/projected/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-kube-api-access-pbtxh\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.809582 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.809563 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.809822 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.809600 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.809822 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.809628 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.809822 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.809655 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.809822 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.809690 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.810020 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.809952 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.810157 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.810062 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.810379 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.810343 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.810502 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.810405 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.810685 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.810633 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.815024 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.815004 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.821436 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.821391 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.823586 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.823526 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:54:53.830365 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.830334 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.832854 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.832769 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbtxh\" (UniqueName: \"kubernetes.io/projected/8f8d9e3c-1335-4726-aec4-b2c6fbc05b93-kube-api-access-pbtxh\") pod \"openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b\" (UID: \"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:53.897339 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:53.896594 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:54:54.149334 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:54.149126 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f"] Nov 03 22:54:54.209989 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:54.209955 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b"] Nov 03 22:54:54.443971 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:54.443884 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" event={"ID":"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93","Type":"ContainerStarted","Data":"48fc59749885052d8901e5ddbc1761c0aacfcd4de907977dbce879c9e911dfb9"} Nov 03 22:54:54.446337 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:54.446300 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" event={"ID":"0e954b77-1065-4605-9acc-4dadcc4c42ad","Type":"ContainerStarted","Data":"90ec06c3f056db81db0aeef5d206e631dab5ecbcbc8a8ea85e5d6cba626f721f"} Nov 03 22:54:56.247296 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:54:56.247261 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:02.247340 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:02.247300 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 22:55:02.247701 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:02.247427 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 22:55:02.247701 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:02.247503 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 22:55:02.507394 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:02.506482 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" event={"ID":"0e954b77-1065-4605-9acc-4dadcc4c42ad","Type":"ContainerStarted","Data":"88ce05b0021bbf441031609710462d654a097cf86035ff4aca15eceec5a94925"} Nov 03 22:55:02.524511 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:02.524374 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" podStartSLOduration=1.440383764 podStartE2EDuration="9.524320971s" totalImagesPullingTime="8.083937207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:55:02.524140797 +0000 UTC m=+209.054247966" watchObservedRunningTime="2026-11-03 22:55:02.524320971 +0000 UTC m=+209.054428139" Nov 03 22:55:02.753620 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:02.752951 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 22:55:02.753620 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:02.753042 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 22:55:02.753620 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:02.753078 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 22:55:02.824396 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:02.824310 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:55:03.514509 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:03.514448 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" event={"ID":"8f8d9e3c-1335-4726-aec4-b2c6fbc05b93","Type":"ContainerStarted","Data":"f29ee26e47a5d35b13e71ffb2401f7374bedaa9027aea26226fb543bb6a7201d"} Nov 03 22:55:03.533263 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:03.533202 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" podStartSLOduration=2.001165305 podStartE2EDuration="10.533178309s" totalImagesPullingTime="8.532013004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:55:03.532058808 +0000 UTC m=+210.062165976" watchObservedRunningTime="2026-11-03 22:55:03.533178309 +0000 UTC m=+210.063285478" Nov 03 22:55:03.830148 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:03.830079 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:55:03.898437 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:03.898394 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:55:03.904366 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:03.904337 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:55:04.521831 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:04.521803 5332 generic.go:356] "Generic (PLEG): container finished" podID="d091f0a9-af0a-409f-8166-433fc10e7666" containerID="6af91d547cde29f72c4b8785124d8fe4771f4228b1809b8139d638e31a0422e7" exitCode=0 Nov 03 22:55:04.522239 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:04.521892 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x" event={"ID":"d091f0a9-af0a-409f-8166-433fc10e7666","Type":"ContainerDied","Data":"6af91d547cde29f72c4b8785124d8fe4771f4228b1809b8139d638e31a0422e7"} Nov 03 22:55:04.524105 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:04.524078 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn" event={"ID":"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59","Type":"ContainerStarted","Data":"bc4df43d5958df0c535387d7fd214720938b13f1abadb631e172961049d87512"} Nov 03 22:55:04.527570 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:04.527550 5332 generic.go:356] "Generic (PLEG): container finished" podID="fe7f84dc-9566-49a4-93bd-6ad0edb0cec0" containerID="fceba548d3c841cb97f614e13edd93621949ec97e00cbebf7b3d1361b0173b71" exitCode=0 Nov 03 22:55:04.527651 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:04.527635 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5" event={"ID":"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0","Type":"ContainerDied","Data":"fceba548d3c841cb97f614e13edd93621949ec97e00cbebf7b3d1361b0173b71"} Nov 03 22:55:04.529956 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:04.529933 5332 generic.go:356] "Generic (PLEG): container finished" podID="0e53eb93-3f10-41c5-8d25-08ed8e158e77" containerID="b180e9292b57562027aaed47956c6ae904010481968d3a40ee03e35faab357ec" exitCode=0 Nov 03 22:55:04.530043 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:04.530000 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl" event={"ID":"0e53eb93-3f10-41c5-8d25-08ed8e158e77","Type":"ContainerDied","Data":"b180e9292b57562027aaed47956c6ae904010481968d3a40ee03e35faab357ec"} Nov 03 22:55:04.530305 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:04.530256 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:55:04.530589 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:04.530434 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:55:04.531317 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:04.531297 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 22:55:04.531673 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:04.531357 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b" Nov 03 22:55:04.570389 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:04.568546 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn" podStartSLOduration=2.056936914 podStartE2EDuration="29.568527017s" totalImagesPullingTime="27.511590103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:54:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:55:04.567262207 +0000 UTC m=+211.097369374" watchObservedRunningTime="2026-11-03 22:55:04.568527017 +0000 UTC m=+211.098634184" Nov 03 22:55:05.536399 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.536362 5332 generic.go:356] "Generic (PLEG): container finished" podID="aa57a7ff-c2c8-45a1-b8b6-564c8f522b59" containerID="bc4df43d5958df0c535387d7fd214720938b13f1abadb631e172961049d87512" exitCode=0 Nov 03 22:55:05.536861 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.536475 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn" event={"ID":"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59","Type":"ContainerDied","Data":"bc4df43d5958df0c535387d7fd214720938b13f1abadb631e172961049d87512"} Nov 03 22:55:05.538787 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.538766 5332 generic.go:356] "Generic (PLEG): container finished" podID="12d13784-79f6-4629-9da2-ac94037cd337" containerID="ecf94db6b681ce181b233e6564d93353b34e055214b6d1ccb9f2a814a25bd25e" exitCode=0 Nov 03 22:55:05.538967 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.538846 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2" event={"ID":"12d13784-79f6-4629-9da2-ac94037cd337","Type":"ContainerDied","Data":"ecf94db6b681ce181b233e6564d93353b34e055214b6d1ccb9f2a814a25bd25e"} Nov 03 22:55:05.540964 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.540943 5332 generic.go:356] "Generic (PLEG): container finished" podID="64d291b4-6b66-42f7-9401-057d2fa30955" containerID="255db0c8151207400e46b631881c78dc6afd3dcdc577527d6ba1c5522f305f04" exitCode=0 Nov 03 22:55:05.541091 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.541027 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw" event={"ID":"64d291b4-6b66-42f7-9401-057d2fa30955","Type":"ContainerDied","Data":"255db0c8151207400e46b631881c78dc6afd3dcdc577527d6ba1c5522f305f04"} Nov 03 22:55:05.679690 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.679668 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x" Nov 03 22:55:05.708982 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.708962 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl" Nov 03 22:55:05.719647 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.719623 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5" Nov 03 22:55:05.724771 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.724664 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e53eb93-3f10-41c5-8d25-08ed8e158e77-bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e53eb93-3f10-41c5-8d25-08ed8e158e77-bundle\") pod \"0e53eb93-3f10-41c5-8d25-08ed8e158e77\" (UID: \"0e53eb93-3f10-41c5-8d25-08ed8e158e77\") " Nov 03 22:55:05.724771 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.724711 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-bundle\") pod \"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0\" (UID: \"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0\") " Nov 03 22:55:05.724944 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.724784 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-util\" (UniqueName: \"kubernetes.io/empty-dir/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-util\") pod \"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0\" (UID: \"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0\") " Nov 03 22:55:05.724944 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.724819 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-kube-api-access-5mgrf\" (UniqueName: \"kubernetes.io/projected/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-kube-api-access-5mgrf\") pod \"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0\" (UID: \"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0\") " Nov 03 22:55:05.724944 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.724851 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d091f0a9-af0a-409f-8166-433fc10e7666-bundle\" (UniqueName: \"kubernetes.io/empty-dir/d091f0a9-af0a-409f-8166-433fc10e7666-bundle\") pod \"d091f0a9-af0a-409f-8166-433fc10e7666\" (UID: \"d091f0a9-af0a-409f-8166-433fc10e7666\") " Nov 03 22:55:05.724944 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.724877 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d091f0a9-af0a-409f-8166-433fc10e7666-kube-api-access-h7td5\" (UniqueName: \"kubernetes.io/projected/d091f0a9-af0a-409f-8166-433fc10e7666-kube-api-access-h7td5\") pod \"d091f0a9-af0a-409f-8166-433fc10e7666\" (UID: \"d091f0a9-af0a-409f-8166-433fc10e7666\") " Nov 03 22:55:05.725189 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.724964 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d091f0a9-af0a-409f-8166-433fc10e7666-util\" (UniqueName: \"kubernetes.io/empty-dir/d091f0a9-af0a-409f-8166-433fc10e7666-util\") pod \"d091f0a9-af0a-409f-8166-433fc10e7666\" (UID: \"d091f0a9-af0a-409f-8166-433fc10e7666\") " Nov 03 22:55:05.725189 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.725028 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e53eb93-3f10-41c5-8d25-08ed8e158e77-kube-api-access-2trnd\" (UniqueName: \"kubernetes.io/projected/0e53eb93-3f10-41c5-8d25-08ed8e158e77-kube-api-access-2trnd\") pod \"0e53eb93-3f10-41c5-8d25-08ed8e158e77\" (UID: \"0e53eb93-3f10-41c5-8d25-08ed8e158e77\") " Nov 03 22:55:05.725189 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.725094 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e53eb93-3f10-41c5-8d25-08ed8e158e77-util\" (UniqueName: \"kubernetes.io/empty-dir/0e53eb93-3f10-41c5-8d25-08ed8e158e77-util\") pod \"0e53eb93-3f10-41c5-8d25-08ed8e158e77\" (UID: \"0e53eb93-3f10-41c5-8d25-08ed8e158e77\") " Nov 03 22:55:05.726405 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.725854 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d091f0a9-af0a-409f-8166-433fc10e7666-bundle" pod "d091f0a9-af0a-409f-8166-433fc10e7666" (UID: "d091f0a9-af0a-409f-8166-433fc10e7666"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:55:05.726405 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.725893 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e53eb93-3f10-41c5-8d25-08ed8e158e77-bundle" pod "0e53eb93-3f10-41c5-8d25-08ed8e158e77" (UID: "0e53eb93-3f10-41c5-8d25-08ed8e158e77"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:55:05.727015 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.726987 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-bundle" pod "fe7f84dc-9566-49a4-93bd-6ad0edb0cec0" (UID: "fe7f84dc-9566-49a4-93bd-6ad0edb0cec0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:55:05.733379 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.733355 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d091f0a9-af0a-409f-8166-433fc10e7666-util" pod "d091f0a9-af0a-409f-8166-433fc10e7666" (UID: "d091f0a9-af0a-409f-8166-433fc10e7666"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:55:05.733886 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.733862 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-util" pod "fe7f84dc-9566-49a4-93bd-6ad0edb0cec0" (UID: "fe7f84dc-9566-49a4-93bd-6ad0edb0cec0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:55:05.733997 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.733867 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e53eb93-3f10-41c5-8d25-08ed8e158e77-util" pod "0e53eb93-3f10-41c5-8d25-08ed8e158e77" (UID: "0e53eb93-3f10-41c5-8d25-08ed8e158e77"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:55:05.733997 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.733885 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d091f0a9-af0a-409f-8166-433fc10e7666-kube-api-access-h7td5" pod "d091f0a9-af0a-409f-8166-433fc10e7666" (UID: "d091f0a9-af0a-409f-8166-433fc10e7666"). InnerVolumeSpecName "kube-api-access-h7td5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 22:55:05.733997 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.733885 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e53eb93-3f10-41c5-8d25-08ed8e158e77-kube-api-access-2trnd" pod "0e53eb93-3f10-41c5-8d25-08ed8e158e77" (UID: "0e53eb93-3f10-41c5-8d25-08ed8e158e77"). InnerVolumeSpecName "kube-api-access-2trnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 22:55:05.733997 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.733952 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-kube-api-access-5mgrf" pod "fe7f84dc-9566-49a4-93bd-6ad0edb0cec0" (UID: "fe7f84dc-9566-49a4-93bd-6ad0edb0cec0"). InnerVolumeSpecName "kube-api-access-5mgrf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 22:55:05.825978 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.825897 5332 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-util\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:05.825978 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.825927 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mgrf\" (UniqueName: \"kubernetes.io/projected/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-kube-api-access-5mgrf\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:05.825978 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.825938 5332 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d091f0a9-af0a-409f-8166-433fc10e7666-bundle\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:05.825978 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.825950 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7td5\" (UniqueName: \"kubernetes.io/projected/d091f0a9-af0a-409f-8166-433fc10e7666-kube-api-access-h7td5\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:05.825978 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.825958 5332 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d091f0a9-af0a-409f-8166-433fc10e7666-util\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:05.825978 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.825969 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2trnd\" (UniqueName: \"kubernetes.io/projected/0e53eb93-3f10-41c5-8d25-08ed8e158e77-kube-api-access-2trnd\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:05.825978 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.825982 5332 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e53eb93-3f10-41c5-8d25-08ed8e158e77-util\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:05.826302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.825991 5332 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e53eb93-3f10-41c5-8d25-08ed8e158e77-bundle\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:05.826302 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:05.825998 5332 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe7f84dc-9566-49a4-93bd-6ad0edb0cec0-bundle\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:06.546772 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.546741 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5" Nov 03 22:55:06.546772 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.546750 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwkbs5" event={"ID":"fe7f84dc-9566-49a4-93bd-6ad0edb0cec0","Type":"ContainerDied","Data":"b7795383d9a79417c6f5ddfa220f0f7f0e22f88f9a8eca6429bc949d6cb097a6"} Nov 03 22:55:06.547270 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.546824 5332 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7795383d9a79417c6f5ddfa220f0f7f0e22f88f9a8eca6429bc949d6cb097a6" Nov 03 22:55:06.548846 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.548814 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl" event={"ID":"0e53eb93-3f10-41c5-8d25-08ed8e158e77","Type":"ContainerDied","Data":"37b75212d532cdb2bfcec3059f271d2395c78d7f0f116a182dea55f996e1b242"} Nov 03 22:55:06.548980 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.548867 5332 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37b75212d532cdb2bfcec3059f271d2395c78d7f0f116a182dea55f996e1b242" Nov 03 22:55:06.548980 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.548826 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xhnpl" Nov 03 22:55:06.550940 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.550922 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x" Nov 03 22:55:06.551070 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.550958 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71wq46x" event={"ID":"d091f0a9-af0a-409f-8166-433fc10e7666","Type":"ContainerDied","Data":"8a110ace1878f5f4309460f897ae2c0e7ea0c901440e2d78eb6925f09433910b"} Nov 03 22:55:06.551070 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.550990 5332 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a110ace1878f5f4309460f897ae2c0e7ea0c901440e2d78eb6925f09433910b" Nov 03 22:55:06.689292 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.689260 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn" Nov 03 22:55:06.712484 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.711387 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw" Nov 03 22:55:06.734567 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.734545 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64d291b4-6b66-42f7-9401-057d2fa30955-util\" (UniqueName: \"kubernetes.io/empty-dir/64d291b4-6b66-42f7-9401-057d2fa30955-util\") pod \"64d291b4-6b66-42f7-9401-057d2fa30955\" (UID: \"64d291b4-6b66-42f7-9401-057d2fa30955\") " Nov 03 22:55:06.734716 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.734588 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-kube-api-access-2fk95\" (UniqueName: \"kubernetes.io/projected/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-kube-api-access-2fk95\") pod \"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59\" (UID: \"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59\") " Nov 03 22:55:06.734716 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.734641 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64d291b4-6b66-42f7-9401-057d2fa30955-kube-api-access-n7psb\" (UniqueName: \"kubernetes.io/projected/64d291b4-6b66-42f7-9401-057d2fa30955-kube-api-access-n7psb\") pod \"64d291b4-6b66-42f7-9401-057d2fa30955\" (UID: \"64d291b4-6b66-42f7-9401-057d2fa30955\") " Nov 03 22:55:06.734849 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.734816 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-bundle\") pod \"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59\" (UID: \"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59\") " Nov 03 22:55:06.735221 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.734904 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-util\" (UniqueName: \"kubernetes.io/empty-dir/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-util\") pod \"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59\" (UID: \"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59\") " Nov 03 22:55:06.735221 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.734985 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64d291b4-6b66-42f7-9401-057d2fa30955-bundle\" (UniqueName: \"kubernetes.io/empty-dir/64d291b4-6b66-42f7-9401-057d2fa30955-bundle\") pod \"64d291b4-6b66-42f7-9401-057d2fa30955\" (UID: \"64d291b4-6b66-42f7-9401-057d2fa30955\") " Nov 03 22:55:06.736049 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.735694 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64d291b4-6b66-42f7-9401-057d2fa30955-bundle" pod "64d291b4-6b66-42f7-9401-057d2fa30955" (UID: "64d291b4-6b66-42f7-9401-057d2fa30955"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:55:06.737109 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.737061 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64d291b4-6b66-42f7-9401-057d2fa30955-kube-api-access-n7psb" pod "64d291b4-6b66-42f7-9401-057d2fa30955" (UID: "64d291b4-6b66-42f7-9401-057d2fa30955"). InnerVolumeSpecName "kube-api-access-n7psb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 22:55:06.737235 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.737155 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-bundle" pod "aa57a7ff-c2c8-45a1-b8b6-564c8f522b59" (UID: "aa57a7ff-c2c8-45a1-b8b6-564c8f522b59"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:55:06.738431 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.738410 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-kube-api-access-2fk95" pod "aa57a7ff-c2c8-45a1-b8b6-564c8f522b59" (UID: "aa57a7ff-c2c8-45a1-b8b6-564c8f522b59"). InnerVolumeSpecName "kube-api-access-2fk95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 22:55:06.739292 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.739267 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2" Nov 03 22:55:06.742337 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.742313 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64d291b4-6b66-42f7-9401-057d2fa30955-util" pod "64d291b4-6b66-42f7-9401-057d2fa30955" (UID: "64d291b4-6b66-42f7-9401-057d2fa30955"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:55:06.742635 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.742619 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-util" pod "aa57a7ff-c2c8-45a1-b8b6-564c8f522b59" (UID: "aa57a7ff-c2c8-45a1-b8b6-564c8f522b59"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:55:06.836374 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.836292 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/12d13784-79f6-4629-9da2-ac94037cd337-util\" (UniqueName: \"kubernetes.io/empty-dir/12d13784-79f6-4629-9da2-ac94037cd337-util\") pod \"12d13784-79f6-4629-9da2-ac94037cd337\" (UID: \"12d13784-79f6-4629-9da2-ac94037cd337\") " Nov 03 22:55:06.836374 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.836364 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/12d13784-79f6-4629-9da2-ac94037cd337-kube-api-access-5dvft\" (UniqueName: \"kubernetes.io/projected/12d13784-79f6-4629-9da2-ac94037cd337-kube-api-access-5dvft\") pod \"12d13784-79f6-4629-9da2-ac94037cd337\" (UID: \"12d13784-79f6-4629-9da2-ac94037cd337\") " Nov 03 22:55:06.836646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.836390 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/12d13784-79f6-4629-9da2-ac94037cd337-bundle\" (UniqueName: \"kubernetes.io/empty-dir/12d13784-79f6-4629-9da2-ac94037cd337-bundle\") pod \"12d13784-79f6-4629-9da2-ac94037cd337\" (UID: \"12d13784-79f6-4629-9da2-ac94037cd337\") " Nov 03 22:55:06.836646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.836575 5332 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64d291b4-6b66-42f7-9401-057d2fa30955-bundle\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:06.836646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.836590 5332 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64d291b4-6b66-42f7-9401-057d2fa30955-util\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:06.836646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.836599 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fk95\" (UniqueName: \"kubernetes.io/projected/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-kube-api-access-2fk95\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:06.836646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.836608 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7psb\" (UniqueName: \"kubernetes.io/projected/64d291b4-6b66-42f7-9401-057d2fa30955-kube-api-access-n7psb\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:06.836646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.836618 5332 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-bundle\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:06.836646 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.836626 5332 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa57a7ff-c2c8-45a1-b8b6-564c8f522b59-util\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:06.836984 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.836920 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d13784-79f6-4629-9da2-ac94037cd337-bundle" pod "12d13784-79f6-4629-9da2-ac94037cd337" (UID: "12d13784-79f6-4629-9da2-ac94037cd337"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:55:06.838610 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.838588 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12d13784-79f6-4629-9da2-ac94037cd337-kube-api-access-5dvft" pod "12d13784-79f6-4629-9da2-ac94037cd337" (UID: "12d13784-79f6-4629-9da2-ac94037cd337"). InnerVolumeSpecName "kube-api-access-5dvft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 22:55:06.840810 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.840788 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d13784-79f6-4629-9da2-ac94037cd337-util" pod "12d13784-79f6-4629-9da2-ac94037cd337" (UID: "12d13784-79f6-4629-9da2-ac94037cd337"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:55:06.937636 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.937607 5332 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12d13784-79f6-4629-9da2-ac94037cd337-util\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:06.937636 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.937634 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dvft\" (UniqueName: \"kubernetes.io/projected/12d13784-79f6-4629-9da2-ac94037cd337-kube-api-access-5dvft\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:06.937800 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:06.937646 5332 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12d13784-79f6-4629-9da2-ac94037cd337-bundle\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:07.556205 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:07.556176 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2" Nov 03 22:55:07.556205 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:07.556194 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cgvk2" event={"ID":"12d13784-79f6-4629-9da2-ac94037cd337","Type":"ContainerDied","Data":"99fbc68812f1e5265df091d1eb15acc1ad6ce779eb755c8ff4186d7a628d6b82"} Nov 03 22:55:07.556757 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:07.556243 5332 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99fbc68812f1e5265df091d1eb15acc1ad6ce779eb755c8ff4186d7a628d6b82" Nov 03 22:55:07.558190 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:07.558170 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw" Nov 03 22:55:07.558305 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:07.558198 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cn5xjw" event={"ID":"64d291b4-6b66-42f7-9401-057d2fa30955","Type":"ContainerDied","Data":"f053e5cbb00d953b7ddef8f5cc0841b538b5e68c3f490bdf812459805ebf9747"} Nov 03 22:55:07.558305 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:07.558229 5332 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f053e5cbb00d953b7ddef8f5cc0841b538b5e68c3f490bdf812459805ebf9747" Nov 03 22:55:07.560139 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:07.560120 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn" event={"ID":"aa57a7ff-c2c8-45a1-b8b6-564c8f522b59","Type":"ContainerDied","Data":"6ffc6f4608c99f051ad436c9a9e0e900f7dba3b2b8f07f9165e7a68859195c33"} Nov 03 22:55:07.560235 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:07.560148 5332 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ffc6f4608c99f051ad436c9a9e0e900f7dba3b2b8f07f9165e7a68859195c33" Nov 03 22:55:07.560235 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:07.560163 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah22cn" Nov 03 22:55:09.493672 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:55:09.493634 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 22:55:10.098427 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:10.098391 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:12.896611 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:12.896575 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:13.106735 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.106703 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-frz8m"] Nov 03 22:55:13.107031 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107017 5332 cpu_manager.go:414] "containerMap: removing container" podUID="aa57a7ff-c2c8-45a1-b8b6-564c8f522b59" containerName="pull" Nov 03 22:55:13.107127 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107033 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aa57a7ff-c2c8-45a1-b8b6-564c8f522b59" containerName="pull" Nov 03 22:55:13.107127 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107043 5332 cpu_manager.go:414] "containerMap: removing container" podUID="12d13784-79f6-4629-9da2-ac94037cd337" containerName="extract" Nov 03 22:55:13.107127 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107048 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="12d13784-79f6-4629-9da2-ac94037cd337" containerName="extract" Nov 03 22:55:13.107127 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107057 5332 cpu_manager.go:414] "containerMap: removing container" podUID="aa57a7ff-c2c8-45a1-b8b6-564c8f522b59" containerName="util" Nov 03 22:55:13.107127 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107063 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aa57a7ff-c2c8-45a1-b8b6-564c8f522b59" containerName="util" Nov 03 22:55:13.107127 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107070 5332 cpu_manager.go:414] "containerMap: removing container" podUID="fe7f84dc-9566-49a4-93bd-6ad0edb0cec0" containerName="extract" Nov 03 22:55:13.107127 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107077 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fe7f84dc-9566-49a4-93bd-6ad0edb0cec0" containerName="extract" Nov 03 22:55:13.107127 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107092 5332 cpu_manager.go:414] "containerMap: removing container" podUID="d091f0a9-af0a-409f-8166-433fc10e7666" containerName="util" Nov 03 22:55:13.107127 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107100 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d091f0a9-af0a-409f-8166-433fc10e7666" containerName="util" Nov 03 22:55:13.107127 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107110 5332 cpu_manager.go:414] "containerMap: removing container" podUID="d091f0a9-af0a-409f-8166-433fc10e7666" containerName="extract" Nov 03 22:55:13.107127 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107117 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d091f0a9-af0a-409f-8166-433fc10e7666" containerName="extract" Nov 03 22:55:13.107127 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107128 5332 cpu_manager.go:414] "containerMap: removing container" podUID="fe7f84dc-9566-49a4-93bd-6ad0edb0cec0" containerName="util" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107136 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fe7f84dc-9566-49a4-93bd-6ad0edb0cec0" containerName="util" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107145 5332 cpu_manager.go:414] "containerMap: removing container" podUID="fe7f84dc-9566-49a4-93bd-6ad0edb0cec0" containerName="pull" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107152 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fe7f84dc-9566-49a4-93bd-6ad0edb0cec0" containerName="pull" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107162 5332 cpu_manager.go:414] "containerMap: removing container" podUID="64d291b4-6b66-42f7-9401-057d2fa30955" containerName="extract" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107169 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64d291b4-6b66-42f7-9401-057d2fa30955" containerName="extract" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107188 5332 cpu_manager.go:414] "containerMap: removing container" podUID="64d291b4-6b66-42f7-9401-057d2fa30955" containerName="pull" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107195 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64d291b4-6b66-42f7-9401-057d2fa30955" containerName="pull" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107210 5332 cpu_manager.go:414] "containerMap: removing container" podUID="0e53eb93-3f10-41c5-8d25-08ed8e158e77" containerName="extract" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107217 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0e53eb93-3f10-41c5-8d25-08ed8e158e77" containerName="extract" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107230 5332 cpu_manager.go:414] "containerMap: removing container" podUID="12d13784-79f6-4629-9da2-ac94037cd337" containerName="util" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107236 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="12d13784-79f6-4629-9da2-ac94037cd337" containerName="util" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107246 5332 cpu_manager.go:414] "containerMap: removing container" podUID="64d291b4-6b66-42f7-9401-057d2fa30955" containerName="util" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107252 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64d291b4-6b66-42f7-9401-057d2fa30955" containerName="util" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107266 5332 cpu_manager.go:414] "containerMap: removing container" podUID="0e53eb93-3f10-41c5-8d25-08ed8e158e77" containerName="pull" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107273 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0e53eb93-3f10-41c5-8d25-08ed8e158e77" containerName="pull" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107280 5332 cpu_manager.go:414] "containerMap: removing container" podUID="d091f0a9-af0a-409f-8166-433fc10e7666" containerName="pull" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107287 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d091f0a9-af0a-409f-8166-433fc10e7666" containerName="pull" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107295 5332 cpu_manager.go:414] "containerMap: removing container" podUID="12d13784-79f6-4629-9da2-ac94037cd337" containerName="pull" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107301 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="12d13784-79f6-4629-9da2-ac94037cd337" containerName="pull" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107312 5332 cpu_manager.go:414] "containerMap: removing container" podUID="0e53eb93-3f10-41c5-8d25-08ed8e158e77" containerName="util" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107319 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0e53eb93-3f10-41c5-8d25-08ed8e158e77" containerName="util" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107335 5332 cpu_manager.go:414] "containerMap: removing container" podUID="aa57a7ff-c2c8-45a1-b8b6-564c8f522b59" containerName="extract" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107340 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aa57a7ff-c2c8-45a1-b8b6-564c8f522b59" containerName="extract" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107409 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="aa57a7ff-c2c8-45a1-b8b6-564c8f522b59" containerName="extract" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107418 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="12d13784-79f6-4629-9da2-ac94037cd337" containerName="extract" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107424 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="fe7f84dc-9566-49a4-93bd-6ad0edb0cec0" containerName="extract" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107429 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="d091f0a9-af0a-409f-8166-433fc10e7666" containerName="extract" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107436 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="64d291b4-6b66-42f7-9401-057d2fa30955" containerName="extract" Nov 03 22:55:13.107517 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.107443 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="0e53eb93-3f10-41c5-8d25-08ed8e158e77" containerName="extract" Nov 03 22:55:13.117898 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.117879 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-frz8m" Nov 03 22:55:13.122661 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.122637 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Nov 03 22:55:13.122824 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.122727 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Nov 03 22:55:13.122824 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.122811 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-87fwf\"" Nov 03 22:55:13.124065 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.124042 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-frz8m"] Nov 03 22:55:13.184825 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.184756 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4a5e54e-3a75-4055-aad3-12a7b9960aaa-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-frz8m\" (UID: \"e4a5e54e-3a75-4055-aad3-12a7b9960aaa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-frz8m" Nov 03 22:55:13.184825 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.184789 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgjnx\" (UniqueName: \"kubernetes.io/projected/e4a5e54e-3a75-4055-aad3-12a7b9960aaa-kube-api-access-bgjnx\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-frz8m\" (UID: \"e4a5e54e-3a75-4055-aad3-12a7b9960aaa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-frz8m" Nov 03 22:55:13.285547 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.285508 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4a5e54e-3a75-4055-aad3-12a7b9960aaa-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-frz8m\" (UID: \"e4a5e54e-3a75-4055-aad3-12a7b9960aaa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-frz8m" Nov 03 22:55:13.285738 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.285561 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgjnx\" (UniqueName: \"kubernetes.io/projected/e4a5e54e-3a75-4055-aad3-12a7b9960aaa-kube-api-access-bgjnx\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-frz8m\" (UID: \"e4a5e54e-3a75-4055-aad3-12a7b9960aaa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-frz8m" Nov 03 22:55:13.285922 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.285902 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4a5e54e-3a75-4055-aad3-12a7b9960aaa-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-frz8m\" (UID: \"e4a5e54e-3a75-4055-aad3-12a7b9960aaa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-frz8m" Nov 03 22:55:13.296067 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.296032 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgjnx\" (UniqueName: \"kubernetes.io/projected/e4a5e54e-3a75-4055-aad3-12a7b9960aaa-kube-api-access-bgjnx\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-frz8m\" (UID: \"e4a5e54e-3a75-4055-aad3-12a7b9960aaa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-frz8m" Nov 03 22:55:13.301405 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.301348 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:13.442658 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.442575 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-frz8m" Nov 03 22:55:13.451284 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.451256 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:13.723440 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:13.723403 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-frz8m"] Nov 03 22:55:13.726583 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:55:13.726560 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4a5e54e_3a75_4055_aad3_12a7b9960aaa.slice/crio-2032bf9a531ecbc72d521a7a024894144347c107d37cedd04e9e8a8a8d0eed06 WatchSource:0}: Error finding container 2032bf9a531ecbc72d521a7a024894144347c107d37cedd04e9e8a8a8d0eed06: Status 404 returned error can't find the container with id 2032bf9a531ecbc72d521a7a024894144347c107d37cedd04e9e8a8a8d0eed06 Nov 03 22:55:14.542780 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.542746 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:14.589377 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.589346 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-frz8m" event={"ID":"e4a5e54e-3a75-4055-aad3-12a7b9960aaa","Type":"ContainerStarted","Data":"2032bf9a531ecbc72d521a7a024894144347c107d37cedd04e9e8a8a8d0eed06"} Nov 03 22:55:14.729192 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.722916 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz"] Nov 03 22:55:14.729968 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.729946 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:14.752829 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.752799 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz"] Nov 03 22:55:14.809037 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.808948 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f7d6490-e663-4016-a80a-32e5df0b4894-tmp\") pod \"opendatahub-operator-controller-manager-8b65dd898-w5dkz\" (UID: \"6f7d6490-e663-4016-a80a-32e5df0b4894\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:14.809037 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.809004 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f7d6490-e663-4016-a80a-32e5df0b4894-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b65dd898-w5dkz\" (UID: \"6f7d6490-e663-4016-a80a-32e5df0b4894\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:14.809260 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.809040 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6f7d6490-e663-4016-a80a-32e5df0b4894-manifests\") pod \"opendatahub-operator-controller-manager-8b65dd898-w5dkz\" (UID: \"6f7d6490-e663-4016-a80a-32e5df0b4894\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:14.809260 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.809073 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f56l\" (UniqueName: \"kubernetes.io/projected/6f7d6490-e663-4016-a80a-32e5df0b4894-kube-api-access-4f56l\") pod \"opendatahub-operator-controller-manager-8b65dd898-w5dkz\" (UID: \"6f7d6490-e663-4016-a80a-32e5df0b4894\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:14.809260 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.809130 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f7d6490-e663-4016-a80a-32e5df0b4894-metrics-cert\") pod \"opendatahub-operator-controller-manager-8b65dd898-w5dkz\" (UID: \"6f7d6490-e663-4016-a80a-32e5df0b4894\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:14.809260 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.809167 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f7d6490-e663-4016-a80a-32e5df0b4894-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b65dd898-w5dkz\" (UID: \"6f7d6490-e663-4016-a80a-32e5df0b4894\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:14.820525 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.820487 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Nov 03 22:55:14.820692 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.820632 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Nov 03 22:55:14.824248 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.824222 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Nov 03 22:55:14.824374 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.824346 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-psthp\"" Nov 03 22:55:14.824374 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.824356 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Nov 03 22:55:14.824486 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.824379 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Nov 03 22:55:14.909580 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.909548 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f7d6490-e663-4016-a80a-32e5df0b4894-tmp\") pod \"opendatahub-operator-controller-manager-8b65dd898-w5dkz\" (UID: \"6f7d6490-e663-4016-a80a-32e5df0b4894\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:14.909772 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.909589 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f7d6490-e663-4016-a80a-32e5df0b4894-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b65dd898-w5dkz\" (UID: \"6f7d6490-e663-4016-a80a-32e5df0b4894\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:14.909772 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.909610 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6f7d6490-e663-4016-a80a-32e5df0b4894-manifests\") pod \"opendatahub-operator-controller-manager-8b65dd898-w5dkz\" (UID: \"6f7d6490-e663-4016-a80a-32e5df0b4894\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:14.909772 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.909636 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f56l\" (UniqueName: \"kubernetes.io/projected/6f7d6490-e663-4016-a80a-32e5df0b4894-kube-api-access-4f56l\") pod \"opendatahub-operator-controller-manager-8b65dd898-w5dkz\" (UID: \"6f7d6490-e663-4016-a80a-32e5df0b4894\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:14.909772 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.909694 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f7d6490-e663-4016-a80a-32e5df0b4894-metrics-cert\") pod \"opendatahub-operator-controller-manager-8b65dd898-w5dkz\" (UID: \"6f7d6490-e663-4016-a80a-32e5df0b4894\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:14.909772 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.909730 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f7d6490-e663-4016-a80a-32e5df0b4894-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b65dd898-w5dkz\" (UID: \"6f7d6490-e663-4016-a80a-32e5df0b4894\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:14.910270 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.910232 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6f7d6490-e663-4016-a80a-32e5df0b4894-manifests\") pod \"opendatahub-operator-controller-manager-8b65dd898-w5dkz\" (UID: \"6f7d6490-e663-4016-a80a-32e5df0b4894\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:14.912274 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.912246 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f7d6490-e663-4016-a80a-32e5df0b4894-tmp\") pod \"opendatahub-operator-controller-manager-8b65dd898-w5dkz\" (UID: \"6f7d6490-e663-4016-a80a-32e5df0b4894\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:14.912887 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.912864 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f7d6490-e663-4016-a80a-32e5df0b4894-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b65dd898-w5dkz\" (UID: \"6f7d6490-e663-4016-a80a-32e5df0b4894\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:14.913209 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.913186 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f7d6490-e663-4016-a80a-32e5df0b4894-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b65dd898-w5dkz\" (UID: \"6f7d6490-e663-4016-a80a-32e5df0b4894\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:14.913735 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.913715 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f7d6490-e663-4016-a80a-32e5df0b4894-metrics-cert\") pod \"opendatahub-operator-controller-manager-8b65dd898-w5dkz\" (UID: \"6f7d6490-e663-4016-a80a-32e5df0b4894\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:14.924627 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.924599 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f56l\" (UniqueName: \"kubernetes.io/projected/6f7d6490-e663-4016-a80a-32e5df0b4894-kube-api-access-4f56l\") pod \"opendatahub-operator-controller-manager-8b65dd898-w5dkz\" (UID: \"6f7d6490-e663-4016-a80a-32e5df0b4894\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:14.990559 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:14.990508 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:15.046378 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:15.046345 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:15.345236 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:15.345204 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz"] Nov 03 22:55:15.349052 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:55:15.349010 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f7d6490_e663_4016_a80a_32e5df0b4894.slice/crio-6be46662762188b18944f4a117b78362cc09a12b3f31cd7c7eb70374cb15c124 WatchSource:0}: Error finding container 6be46662762188b18944f4a117b78362cc09a12b3f31cd7c7eb70374cb15c124: Status 404 returned error can't find the container with id 6be46662762188b18944f4a117b78362cc09a12b3f31cd7c7eb70374cb15c124 Nov 03 22:55:15.595884 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:15.595855 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" event={"ID":"6f7d6490-e663-4016-a80a-32e5df0b4894","Type":"ContainerStarted","Data":"6be46662762188b18944f4a117b78362cc09a12b3f31cd7c7eb70374cb15c124"} Nov 03 22:55:16.343174 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:16.343132 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:16.605028 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:16.604938 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-frz8m" event={"ID":"e4a5e54e-3a75-4055-aad3-12a7b9960aaa","Type":"ContainerStarted","Data":"f01c9c5a584d1ac6c0badee74734ff8ef35f22b4605fda7344dd1ac5dc1b9207"} Nov 03 22:55:16.629350 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:16.629292 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-frz8m" podStartSLOduration=1.7631599310000001 podStartE2EDuration="3.629272983s" totalImagesPullingTime="1.866113052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:55:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:55:16.627714581 +0000 UTC m=+223.157821748" watchObservedRunningTime="2026-11-03 22:55:16.629272983 +0000 UTC m=+223.159380148" Nov 03 22:55:17.644536 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:17.644496 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:17.775528 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:17.775485 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:18.162851 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:18.162792 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:18.617489 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:18.617433 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" event={"ID":"6f7d6490-e663-4016-a80a-32e5df0b4894","Type":"ContainerStarted","Data":"8eb40e6641a37abcf6f9383ee4c4740f3f5b48eb22944117e052f099da935ffd"} Nov 03 22:55:19.623314 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:19.623281 5332 generic.go:356] "Generic (PLEG): container finished" podID="6f7d6490-e663-4016-a80a-32e5df0b4894" containerID="8eb40e6641a37abcf6f9383ee4c4740f3f5b48eb22944117e052f099da935ffd" exitCode=0 Nov 03 22:55:19.623744 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:19.623364 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" event={"ID":"6f7d6490-e663-4016-a80a-32e5df0b4894","Type":"ContainerDied","Data":"8eb40e6641a37abcf6f9383ee4c4740f3f5b48eb22944117e052f099da935ffd"} Nov 03 22:55:19.843977 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:19.843941 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:20.306317 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:20.306235 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:20.629996 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:20.629914 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" event={"ID":"6f7d6490-e663-4016-a80a-32e5df0b4894","Type":"ContainerStarted","Data":"96683542c5a6bff757503863cee53d292cfdff97aa177cc81025477957590be5"} Nov 03 22:55:20.630508 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:20.630043 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:20.678240 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:20.673315 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" podStartSLOduration=2.710480895 podStartE2EDuration="6.673296116s" totalImagesPullingTime="3.511805125s" totalInitContainerRuntime="451.010096ms" isStatefulPod=false podCreationTimestamp="2026-11-03 22:55:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:55:20.670541063 +0000 UTC m=+227.200648230" watchObservedRunningTime="2026-11-03 22:55:20.673296116 +0000 UTC m=+227.203403283" Nov 03 22:55:21.017418 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:21.017384 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-59v6p"] Nov 03 22:55:21.020634 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:21.020618 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-59v6p" Nov 03 22:55:21.026793 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:21.026758 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-c6kz4\"" Nov 03 22:55:21.029016 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:21.028992 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-59v6p"] Nov 03 22:55:21.031113 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:21.031092 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Nov 03 22:55:21.031207 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:21.031158 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Nov 03 22:55:21.065474 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:21.065431 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9edc475-fd48-4ab2-be52-db41fa1a5b3b-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-59v6p\" (UID: \"b9edc475-fd48-4ab2-be52-db41fa1a5b3b\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-59v6p" Nov 03 22:55:21.065621 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:21.065503 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhv5m\" (UniqueName: \"kubernetes.io/projected/b9edc475-fd48-4ab2-be52-db41fa1a5b3b-kube-api-access-jhv5m\") pod \"cert-manager-cainjector-5c57bbd4fc-59v6p\" (UID: \"b9edc475-fd48-4ab2-be52-db41fa1a5b3b\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-59v6p" Nov 03 22:55:21.139703 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:21.139663 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:21.166313 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:21.166282 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9edc475-fd48-4ab2-be52-db41fa1a5b3b-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-59v6p\" (UID: \"b9edc475-fd48-4ab2-be52-db41fa1a5b3b\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-59v6p" Nov 03 22:55:21.166475 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:21.166331 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhv5m\" (UniqueName: \"kubernetes.io/projected/b9edc475-fd48-4ab2-be52-db41fa1a5b3b-kube-api-access-jhv5m\") pod \"cert-manager-cainjector-5c57bbd4fc-59v6p\" (UID: \"b9edc475-fd48-4ab2-be52-db41fa1a5b3b\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-59v6p" Nov 03 22:55:21.174371 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:21.174346 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhv5m\" (UniqueName: \"kubernetes.io/projected/b9edc475-fd48-4ab2-be52-db41fa1a5b3b-kube-api-access-jhv5m\") pod \"cert-manager-cainjector-5c57bbd4fc-59v6p\" (UID: \"b9edc475-fd48-4ab2-be52-db41fa1a5b3b\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-59v6p" Nov 03 22:55:21.174487 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:21.174407 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9edc475-fd48-4ab2-be52-db41fa1a5b3b-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-59v6p\" (UID: \"b9edc475-fd48-4ab2-be52-db41fa1a5b3b\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-59v6p" Nov 03 22:55:21.249491 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:21.249435 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:21.346150 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:21.346070 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-59v6p" Nov 03 22:55:21.616792 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:21.616768 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-59v6p"] Nov 03 22:55:21.619320 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:55:21.619290 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9edc475_fd48_4ab2_be52_db41fa1a5b3b.slice/crio-1b44ade399b1051c2f659d532421a0b444c20c78682645fabae18651c997e48d WatchSource:0}: Error finding container 1b44ade399b1051c2f659d532421a0b444c20c78682645fabae18651c997e48d: Status 404 returned error can't find the container with id 1b44ade399b1051c2f659d532421a0b444c20c78682645fabae18651c997e48d Nov 03 22:55:21.634399 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:21.634374 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-59v6p" event={"ID":"b9edc475-fd48-4ab2-be52-db41fa1a5b3b","Type":"ContainerStarted","Data":"1b44ade399b1051c2f659d532421a0b444c20c78682645fabae18651c997e48d"} Nov 03 22:55:23.783114 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:23.783084 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-5s8w9"] Nov 03 22:55:23.786283 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:23.786268 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-5s8w9" Nov 03 22:55:23.792323 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:23.792298 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Nov 03 22:55:23.792475 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:23.792347 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Nov 03 22:55:23.792590 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:23.792560 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-z8wlw\"" Nov 03 22:55:23.795138 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:23.795116 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-5s8w9"] Nov 03 22:55:23.889780 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:23.889737 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n844h\" (UniqueName: \"kubernetes.io/projected/7a60f345-5f0f-4a95-a6cb-1cc7936a4f67-kube-api-access-n844h\") pod \"jobset-operator-674cd59dc5-5s8w9\" (UID: \"7a60f345-5f0f-4a95-a6cb-1cc7936a4f67\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-5s8w9" Nov 03 22:55:23.889780 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:23.889773 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a60f345-5f0f-4a95-a6cb-1cc7936a4f67-tmp\") pod \"jobset-operator-674cd59dc5-5s8w9\" (UID: \"7a60f345-5f0f-4a95-a6cb-1cc7936a4f67\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-5s8w9" Nov 03 22:55:23.991286 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:23.991245 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n844h\" (UniqueName: \"kubernetes.io/projected/7a60f345-5f0f-4a95-a6cb-1cc7936a4f67-kube-api-access-n844h\") pod \"jobset-operator-674cd59dc5-5s8w9\" (UID: \"7a60f345-5f0f-4a95-a6cb-1cc7936a4f67\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-5s8w9" Nov 03 22:55:23.991515 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:23.991301 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a60f345-5f0f-4a95-a6cb-1cc7936a4f67-tmp\") pod \"jobset-operator-674cd59dc5-5s8w9\" (UID: \"7a60f345-5f0f-4a95-a6cb-1cc7936a4f67\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-5s8w9" Nov 03 22:55:23.991748 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:23.991729 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a60f345-5f0f-4a95-a6cb-1cc7936a4f67-tmp\") pod \"jobset-operator-674cd59dc5-5s8w9\" (UID: \"7a60f345-5f0f-4a95-a6cb-1cc7936a4f67\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-5s8w9" Nov 03 22:55:24.022181 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:24.022146 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n844h\" (UniqueName: \"kubernetes.io/projected/7a60f345-5f0f-4a95-a6cb-1cc7936a4f67-kube-api-access-n844h\") pod \"jobset-operator-674cd59dc5-5s8w9\" (UID: \"7a60f345-5f0f-4a95-a6cb-1cc7936a4f67\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-5s8w9" Nov 03 22:55:24.099023 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:24.098945 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-5s8w9" Nov 03 22:55:24.370262 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:24.370193 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-5s8w9"] Nov 03 22:55:24.373205 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:55:24.373175 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a60f345_5f0f_4a95_a6cb_1cc7936a4f67.slice/crio-0898b190e38f81b06746281f92df38cb1ab9e027166133cce9a4de9eb9ed329b WatchSource:0}: Error finding container 0898b190e38f81b06746281f92df38cb1ab9e027166133cce9a4de9eb9ed329b: Status 404 returned error can't find the container with id 0898b190e38f81b06746281f92df38cb1ab9e027166133cce9a4de9eb9ed329b Nov 03 22:55:24.648696 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:24.648615 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-5s8w9" event={"ID":"7a60f345-5f0f-4a95-a6cb-1cc7936a4f67","Type":"ContainerStarted","Data":"0898b190e38f81b06746281f92df38cb1ab9e027166133cce9a4de9eb9ed329b"} Nov 03 22:55:24.699200 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:24.699159 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:25.918206 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:25.918122 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:27.088089 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:27.088049 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:27.666360 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:27.666326 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-5s8w9" event={"ID":"7a60f345-5f0f-4a95-a6cb-1cc7936a4f67","Type":"ContainerStarted","Data":"f6f05cb62d4d3cd99570e16a25a558a420b174104a35a393397537ef7c353c83"} Nov 03 22:55:27.681085 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:27.681035 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-5s8w9" podStartSLOduration=1.788400276 podStartE2EDuration="4.681020911s" totalImagesPullingTime="2.892620635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:55:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:55:27.679885975 +0000 UTC m=+234.209993142" watchObservedRunningTime="2026-11-03 22:55:27.681020911 +0000 UTC m=+234.211128070" Nov 03 22:55:27.829567 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:27.829533 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:30.604834 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:30.604794 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:30.960615 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:30.960571 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:31.074662 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:31.074627 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:31.636711 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:31.636680 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-w5dkz" Nov 03 22:55:31.904072 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:31.903976 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:32.514556 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:32.514522 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:34.701050 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:34.701014 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-59v6p" event={"ID":"b9edc475-fd48-4ab2-be52-db41fa1a5b3b","Type":"ContainerStarted","Data":"bb00d02fe840b97e051dcec2ad229edfac87365c9b44f09fa0c905fea0d351df"} Nov 03 22:55:34.716533 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:34.716486 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-59v6p" podStartSLOduration=2.47198854 podStartE2EDuration="14.71647117s" totalImagesPullingTime="12.24448263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:55:34.715372227 +0000 UTC m=+241.245479396" watchObservedRunningTime="2026-11-03 22:55:34.71647117 +0000 UTC m=+241.246578328" Nov 03 22:55:34.806640 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:34.806595 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:34.976995 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:34.976963 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:36.101627 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:36.101575 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:36.343408 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:36.343372 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:37.547269 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:37.547237 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-j5bdq"] Nov 03 22:55:37.553415 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:37.553392 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j5bdq" Nov 03 22:55:37.558114 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:37.558094 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Nov 03 22:55:37.558301 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:37.558278 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Nov 03 22:55:37.558486 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:37.558334 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Nov 03 22:55:37.558552 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:37.558358 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Nov 03 22:55:37.558552 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:37.558405 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6br6k\"" Nov 03 22:55:37.558643 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:37.558624 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-j5bdq"] Nov 03 22:55:37.589738 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:37.589706 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:37.706196 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:37.706156 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:37.719280 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:37.719250 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c975c60e-f871-4058-b060-d46deab53914-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-j5bdq\" (UID: \"c975c60e-f871-4058-b060-d46deab53914\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j5bdq" Nov 03 22:55:37.719493 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:37.719313 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4fgt\" (UniqueName: \"kubernetes.io/projected/c975c60e-f871-4058-b060-d46deab53914-kube-api-access-b4fgt\") pod \"kuadrant-console-plugin-66c4fb575d-j5bdq\" (UID: \"c975c60e-f871-4058-b060-d46deab53914\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j5bdq" Nov 03 22:55:37.719493 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:37.719395 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c975c60e-f871-4058-b060-d46deab53914-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-j5bdq\" (UID: \"c975c60e-f871-4058-b060-d46deab53914\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j5bdq" Nov 03 22:55:37.820194 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:37.820094 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4fgt\" (UniqueName: \"kubernetes.io/projected/c975c60e-f871-4058-b060-d46deab53914-kube-api-access-b4fgt\") pod \"kuadrant-console-plugin-66c4fb575d-j5bdq\" (UID: \"c975c60e-f871-4058-b060-d46deab53914\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j5bdq" Nov 03 22:55:37.820194 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:37.820150 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c975c60e-f871-4058-b060-d46deab53914-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-j5bdq\" (UID: \"c975c60e-f871-4058-b060-d46deab53914\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j5bdq" Nov 03 22:55:37.820493 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:37.820226 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c975c60e-f871-4058-b060-d46deab53914-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-j5bdq\" (UID: \"c975c60e-f871-4058-b060-d46deab53914\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j5bdq" Nov 03 22:55:37.821170 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:37.821143 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c975c60e-f871-4058-b060-d46deab53914-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-j5bdq\" (UID: \"c975c60e-f871-4058-b060-d46deab53914\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j5bdq" Nov 03 22:55:37.831034 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:37.830820 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4fgt\" (UniqueName: \"kubernetes.io/projected/c975c60e-f871-4058-b060-d46deab53914-kube-api-access-b4fgt\") pod \"kuadrant-console-plugin-66c4fb575d-j5bdq\" (UID: \"c975c60e-f871-4058-b060-d46deab53914\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j5bdq" Nov 03 22:55:37.832874 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:37.832848 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c975c60e-f871-4058-b060-d46deab53914-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-j5bdq\" (UID: \"c975c60e-f871-4058-b060-d46deab53914\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j5bdq" Nov 03 22:55:37.865913 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:37.865879 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j5bdq" Nov 03 22:55:38.142600 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:38.142579 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-j5bdq"] Nov 03 22:55:38.145093 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:55:38.145067 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc975c60e_f871_4058_b060_d46deab53914.slice/crio-8d52656d199cf857823193112ed5078274ec122f1017e5742c518c187214f51e WatchSource:0}: Error finding container 8d52656d199cf857823193112ed5078274ec122f1017e5742c518c187214f51e: Status 404 returned error can't find the container with id 8d52656d199cf857823193112ed5078274ec122f1017e5742c518c187214f51e Nov 03 22:55:38.211806 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:38.211779 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-xgv72"] Nov 03 22:55:38.216124 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:38.216106 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-xgv72" Nov 03 22:55:38.219631 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:38.219610 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-cx94k\"" Nov 03 22:55:38.224849 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:38.224808 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Nov 03 22:55:38.226636 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:38.226614 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-xgv72"] Nov 03 22:55:38.324928 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:38.324894 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7wb9\" (UniqueName: \"kubernetes.io/projected/05c1e9af-42b0-481f-ace5-fbee95f30055-kube-api-access-j7wb9\") pod \"dns-operator-controller-manager-8557cbdb84-xgv72\" (UID: \"05c1e9af-42b0-481f-ace5-fbee95f30055\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-xgv72" Nov 03 22:55:38.340127 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:38.340095 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:38.426373 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:38.426286 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7wb9\" (UniqueName: \"kubernetes.io/projected/05c1e9af-42b0-481f-ace5-fbee95f30055-kube-api-access-j7wb9\") pod \"dns-operator-controller-manager-8557cbdb84-xgv72\" (UID: \"05c1e9af-42b0-481f-ace5-fbee95f30055\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-xgv72" Nov 03 22:55:38.436231 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:38.436204 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7wb9\" (UniqueName: \"kubernetes.io/projected/05c1e9af-42b0-481f-ace5-fbee95f30055-kube-api-access-j7wb9\") pod \"dns-operator-controller-manager-8557cbdb84-xgv72\" (UID: \"05c1e9af-42b0-481f-ace5-fbee95f30055\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-xgv72" Nov 03 22:55:38.529354 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:38.529320 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-xgv72" Nov 03 22:55:38.719653 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:38.719618 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j5bdq" event={"ID":"c975c60e-f871-4058-b060-d46deab53914","Type":"ContainerStarted","Data":"8d52656d199cf857823193112ed5078274ec122f1017e5742c518c187214f51e"} Nov 03 22:55:38.804294 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:38.804261 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-xgv72"] Nov 03 22:55:38.807209 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:55:38.807184 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05c1e9af_42b0_481f_ace5_fbee95f30055.slice/crio-0f3a5642e8a6ad163081af26a46dc639eb771d4c7ee7fe8e28fe3e9f5cf59670 WatchSource:0}: Error finding container 0f3a5642e8a6ad163081af26a46dc639eb771d4c7ee7fe8e28fe3e9f5cf59670: Status 404 returned error can't find the container with id 0f3a5642e8a6ad163081af26a46dc639eb771d4c7ee7fe8e28fe3e9f5cf59670 Nov 03 22:55:39.497862 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:39.497827 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:39.499625 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:55:39.499594 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 22:55:39.726270 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:39.726198 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-xgv72" event={"ID":"05c1e9af-42b0-481f-ace5-fbee95f30055","Type":"ContainerStarted","Data":"0f3a5642e8a6ad163081af26a46dc639eb771d4c7ee7fe8e28fe3e9f5cf59670"} Nov 03 22:55:40.327668 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:40.327603 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:42.744372 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:42.744334 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-xgv72" event={"ID":"05c1e9af-42b0-481f-ace5-fbee95f30055","Type":"ContainerStarted","Data":"3521e89e920837189193cab6e1fea7653b926a9685882feb69fd733999929f1c"} Nov 03 22:55:42.744848 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:42.744498 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-xgv72" Nov 03 22:55:42.771658 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:42.771584 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-xgv72" podStartSLOduration=1.539842155 podStartE2EDuration="4.771565425s" totalImagesPullingTime="3.23172327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:55:42.767320996 +0000 UTC m=+249.297428170" watchObservedRunningTime="2026-11-03 22:55:42.771565425 +0000 UTC m=+249.301672594" Nov 03 22:55:43.469077 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:43.469037 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:44.754924 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:44.754885 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j5bdq" event={"ID":"c975c60e-f871-4058-b060-d46deab53914","Type":"ContainerStarted","Data":"e8f599ea5961bd5ff9e0756f4689df7c4cfb162c297a2220650804d8e5290dbc"} Nov 03 22:55:44.770000 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:44.769945 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j5bdq" podStartSLOduration=1.345224945 podStartE2EDuration="7.769929315s" totalImagesPullingTime="6.42470437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:55:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:55:44.768942501 +0000 UTC m=+251.299049670" watchObservedRunningTime="2026-11-03 22:55:44.769929315 +0000 UTC m=+251.300036482" Nov 03 22:55:45.497189 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:45.497157 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:45.606631 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:45.606571 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:45.906328 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:45.906247 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:46.019362 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:46.019331 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:46.379206 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:46.379172 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:46.492602 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:46.492571 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:47.094688 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.094652 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:47.218728 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.218696 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:47.284832 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.284801 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-685596c46f-cvm95"] Nov 03 22:55:47.290825 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.290804 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-685596c46f-cvm95" Nov 03 22:55:47.310798 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.306246 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Nov 03 22:55:47.310798 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.307132 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-57xzn\"" Nov 03 22:55:47.310798 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.309102 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-685596c46f-cvm95"] Nov 03 22:55:47.310798 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.309153 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Nov 03 22:55:47.317862 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.317839 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e23bcd28-9f87-4446-8e6b-98d06af0647a-tmp\") pod \"kube-auth-proxy-685596c46f-cvm95\" (UID: \"e23bcd28-9f87-4446-8e6b-98d06af0647a\") " pod="openshift-ingress/kube-auth-proxy-685596c46f-cvm95" Nov 03 22:55:47.318016 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.317876 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e23bcd28-9f87-4446-8e6b-98d06af0647a-tls-certs\") pod \"kube-auth-proxy-685596c46f-cvm95\" (UID: \"e23bcd28-9f87-4446-8e6b-98d06af0647a\") " pod="openshift-ingress/kube-auth-proxy-685596c46f-cvm95" Nov 03 22:55:47.318016 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.317903 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4q9r\" (UniqueName: \"kubernetes.io/projected/e23bcd28-9f87-4446-8e6b-98d06af0647a-kube-api-access-q4q9r\") pod \"kube-auth-proxy-685596c46f-cvm95\" (UID: \"e23bcd28-9f87-4446-8e6b-98d06af0647a\") " pod="openshift-ingress/kube-auth-proxy-685596c46f-cvm95" Nov 03 22:55:47.377819 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.377730 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:47.418897 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.418861 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e23bcd28-9f87-4446-8e6b-98d06af0647a-tmp\") pod \"kube-auth-proxy-685596c46f-cvm95\" (UID: \"e23bcd28-9f87-4446-8e6b-98d06af0647a\") " pod="openshift-ingress/kube-auth-proxy-685596c46f-cvm95" Nov 03 22:55:47.419081 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.418906 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e23bcd28-9f87-4446-8e6b-98d06af0647a-tls-certs\") pod \"kube-auth-proxy-685596c46f-cvm95\" (UID: \"e23bcd28-9f87-4446-8e6b-98d06af0647a\") " pod="openshift-ingress/kube-auth-proxy-685596c46f-cvm95" Nov 03 22:55:47.419081 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.418929 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4q9r\" (UniqueName: \"kubernetes.io/projected/e23bcd28-9f87-4446-8e6b-98d06af0647a-kube-api-access-q4q9r\") pod \"kube-auth-proxy-685596c46f-cvm95\" (UID: \"e23bcd28-9f87-4446-8e6b-98d06af0647a\") " pod="openshift-ingress/kube-auth-proxy-685596c46f-cvm95" Nov 03 22:55:47.421970 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.421933 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e23bcd28-9f87-4446-8e6b-98d06af0647a-tmp\") pod \"kube-auth-proxy-685596c46f-cvm95\" (UID: \"e23bcd28-9f87-4446-8e6b-98d06af0647a\") " pod="openshift-ingress/kube-auth-proxy-685596c46f-cvm95" Nov 03 22:55:47.422110 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.422079 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e23bcd28-9f87-4446-8e6b-98d06af0647a-tls-certs\") pod \"kube-auth-proxy-685596c46f-cvm95\" (UID: \"e23bcd28-9f87-4446-8e6b-98d06af0647a\") " pod="openshift-ingress/kube-auth-proxy-685596c46f-cvm95" Nov 03 22:55:47.432202 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.432173 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4q9r\" (UniqueName: \"kubernetes.io/projected/e23bcd28-9f87-4446-8e6b-98d06af0647a-kube-api-access-q4q9r\") pod \"kube-auth-proxy-685596c46f-cvm95\" (UID: \"e23bcd28-9f87-4446-8e6b-98d06af0647a\") " pod="openshift-ingress/kube-auth-proxy-685596c46f-cvm95" Nov 03 22:55:47.511162 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.511125 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2"] Nov 03 22:55:47.515957 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.515933 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.519088 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.519068 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-w7g4h\"" Nov 03 22:55:47.533277 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.533251 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2"] Nov 03 22:55:47.546377 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.546345 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:47.604721 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.604698 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-685596c46f-cvm95" Nov 03 22:55:47.620660 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.620633 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cceb7b-521b-43e9-b440-abf2f2926a0d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.620795 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.620675 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93cceb7b-521b-43e9-b440-abf2f2926a0d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.620795 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.620709 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93cceb7b-521b-43e9-b440-abf2f2926a0d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.620929 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.620849 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-642sf\" (UniqueName: \"kubernetes.io/projected/93cceb7b-521b-43e9-b440-abf2f2926a0d-kube-api-access-642sf\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.620986 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.620934 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93cceb7b-521b-43e9-b440-abf2f2926a0d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.620986 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.620978 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cceb7b-521b-43e9-b440-abf2f2926a0d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.621100 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.621072 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93cceb7b-521b-43e9-b440-abf2f2926a0d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.621160 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.621110 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93cceb7b-521b-43e9-b440-abf2f2926a0d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.621160 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.621135 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93cceb7b-521b-43e9-b440-abf2f2926a0d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.660429 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.660394 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:47.722689 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.722647 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-642sf\" (UniqueName: \"kubernetes.io/projected/93cceb7b-521b-43e9-b440-abf2f2926a0d-kube-api-access-642sf\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.722883 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.722707 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93cceb7b-521b-43e9-b440-abf2f2926a0d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.722883 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.722760 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cceb7b-521b-43e9-b440-abf2f2926a0d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.722883 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.722785 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93cceb7b-521b-43e9-b440-abf2f2926a0d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.723042 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.722940 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93cceb7b-521b-43e9-b440-abf2f2926a0d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.723042 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.722986 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93cceb7b-521b-43e9-b440-abf2f2926a0d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.723148 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.723109 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cceb7b-521b-43e9-b440-abf2f2926a0d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.723208 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.723142 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93cceb7b-521b-43e9-b440-abf2f2926a0d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.723208 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.723179 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cceb7b-521b-43e9-b440-abf2f2926a0d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.723309 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.723186 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93cceb7b-521b-43e9-b440-abf2f2926a0d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.723309 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.723281 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93cceb7b-521b-43e9-b440-abf2f2926a0d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.723513 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.723489 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93cceb7b-521b-43e9-b440-abf2f2926a0d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.723606 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.723542 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cceb7b-521b-43e9-b440-abf2f2926a0d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.723937 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.723914 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93cceb7b-521b-43e9-b440-abf2f2926a0d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.725736 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.725720 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93cceb7b-521b-43e9-b440-abf2f2926a0d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.725827 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.725808 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93cceb7b-521b-43e9-b440-abf2f2926a0d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.730015 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.729983 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93cceb7b-521b-43e9-b440-abf2f2926a0d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.730544 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.730523 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-642sf\" (UniqueName: \"kubernetes.io/projected/93cceb7b-521b-43e9-b440-abf2f2926a0d-kube-api-access-642sf\") pod \"data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2\" (UID: \"93cceb7b-521b-43e9-b440-abf2f2926a0d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.765809 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.765764 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:47.831181 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.831142 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:47.877300 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:47.877261 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-685596c46f-cvm95"] Nov 03 22:55:47.890549 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:55:47.890046 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode23bcd28_9f87_4446_8e6b_98d06af0647a.slice/crio-f6b2eaa754ce3dd9c265638a8aba586bf93b6db1317f41aa2adc1a10dcc52ed1 WatchSource:0}: Error finding container f6b2eaa754ce3dd9c265638a8aba586bf93b6db1317f41aa2adc1a10dcc52ed1: Status 404 returned error can't find the container with id f6b2eaa754ce3dd9c265638a8aba586bf93b6db1317f41aa2adc1a10dcc52ed1 Nov 03 22:55:48.114342 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:48.114317 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2"] Nov 03 22:55:48.116713 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:55:48.116685 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93cceb7b_521b_43e9_b440_abf2f2926a0d.slice/crio-94c2b5183d92a3160e3d83b2c28f4f247e7ca08e3da289d1d4803c0da986ba9a WatchSource:0}: Error finding container 94c2b5183d92a3160e3d83b2c28f4f247e7ca08e3da289d1d4803c0da986ba9a: Status 404 returned error can't find the container with id 94c2b5183d92a3160e3d83b2c28f4f247e7ca08e3da289d1d4803c0da986ba9a Nov 03 22:55:48.118995 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:48.118960 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 22:55:48.119146 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:48.119039 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 22:55:48.119146 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:48.119083 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 22:55:48.776407 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:48.776342 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-685596c46f-cvm95" event={"ID":"e23bcd28-9f87-4446-8e6b-98d06af0647a","Type":"ContainerStarted","Data":"f6b2eaa754ce3dd9c265638a8aba586bf93b6db1317f41aa2adc1a10dcc52ed1"} Nov 03 22:55:48.778266 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:48.778235 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" event={"ID":"93cceb7b-521b-43e9-b440-abf2f2926a0d","Type":"ContainerStarted","Data":"cc44f18c79aa108332cf726de2f72820a05fc4fff5927197e9fac9a2e8ad2e08"} Nov 03 22:55:48.778407 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:48.778300 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" event={"ID":"93cceb7b-521b-43e9-b440-abf2f2926a0d","Type":"ContainerStarted","Data":"94c2b5183d92a3160e3d83b2c28f4f247e7ca08e3da289d1d4803c0da986ba9a"} Nov 03 22:55:48.808672 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:48.808576 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" podStartSLOduration=1.808544438 podStartE2EDuration="1.808544438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:55:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:55:48.80591344 +0000 UTC m=+255.336020619" watchObservedRunningTime="2026-11-03 22:55:48.808544438 +0000 UTC m=+255.338651595" Nov 03 22:55:48.832246 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:48.832174 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:49.134977 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:49.134889 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:49.656775 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:49.656738 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:49.795968 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:49.795887 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:49.838151 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:49.838118 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:49.948163 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:49.948070 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:50.271767 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:50.271727 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:50.389123 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:50.389092 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:50.600207 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:50.600134 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:50.708305 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:50.708273 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:50.794652 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:50.794614 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-685596c46f-cvm95" event={"ID":"e23bcd28-9f87-4446-8e6b-98d06af0647a","Type":"ContainerStarted","Data":"91346e37bccbe29fb0cc52998d32acaced8bffbdcb25acb840e4781182d87928"} Nov 03 22:55:50.794893 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:50.794870 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:50.795869 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:50.795853 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2" Nov 03 22:55:50.810239 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:50.810195 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-685596c46f-cvm95" podStartSLOduration=1.246484791 podStartE2EDuration="3.810181685s" totalImagesPullingTime="2.563696894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:55:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:55:50.80872426 +0000 UTC m=+257.338831427" watchObservedRunningTime="2026-11-03 22:55:50.810181685 +0000 UTC m=+257.340288893" Nov 03 22:55:53.751210 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:53.751178 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-xgv72" Nov 03 22:55:54.762909 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:54.762873 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:54.879088 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:54.879050 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:57.222614 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:57.222576 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:55:57.329667 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:55:57.329630 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:01.953966 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:01.953923 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:02.066920 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:02.066876 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:05.241168 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:05.241133 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:05.342745 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:05.342712 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:07.740107 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:07.740070 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:07.849844 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:07.849812 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:08.188987 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:08.188900 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:08.288126 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:08.288088 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:08.555775 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:08.555739 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:08.664653 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:08.664618 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:08.946435 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:08.946353 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:09.054959 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:09.054922 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:09.494173 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:56:09.494139 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 22:56:18.346723 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:18.346500 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:18.445935 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:18.445892 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:18.546931 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:18.546891 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:18.652908 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:18.652800 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:20.130637 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:20.130599 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:20.236413 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:20.236363 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:24.761527 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:24.761490 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:24.872512 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:24.872482 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:39.498256 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:56:39.498220 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 22:56:40.732622 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.732575 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:40.737952 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.737925 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68"] Nov 03 22:56:40.768330 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.768302 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68"] Nov 03 22:56:40.768522 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.768411 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.772826 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.772777 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Nov 03 22:56:40.772983 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.772895 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Nov 03 22:56:40.773056 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.772999 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4z5kk\"" Nov 03 22:56:40.773583 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.773505 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Nov 03 22:56:40.788611 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.788584 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/774a1c32-380d-4046-b391-cecf1bf44bec-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.788729 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.788625 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/774a1c32-380d-4046-b391-cecf1bf44bec-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.788729 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.788650 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/774a1c32-380d-4046-b391-cecf1bf44bec-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.788729 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.788698 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/774a1c32-380d-4046-b391-cecf1bf44bec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.788892 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.788795 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/774a1c32-380d-4046-b391-cecf1bf44bec-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.788892 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.788838 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp5lp\" (UniqueName: \"kubernetes.io/projected/774a1c32-380d-4046-b391-cecf1bf44bec-kube-api-access-gp5lp\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.789129 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.788942 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/774a1c32-380d-4046-b391-cecf1bf44bec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.890419 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.890381 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/774a1c32-380d-4046-b391-cecf1bf44bec-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.890686 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.890443 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp5lp\" (UniqueName: \"kubernetes.io/projected/774a1c32-380d-4046-b391-cecf1bf44bec-kube-api-access-gp5lp\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.890686 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.890559 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/774a1c32-380d-4046-b391-cecf1bf44bec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.890686 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.890598 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/774a1c32-380d-4046-b391-cecf1bf44bec-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.890686 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.890631 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/774a1c32-380d-4046-b391-cecf1bf44bec-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.890686 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.890655 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/774a1c32-380d-4046-b391-cecf1bf44bec-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.890686 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.890680 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/774a1c32-380d-4046-b391-cecf1bf44bec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.892196 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.892159 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/774a1c32-380d-4046-b391-cecf1bf44bec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.893249 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.893217 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:40.894031 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.893971 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/774a1c32-380d-4046-b391-cecf1bf44bec-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.894216 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.894198 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/774a1c32-380d-4046-b391-cecf1bf44bec-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.894293 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.894209 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/774a1c32-380d-4046-b391-cecf1bf44bec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.895199 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.895178 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/774a1c32-380d-4046-b391-cecf1bf44bec-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.914444 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.913857 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp5lp\" (UniqueName: \"kubernetes.io/projected/774a1c32-380d-4046-b391-cecf1bf44bec-kube-api-access-gp5lp\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:40.915379 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:40.915355 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/774a1c32-380d-4046-b391-cecf1bf44bec-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hww68\" (UID: \"774a1c32-380d-4046-b391-cecf1bf44bec\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:41.003644 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:41.003560 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:41.083572 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:41.083541 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:41.123045 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:41.123002 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:41.377987 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:41.377962 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68"] Nov 03 22:56:41.380207 ip-10-0-138-89 kubenswrapper[5332]: W1103 22:56:41.380180 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774a1c32_380d_4046_b391_cecf1bf44bec.slice/crio-3a11acf33a9dd6db2a5627a7f08f61052aa27ecb90088b8250d5d67ef4edee32 WatchSource:0}: Error finding container 3a11acf33a9dd6db2a5627a7f08f61052aa27ecb90088b8250d5d67ef4edee32: Status 404 returned error can't find the container with id 3a11acf33a9dd6db2a5627a7f08f61052aa27ecb90088b8250d5d67ef4edee32 Nov 03 22:56:41.382087 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:41.382072 5332 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 22:56:41.913570 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:41.913528 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:42.025163 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:42.025130 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:42.034596 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:42.034569 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" event={"ID":"774a1c32-380d-4046-b391-cecf1bf44bec","Type":"ContainerStarted","Data":"3a11acf33a9dd6db2a5627a7f08f61052aa27ecb90088b8250d5d67ef4edee32"} Nov 03 22:56:42.136666 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:42.136631 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:43.534295 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:43.534255 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:56:45.234544 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:45.234510 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 22:56:45.234843 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:45.234574 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 22:56:46.055612 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:46.055569 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" event={"ID":"774a1c32-380d-4046-b391-cecf1bf44bec","Type":"ContainerStarted","Data":"e54a06c135ee5a479e64d7256f12f1c18e0dbbde36ce3a066d000305188faac5"} Nov 03 22:56:46.055814 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:46.055731 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:46.057284 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:46.057261 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" Nov 03 22:56:46.074382 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:56:46.074317 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hww68" podStartSLOduration=2.222935459 podStartE2EDuration="6.074301407s" totalImagesPullingTime="3.851365948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:56:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:56:46.07325055 +0000 UTC m=+312.603357716" watchObservedRunningTime="2026-11-03 22:56:46.074301407 +0000 UTC m=+312.604408575" Nov 03 22:57:05.423854 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:57:05.423818 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:57:05.533554 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:57:05.533515 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:57:09.493261 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:57:09.493213 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 22:57:39.494260 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:57:39.494220 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 22:57:43.589292 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:57:43.589210 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:57:47.667754 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:57:47.667718 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:58:09.492489 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:58:09.492436 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 22:58:39.493310 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:58:39.493272 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 22:58:43.628209 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:58:43.628173 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:58:57.630443 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:58:57.630403 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:58:57.744808 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:58:57.744774 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:59:09.493758 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:59:09.493720 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 22:59:36.130515 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:59:36.130408 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:59:39.493658 ip-10-0-138-89 kubenswrapper[5332]: E1103 22:59:39.493622 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 22:59:41.502905 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:59:41.502868 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:59:41.609425 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:59:41.609385 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 22:59:43.669942 ip-10-0-138-89 kubenswrapper[5332]: I1103 22:59:43.669896 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:00:09.494152 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:00:09.494111 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:00:37.367034 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:00:37.367000 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:00:39.494408 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:00:39.494371 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:00:43.683934 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:00:43.683861 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:01:09.493917 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:01:09.493869 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:01:36.183303 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:01:36.183268 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:01:39.492784 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:01:39.492744 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:01:43.774703 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:01:43.774663 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:02:03.221077 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:02:03.221039 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:02:03.326173 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:02:03.326137 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:02:09.494152 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:02:09.494115 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:02:39.493334 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:02:39.493251 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:02:43.815730 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:02:43.815693 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:03:09.493021 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:03:09.492972 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:03:39.492926 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:03:39.492889 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:03:43.863950 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:03:43.863861 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:04:09.493949 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:04:09.493911 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:04:39.493960 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:04:39.493927 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:04:43.904693 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:04:43.904655 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:05:09.492504 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:05:09.492434 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:05:39.493827 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:05:39.493777 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:05:43.952366 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:05:43.952328 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:05:45.034248 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:05:45.034217 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:06:09.493297 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:06:09.493261 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:06:25.982270 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:06:25.982235 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:06:39.493308 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:06:39.493264 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:06:44.001270 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:06:44.001187 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:06:45.229607 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:06:45.229572 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:06:45.340891 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:06:45.340849 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:06:45.998783 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:06:45.998745 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:07:00.542333 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:07:00.542295 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:07:00.657852 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:07:00.657820 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:07:00.946861 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:07:00.946766 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:07:09.493171 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:07:09.493138 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:07:30.311876 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:07:30.311838 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:07:30.416166 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:07:30.416137 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:07:39.493659 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:07:39.493623 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:07:44.044207 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:07:44.044160 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:08:09.170030 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:09.169997 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:08:09.283896 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:09.283865 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:08:09.389540 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:09.389508 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:08:09.494514 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:08:09.494477 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:08:09.494906 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:09.494887 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:08:09.597607 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:09.597577 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:08:13.375599 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:13.375518 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:08:13.516697 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:13.516649 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:08:15.097548 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:15.097515 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:08:15.206474 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:15.206417 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:08:24.256754 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:24.256723 5332 generic.go:356] "Generic (PLEG): container finished" podID="0e954b77-1065-4605-9acc-4dadcc4c42ad" containerID="88ce05b0021bbf441031609710462d654a097cf86035ff4aca15eceec5a94925" exitCode=0 Nov 03 23:08:24.257171 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:24.256798 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" event={"ID":"0e954b77-1065-4605-9acc-4dadcc4c42ad","Type":"ContainerDied","Data":"88ce05b0021bbf441031609710462d654a097cf86035ff4aca15eceec5a94925"} Nov 03 23:08:24.257171 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:24.257149 5332 scope.go:122] "RemoveContainer" containerID="88ce05b0021bbf441031609710462d654a097cf86035ff4aca15eceec5a94925" Nov 03 23:08:24.258153 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:24.258128 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:08:24.258212 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:24.258199 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:08:24.258252 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:24.258239 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:08:25.263249 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:25.263215 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" event={"ID":"0e954b77-1065-4605-9acc-4dadcc4c42ad","Type":"ContainerStarted","Data":"9cfaeca01969f60de8670ac8827dff72822daf06244dfe8bf7223c8d9166b522"} Nov 03 23:08:25.824795 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:25.824751 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 23:08:25.824980 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:25.824953 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body= Nov 03 23:08:25.825030 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:25.825001 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" podUID="0e954b77-1065-4605-9acc-4dadcc4c42ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" Nov 03 23:08:26.824643 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:26.824604 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body= Nov 03 23:08:26.825123 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:26.824669 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" podUID="0e954b77-1065-4605-9acc-4dadcc4c42ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" Nov 03 23:08:27.824128 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:27.824085 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body= Nov 03 23:08:27.824347 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:27.824153 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" podUID="0e954b77-1065-4605-9acc-4dadcc4c42ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" Nov 03 23:08:28.824067 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:28.824029 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body= Nov 03 23:08:28.824603 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:28.824088 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" podUID="0e954b77-1065-4605-9acc-4dadcc4c42ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" Nov 03 23:08:29.824651 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:29.824616 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body= Nov 03 23:08:29.825020 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:29.824679 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" podUID="0e954b77-1065-4605-9acc-4dadcc4c42ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" Nov 03 23:08:30.828055 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:30.828021 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 23:08:30.828520 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:30.828304 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 23:08:30.828902 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:30.828884 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" Nov 03 23:08:32.459679 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:32.459643 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:08:39.494161 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:08:39.494121 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:08:44.092682 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:44.092640 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:08:45.173865 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:45.173832 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:08:45.292511 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:45.292477 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:08:46.513715 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:46.513679 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:08:46.661992 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:46.661952 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:08:46.805024 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:46.804929 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:08:58.010468 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:58.010429 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:08:58.110237 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:08:58.110206 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:09:09.492925 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:09:09.492876 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:09:39.492751 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:09:39.492718 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:09:44.141323 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:09:44.141237 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:10:09.495323 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:10:09.495281 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:10:22.202805 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:22.202769 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:10:22.310338 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:22.310304 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:10:28.423489 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:28.423431 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-mrg4r"] Nov 03 23:10:28.427243 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:28.427220 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-mrg4r" Nov 03 23:10:28.438349 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:28.438324 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Nov 03 23:10:28.439365 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:28.439339 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-mrg4r"] Nov 03 23:10:28.439973 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:28.439946 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:10:28.539029 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:28.538990 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c4d252c-8f2c-42ee-a443-617c1ed3f5a2-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-mrg4r\" (UID: \"8c4d252c-8f2c-42ee-a443-617c1ed3f5a2\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-mrg4r" Nov 03 23:10:28.539217 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:28.539042 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txtgl\" (UniqueName: \"kubernetes.io/projected/8c4d252c-8f2c-42ee-a443-617c1ed3f5a2-kube-api-access-txtgl\") pod \"payload-pre-processing-7b98bb678c-mrg4r\" (UID: \"8c4d252c-8f2c-42ee-a443-617c1ed3f5a2\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-mrg4r" Nov 03 23:10:28.627945 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:28.627905 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:10:28.639969 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:28.639943 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c4d252c-8f2c-42ee-a443-617c1ed3f5a2-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-mrg4r\" (UID: \"8c4d252c-8f2c-42ee-a443-617c1ed3f5a2\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-mrg4r" Nov 03 23:10:28.640076 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:28.639982 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txtgl\" (UniqueName: \"kubernetes.io/projected/8c4d252c-8f2c-42ee-a443-617c1ed3f5a2-kube-api-access-txtgl\") pod \"payload-pre-processing-7b98bb678c-mrg4r\" (UID: \"8c4d252c-8f2c-42ee-a443-617c1ed3f5a2\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-mrg4r" Nov 03 23:10:28.640672 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:28.640655 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c4d252c-8f2c-42ee-a443-617c1ed3f5a2-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-mrg4r\" (UID: \"8c4d252c-8f2c-42ee-a443-617c1ed3f5a2\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-mrg4r" Nov 03 23:10:28.647275 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:28.647242 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txtgl\" (UniqueName: \"kubernetes.io/projected/8c4d252c-8f2c-42ee-a443-617c1ed3f5a2-kube-api-access-txtgl\") pod \"payload-pre-processing-7b98bb678c-mrg4r\" (UID: \"8c4d252c-8f2c-42ee-a443-617c1ed3f5a2\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-mrg4r" Nov 03 23:10:28.745424 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:28.745397 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-mrg4r" Nov 03 23:10:29.015664 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:29.015587 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-mrg4r"] Nov 03 23:10:29.018179 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:10:29.018154 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c4d252c_8f2c_42ee_a443_617c1ed3f5a2.slice/crio-592c2923aa26cac7688ec3a30fabf2f8fa801f541e2dbff2e0fa253b7f6d4e2b WatchSource:0}: Error finding container 592c2923aa26cac7688ec3a30fabf2f8fa801f541e2dbff2e0fa253b7f6d4e2b: Status 404 returned error can't find the container with id 592c2923aa26cac7688ec3a30fabf2f8fa801f541e2dbff2e0fa253b7f6d4e2b Nov 03 23:10:29.019821 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:29.019805 5332 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 23:10:29.823860 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:29.823815 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-mrg4r" event={"ID":"8c4d252c-8f2c-42ee-a443-617c1ed3f5a2","Type":"ContainerStarted","Data":"592c2923aa26cac7688ec3a30fabf2f8fa801f541e2dbff2e0fa253b7f6d4e2b"} Nov 03 23:10:31.837514 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:31.837415 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-mrg4r" event={"ID":"8c4d252c-8f2c-42ee-a443-617c1ed3f5a2","Type":"ContainerStarted","Data":"73fba75468194dc951defa1ef70af17e64b3d9a0eb30328c537c25900a384d8e"} Nov 03 23:10:31.837949 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:31.837526 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-mrg4r" Nov 03 23:10:31.853222 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:31.853166 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-mrg4r" podStartSLOduration=1.724185863 podStartE2EDuration="3.853146397s" totalImagesPullingTime="2.128960534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:10:31.851738923 +0000 UTC m=+1138.381846091" watchObservedRunningTime="2026-11-03 23:10:31.853146397 +0000 UTC m=+1138.383253569" Nov 03 23:10:38.403094 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:38.403058 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-95895fbfc-2qtm9"] Nov 03 23:10:38.406662 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:38.406642 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-95895fbfc-2qtm9" Nov 03 23:10:38.413351 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:38.413320 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-95895fbfc-2qtm9"] Nov 03 23:10:38.414063 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:38.413959 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Nov 03 23:10:38.414063 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:38.414031 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Nov 03 23:10:38.414198 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:38.414105 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Nov 03 23:10:38.414198 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:38.414110 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\"" Nov 03 23:10:38.414285 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:38.414240 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-wmn4x\"" Nov 03 23:10:38.417172 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:38.417146 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgncx\" (UniqueName: \"kubernetes.io/projected/891c9f5c-8c84-41d6-81fb-89d3af025123-kube-api-access-lgncx\") pod \"ai-gateway-controller-95895fbfc-2qtm9\" (UID: \"891c9f5c-8c84-41d6-81fb-89d3af025123\") " pod="opendatahub/ai-gateway-controller-95895fbfc-2qtm9" Nov 03 23:10:38.417279 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:38.417195 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/891c9f5c-8c84-41d6-81fb-89d3af025123-metrics-certs\") pod \"ai-gateway-controller-95895fbfc-2qtm9\" (UID: \"891c9f5c-8c84-41d6-81fb-89d3af025123\") " pod="opendatahub/ai-gateway-controller-95895fbfc-2qtm9" Nov 03 23:10:38.518438 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:38.518401 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/891c9f5c-8c84-41d6-81fb-89d3af025123-metrics-certs\") pod \"ai-gateway-controller-95895fbfc-2qtm9\" (UID: \"891c9f5c-8c84-41d6-81fb-89d3af025123\") " pod="opendatahub/ai-gateway-controller-95895fbfc-2qtm9" Nov 03 23:10:38.518647 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:38.518516 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgncx\" (UniqueName: \"kubernetes.io/projected/891c9f5c-8c84-41d6-81fb-89d3af025123-kube-api-access-lgncx\") pod \"ai-gateway-controller-95895fbfc-2qtm9\" (UID: \"891c9f5c-8c84-41d6-81fb-89d3af025123\") " pod="opendatahub/ai-gateway-controller-95895fbfc-2qtm9" Nov 03 23:10:38.521021 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:38.520997 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/891c9f5c-8c84-41d6-81fb-89d3af025123-metrics-certs\") pod \"ai-gateway-controller-95895fbfc-2qtm9\" (UID: \"891c9f5c-8c84-41d6-81fb-89d3af025123\") " pod="opendatahub/ai-gateway-controller-95895fbfc-2qtm9" Nov 03 23:10:38.525942 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:38.525912 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgncx\" (UniqueName: \"kubernetes.io/projected/891c9f5c-8c84-41d6-81fb-89d3af025123-kube-api-access-lgncx\") pod \"ai-gateway-controller-95895fbfc-2qtm9\" (UID: \"891c9f5c-8c84-41d6-81fb-89d3af025123\") " pod="opendatahub/ai-gateway-controller-95895fbfc-2qtm9" Nov 03 23:10:38.720173 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:38.720140 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-95895fbfc-2qtm9" Nov 03 23:10:38.991310 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:38.991288 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-95895fbfc-2qtm9"] Nov 03 23:10:38.994049 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:10:38.994024 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod891c9f5c_8c84_41d6_81fb_89d3af025123.slice/crio-83e0c38cedadd4a46b52ca7b0599ed353aa911f421192c0911f4c002951d51b0 WatchSource:0}: Error finding container 83e0c38cedadd4a46b52ca7b0599ed353aa911f421192c0911f4c002951d51b0: Status 404 returned error can't find the container with id 83e0c38cedadd4a46b52ca7b0599ed353aa911f421192c0911f4c002951d51b0 Nov 03 23:10:39.505599 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:10:39.505563 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:10:39.878822 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:39.878742 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-95895fbfc-2qtm9" event={"ID":"891c9f5c-8c84-41d6-81fb-89d3af025123","Type":"ContainerStarted","Data":"83e0c38cedadd4a46b52ca7b0599ed353aa911f421192c0911f4c002951d51b0"} Nov 03 23:10:41.890519 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:41.890486 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-95895fbfc-2qtm9" event={"ID":"891c9f5c-8c84-41d6-81fb-89d3af025123","Type":"ContainerStarted","Data":"5a883a0df0b72f7e1d5111f36d1bcb21a20faf6dea49b37cf4c96547f68af6f3"} Nov 03 23:10:41.891018 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:41.890572 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-95895fbfc-2qtm9" Nov 03 23:10:41.905839 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:41.905773 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-95895fbfc-2qtm9" podStartSLOduration=1.626317952 podStartE2EDuration="3.905754908s" totalImagesPullingTime="2.279436956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:10:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:10:41.904593162 +0000 UTC m=+1148.434700350" watchObservedRunningTime="2026-11-03 23:10:41.905754908 +0000 UTC m=+1148.435862076" Nov 03 23:10:42.846094 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:42.846067 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-mrg4r" Nov 03 23:10:44.187711 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:44.187666 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:10:52.898230 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:10:52.898202 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-95895fbfc-2qtm9" Nov 03 23:11:04.574363 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:04.574314 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:11:09.495907 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:11:09.495864 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:11:15.041196 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:15.041109 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:11:16.419142 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:16.419105 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:11:16.531912 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:16.531871 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:11:18.395097 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:18.395058 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:11:18.510415 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:18.510382 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:11:19.458676 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:19.458642 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:11:22.010157 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.010126 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5"] Nov 03 23:11:22.013619 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.013598 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:22.017764 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.017745 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dsjx4\"" Nov 03 23:11:22.019707 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.019686 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Nov 03 23:11:22.020284 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.020223 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Nov 03 23:11:22.020402 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.020358 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Nov 03 23:11:22.022732 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.022706 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5"] Nov 03 23:11:22.071940 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.071888 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:11:22.199507 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.199446 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc63c523-9c57-4273-93a1-ce5bbe4de920-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-6nbz5\" (UID: \"fc63c523-9c57-4273-93a1-ce5bbe4de920\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:22.199676 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.199577 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc63c523-9c57-4273-93a1-ce5bbe4de920-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-6nbz5\" (UID: \"fc63c523-9c57-4273-93a1-ce5bbe4de920\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:22.199676 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.199603 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc63c523-9c57-4273-93a1-ce5bbe4de920-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-6nbz5\" (UID: \"fc63c523-9c57-4273-93a1-ce5bbe4de920\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:22.199762 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.199684 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc63c523-9c57-4273-93a1-ce5bbe4de920-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-6nbz5\" (UID: \"fc63c523-9c57-4273-93a1-ce5bbe4de920\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:22.199762 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.199740 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9v5q\" (UniqueName: \"kubernetes.io/projected/fc63c523-9c57-4273-93a1-ce5bbe4de920-kube-api-access-t9v5q\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-6nbz5\" (UID: \"fc63c523-9c57-4273-93a1-ce5bbe4de920\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:22.199837 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.199776 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc63c523-9c57-4273-93a1-ce5bbe4de920-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-6nbz5\" (UID: \"fc63c523-9c57-4273-93a1-ce5bbe4de920\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:22.300501 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.300399 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9v5q\" (UniqueName: \"kubernetes.io/projected/fc63c523-9c57-4273-93a1-ce5bbe4de920-kube-api-access-t9v5q\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-6nbz5\" (UID: \"fc63c523-9c57-4273-93a1-ce5bbe4de920\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:22.300501 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.300447 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc63c523-9c57-4273-93a1-ce5bbe4de920-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-6nbz5\" (UID: \"fc63c523-9c57-4273-93a1-ce5bbe4de920\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:22.300501 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.300492 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc63c523-9c57-4273-93a1-ce5bbe4de920-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-6nbz5\" (UID: \"fc63c523-9c57-4273-93a1-ce5bbe4de920\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:22.300781 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.300526 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc63c523-9c57-4273-93a1-ce5bbe4de920-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-6nbz5\" (UID: \"fc63c523-9c57-4273-93a1-ce5bbe4de920\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:22.300781 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.300544 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc63c523-9c57-4273-93a1-ce5bbe4de920-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-6nbz5\" (UID: \"fc63c523-9c57-4273-93a1-ce5bbe4de920\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:22.300781 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.300572 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc63c523-9c57-4273-93a1-ce5bbe4de920-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-6nbz5\" (UID: \"fc63c523-9c57-4273-93a1-ce5bbe4de920\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:22.300960 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.300933 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc63c523-9c57-4273-93a1-ce5bbe4de920-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-6nbz5\" (UID: \"fc63c523-9c57-4273-93a1-ce5bbe4de920\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:22.301023 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.300948 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc63c523-9c57-4273-93a1-ce5bbe4de920-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-6nbz5\" (UID: \"fc63c523-9c57-4273-93a1-ce5bbe4de920\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:22.301063 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.301032 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc63c523-9c57-4273-93a1-ce5bbe4de920-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-6nbz5\" (UID: \"fc63c523-9c57-4273-93a1-ce5bbe4de920\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:22.303012 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.302990 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc63c523-9c57-4273-93a1-ce5bbe4de920-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-6nbz5\" (UID: \"fc63c523-9c57-4273-93a1-ce5bbe4de920\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:22.303373 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.303349 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc63c523-9c57-4273-93a1-ce5bbe4de920-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-6nbz5\" (UID: \"fc63c523-9c57-4273-93a1-ce5bbe4de920\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:22.307545 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.307523 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9v5q\" (UniqueName: \"kubernetes.io/projected/fc63c523-9c57-4273-93a1-ce5bbe4de920-kube-api-access-t9v5q\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-6nbz5\" (UID: \"fc63c523-9c57-4273-93a1-ce5bbe4de920\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:22.329566 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.329534 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:22.601623 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:22.601414 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5"] Nov 03 23:11:22.603995 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:11:22.603963 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc63c523_9c57_4273_93a1_ce5bbe4de920.slice/crio-5903d46a64d145ececb94509ca489eaaa31d073fd45c58c3b8275b1a61ed2d74 WatchSource:0}: Error finding container 5903d46a64d145ececb94509ca489eaaa31d073fd45c58c3b8275b1a61ed2d74: Status 404 returned error can't find the container with id 5903d46a64d145ececb94509ca489eaaa31d073fd45c58c3b8275b1a61ed2d74 Nov 03 23:11:23.069033 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.069001 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4"] Nov 03 23:11:23.072842 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.072751 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:23.084057 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.083473 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4"] Nov 03 23:11:23.084057 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.083691 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Nov 03 23:11:23.117849 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.113770 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" event={"ID":"fc63c523-9c57-4273-93a1-ce5bbe4de920","Type":"ContainerStarted","Data":"5903d46a64d145ececb94509ca489eaaa31d073fd45c58c3b8275b1a61ed2d74"} Nov 03 23:11:23.144176 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.144099 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:11:23.216128 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.216006 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pkjh4\" (UID: \"1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:23.216532 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.216101 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pkjh4\" (UID: \"1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:23.216810 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.216715 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hqr6\" (UniqueName: \"kubernetes.io/projected/1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459-kube-api-access-8hqr6\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pkjh4\" (UID: \"1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:23.217019 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.216973 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pkjh4\" (UID: \"1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:23.217186 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.217140 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pkjh4\" (UID: \"1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:23.217436 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.217379 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pkjh4\" (UID: \"1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:23.319384 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.318091 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pkjh4\" (UID: \"1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:23.319384 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.318149 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hqr6\" (UniqueName: \"kubernetes.io/projected/1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459-kube-api-access-8hqr6\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pkjh4\" (UID: \"1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:23.319384 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.318180 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pkjh4\" (UID: \"1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:23.319384 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.318197 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pkjh4\" (UID: \"1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:23.319384 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.318214 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pkjh4\" (UID: \"1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:23.319384 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.318280 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pkjh4\" (UID: \"1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:23.319384 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.318869 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pkjh4\" (UID: \"1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:23.319384 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.318930 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pkjh4\" (UID: \"1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:23.319384 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.319207 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pkjh4\" (UID: \"1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:23.323602 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.323575 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pkjh4\" (UID: \"1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:23.327073 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.327046 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hqr6\" (UniqueName: \"kubernetes.io/projected/1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459-kube-api-access-8hqr6\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pkjh4\" (UID: \"1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:23.331196 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.331137 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pkjh4\" (UID: \"1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:23.391655 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.391401 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:23.713055 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:23.713019 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4"] Nov 03 23:11:23.716937 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:11:23.716903 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a7e5c7b_f80f_4ce1_aef5_2da9b0cc9459.slice/crio-65e36f7df20f3d717a6bcd581cace81dec3989cbae9d3a4f2ed740f55d97022b WatchSource:0}: Error finding container 65e36f7df20f3d717a6bcd581cace81dec3989cbae9d3a4f2ed740f55d97022b: Status 404 returned error can't find the container with id 65e36f7df20f3d717a6bcd581cace81dec3989cbae9d3a4f2ed740f55d97022b Nov 03 23:11:24.125020 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:24.124987 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" event={"ID":"1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459","Type":"ContainerStarted","Data":"1a33e81d13d142c83f9910e17686271bd787ac863bb9018fa6b77eacd49168ee"} Nov 03 23:11:24.125496 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:24.125047 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" event={"ID":"1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459","Type":"ContainerStarted","Data":"65e36f7df20f3d717a6bcd581cace81dec3989cbae9d3a4f2ed740f55d97022b"} Nov 03 23:11:24.126904 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:24.126881 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" event={"ID":"fc63c523-9c57-4273-93a1-ce5bbe4de920","Type":"ContainerStarted","Data":"6af22cc4ba65a8b782995b4b7149654c1a0e47e6ba320a0f9299dc3ad9ee6905"} Nov 03 23:11:24.140927 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:24.140863 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" podStartSLOduration=0.827624269 podStartE2EDuration="1.140847787s" totalImagesPullingTime="313.223518ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:11:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:11:24.140152711 +0000 UTC m=+1190.670259879" watchObservedRunningTime="2026-11-03 23:11:24.140847787 +0000 UTC m=+1190.670954955" Nov 03 23:11:24.155623 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:24.155581 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" podStartSLOduration=1.752939541 podStartE2EDuration="3.155570672s" totalImagesPullingTime="1.402631131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:11:24.155344606 +0000 UTC m=+1190.685451774" watchObservedRunningTime="2026-11-03 23:11:24.155570672 +0000 UTC m=+1190.685677879" Nov 03 23:11:24.329748 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:24.329673 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:24.391901 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:24.391861 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:26.466061 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:26.466029 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:11:28.680753 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.680723 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6"] Nov 03 23:11:28.684278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.684259 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:28.688045 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.688024 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Nov 03 23:11:28.693900 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.693874 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6"] Nov 03 23:11:28.747946 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.747912 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:11:28.762812 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.762784 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d9ddb43-4e3c-459b-9bf2-ba6e422d414e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6\" (UID: \"4d9ddb43-4e3c-459b-9bf2-ba6e422d414e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:28.762923 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.762813 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d9ddb43-4e3c-459b-9bf2-ba6e422d414e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6\" (UID: \"4d9ddb43-4e3c-459b-9bf2-ba6e422d414e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:28.762923 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.762842 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d9ddb43-4e3c-459b-9bf2-ba6e422d414e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6\" (UID: \"4d9ddb43-4e3c-459b-9bf2-ba6e422d414e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:28.762999 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.762938 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d9ddb43-4e3c-459b-9bf2-ba6e422d414e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6\" (UID: \"4d9ddb43-4e3c-459b-9bf2-ba6e422d414e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:28.762999 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.762956 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d4kk\" (UniqueName: \"kubernetes.io/projected/4d9ddb43-4e3c-459b-9bf2-ba6e422d414e-kube-api-access-4d4kk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6\" (UID: \"4d9ddb43-4e3c-459b-9bf2-ba6e422d414e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:28.763073 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.763021 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d9ddb43-4e3c-459b-9bf2-ba6e422d414e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6\" (UID: \"4d9ddb43-4e3c-459b-9bf2-ba6e422d414e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:28.863579 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.863548 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d9ddb43-4e3c-459b-9bf2-ba6e422d414e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6\" (UID: \"4d9ddb43-4e3c-459b-9bf2-ba6e422d414e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:28.863766 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.863605 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d9ddb43-4e3c-459b-9bf2-ba6e422d414e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6\" (UID: \"4d9ddb43-4e3c-459b-9bf2-ba6e422d414e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:28.863766 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.863623 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d4kk\" (UniqueName: \"kubernetes.io/projected/4d9ddb43-4e3c-459b-9bf2-ba6e422d414e-kube-api-access-4d4kk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6\" (UID: \"4d9ddb43-4e3c-459b-9bf2-ba6e422d414e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:28.863766 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.863649 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d9ddb43-4e3c-459b-9bf2-ba6e422d414e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6\" (UID: \"4d9ddb43-4e3c-459b-9bf2-ba6e422d414e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:28.863945 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.863797 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d9ddb43-4e3c-459b-9bf2-ba6e422d414e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6\" (UID: \"4d9ddb43-4e3c-459b-9bf2-ba6e422d414e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:28.863945 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.863845 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d9ddb43-4e3c-459b-9bf2-ba6e422d414e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6\" (UID: \"4d9ddb43-4e3c-459b-9bf2-ba6e422d414e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:28.864048 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.863970 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d9ddb43-4e3c-459b-9bf2-ba6e422d414e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6\" (UID: \"4d9ddb43-4e3c-459b-9bf2-ba6e422d414e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:28.864206 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.864183 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d9ddb43-4e3c-459b-9bf2-ba6e422d414e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6\" (UID: \"4d9ddb43-4e3c-459b-9bf2-ba6e422d414e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:28.864259 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.864238 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d9ddb43-4e3c-459b-9bf2-ba6e422d414e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6\" (UID: \"4d9ddb43-4e3c-459b-9bf2-ba6e422d414e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:28.866019 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.865999 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d9ddb43-4e3c-459b-9bf2-ba6e422d414e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6\" (UID: \"4d9ddb43-4e3c-459b-9bf2-ba6e422d414e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:28.866215 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.866194 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d9ddb43-4e3c-459b-9bf2-ba6e422d414e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6\" (UID: \"4d9ddb43-4e3c-459b-9bf2-ba6e422d414e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:28.871986 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.871966 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d4kk\" (UniqueName: \"kubernetes.io/projected/4d9ddb43-4e3c-459b-9bf2-ba6e422d414e-kube-api-access-4d4kk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6\" (UID: \"4d9ddb43-4e3c-459b-9bf2-ba6e422d414e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:28.998656 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:28.998627 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:29.276375 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:29.276352 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6"] Nov 03 23:11:29.278931 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:11:29.278897 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d9ddb43_4e3c_459b_9bf2_ba6e422d414e.slice/crio-da63da6f36ad4b250c5f9a2f36ef47c6230bbc31103f436a712afcdaed273556 WatchSource:0}: Error finding container da63da6f36ad4b250c5f9a2f36ef47c6230bbc31103f436a712afcdaed273556: Status 404 returned error can't find the container with id da63da6f36ad4b250c5f9a2f36ef47c6230bbc31103f436a712afcdaed273556 Nov 03 23:11:30.062905 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:30.062869 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:11:30.162795 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:30.162760 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" event={"ID":"4d9ddb43-4e3c-459b-9bf2-ba6e422d414e","Type":"ContainerStarted","Data":"5325880b0c8f1ac6b62b57b59c70e4ad01bfc90f15bfffaea29eb837dd59a096"} Nov 03 23:11:30.162963 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:30.162808 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" event={"ID":"4d9ddb43-4e3c-459b-9bf2-ba6e422d414e","Type":"ContainerStarted","Data":"da63da6f36ad4b250c5f9a2f36ef47c6230bbc31103f436a712afcdaed273556"} Nov 03 23:11:30.180799 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:30.180737 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" podStartSLOduration=1.856882906 podStartE2EDuration="2.180722569s" totalImagesPullingTime="323.839663ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:11:30.178573018 +0000 UTC m=+1196.708680196" watchObservedRunningTime="2026-11-03 23:11:30.180722569 +0000 UTC m=+1196.710829737" Nov 03 23:11:30.998923 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:30.998882 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:31.213749 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:31.213713 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:11:32.330446 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:32.330399 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:32.344428 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:32.344398 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:32.649227 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:32.649139 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:11:33.190336 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:33.190307 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-6nbz5" Nov 03 23:11:33.392025 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:33.391992 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:33.404430 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:33.404406 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:34.197279 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:34.197247 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pkjh4" Nov 03 23:11:38.999380 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:38.999346 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:39.011964 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:39.011937 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:39.220751 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:39.220727 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6" Nov 03 23:11:39.493030 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:11:39.492996 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:11:44.245173 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:44.245142 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:11:54.439177 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.439140 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb"] Nov 03 23:11:54.443096 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.443073 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.458504 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.458480 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb"] Nov 03 23:11:54.488181 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.488151 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2968f41-e062-475f-b3ca-22c20073f2f1-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.488333 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.488185 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2968f41-e062-475f-b3ca-22c20073f2f1-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.488333 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.488207 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2968f41-e062-475f-b3ca-22c20073f2f1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.488333 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.488227 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2968f41-e062-475f-b3ca-22c20073f2f1-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.488442 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.488357 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcf92\" (UniqueName: \"kubernetes.io/projected/d2968f41-e062-475f-b3ca-22c20073f2f1-kube-api-access-tcf92\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.488442 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.488392 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2968f41-e062-475f-b3ca-22c20073f2f1-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.488549 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.488491 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2968f41-e062-475f-b3ca-22c20073f2f1-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.488549 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.488508 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2968f41-e062-475f-b3ca-22c20073f2f1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.488549 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.488543 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2968f41-e062-475f-b3ca-22c20073f2f1-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.589286 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.589242 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2968f41-e062-475f-b3ca-22c20073f2f1-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.589477 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.589292 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2968f41-e062-475f-b3ca-22c20073f2f1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.589477 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.589328 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2968f41-e062-475f-b3ca-22c20073f2f1-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.589477 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.589389 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2968f41-e062-475f-b3ca-22c20073f2f1-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.589477 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.589417 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2968f41-e062-475f-b3ca-22c20073f2f1-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.589477 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.589441 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2968f41-e062-475f-b3ca-22c20073f2f1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.589770 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.589492 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2968f41-e062-475f-b3ca-22c20073f2f1-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.589770 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.589523 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcf92\" (UniqueName: \"kubernetes.io/projected/d2968f41-e062-475f-b3ca-22c20073f2f1-kube-api-access-tcf92\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.589770 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.589546 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2968f41-e062-475f-b3ca-22c20073f2f1-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.589770 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.589665 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2968f41-e062-475f-b3ca-22c20073f2f1-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.589770 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.589735 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2968f41-e062-475f-b3ca-22c20073f2f1-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.590067 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.590037 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2968f41-e062-475f-b3ca-22c20073f2f1-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.590351 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.590323 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2968f41-e062-475f-b3ca-22c20073f2f1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.590481 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.590355 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2968f41-e062-475f-b3ca-22c20073f2f1-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.592129 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.592107 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2968f41-e062-475f-b3ca-22c20073f2f1-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.592211 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.592113 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2968f41-e062-475f-b3ca-22c20073f2f1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.596291 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.596270 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2968f41-e062-475f-b3ca-22c20073f2f1-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.596581 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.596560 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcf92\" (UniqueName: \"kubernetes.io/projected/d2968f41-e062-475f-b3ca-22c20073f2f1-kube-api-access-tcf92\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-kjjnb\" (UID: \"d2968f41-e062-475f-b3ca-22c20073f2f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:54.763588 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:54.763554 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:55.036611 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:55.036586 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb"] Nov 03 23:11:55.039067 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:11:55.039035 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2968f41_e062_475f_b3ca_22c20073f2f1.slice/crio-f2a9356783c0f7e41bfc45ee0c39dab812505ed5a0fb1b60fc0fc8f49ae1c40a WatchSource:0}: Error finding container f2a9356783c0f7e41bfc45ee0c39dab812505ed5a0fb1b60fc0fc8f49ae1c40a: Status 404 returned error can't find the container with id f2a9356783c0f7e41bfc45ee0c39dab812505ed5a0fb1b60fc0fc8f49ae1c40a Nov 03 23:11:55.041200 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:55.041170 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:11:55.041274 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:55.041233 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:11:55.041313 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:55.041275 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:11:55.289154 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:55.289060 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" event={"ID":"d2968f41-e062-475f-b3ca-22c20073f2f1","Type":"ContainerStarted","Data":"22aa6d8db30084afa4c3a295eb7d1e3beb55e9b1c9a43b5b351c083ee8c2f8f3"} Nov 03 23:11:55.289154 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:55.289128 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" event={"ID":"d2968f41-e062-475f-b3ca-22c20073f2f1","Type":"ContainerStarted","Data":"f2a9356783c0f7e41bfc45ee0c39dab812505ed5a0fb1b60fc0fc8f49ae1c40a"} Nov 03 23:11:55.307398 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:55.307342 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" podStartSLOduration=1.30732264 podStartE2EDuration="1.30732264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:11:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:11:55.30558272 +0000 UTC m=+1221.835689910" watchObservedRunningTime="2026-11-03 23:11:55.30732264 +0000 UTC m=+1221.837429809" Nov 03 23:11:55.764354 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:55.764318 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:11:56.765087 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:56.765051 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Nov 03 23:11:56.765530 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:56.765118 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" podUID="d2968f41-e062-475f-b3ca-22c20073f2f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Nov 03 23:11:57.764308 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:57.764277 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Nov 03 23:11:57.764513 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:57.764340 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" podUID="d2968f41-e062-475f-b3ca-22c20073f2f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Nov 03 23:11:58.763965 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:58.763928 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Nov 03 23:11:58.764394 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:58.763994 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" podUID="d2968f41-e062-475f-b3ca-22c20073f2f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Nov 03 23:11:59.764645 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:59.764611 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Nov 03 23:11:59.765052 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:11:59.764664 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" podUID="d2968f41-e062-475f-b3ca-22c20073f2f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Nov 03 23:12:00.764182 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:00.764145 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Nov 03 23:12:00.764361 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:00.764198 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" podUID="d2968f41-e062-475f-b3ca-22c20073f2f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Nov 03 23:12:01.764149 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:01.764109 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Nov 03 23:12:01.764683 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:01.764187 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" podUID="d2968f41-e062-475f-b3ca-22c20073f2f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Nov 03 23:12:03.143990 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:03.143951 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:12:03.259673 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:03.259628 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:12:03.259985 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:03.259966 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:12:03.260144 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:03.260120 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:12:03.261040 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:03.261021 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" Nov 03 23:12:04.698600 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:04.698558 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:12:04.807863 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:04.807818 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:12:09.494112 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:12:09.494074 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:12:09.575149 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.575109 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl"] Nov 03 23:12:09.581303 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.581280 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.622595 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.622563 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl"] Nov 03 23:12:09.644815 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.644782 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.645043 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.644828 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.645043 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.644937 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.645043 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.644973 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf7vf\" (UniqueName: \"kubernetes.io/projected/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-kube-api-access-hf7vf\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.645043 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.645007 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.645043 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.645025 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.645327 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.645060 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.645327 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.645157 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.645327 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.645182 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.746024 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.745914 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.746024 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.745956 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf7vf\" (UniqueName: \"kubernetes.io/projected/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-kube-api-access-hf7vf\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.746024 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.745986 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.746324 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.746006 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.746324 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.746086 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.746324 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.746147 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.746324 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.746188 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.746324 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.746248 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.746324 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.746296 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.746635 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.746447 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.746702 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.746679 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.746761 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.746716 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.746818 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.746793 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.747014 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.746987 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.748762 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.748737 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.748972 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.748951 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.756828 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.756789 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.756976 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.756900 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf7vf\" (UniqueName: \"kubernetes.io/projected/1521f713-eb6c-4d6b-b2bc-8aa05430fd6f-kube-api-access-hf7vf\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-gpnwl\" (UID: \"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:09.896786 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:09.896736 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:10.174331 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:10.174299 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl"] Nov 03 23:12:10.177080 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:12:10.177054 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1521f713_eb6c_4d6b_b2bc_8aa05430fd6f.slice/crio-82bb82464860502d1c3cb3dcbde60db4b27b65445592b61a5cf0f4556dbe4cfe WatchSource:0}: Error finding container 82bb82464860502d1c3cb3dcbde60db4b27b65445592b61a5cf0f4556dbe4cfe: Status 404 returned error can't find the container with id 82bb82464860502d1c3cb3dcbde60db4b27b65445592b61a5cf0f4556dbe4cfe Nov 03 23:12:10.180528 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:10.179996 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:12:10.180528 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:10.180086 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:12:10.180528 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:10.180133 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:12:10.385756 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:10.385720 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" event={"ID":"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f","Type":"ContainerStarted","Data":"4209859874c0179c7d29fa3dfc5824e0dec08683e6ef167d4cdb7a225a9acc89"} Nov 03 23:12:10.385935 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:10.385785 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" event={"ID":"1521f713-eb6c-4d6b-b2bc-8aa05430fd6f","Type":"ContainerStarted","Data":"82bb82464860502d1c3cb3dcbde60db4b27b65445592b61a5cf0f4556dbe4cfe"} Nov 03 23:12:10.404052 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:10.404001 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" podStartSLOduration=1.403986202 podStartE2EDuration="1.403986202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:12:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:12:10.402055879 +0000 UTC m=+1236.932163046" watchObservedRunningTime="2026-11-03 23:12:10.403986202 +0000 UTC m=+1236.934093369" Nov 03 23:12:10.911379 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:10.910562 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:11.917741 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:11.917705 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Nov 03 23:12:11.918146 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:11.917762 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" podUID="1521f713-eb6c-4d6b-b2bc-8aa05430fd6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Nov 03 23:12:12.912479 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:12.911569 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Nov 03 23:12:12.912479 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:12.911651 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" podUID="1521f713-eb6c-4d6b-b2bc-8aa05430fd6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Nov 03 23:12:13.916627 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:13.916586 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Nov 03 23:12:13.917026 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:13.916668 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" podUID="1521f713-eb6c-4d6b-b2bc-8aa05430fd6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Nov 03 23:12:14.909479 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:14.908418 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Nov 03 23:12:14.909479 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:14.908502 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" podUID="1521f713-eb6c-4d6b-b2bc-8aa05430fd6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Nov 03 23:12:15.912481 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:15.906928 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Nov 03 23:12:15.912481 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:15.906993 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" podUID="1521f713-eb6c-4d6b-b2bc-8aa05430fd6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Nov 03 23:12:16.897271 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:16.897229 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Nov 03 23:12:16.897499 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:16.897280 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" podUID="1521f713-eb6c-4d6b-b2bc-8aa05430fd6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Nov 03 23:12:18.428172 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:18.428138 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:18.428683 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:18.428478 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:18.429471 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:18.429434 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" Nov 03 23:12:38.888748 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:38.888713 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2"] Nov 03 23:12:38.893501 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:38.893420 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:38.897502 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:38.897477 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"grid-inv-9698c1f0-model-kserve-self-signed-certs\"" Nov 03 23:12:38.900139 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:38.900110 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2"] Nov 03 23:12:38.940446 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:38.940415 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-model-cache\") pod \"grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:38.940617 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:38.940478 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxt7q\" (UniqueName: \"kubernetes.io/projected/1c57753b-e128-4d6d-948b-b407c4b01ff7-kube-api-access-jxt7q\") pod \"grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:38.940617 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:38.940554 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-tmp-dir\") pod \"grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:38.940617 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:38.940607 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-home\") pod \"grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:38.940742 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:38.940723 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c57753b-e128-4d6d-948b-b407c4b01ff7-tls-certs\") pod \"grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:38.940777 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:38.940761 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-dshm\") pod \"grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:38.965922 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:38.965887 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:12:39.041943 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:39.041902 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c57753b-e128-4d6d-948b-b407c4b01ff7-tls-certs\") pod \"grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:39.042147 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:39.041969 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-dshm\") pod \"grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:39.042147 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:39.042024 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-model-cache\") pod \"grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:39.042147 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:39.042063 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxt7q\" (UniqueName: \"kubernetes.io/projected/1c57753b-e128-4d6d-948b-b407c4b01ff7-kube-api-access-jxt7q\") pod \"grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:39.042147 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:39.042096 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-tmp-dir\") pod \"grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:39.042364 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:39.042151 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-home\") pod \"grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:39.042806 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:39.042780 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-model-cache\") pod \"grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:39.042970 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:39.042919 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-home\") pod \"grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:39.043111 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:39.043087 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-tmp-dir\") pod \"grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:39.047898 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:39.047842 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-dshm\") pod \"grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:39.059248 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:39.049274 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c57753b-e128-4d6d-948b-b407c4b01ff7-tls-certs\") pod \"grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:39.059248 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:39.059182 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxt7q\" (UniqueName: \"kubernetes.io/projected/1c57753b-e128-4d6d-948b-b407c4b01ff7-kube-api-access-jxt7q\") pod \"grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:39.209682 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:39.209641 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:39.485676 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:39.485650 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2"] Nov 03 23:12:39.488485 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:12:39.488423 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c57753b_e128_4d6d_948b_b407c4b01ff7.slice/crio-da24f1e58315ed6c68a93a4fe0cdd883de524620997ab46e31d78446c39e9c52 WatchSource:0}: Error finding container da24f1e58315ed6c68a93a4fe0cdd883de524620997ab46e31d78446c39e9c52: Status 404 returned error can't find the container with id da24f1e58315ed6c68a93a4fe0cdd883de524620997ab46e31d78446c39e9c52 Nov 03 23:12:39.498472 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:12:39.498427 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:12:39.561753 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:39.561725 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" event={"ID":"1c57753b-e128-4d6d-948b-b407c4b01ff7","Type":"ContainerStarted","Data":"82cc6cf373a35a5a990bbde370aa2fdec1997e50539d9af53889d02f678698b1"} Nov 03 23:12:39.561905 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:39.561769 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" event={"ID":"1c57753b-e128-4d6d-948b-b407c4b01ff7","Type":"ContainerStarted","Data":"da24f1e58315ed6c68a93a4fe0cdd883de524620997ab46e31d78446c39e9c52"} Nov 03 23:12:39.577345 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:39.577293 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" podStartSLOduration=1.577280047 podStartE2EDuration="1.577280047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:12:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:12:39.575103017 +0000 UTC m=+1266.105210185" watchObservedRunningTime="2026-11-03 23:12:39.577280047 +0000 UTC m=+1266.107387214" Nov 03 23:12:40.210040 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:40.210006 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:42.881328 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:42.881296 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s"] Nov 03 23:12:42.885692 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:42.885665 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:42.903479 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:42.894508 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s"] Nov 03 23:12:42.903479 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:42.894679 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"grid-inv-9698c1f0-unmatched-kserve-self-signed-certs\"" Nov 03 23:12:42.984065 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:42.983071 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-tmp-dir\") pod \"grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:42.984065 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:42.983124 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-home\") pod \"grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:42.984065 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:42.983149 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-model-cache\") pod \"grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:42.984065 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:42.983193 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/533ab966-4575-44ec-9a34-d2e21770b685-tls-certs\") pod \"grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:42.984065 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:42.983221 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w5j6\" (UniqueName: \"kubernetes.io/projected/533ab966-4575-44ec-9a34-d2e21770b685-kube-api-access-8w5j6\") pod \"grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:42.984065 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:42.983359 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-dshm\") pod \"grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:42.984656 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:42.984144 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:12:43.086477 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:43.084124 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-dshm\") pod \"grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:43.086477 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:43.084218 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-tmp-dir\") pod \"grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:43.086477 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:43.084254 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-home\") pod \"grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:43.086477 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:43.084280 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-model-cache\") pod \"grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:43.086477 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:43.084324 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/533ab966-4575-44ec-9a34-d2e21770b685-tls-certs\") pod \"grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:43.086477 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:43.084351 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w5j6\" (UniqueName: \"kubernetes.io/projected/533ab966-4575-44ec-9a34-d2e21770b685-kube-api-access-8w5j6\") pod \"grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:43.112479 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:43.099975 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-home\") pod \"grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:43.112479 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:43.100314 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-tmp-dir\") pod \"grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:43.112479 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:43.100593 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-model-cache\") pod \"grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:43.112479 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:43.110735 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/533ab966-4575-44ec-9a34-d2e21770b685-tls-certs\") pod \"grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:43.130480 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:43.129936 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-dshm\") pod \"grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:43.157522 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:43.151121 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w5j6\" (UniqueName: \"kubernetes.io/projected/533ab966-4575-44ec-9a34-d2e21770b685-kube-api-access-8w5j6\") pod \"grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:43.288716 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:43.288639 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:43.691165 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:43.691122 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s"] Nov 03 23:12:44.327067 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:44.327025 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:12:44.592143 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:44.592059 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" event={"ID":"533ab966-4575-44ec-9a34-d2e21770b685","Type":"ContainerStarted","Data":"6b91f5786a06bd7bedb88508aa569e0a689b535750f632e60f604fb2a74551a0"} Nov 03 23:12:44.592143 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:44.592095 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" event={"ID":"533ab966-4575-44ec-9a34-d2e21770b685","Type":"ContainerStarted","Data":"bcfe34f6c9f276cad509e32c13c7537b23c50df14fc895fe3149e3ebfe5becb5"} Nov 03 23:12:44.607769 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:44.607721 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" podStartSLOduration=2.607706838 podStartE2EDuration="2.607706838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:12:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:12:44.605590006 +0000 UTC m=+1271.135697177" watchObservedRunningTime="2026-11-03 23:12:44.607706838 +0000 UTC m=+1271.137814005" Nov 03 23:12:45.288970 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:45.288924 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:49.213797 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:49.213765 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:49.254564 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:49.254534 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:49.306617 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:49.306581 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 23:12:49.306822 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:49.306640 5332 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" podUID="d2968f41-e062-475f-b3ca-22c20073f2f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 23:12:49.663350 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:49.663267 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:12:53.289021 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:53.288984 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:53.301841 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:53.301808 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:53.681415 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:53.681334 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:12:57.099680 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:57.099649 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv"] Nov 03 23:12:57.103016 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:57.102997 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv" Nov 03 23:12:57.113215 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:57.108735 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 23:12:57.113215 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:57.109161 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 23:12:57.113215 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:57.109481 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-54hnx\"" Nov 03 23:12:57.113215 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:57.109569 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 23:12:57.113215 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:57.113202 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv"] Nov 03 23:12:57.161135 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:57.161091 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6daac75e-kv8cv\" (UID: \"ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv" Nov 03 23:12:57.161311 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:57.161145 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6daac75e-kv8cv\" (UID: \"ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv" Nov 03 23:12:57.161311 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:57.161249 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbx5m\" (UniqueName: \"kubernetes.io/projected/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-kube-api-access-jbx5m\") pod \"maas-api-revoke-sub-6daac75e-kv8cv\" (UID: \"ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv" Nov 03 23:12:57.262769 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:57.262734 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6daac75e-kv8cv\" (UID: \"ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv" Nov 03 23:12:57.262945 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:57.262791 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6daac75e-kv8cv\" (UID: \"ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv" Nov 03 23:12:57.262945 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:57.262824 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbx5m\" (UniqueName: \"kubernetes.io/projected/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-kube-api-access-jbx5m\") pod \"maas-api-revoke-sub-6daac75e-kv8cv\" (UID: \"ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv" Nov 03 23:12:57.263708 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:57.263610 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6daac75e-kv8cv\" (UID: \"ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv" Nov 03 23:12:57.265367 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:57.265343 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6daac75e-kv8cv\" (UID: \"ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv" Nov 03 23:12:57.269746 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:57.269724 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbx5m\" (UniqueName: \"kubernetes.io/projected/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-kube-api-access-jbx5m\") pod \"maas-api-revoke-sub-6daac75e-kv8cv\" (UID: \"ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv" Nov 03 23:12:57.426252 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:57.426162 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv" Nov 03 23:12:57.697845 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:57.697821 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv"] Nov 03 23:12:57.700090 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:12:57.700062 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee3dcd2c_2d42_4618_b9d2_c8d0b8814cc8.slice/crio-1f224c0c71939f3c20a4d022015c67af6babff7f4b693d73f7ad9c7a62a4544a WatchSource:0}: Error finding container 1f224c0c71939f3c20a4d022015c67af6babff7f4b693d73f7ad9c7a62a4544a: Status 404 returned error can't find the container with id 1f224c0c71939f3c20a4d022015c67af6babff7f4b693d73f7ad9c7a62a4544a Nov 03 23:12:58.696109 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:12:58.696068 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv" event={"ID":"ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8","Type":"ContainerStarted","Data":"1f224c0c71939f3c20a4d022015c67af6babff7f4b693d73f7ad9c7a62a4544a"} Nov 03 23:13:00.707884 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:00.707849 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv" event={"ID":"ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8","Type":"ContainerStarted","Data":"80bee4cc064e07ee1b431a1214b83cfd46f9ac8596a5741cc5dd01f18d09dfb6"} Nov 03 23:13:00.722946 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:00.722602 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv" podStartSLOduration=1.2007018600000001 podStartE2EDuration="3.722586519s" totalImagesPullingTime="2.521884659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:13:00.722511238 +0000 UTC m=+1287.252618403" watchObservedRunningTime="2026-11-03 23:13:00.722586519 +0000 UTC m=+1287.252693687" Nov 03 23:13:01.714603 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:01.714570 5332 generic.go:356] "Generic (PLEG): container finished" podID="ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8" containerID="80bee4cc064e07ee1b431a1214b83cfd46f9ac8596a5741cc5dd01f18d09dfb6" exitCode=0 Nov 03 23:13:01.715039 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:01.714645 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv" event={"ID":"ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8","Type":"ContainerDied","Data":"80bee4cc064e07ee1b431a1214b83cfd46f9ac8596a5741cc5dd01f18d09dfb6"} Nov 03 23:13:02.855847 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:02.855822 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv" Nov 03 23:13:02.918208 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:02.918169 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-kube-api-access-jbx5m\" (UniqueName: \"kubernetes.io/projected/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-kube-api-access-jbx5m\") pod \"ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8\" (UID: \"ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8\") " Nov 03 23:13:02.918370 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:02.918239 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-maas-api-xks-ca\") pod \"ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8\" (UID: \"ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8\") " Nov 03 23:13:02.918370 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:02.918329 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-maas-api-openshift-ca\") pod \"ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8\" (UID: \"ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8\") " Nov 03 23:13:02.918770 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:02.918738 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-maas-api-openshift-ca" pod "ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8" (UID: "ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:13:02.920557 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:02.920532 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-kube-api-access-jbx5m" pod "ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8" (UID: "ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8"). InnerVolumeSpecName "kube-api-access-jbx5m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:13:02.920643 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:02.920611 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-maas-api-xks-ca" pod "ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8" (UID: "ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:13:03.020149 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:03.020049 5332 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-maas-api-xks-ca\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:13:03.020149 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:03.020090 5332 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-maas-api-openshift-ca\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:13:03.020149 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:03.020104 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbx5m\" (UniqueName: \"kubernetes.io/projected/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8-kube-api-access-jbx5m\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:13:03.725899 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:03.725871 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv" Nov 03 23:13:03.725899 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:03.725876 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv" event={"ID":"ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8","Type":"ContainerDied","Data":"1f224c0c71939f3c20a4d022015c67af6babff7f4b693d73f7ad9c7a62a4544a"} Nov 03 23:13:03.726114 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:03.725929 5332 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f224c0c71939f3c20a4d022015c67af6babff7f4b693d73f7ad9c7a62a4544a" Nov 03 23:13:07.420497 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.420430 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7"] Nov 03 23:13:07.421379 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.421354 5332 cpu_manager.go:414] "containerMap: removing container" podUID="ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8" containerName="revoke-keys" Nov 03 23:13:07.421572 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.421556 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8" containerName="revoke-keys" Nov 03 23:13:07.421909 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.421893 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8" containerName="revoke-keys" Nov 03 23:13:07.427376 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.427352 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7" Nov 03 23:13:07.430088 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.430066 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7"] Nov 03 23:13:07.431563 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.430791 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 23:13:07.431563 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.430863 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 23:13:07.431563 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.430915 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-54hnx\"" Nov 03 23:13:07.431563 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.430985 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 23:13:07.561651 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.561614 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1f16e236-c713-4c67-afaf-932072a1da24-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e997c91e-nksc7\" (UID: \"1f16e236-c713-4c67-afaf-932072a1da24\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7" Nov 03 23:13:07.561651 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.561654 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcdkf\" (UniqueName: \"kubernetes.io/projected/1f16e236-c713-4c67-afaf-932072a1da24-kube-api-access-kcdkf\") pod \"maas-api-revoke-sub-e997c91e-nksc7\" (UID: \"1f16e236-c713-4c67-afaf-932072a1da24\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7" Nov 03 23:13:07.561891 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.561776 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1f16e236-c713-4c67-afaf-932072a1da24-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e997c91e-nksc7\" (UID: \"1f16e236-c713-4c67-afaf-932072a1da24\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7" Nov 03 23:13:07.663078 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.663042 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1f16e236-c713-4c67-afaf-932072a1da24-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e997c91e-nksc7\" (UID: \"1f16e236-c713-4c67-afaf-932072a1da24\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7" Nov 03 23:13:07.663261 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.663161 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1f16e236-c713-4c67-afaf-932072a1da24-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e997c91e-nksc7\" (UID: \"1f16e236-c713-4c67-afaf-932072a1da24\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7" Nov 03 23:13:07.663261 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.663194 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcdkf\" (UniqueName: \"kubernetes.io/projected/1f16e236-c713-4c67-afaf-932072a1da24-kube-api-access-kcdkf\") pod \"maas-api-revoke-sub-e997c91e-nksc7\" (UID: \"1f16e236-c713-4c67-afaf-932072a1da24\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7" Nov 03 23:13:07.663862 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.663838 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1f16e236-c713-4c67-afaf-932072a1da24-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e997c91e-nksc7\" (UID: \"1f16e236-c713-4c67-afaf-932072a1da24\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7" Nov 03 23:13:07.665677 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.665653 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1f16e236-c713-4c67-afaf-932072a1da24-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e997c91e-nksc7\" (UID: \"1f16e236-c713-4c67-afaf-932072a1da24\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7" Nov 03 23:13:07.670074 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.670054 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcdkf\" (UniqueName: \"kubernetes.io/projected/1f16e236-c713-4c67-afaf-932072a1da24-kube-api-access-kcdkf\") pod \"maas-api-revoke-sub-e997c91e-nksc7\" (UID: \"1f16e236-c713-4c67-afaf-932072a1da24\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7" Nov 03 23:13:07.743603 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.743569 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7" Nov 03 23:13:07.799325 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.799217 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:13:07.898933 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:07.898896 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:13:08.015847 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:08.015819 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7"] Nov 03 23:13:08.018518 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:13:08.017934 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f16e236_c713_4c67_afaf_932072a1da24.slice/crio-c9a00cc8f18eb68514e000aaade0e2b91543348b1f39eb3a5778a689b86bff43 WatchSource:0}: Error finding container c9a00cc8f18eb68514e000aaade0e2b91543348b1f39eb3a5778a689b86bff43: Status 404 returned error can't find the container with id c9a00cc8f18eb68514e000aaade0e2b91543348b1f39eb3a5778a689b86bff43 Nov 03 23:13:08.752438 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:08.752398 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7" event={"ID":"1f16e236-c713-4c67-afaf-932072a1da24","Type":"ContainerStarted","Data":"883031bafea9133840600bca1a9d3ff8dd55c3bfa82e1b81b4c23a636ea532b4"} Nov 03 23:13:08.752931 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:08.752478 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7" event={"ID":"1f16e236-c713-4c67-afaf-932072a1da24","Type":"ContainerStarted","Data":"c9a00cc8f18eb68514e000aaade0e2b91543348b1f39eb3a5778a689b86bff43"} Nov 03 23:13:08.769608 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:08.769560 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7" podStartSLOduration=1.7695465000000001 podStartE2EDuration="1.7695465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:13:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:13:08.767838019 +0000 UTC m=+1295.297945189" watchObservedRunningTime="2026-11-03 23:13:08.7695465 +0000 UTC m=+1295.299653691" Nov 03 23:13:09.502811 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:13:09.502770 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:13:09.535642 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.535598 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95"] Nov 03 23:13:09.540040 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.540013 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.551649 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.551617 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95"] Nov 03 23:13:09.683238 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.683207 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8f0c433-9c57-4b4c-9094-6b618981f530-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.683238 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.683240 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8f0c433-9c57-4b4c-9094-6b618981f530-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.683571 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.683284 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qzll\" (UniqueName: \"kubernetes.io/projected/e8f0c433-9c57-4b4c-9094-6b618981f530-kube-api-access-5qzll\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.683571 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.683336 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8f0c433-9c57-4b4c-9094-6b618981f530-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.683571 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.683409 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8f0c433-9c57-4b4c-9094-6b618981f530-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.683571 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.683438 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8f0c433-9c57-4b4c-9094-6b618981f530-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.683571 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.683485 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8f0c433-9c57-4b4c-9094-6b618981f530-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.683571 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.683554 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8f0c433-9c57-4b4c-9094-6b618981f530-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.683927 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.683578 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8f0c433-9c57-4b4c-9094-6b618981f530-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.760235 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.760139 5332 generic.go:356] "Generic (PLEG): container finished" podID="1f16e236-c713-4c67-afaf-932072a1da24" containerID="883031bafea9133840600bca1a9d3ff8dd55c3bfa82e1b81b4c23a636ea532b4" exitCode=0 Nov 03 23:13:09.760653 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.760228 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7" event={"ID":"1f16e236-c713-4c67-afaf-932072a1da24","Type":"ContainerDied","Data":"883031bafea9133840600bca1a9d3ff8dd55c3bfa82e1b81b4c23a636ea532b4"} Nov 03 23:13:09.784275 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.784223 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qzll\" (UniqueName: \"kubernetes.io/projected/e8f0c433-9c57-4b4c-9094-6b618981f530-kube-api-access-5qzll\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.784472 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.784278 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8f0c433-9c57-4b4c-9094-6b618981f530-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.784472 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.784339 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8f0c433-9c57-4b4c-9094-6b618981f530-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.784472 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.784384 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8f0c433-9c57-4b4c-9094-6b618981f530-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.784472 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.784434 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8f0c433-9c57-4b4c-9094-6b618981f530-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.784690 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.784498 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8f0c433-9c57-4b4c-9094-6b618981f530-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.784690 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.784539 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8f0c433-9c57-4b4c-9094-6b618981f530-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.784690 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.784633 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8f0c433-9c57-4b4c-9094-6b618981f530-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.784690 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.784666 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8f0c433-9c57-4b4c-9094-6b618981f530-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.784943 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.784916 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8f0c433-9c57-4b4c-9094-6b618981f530-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.785001 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.784981 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8f0c433-9c57-4b4c-9094-6b618981f530-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.785279 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.785251 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8f0c433-9c57-4b4c-9094-6b618981f530-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.785279 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.785269 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8f0c433-9c57-4b4c-9094-6b618981f530-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.786394 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.786366 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8f0c433-9c57-4b4c-9094-6b618981f530-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.789734 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.789684 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8f0c433-9c57-4b4c-9094-6b618981f530-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.790050 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.790025 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8f0c433-9c57-4b4c-9094-6b618981f530-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.793129 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.793084 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qzll\" (UniqueName: \"kubernetes.io/projected/e8f0c433-9c57-4b4c-9094-6b618981f530-kube-api-access-5qzll\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.793584 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.793563 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8f0c433-9c57-4b4c-9094-6b618981f530-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-ddn95\" (UID: \"e8f0c433-9c57-4b4c-9094-6b618981f530\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:09.863490 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:09.863442 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:10.152867 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:10.152837 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95"] Nov 03 23:13:10.156519 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:13:10.156485 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8f0c433_9c57_4b4c_9094_6b618981f530.slice/crio-1975a788f9d4a8e4491e6041072c24330c5b71069a874ad4b4ed28b5dacde8d0 WatchSource:0}: Error finding container 1975a788f9d4a8e4491e6041072c24330c5b71069a874ad4b4ed28b5dacde8d0: Status 404 returned error can't find the container with id 1975a788f9d4a8e4491e6041072c24330c5b71069a874ad4b4ed28b5dacde8d0 Nov 03 23:13:10.159670 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:10.159632 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:13:10.159788 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:10.159721 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:13:10.159788 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:10.159768 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:13:10.774719 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:10.774680 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" event={"ID":"e8f0c433-9c57-4b4c-9094-6b618981f530","Type":"ContainerStarted","Data":"bc6d0775b9c8ec8045a1ab0e838c16214c2e4b4d32308c6b82c8e6870e663080"} Nov 03 23:13:10.775243 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:10.774749 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" event={"ID":"e8f0c433-9c57-4b4c-9094-6b618981f530","Type":"ContainerStarted","Data":"1975a788f9d4a8e4491e6041072c24330c5b71069a874ad4b4ed28b5dacde8d0"} Nov 03 23:13:10.825479 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:10.814082 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" podStartSLOduration=1.8140609030000001 podStartE2EDuration="1.814060903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:13:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:13:10.805904655 +0000 UTC m=+1297.336011823" watchObservedRunningTime="2026-11-03 23:13:10.814060903 +0000 UTC m=+1297.344168070" Nov 03 23:13:10.874530 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:10.873542 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:11.287867 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:11.287837 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7" Nov 03 23:13:11.491861 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:11.491821 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1f16e236-c713-4c67-afaf-932072a1da24-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1f16e236-c713-4c67-afaf-932072a1da24-maas-api-xks-ca\") pod \"1f16e236-c713-4c67-afaf-932072a1da24\" (UID: \"1f16e236-c713-4c67-afaf-932072a1da24\") " Nov 03 23:13:11.492184 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:11.492166 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1f16e236-c713-4c67-afaf-932072a1da24-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1f16e236-c713-4c67-afaf-932072a1da24-maas-api-openshift-ca\") pod \"1f16e236-c713-4c67-afaf-932072a1da24\" (UID: \"1f16e236-c713-4c67-afaf-932072a1da24\") " Nov 03 23:13:11.492348 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:11.492334 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1f16e236-c713-4c67-afaf-932072a1da24-kube-api-access-kcdkf\" (UniqueName: \"kubernetes.io/projected/1f16e236-c713-4c67-afaf-932072a1da24-kube-api-access-kcdkf\") pod \"1f16e236-c713-4c67-afaf-932072a1da24\" (UID: \"1f16e236-c713-4c67-afaf-932072a1da24\") " Nov 03 23:13:11.502868 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:11.502832 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f16e236-c713-4c67-afaf-932072a1da24-maas-api-openshift-ca" pod "1f16e236-c713-4c67-afaf-932072a1da24" (UID: "1f16e236-c713-4c67-afaf-932072a1da24"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:13:11.524910 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:11.524871 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f16e236-c713-4c67-afaf-932072a1da24-kube-api-access-kcdkf" pod "1f16e236-c713-4c67-afaf-932072a1da24" (UID: "1f16e236-c713-4c67-afaf-932072a1da24"). InnerVolumeSpecName "kube-api-access-kcdkf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:13:11.549652 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:11.549592 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f16e236-c713-4c67-afaf-932072a1da24-maas-api-xks-ca" pod "1f16e236-c713-4c67-afaf-932072a1da24" (UID: "1f16e236-c713-4c67-afaf-932072a1da24"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:13:11.595189 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:11.595143 5332 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1f16e236-c713-4c67-afaf-932072a1da24-maas-api-openshift-ca\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:13:11.595189 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:11.595186 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcdkf\" (UniqueName: \"kubernetes.io/projected/1f16e236-c713-4c67-afaf-932072a1da24-kube-api-access-kcdkf\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:13:11.595439 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:11.595199 5332 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1f16e236-c713-4c67-afaf-932072a1da24-maas-api-xks-ca\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:13:11.847531 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:11.835686 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7" Nov 03 23:13:11.847531 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:11.836619 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7" event={"ID":"1f16e236-c713-4c67-afaf-932072a1da24","Type":"ContainerDied","Data":"c9a00cc8f18eb68514e000aaade0e2b91543348b1f39eb3a5778a689b86bff43"} Nov 03 23:13:11.847531 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:11.836669 5332 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9a00cc8f18eb68514e000aaade0e2b91543348b1f39eb3a5778a689b86bff43" Nov 03 23:13:11.878480 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:11.875598 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-ddn95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Nov 03 23:13:11.878480 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:11.875674 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" podUID="e8f0c433-9c57-4b4c-9094-6b618981f530" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Nov 03 23:13:12.864666 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:12.864626 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-ddn95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Nov 03 23:13:12.865099 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:12.864694 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" podUID="e8f0c433-9c57-4b4c-9094-6b618981f530" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Nov 03 23:13:13.864527 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:13.864484 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-ddn95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Nov 03 23:13:13.864714 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:13.864554 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" podUID="e8f0c433-9c57-4b4c-9094-6b618981f530" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Nov 03 23:13:14.895024 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:14.894988 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-ddn95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Nov 03 23:13:14.895668 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:14.895634 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" podUID="e8f0c433-9c57-4b4c-9094-6b618981f530" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Nov 03 23:13:15.876600 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:15.876560 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-ddn95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Nov 03 23:13:15.876880 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:15.876849 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" podUID="e8f0c433-9c57-4b4c-9094-6b618981f530" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Nov 03 23:13:16.863883 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:16.863846 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-ddn95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Nov 03 23:13:16.864280 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:16.863908 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" podUID="e8f0c433-9c57-4b4c-9094-6b618981f530" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Nov 03 23:13:17.629349 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.629307 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq"] Nov 03 23:13:17.630011 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.629986 5332 cpu_manager.go:414] "containerMap: removing container" podUID="1f16e236-c713-4c67-afaf-932072a1da24" containerName="revoke-keys" Nov 03 23:13:17.630152 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.630012 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f16e236-c713-4c67-afaf-932072a1da24" containerName="revoke-keys" Nov 03 23:13:17.630152 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.630125 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="1f16e236-c713-4c67-afaf-932072a1da24" containerName="revoke-keys" Nov 03 23:13:17.633984 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.633952 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq" Nov 03 23:13:17.636569 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.636529 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 23:13:17.640242 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.637313 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 23:13:17.640242 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.637357 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-54hnx\"" Nov 03 23:13:17.640242 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.637406 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 23:13:17.640242 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.640138 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq"] Nov 03 23:13:17.672194 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.672160 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/697bc6ee-0994-49a2-b2fc-9156bb4d9341-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-36f677f4-dprpq\" (UID: \"697bc6ee-0994-49a2-b2fc-9156bb4d9341\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq" Nov 03 23:13:17.672432 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.672283 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfsqj\" (UniqueName: \"kubernetes.io/projected/697bc6ee-0994-49a2-b2fc-9156bb4d9341-kube-api-access-zfsqj\") pod \"maas-api-revoke-sub-36f677f4-dprpq\" (UID: \"697bc6ee-0994-49a2-b2fc-9156bb4d9341\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq" Nov 03 23:13:17.672432 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.672352 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/697bc6ee-0994-49a2-b2fc-9156bb4d9341-maas-api-xks-ca\") pod \"maas-api-revoke-sub-36f677f4-dprpq\" (UID: \"697bc6ee-0994-49a2-b2fc-9156bb4d9341\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq" Nov 03 23:13:17.773299 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.773249 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/697bc6ee-0994-49a2-b2fc-9156bb4d9341-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-36f677f4-dprpq\" (UID: \"697bc6ee-0994-49a2-b2fc-9156bb4d9341\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq" Nov 03 23:13:17.773549 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.773315 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfsqj\" (UniqueName: \"kubernetes.io/projected/697bc6ee-0994-49a2-b2fc-9156bb4d9341-kube-api-access-zfsqj\") pod \"maas-api-revoke-sub-36f677f4-dprpq\" (UID: \"697bc6ee-0994-49a2-b2fc-9156bb4d9341\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq" Nov 03 23:13:17.773549 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.773361 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/697bc6ee-0994-49a2-b2fc-9156bb4d9341-maas-api-xks-ca\") pod \"maas-api-revoke-sub-36f677f4-dprpq\" (UID: \"697bc6ee-0994-49a2-b2fc-9156bb4d9341\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq" Nov 03 23:13:17.774279 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.774253 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/697bc6ee-0994-49a2-b2fc-9156bb4d9341-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-36f677f4-dprpq\" (UID: \"697bc6ee-0994-49a2-b2fc-9156bb4d9341\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq" Nov 03 23:13:17.775936 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.775912 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/697bc6ee-0994-49a2-b2fc-9156bb4d9341-maas-api-xks-ca\") pod \"maas-api-revoke-sub-36f677f4-dprpq\" (UID: \"697bc6ee-0994-49a2-b2fc-9156bb4d9341\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq" Nov 03 23:13:17.780280 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.780252 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfsqj\" (UniqueName: \"kubernetes.io/projected/697bc6ee-0994-49a2-b2fc-9156bb4d9341-kube-api-access-zfsqj\") pod \"maas-api-revoke-sub-36f677f4-dprpq\" (UID: \"697bc6ee-0994-49a2-b2fc-9156bb4d9341\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq" Nov 03 23:13:17.864862 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.864822 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-ddn95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Nov 03 23:13:17.865251 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.864892 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" podUID="e8f0c433-9c57-4b4c-9094-6b618981f530" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Nov 03 23:13:17.956164 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:17.956142 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq" Nov 03 23:13:18.233177 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:18.233149 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq"] Nov 03 23:13:18.233798 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:13:18.233772 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod697bc6ee_0994_49a2_b2fc_9156bb4d9341.slice/crio-24924eab8426cb8babe004c648c639dd2766eb845f8d18f010bde23009cfa4e9 WatchSource:0}: Error finding container 24924eab8426cb8babe004c648c639dd2766eb845f8d18f010bde23009cfa4e9: Status 404 returned error can't find the container with id 24924eab8426cb8babe004c648c639dd2766eb845f8d18f010bde23009cfa4e9 Nov 03 23:13:18.864839 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:18.864753 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-ddn95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Nov 03 23:13:18.864839 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:18.864822 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" podUID="e8f0c433-9c57-4b4c-9094-6b618981f530" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Nov 03 23:13:18.945903 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:18.945866 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq" event={"ID":"697bc6ee-0994-49a2-b2fc-9156bb4d9341","Type":"ContainerStarted","Data":"184a1c9adb83b8385e5189c1223e0f05de0bc613adfea9a60d3d4ca5db4c1aa3"} Nov 03 23:13:18.946084 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:18.945925 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq" event={"ID":"697bc6ee-0994-49a2-b2fc-9156bb4d9341","Type":"ContainerStarted","Data":"24924eab8426cb8babe004c648c639dd2766eb845f8d18f010bde23009cfa4e9"} Nov 03 23:13:18.961679 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:18.961627 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq" podStartSLOduration=1.961612157 podStartE2EDuration="1.961612157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:13:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:13:18.959649137 +0000 UTC m=+1305.489756305" watchObservedRunningTime="2026-11-03 23:13:18.961612157 +0000 UTC m=+1305.491719327" Nov 03 23:13:19.952535 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:19.952499 5332 generic.go:356] "Generic (PLEG): container finished" podID="697bc6ee-0994-49a2-b2fc-9156bb4d9341" containerID="184a1c9adb83b8385e5189c1223e0f05de0bc613adfea9a60d3d4ca5db4c1aa3" exitCode=0 Nov 03 23:13:19.952946 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:19.952595 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq" event={"ID":"697bc6ee-0994-49a2-b2fc-9156bb4d9341","Type":"ContainerDied","Data":"184a1c9adb83b8385e5189c1223e0f05de0bc613adfea9a60d3d4ca5db4c1aa3"} Nov 03 23:13:20.864733 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:20.864690 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-ddn95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 23:13:20.864951 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:20.864768 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" podUID="e8f0c433-9c57-4b4c-9094-6b618981f530" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 23:13:21.091497 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:21.091469 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq" Nov 03 23:13:21.208649 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:21.208613 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/697bc6ee-0994-49a2-b2fc-9156bb4d9341-kube-api-access-zfsqj\" (UniqueName: \"kubernetes.io/projected/697bc6ee-0994-49a2-b2fc-9156bb4d9341-kube-api-access-zfsqj\") pod \"697bc6ee-0994-49a2-b2fc-9156bb4d9341\" (UID: \"697bc6ee-0994-49a2-b2fc-9156bb4d9341\") " Nov 03 23:13:21.208843 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:21.208734 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/697bc6ee-0994-49a2-b2fc-9156bb4d9341-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/697bc6ee-0994-49a2-b2fc-9156bb4d9341-maas-api-openshift-ca\") pod \"697bc6ee-0994-49a2-b2fc-9156bb4d9341\" (UID: \"697bc6ee-0994-49a2-b2fc-9156bb4d9341\") " Nov 03 23:13:21.208843 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:21.208773 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/697bc6ee-0994-49a2-b2fc-9156bb4d9341-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/697bc6ee-0994-49a2-b2fc-9156bb4d9341-maas-api-xks-ca\") pod \"697bc6ee-0994-49a2-b2fc-9156bb4d9341\" (UID: \"697bc6ee-0994-49a2-b2fc-9156bb4d9341\") " Nov 03 23:13:21.209176 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:21.209148 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/697bc6ee-0994-49a2-b2fc-9156bb4d9341-maas-api-openshift-ca" pod "697bc6ee-0994-49a2-b2fc-9156bb4d9341" (UID: "697bc6ee-0994-49a2-b2fc-9156bb4d9341"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:13:21.211549 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:21.211521 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/697bc6ee-0994-49a2-b2fc-9156bb4d9341-kube-api-access-zfsqj" pod "697bc6ee-0994-49a2-b2fc-9156bb4d9341" (UID: "697bc6ee-0994-49a2-b2fc-9156bb4d9341"). InnerVolumeSpecName "kube-api-access-zfsqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:13:21.216566 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:21.216541 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/697bc6ee-0994-49a2-b2fc-9156bb4d9341-maas-api-xks-ca" pod "697bc6ee-0994-49a2-b2fc-9156bb4d9341" (UID: "697bc6ee-0994-49a2-b2fc-9156bb4d9341"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:13:21.310342 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:21.310302 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfsqj\" (UniqueName: \"kubernetes.io/projected/697bc6ee-0994-49a2-b2fc-9156bb4d9341-kube-api-access-zfsqj\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:13:21.310342 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:21.310330 5332 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/697bc6ee-0994-49a2-b2fc-9156bb4d9341-maas-api-openshift-ca\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:13:21.310342 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:21.310341 5332 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/697bc6ee-0994-49a2-b2fc-9156bb4d9341-maas-api-xks-ca\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:13:21.906710 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:21.906603 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-ddn95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 23:13:21.906710 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:21.906683 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" podUID="e8f0c433-9c57-4b4c-9094-6b618981f530" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 23:13:21.964858 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:21.964828 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq" Nov 03 23:13:21.965018 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:21.964828 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq" event={"ID":"697bc6ee-0994-49a2-b2fc-9156bb4d9341","Type":"ContainerDied","Data":"24924eab8426cb8babe004c648c639dd2766eb845f8d18f010bde23009cfa4e9"} Nov 03 23:13:21.965018 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:21.964954 5332 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24924eab8426cb8babe004c648c639dd2766eb845f8d18f010bde23009cfa4e9" Nov 03 23:13:22.510038 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:22.510007 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:22.510502 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:22.510325 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:22.511208 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:22.511187 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" Nov 03 23:13:27.851828 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:27.851790 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv"] Nov 03 23:13:27.854274 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:27.852398 5332 cpu_manager.go:414] "containerMap: removing container" podUID="697bc6ee-0994-49a2-b2fc-9156bb4d9341" containerName="revoke-keys" Nov 03 23:13:27.854274 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:27.852415 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="697bc6ee-0994-49a2-b2fc-9156bb4d9341" containerName="revoke-keys" Nov 03 23:13:27.854274 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:27.852520 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="697bc6ee-0994-49a2-b2fc-9156bb4d9341" containerName="revoke-keys" Nov 03 23:13:27.855500 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:27.855482 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv" Nov 03 23:13:27.860803 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:27.858592 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 23:13:27.860803 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:27.859109 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 23:13:27.867185 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:27.864899 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv"] Nov 03 23:13:27.870982 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:27.870939 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 23:13:27.871112 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:27.871050 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-54hnx\"" Nov 03 23:13:27.978777 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:27.978737 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pptx\" (UniqueName: \"kubernetes.io/projected/7eacc1cf-8651-4201-83a5-73733722489c-kube-api-access-5pptx\") pod \"maas-api-revoke-sub-4fef5ae8-5l4dv\" (UID: \"7eacc1cf-8651-4201-83a5-73733722489c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv" Nov 03 23:13:27.978777 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:27.978785 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7eacc1cf-8651-4201-83a5-73733722489c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4fef5ae8-5l4dv\" (UID: \"7eacc1cf-8651-4201-83a5-73733722489c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv" Nov 03 23:13:27.979005 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:27.978903 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7eacc1cf-8651-4201-83a5-73733722489c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4fef5ae8-5l4dv\" (UID: \"7eacc1cf-8651-4201-83a5-73733722489c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv" Nov 03 23:13:28.080182 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:28.080146 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pptx\" (UniqueName: \"kubernetes.io/projected/7eacc1cf-8651-4201-83a5-73733722489c-kube-api-access-5pptx\") pod \"maas-api-revoke-sub-4fef5ae8-5l4dv\" (UID: \"7eacc1cf-8651-4201-83a5-73733722489c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv" Nov 03 23:13:28.080182 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:28.080187 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7eacc1cf-8651-4201-83a5-73733722489c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4fef5ae8-5l4dv\" (UID: \"7eacc1cf-8651-4201-83a5-73733722489c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv" Nov 03 23:13:28.080405 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:28.080225 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7eacc1cf-8651-4201-83a5-73733722489c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4fef5ae8-5l4dv\" (UID: \"7eacc1cf-8651-4201-83a5-73733722489c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv" Nov 03 23:13:28.080992 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:28.080970 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7eacc1cf-8651-4201-83a5-73733722489c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4fef5ae8-5l4dv\" (UID: \"7eacc1cf-8651-4201-83a5-73733722489c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv" Nov 03 23:13:28.082687 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:28.082670 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7eacc1cf-8651-4201-83a5-73733722489c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4fef5ae8-5l4dv\" (UID: \"7eacc1cf-8651-4201-83a5-73733722489c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv" Nov 03 23:13:28.087574 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:28.087554 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pptx\" (UniqueName: \"kubernetes.io/projected/7eacc1cf-8651-4201-83a5-73733722489c-kube-api-access-5pptx\") pod \"maas-api-revoke-sub-4fef5ae8-5l4dv\" (UID: \"7eacc1cf-8651-4201-83a5-73733722489c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv" Nov 03 23:13:28.182705 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:28.182625 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv" Nov 03 23:13:28.457552 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:28.457526 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv"] Nov 03 23:13:28.459342 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:13:28.459299 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eacc1cf_8651_4201_83a5_73733722489c.slice/crio-e835a6c94bc1ee42c71e7848f1d524df959610b699b9497bd146107b67718c52 WatchSource:0}: Error finding container e835a6c94bc1ee42c71e7848f1d524df959610b699b9497bd146107b67718c52: Status 404 returned error can't find the container with id e835a6c94bc1ee42c71e7848f1d524df959610b699b9497bd146107b67718c52 Nov 03 23:13:29.011005 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:29.010918 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv" event={"ID":"7eacc1cf-8651-4201-83a5-73733722489c","Type":"ContainerStarted","Data":"5b9a8c2560d2a51314161dd4cdc204ed26e010df17496d673cc10be2aaf604ff"} Nov 03 23:13:29.011005 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:29.010968 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv" event={"ID":"7eacc1cf-8651-4201-83a5-73733722489c","Type":"ContainerStarted","Data":"e835a6c94bc1ee42c71e7848f1d524df959610b699b9497bd146107b67718c52"} Nov 03 23:13:29.032254 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:29.032198 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv" podStartSLOduration=2.032181928 podStartE2EDuration="2.032181928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:13:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:13:29.030103059 +0000 UTC m=+1315.560210226" watchObservedRunningTime="2026-11-03 23:13:29.032181928 +0000 UTC m=+1315.562289137" Nov 03 23:13:30.021641 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:30.021604 5332 generic.go:356] "Generic (PLEG): container finished" podID="7eacc1cf-8651-4201-83a5-73733722489c" containerID="5b9a8c2560d2a51314161dd4cdc204ed26e010df17496d673cc10be2aaf604ff" exitCode=0 Nov 03 23:13:30.022167 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:30.021670 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv" event={"ID":"7eacc1cf-8651-4201-83a5-73733722489c","Type":"ContainerDied","Data":"5b9a8c2560d2a51314161dd4cdc204ed26e010df17496d673cc10be2aaf604ff"} Nov 03 23:13:31.973649 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:31.898618 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 23:13:31.973649 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:31.898684 5332 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" podUID="0e954b77-1065-4605-9acc-4dadcc4c42ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 23:13:32.054988 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:32.054685 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv" Nov 03 23:13:32.070893 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:32.070592 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv" event={"ID":"7eacc1cf-8651-4201-83a5-73733722489c","Type":"ContainerDied","Data":"e835a6c94bc1ee42c71e7848f1d524df959610b699b9497bd146107b67718c52"} Nov 03 23:13:32.070893 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:32.070659 5332 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e835a6c94bc1ee42c71e7848f1d524df959610b699b9497bd146107b67718c52" Nov 03 23:13:32.070893 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:32.070731 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv" Nov 03 23:13:32.141479 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:32.133004 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7eacc1cf-8651-4201-83a5-73733722489c-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7eacc1cf-8651-4201-83a5-73733722489c-maas-api-xks-ca\") pod \"7eacc1cf-8651-4201-83a5-73733722489c\" (UID: \"7eacc1cf-8651-4201-83a5-73733722489c\") " Nov 03 23:13:32.142284 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:32.142256 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7eacc1cf-8651-4201-83a5-73733722489c-kube-api-access-5pptx\" (UniqueName: \"kubernetes.io/projected/7eacc1cf-8651-4201-83a5-73733722489c-kube-api-access-5pptx\") pod \"7eacc1cf-8651-4201-83a5-73733722489c\" (UID: \"7eacc1cf-8651-4201-83a5-73733722489c\") " Nov 03 23:13:32.166481 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:32.150937 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7eacc1cf-8651-4201-83a5-73733722489c-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7eacc1cf-8651-4201-83a5-73733722489c-maas-api-openshift-ca\") pod \"7eacc1cf-8651-4201-83a5-73733722489c\" (UID: \"7eacc1cf-8651-4201-83a5-73733722489c\") " Nov 03 23:13:32.167251 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:32.152828 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7eacc1cf-8651-4201-83a5-73733722489c-maas-api-openshift-ca" pod "7eacc1cf-8651-4201-83a5-73733722489c" (UID: "7eacc1cf-8651-4201-83a5-73733722489c"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:13:32.178540 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:32.175656 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7eacc1cf-8651-4201-83a5-73733722489c-maas-api-xks-ca" pod "7eacc1cf-8651-4201-83a5-73733722489c" (UID: "7eacc1cf-8651-4201-83a5-73733722489c"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:13:32.266781 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:32.266659 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7eacc1cf-8651-4201-83a5-73733722489c-kube-api-access-5pptx" pod "7eacc1cf-8651-4201-83a5-73733722489c" (UID: "7eacc1cf-8651-4201-83a5-73733722489c"). InnerVolumeSpecName "kube-api-access-5pptx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:13:32.268332 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:32.268256 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pptx\" (UniqueName: \"kubernetes.io/projected/7eacc1cf-8651-4201-83a5-73733722489c-kube-api-access-5pptx\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:13:32.268332 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:32.268288 5332 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7eacc1cf-8651-4201-83a5-73733722489c-maas-api-openshift-ca\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:13:32.268332 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:32.268304 5332 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7eacc1cf-8651-4201-83a5-73733722489c-maas-api-xks-ca\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:13:35.945855 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:35.945813 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:13:38.061264 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.061222 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws"] Nov 03 23:13:38.061912 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.061892 5332 cpu_manager.go:414] "containerMap: removing container" podUID="7eacc1cf-8651-4201-83a5-73733722489c" containerName="revoke-keys" Nov 03 23:13:38.062018 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.061914 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7eacc1cf-8651-4201-83a5-73733722489c" containerName="revoke-keys" Nov 03 23:13:38.062075 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.062036 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="7eacc1cf-8651-4201-83a5-73733722489c" containerName="revoke-keys" Nov 03 23:13:38.065437 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.065416 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws" Nov 03 23:13:38.071499 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.068436 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 23:13:38.071499 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.068806 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 23:13:38.071499 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.069618 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-54hnx\"" Nov 03 23:13:38.071499 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.069671 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 23:13:38.071763 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.071519 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws"] Nov 03 23:13:38.130168 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.130135 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e6b44c24-1f30-4e6c-8409-404b0cbd575e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9c85b486-msnws\" (UID: \"e6b44c24-1f30-4e6c-8409-404b0cbd575e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws" Nov 03 23:13:38.130337 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.130178 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88xrw\" (UniqueName: \"kubernetes.io/projected/e6b44c24-1f30-4e6c-8409-404b0cbd575e-kube-api-access-88xrw\") pod \"maas-api-revoke-sub-9c85b486-msnws\" (UID: \"e6b44c24-1f30-4e6c-8409-404b0cbd575e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws" Nov 03 23:13:38.130337 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.130281 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e6b44c24-1f30-4e6c-8409-404b0cbd575e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9c85b486-msnws\" (UID: \"e6b44c24-1f30-4e6c-8409-404b0cbd575e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws" Nov 03 23:13:38.231548 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.231511 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88xrw\" (UniqueName: \"kubernetes.io/projected/e6b44c24-1f30-4e6c-8409-404b0cbd575e-kube-api-access-88xrw\") pod \"maas-api-revoke-sub-9c85b486-msnws\" (UID: \"e6b44c24-1f30-4e6c-8409-404b0cbd575e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws" Nov 03 23:13:38.231748 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.231587 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e6b44c24-1f30-4e6c-8409-404b0cbd575e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9c85b486-msnws\" (UID: \"e6b44c24-1f30-4e6c-8409-404b0cbd575e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws" Nov 03 23:13:38.231748 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.231728 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e6b44c24-1f30-4e6c-8409-404b0cbd575e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9c85b486-msnws\" (UID: \"e6b44c24-1f30-4e6c-8409-404b0cbd575e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws" Nov 03 23:13:38.232465 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.232427 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e6b44c24-1f30-4e6c-8409-404b0cbd575e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9c85b486-msnws\" (UID: \"e6b44c24-1f30-4e6c-8409-404b0cbd575e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws" Nov 03 23:13:38.234200 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.234178 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e6b44c24-1f30-4e6c-8409-404b0cbd575e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9c85b486-msnws\" (UID: \"e6b44c24-1f30-4e6c-8409-404b0cbd575e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws" Nov 03 23:13:38.238515 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.238495 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88xrw\" (UniqueName: \"kubernetes.io/projected/e6b44c24-1f30-4e6c-8409-404b0cbd575e-kube-api-access-88xrw\") pod \"maas-api-revoke-sub-9c85b486-msnws\" (UID: \"e6b44c24-1f30-4e6c-8409-404b0cbd575e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws" Nov 03 23:13:38.385933 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.385847 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws" Nov 03 23:13:38.658509 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:38.658478 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws"] Nov 03 23:13:38.659216 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:13:38.659191 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6b44c24_1f30_4e6c_8409_404b0cbd575e.slice/crio-4e576644260fea80187ab50cbc9deae6063c03f1ae1884653241e2ff976c69e8 WatchSource:0}: Error finding container 4e576644260fea80187ab50cbc9deae6063c03f1ae1884653241e2ff976c69e8: Status 404 returned error can't find the container with id 4e576644260fea80187ab50cbc9deae6063c03f1ae1884653241e2ff976c69e8 Nov 03 23:13:39.113817 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:39.113785 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws" event={"ID":"e6b44c24-1f30-4e6c-8409-404b0cbd575e","Type":"ContainerStarted","Data":"36907277c46a3b15e83fb08126ac8df823eb2667200cafbf3658017abad6ddc8"} Nov 03 23:13:39.114219 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:39.113838 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws" event={"ID":"e6b44c24-1f30-4e6c-8409-404b0cbd575e","Type":"ContainerStarted","Data":"4e576644260fea80187ab50cbc9deae6063c03f1ae1884653241e2ff976c69e8"} Nov 03 23:13:39.129486 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:39.129416 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws" podStartSLOduration=1.129399867 podStartE2EDuration="1.129399867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:13:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:13:39.126930844 +0000 UTC m=+1325.657038005" watchObservedRunningTime="2026-11-03 23:13:39.129399867 +0000 UTC m=+1325.659507034" Nov 03 23:13:39.514356 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:13:39.514310 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:13:40.142864 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:40.142826 5332 generic.go:356] "Generic (PLEG): container finished" podID="e6b44c24-1f30-4e6c-8409-404b0cbd575e" containerID="36907277c46a3b15e83fb08126ac8df823eb2667200cafbf3658017abad6ddc8" exitCode=0 Nov 03 23:13:40.143371 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:40.142924 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws" event={"ID":"e6b44c24-1f30-4e6c-8409-404b0cbd575e","Type":"ContainerDied","Data":"36907277c46a3b15e83fb08126ac8df823eb2667200cafbf3658017abad6ddc8"} Nov 03 23:13:41.957493 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:41.947609 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws" Nov 03 23:13:42.091481 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:42.090681 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e6b44c24-1f30-4e6c-8409-404b0cbd575e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e6b44c24-1f30-4e6c-8409-404b0cbd575e-maas-api-openshift-ca\") pod \"e6b44c24-1f30-4e6c-8409-404b0cbd575e\" (UID: \"e6b44c24-1f30-4e6c-8409-404b0cbd575e\") " Nov 03 23:13:42.091481 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:42.091101 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6b44c24-1f30-4e6c-8409-404b0cbd575e-maas-api-openshift-ca" pod "e6b44c24-1f30-4e6c-8409-404b0cbd575e" (UID: "e6b44c24-1f30-4e6c-8409-404b0cbd575e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:13:42.091481 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:42.091231 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e6b44c24-1f30-4e6c-8409-404b0cbd575e-kube-api-access-88xrw\" (UniqueName: \"kubernetes.io/projected/e6b44c24-1f30-4e6c-8409-404b0cbd575e-kube-api-access-88xrw\") pod \"e6b44c24-1f30-4e6c-8409-404b0cbd575e\" (UID: \"e6b44c24-1f30-4e6c-8409-404b0cbd575e\") " Nov 03 23:13:42.101478 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:42.100942 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e6b44c24-1f30-4e6c-8409-404b0cbd575e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e6b44c24-1f30-4e6c-8409-404b0cbd575e-maas-api-xks-ca\") pod \"e6b44c24-1f30-4e6c-8409-404b0cbd575e\" (UID: \"e6b44c24-1f30-4e6c-8409-404b0cbd575e\") " Nov 03 23:13:42.118536 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:42.110215 5332 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e6b44c24-1f30-4e6c-8409-404b0cbd575e-maas-api-openshift-ca\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:13:42.205511 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:42.195561 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6b44c24-1f30-4e6c-8409-404b0cbd575e-maas-api-xks-ca" pod "e6b44c24-1f30-4e6c-8409-404b0cbd575e" (UID: "e6b44c24-1f30-4e6c-8409-404b0cbd575e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:13:42.223488 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:42.223108 5332 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e6b44c24-1f30-4e6c-8409-404b0cbd575e-maas-api-xks-ca\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:13:42.324509 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:42.274955 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws" event={"ID":"e6b44c24-1f30-4e6c-8409-404b0cbd575e","Type":"ContainerDied","Data":"4e576644260fea80187ab50cbc9deae6063c03f1ae1884653241e2ff976c69e8"} Nov 03 23:13:42.324509 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:42.275032 5332 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e576644260fea80187ab50cbc9deae6063c03f1ae1884653241e2ff976c69e8" Nov 03 23:13:42.324509 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:42.275114 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws" Nov 03 23:13:42.324509 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:42.280698 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6b44c24-1f30-4e6c-8409-404b0cbd575e-kube-api-access-88xrw" pod "e6b44c24-1f30-4e6c-8409-404b0cbd575e" (UID: "e6b44c24-1f30-4e6c-8409-404b0cbd575e"). InnerVolumeSpecName "kube-api-access-88xrw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:13:42.324509 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:42.323805 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88xrw\" (UniqueName: \"kubernetes.io/projected/e6b44c24-1f30-4e6c-8409-404b0cbd575e-kube-api-access-88xrw\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:13:44.373879 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:44.373842 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:13:50.292731 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:50.292693 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2"] Nov 03 23:13:50.353611 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:50.353570 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:13:51.866048 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:51.840790 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s"] Nov 03 23:13:51.866048 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:51.841843 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:13:56.663671 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:56.663537 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:13:58.466481 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:13:58.445018 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:01.886908 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:01.886843 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 23:14:01.887562 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:01.887511 5332 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-jtf6f" podUID="0e954b77-1065-4605-9acc-4dadcc4c42ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 23:14:05.332054 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:05.332004 5332 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" podUID="1c57753b-e128-4d6d-948b-b407c4b01ff7" containerName="main" containerID="cri-o://82cc6cf373a35a5a990bbde370aa2fdec1997e50539d9af53889d02f678698b1" gracePeriod=45 Nov 03 23:14:05.650546 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:05.649301 5332 generic.go:356] "Generic (PLEG): container finished" podID="1c57753b-e128-4d6d-948b-b407c4b01ff7" containerID="82cc6cf373a35a5a990bbde370aa2fdec1997e50539d9af53889d02f678698b1" exitCode=0 Nov 03 23:14:05.650546 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:05.649406 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" event={"ID":"1c57753b-e128-4d6d-948b-b407c4b01ff7","Type":"ContainerDied","Data":"82cc6cf373a35a5a990bbde370aa2fdec1997e50539d9af53889d02f678698b1"} Nov 03 23:14:05.654480 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:05.651917 5332 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" podUID="1c57753b-e128-4d6d-948b-b407c4b01ff7" containerName="main" probeResult="failure" output="Get \"https://10.133.0.38:8000/ready\": dial tcp 10.133.0.38:8000: connect: connection refused" Nov 03 23:14:06.226734 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.226701 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:14:06.398484 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.389077 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1c57753b-e128-4d6d-948b-b407c4b01ff7-kube-api-access-jxt7q\" (UniqueName: \"kubernetes.io/projected/1c57753b-e128-4d6d-948b-b407c4b01ff7-kube-api-access-jxt7q\") pod \"1c57753b-e128-4d6d-948b-b407c4b01ff7\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " Nov 03 23:14:06.398484 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.389153 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-home\" (UniqueName: \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-home\") pod \"1c57753b-e128-4d6d-948b-b407c4b01ff7\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " Nov 03 23:14:06.398484 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.389206 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-tmp-dir\") pod \"1c57753b-e128-4d6d-948b-b407c4b01ff7\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " Nov 03 23:14:06.398484 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.389236 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-dshm\") pod \"1c57753b-e128-4d6d-948b-b407c4b01ff7\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " Nov 03 23:14:06.398484 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.389370 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-model-cache\") pod \"1c57753b-e128-4d6d-948b-b407c4b01ff7\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " Nov 03 23:14:06.398484 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.389411 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1c57753b-e128-4d6d-948b-b407c4b01ff7-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c57753b-e128-4d6d-948b-b407c4b01ff7-tls-certs\") pod \"1c57753b-e128-4d6d-948b-b407c4b01ff7\" (UID: \"1c57753b-e128-4d6d-948b-b407c4b01ff7\") " Nov 03 23:14:06.404606 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.404542 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-home" pod "1c57753b-e128-4d6d-948b-b407c4b01ff7" (UID: "1c57753b-e128-4d6d-948b-b407c4b01ff7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:14:06.406277 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.404918 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-model-cache" pod "1c57753b-e128-4d6d-948b-b407c4b01ff7" (UID: "1c57753b-e128-4d6d-948b-b407c4b01ff7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:14:06.422996 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.422969 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-tmp-dir" pod "1c57753b-e128-4d6d-948b-b407c4b01ff7" (UID: "1c57753b-e128-4d6d-948b-b407c4b01ff7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:14:06.475700 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.475659 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c57753b-e128-4d6d-948b-b407c4b01ff7-tls-certs" pod "1c57753b-e128-4d6d-948b-b407c4b01ff7" (UID: "1c57753b-e128-4d6d-948b-b407c4b01ff7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:14:06.476041 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.476020 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-dshm" pod "1c57753b-e128-4d6d-948b-b407c4b01ff7" (UID: "1c57753b-e128-4d6d-948b-b407c4b01ff7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:14:06.476673 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.476635 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c57753b-e128-4d6d-948b-b407c4b01ff7-kube-api-access-jxt7q" pod "1c57753b-e128-4d6d-948b-b407c4b01ff7" (UID: "1c57753b-e128-4d6d-948b-b407c4b01ff7"). InnerVolumeSpecName "kube-api-access-jxt7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:14:06.495262 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.495136 5332 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-model-cache\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:14:06.495262 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.495168 5332 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c57753b-e128-4d6d-948b-b407c4b01ff7-tls-certs\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:14:06.495262 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.495185 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxt7q\" (UniqueName: \"kubernetes.io/projected/1c57753b-e128-4d6d-948b-b407c4b01ff7-kube-api-access-jxt7q\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:14:06.495262 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.495200 5332 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-home\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:14:06.495262 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.495216 5332 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-tmp-dir\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:14:06.495262 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.495228 5332 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c57753b-e128-4d6d-948b-b407c4b01ff7-dshm\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:14:06.675773 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.675665 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" event={"ID":"1c57753b-e128-4d6d-948b-b407c4b01ff7","Type":"ContainerDied","Data":"da24f1e58315ed6c68a93a4fe0cdd883de524620997ab46e31d78446c39e9c52"} Nov 03 23:14:06.676037 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.676017 5332 scope.go:122] "RemoveContainer" containerID="82cc6cf373a35a5a990bbde370aa2fdec1997e50539d9af53889d02f678698b1" Nov 03 23:14:06.676333 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.676314 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2" Nov 03 23:14:06.857537 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.842597 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2"] Nov 03 23:14:06.857537 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.855928 5332 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/grid-inv-9698c1f0-model-kserve-57859b89fb-mrpl2"] Nov 03 23:14:06.983768 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:06.981648 5332 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" podUID="533ab966-4575-44ec-9a34-d2e21770b685" containerName="main" containerID="cri-o://6b91f5786a06bd7bedb88508aa569e0a689b535750f632e60f604fb2a74551a0" gracePeriod=45 Nov 03 23:14:07.363851 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.363827 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:14:07.469373 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.469339 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/533ab966-4575-44ec-9a34-d2e21770b685-kube-api-access-8w5j6\" (UniqueName: \"kubernetes.io/projected/533ab966-4575-44ec-9a34-d2e21770b685-kube-api-access-8w5j6\") pod \"533ab966-4575-44ec-9a34-d2e21770b685\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " Nov 03 23:14:07.469876 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.469388 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-home\" (UniqueName: \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-home\") pod \"533ab966-4575-44ec-9a34-d2e21770b685\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " Nov 03 23:14:07.469876 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.469421 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-dshm\" (UniqueName: \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-dshm\") pod \"533ab966-4575-44ec-9a34-d2e21770b685\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " Nov 03 23:14:07.469876 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.469448 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-tmp-dir\") pod \"533ab966-4575-44ec-9a34-d2e21770b685\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " Nov 03 23:14:07.469876 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.469488 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/533ab966-4575-44ec-9a34-d2e21770b685-tls-certs\" (UniqueName: \"kubernetes.io/secret/533ab966-4575-44ec-9a34-d2e21770b685-tls-certs\") pod \"533ab966-4575-44ec-9a34-d2e21770b685\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " Nov 03 23:14:07.469876 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.469524 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-model-cache\") pod \"533ab966-4575-44ec-9a34-d2e21770b685\" (UID: \"533ab966-4575-44ec-9a34-d2e21770b685\") " Nov 03 23:14:07.469876 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.469770 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-home" pod "533ab966-4575-44ec-9a34-d2e21770b685" (UID: "533ab966-4575-44ec-9a34-d2e21770b685"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:14:07.469876 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.469808 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-tmp-dir" pod "533ab966-4575-44ec-9a34-d2e21770b685" (UID: "533ab966-4575-44ec-9a34-d2e21770b685"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:14:07.469876 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.469825 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-model-cache" pod "533ab966-4575-44ec-9a34-d2e21770b685" (UID: "533ab966-4575-44ec-9a34-d2e21770b685"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:14:07.471718 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.471689 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/533ab966-4575-44ec-9a34-d2e21770b685-tls-certs" pod "533ab966-4575-44ec-9a34-d2e21770b685" (UID: "533ab966-4575-44ec-9a34-d2e21770b685"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:14:07.472189 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.472171 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-dshm" pod "533ab966-4575-44ec-9a34-d2e21770b685" (UID: "533ab966-4575-44ec-9a34-d2e21770b685"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:14:07.472189 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.472175 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/533ab966-4575-44ec-9a34-d2e21770b685-kube-api-access-8w5j6" pod "533ab966-4575-44ec-9a34-d2e21770b685" (UID: "533ab966-4575-44ec-9a34-d2e21770b685"). InnerVolumeSpecName "kube-api-access-8w5j6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:14:07.571217 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.571130 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w5j6\" (UniqueName: \"kubernetes.io/projected/533ab966-4575-44ec-9a34-d2e21770b685-kube-api-access-8w5j6\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:14:07.571217 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.571162 5332 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-home\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:14:07.571217 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.571173 5332 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-dshm\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:14:07.571217 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.571181 5332 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-tmp-dir\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:14:07.571217 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.571189 5332 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/533ab966-4575-44ec-9a34-d2e21770b685-tls-certs\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:14:07.571217 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.571196 5332 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/533ab966-4575-44ec-9a34-d2e21770b685-model-cache\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:14:07.596049 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.596015 5332 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1c57753b-e128-4d6d-948b-b407c4b01ff7" path="/var/lib/kubelet/pods/1c57753b-e128-4d6d-948b-b407c4b01ff7/volumes" Nov 03 23:14:07.682827 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.682793 5332 generic.go:356] "Generic (PLEG): container finished" podID="533ab966-4575-44ec-9a34-d2e21770b685" containerID="6b91f5786a06bd7bedb88508aa569e0a689b535750f632e60f604fb2a74551a0" exitCode=0 Nov 03 23:14:07.682991 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.682837 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" Nov 03 23:14:07.682991 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.682872 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" event={"ID":"533ab966-4575-44ec-9a34-d2e21770b685","Type":"ContainerDied","Data":"6b91f5786a06bd7bedb88508aa569e0a689b535750f632e60f604fb2a74551a0"} Nov 03 23:14:07.682991 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.682913 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s" event={"ID":"533ab966-4575-44ec-9a34-d2e21770b685","Type":"ContainerDied","Data":"bcfe34f6c9f276cad509e32c13c7537b23c50df14fc895fe3149e3ebfe5becb5"} Nov 03 23:14:07.682991 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.682931 5332 scope.go:122] "RemoveContainer" containerID="6b91f5786a06bd7bedb88508aa569e0a689b535750f632e60f604fb2a74551a0" Nov 03 23:14:07.692102 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.692087 5332 scope.go:122] "RemoveContainer" containerID="6b91f5786a06bd7bedb88508aa569e0a689b535750f632e60f604fb2a74551a0" Nov 03 23:14:07.692354 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:14:07.692338 5332 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b91f5786a06bd7bedb88508aa569e0a689b535750f632e60f604fb2a74551a0\": container with ID starting with 6b91f5786a06bd7bedb88508aa569e0a689b535750f632e60f604fb2a74551a0 not found: ID does not exist" containerID="6b91f5786a06bd7bedb88508aa569e0a689b535750f632e60f604fb2a74551a0" Nov 03 23:14:07.692400 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.692364 5332 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b91f5786a06bd7bedb88508aa569e0a689b535750f632e60f604fb2a74551a0"} err="failed to get container status \"6b91f5786a06bd7bedb88508aa569e0a689b535750f632e60f604fb2a74551a0\": rpc error: code = NotFound desc = could not find container \"6b91f5786a06bd7bedb88508aa569e0a689b535750f632e60f604fb2a74551a0\": container with ID starting with 6b91f5786a06bd7bedb88508aa569e0a689b535750f632e60f604fb2a74551a0 not found: ID does not exist" Nov 03 23:14:07.697799 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.697778 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s"] Nov 03 23:14:07.699562 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:07.699541 5332 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/grid-inv-9698c1f0-unmatched-kserve-8bc6778b-ql48s"] Nov 03 23:14:09.495618 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:14:09.495578 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:14:09.596878 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:09.596843 5332 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="533ab966-4575-44ec-9a34-d2e21770b685" path="/var/lib/kubelet/pods/533ab966-4575-44ec-9a34-d2e21770b685/volumes" Nov 03 23:14:09.962218 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:09.962165 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:12.369207 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:12.369167 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-12475-f2203b"] Nov 03 23:14:12.369781 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:12.369761 5332 cpu_manager.go:414] "containerMap: removing container" podUID="533ab966-4575-44ec-9a34-d2e21770b685" containerName="main" Nov 03 23:14:12.369870 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:12.369784 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="533ab966-4575-44ec-9a34-d2e21770b685" containerName="main" Nov 03 23:14:12.369870 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:12.369801 5332 cpu_manager.go:414] "containerMap: removing container" podUID="1c57753b-e128-4d6d-948b-b407c4b01ff7" containerName="main" Nov 03 23:14:12.369870 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:12.369809 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1c57753b-e128-4d6d-948b-b407c4b01ff7" containerName="main" Nov 03 23:14:12.369870 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:12.369827 5332 cpu_manager.go:414] "containerMap: removing container" podUID="e6b44c24-1f30-4e6c-8409-404b0cbd575e" containerName="revoke-keys" Nov 03 23:14:12.369870 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:12.369834 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e6b44c24-1f30-4e6c-8409-404b0cbd575e" containerName="revoke-keys" Nov 03 23:14:12.370119 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:12.369976 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="533ab966-4575-44ec-9a34-d2e21770b685" containerName="main" Nov 03 23:14:12.370119 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:12.369989 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="1c57753b-e128-4d6d-948b-b407c4b01ff7" containerName="main" Nov 03 23:14:12.370119 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:12.370001 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="e6b44c24-1f30-4e6c-8409-404b0cbd575e" containerName="revoke-keys" Nov 03 23:14:12.374576 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:12.374555 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-12475-f2203b" Nov 03 23:14:12.377541 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:12.377431 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-12475-f2203b"] Nov 03 23:14:12.377698 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:12.377681 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qjwd6\"" Nov 03 23:14:12.521725 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:12.521688 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pvnn\" (UniqueName: \"kubernetes.io/projected/5730ac53-aeaf-45c7-be7d-5f38dbd420d3-kube-api-access-2pvnn\") pod \"test-curl-12475-f2203b\" (UID: \"5730ac53-aeaf-45c7-be7d-5f38dbd420d3\") " pod="opendatahub/test-curl-12475-f2203b" Nov 03 23:14:12.622411 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:12.622315 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pvnn\" (UniqueName: \"kubernetes.io/projected/5730ac53-aeaf-45c7-be7d-5f38dbd420d3-kube-api-access-2pvnn\") pod \"test-curl-12475-f2203b\" (UID: \"5730ac53-aeaf-45c7-be7d-5f38dbd420d3\") " pod="opendatahub/test-curl-12475-f2203b" Nov 03 23:14:12.630639 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:12.630609 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pvnn\" (UniqueName: \"kubernetes.io/projected/5730ac53-aeaf-45c7-be7d-5f38dbd420d3-kube-api-access-2pvnn\") pod \"test-curl-12475-f2203b\" (UID: \"5730ac53-aeaf-45c7-be7d-5f38dbd420d3\") " pod="opendatahub/test-curl-12475-f2203b" Nov 03 23:14:12.688381 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:12.688350 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-12475-f2203b" Nov 03 23:14:12.960941 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:12.960918 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-12475-f2203b"] Nov 03 23:14:12.963156 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:14:12.963124 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5730ac53_aeaf_45c7_be7d_5f38dbd420d3.slice/crio-e48d1e05e39a2ca75043d7bddb450958df98ea987b4e5c75823e607fb5137663 WatchSource:0}: Error finding container e48d1e05e39a2ca75043d7bddb450958df98ea987b4e5c75823e607fb5137663: Status 404 returned error can't find the container with id e48d1e05e39a2ca75043d7bddb450958df98ea987b4e5c75823e607fb5137663 Nov 03 23:14:13.717852 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:13.717814 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-12475-f2203b" event={"ID":"5730ac53-aeaf-45c7-be7d-5f38dbd420d3","Type":"ContainerStarted","Data":"e48d1e05e39a2ca75043d7bddb450958df98ea987b4e5c75823e607fb5137663"} Nov 03 23:14:15.731186 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:15.731151 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-12475-f2203b" event={"ID":"5730ac53-aeaf-45c7-be7d-5f38dbd420d3","Type":"ContainerStarted","Data":"7865622ff46ddbf84d629d06c922bfb5f57dfcdbb64a86552f77db846bcd75d5"} Nov 03 23:14:15.750448 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:15.745618 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-12475-f2203b" podStartSLOduration=1.17667187 podStartE2EDuration="3.745597001s" totalImagesPullingTime="2.568925131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:14:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:14:15.743175284 +0000 UTC m=+1362.273282451" watchObservedRunningTime="2026-11-03 23:14:15.745597001 +0000 UTC m=+1362.275704186" Nov 03 23:14:16.447389 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:16.447355 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-12475-f2203b"] Nov 03 23:14:16.451631 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:16.451607 5332 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-12475-f2203b"] Nov 03 23:14:16.786179 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:16.786145 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-12475-02a120"] Nov 03 23:14:16.786640 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:16.786579 5332 cpu_manager.go:414] "containerMap: removing container" podUID="5730ac53-aeaf-45c7-be7d-5f38dbd420d3" containerName="test-curl-12475-f2203b" Nov 03 23:14:16.786640 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:16.786594 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5730ac53-aeaf-45c7-be7d-5f38dbd420d3" containerName="test-curl-12475-f2203b" Nov 03 23:14:16.786732 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:16.786668 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="5730ac53-aeaf-45c7-be7d-5f38dbd420d3" containerName="test-curl-12475-f2203b" Nov 03 23:14:16.790092 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:16.790076 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-12475-02a120" Nov 03 23:14:16.794442 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:16.794418 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-12475-02a120"] Nov 03 23:14:16.871544 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:16.871512 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4ddq\" (UniqueName: \"kubernetes.io/projected/4e297c16-4f7d-4a22-906e-2ff383020cee-kube-api-access-k4ddq\") pod \"test-curl-12475-02a120\" (UID: \"4e297c16-4f7d-4a22-906e-2ff383020cee\") " pod="opendatahub/test-curl-12475-02a120" Nov 03 23:14:16.973064 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:16.973018 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4ddq\" (UniqueName: \"kubernetes.io/projected/4e297c16-4f7d-4a22-906e-2ff383020cee-kube-api-access-k4ddq\") pod \"test-curl-12475-02a120\" (UID: \"4e297c16-4f7d-4a22-906e-2ff383020cee\") " pod="opendatahub/test-curl-12475-02a120" Nov 03 23:14:16.980304 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:16.980282 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4ddq\" (UniqueName: \"kubernetes.io/projected/4e297c16-4f7d-4a22-906e-2ff383020cee-kube-api-access-k4ddq\") pod \"test-curl-12475-02a120\" (UID: \"4e297c16-4f7d-4a22-906e-2ff383020cee\") " pod="opendatahub/test-curl-12475-02a120" Nov 03 23:14:17.103769 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:17.103684 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-12475-02a120" Nov 03 23:14:17.379212 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:17.379186 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-12475-02a120"] Nov 03 23:14:17.381057 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:14:17.381028 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e297c16_4f7d_4a22_906e_2ff383020cee.slice/crio-084d2257672031ce1d792ff61f5db153e23c3907a8353426a700c296bbade2c8 WatchSource:0}: Error finding container 084d2257672031ce1d792ff61f5db153e23c3907a8353426a700c296bbade2c8: Status 404 returned error can't find the container with id 084d2257672031ce1d792ff61f5db153e23c3907a8353426a700c296bbade2c8 Nov 03 23:14:17.743287 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:17.743253 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-12475-02a120" event={"ID":"4e297c16-4f7d-4a22-906e-2ff383020cee","Type":"ContainerStarted","Data":"0817345d1a2d549a8003ab8d3f65aa62a4cf06231d8ffc02168fa14c36990543"} Nov 03 23:14:17.743495 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:17.743303 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-12475-02a120" event={"ID":"4e297c16-4f7d-4a22-906e-2ff383020cee","Type":"ContainerStarted","Data":"084d2257672031ce1d792ff61f5db153e23c3907a8353426a700c296bbade2c8"} Nov 03 23:14:17.743495 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:17.743329 5332 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-12475-f2203b" podUID="5730ac53-aeaf-45c7-be7d-5f38dbd420d3" containerName="test-curl-12475-f2203b" containerID="cri-o://7865622ff46ddbf84d629d06c922bfb5f57dfcdbb64a86552f77db846bcd75d5" gracePeriod=2 Nov 03 23:14:17.755622 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:17.755567 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-12475-02a120" podStartSLOduration=1.755553892 podStartE2EDuration="1.755553892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:14:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:14:17.755011441 +0000 UTC m=+1364.285118607" watchObservedRunningTime="2026-11-03 23:14:17.755553892 +0000 UTC m=+1364.285661060" Nov 03 23:14:18.414224 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:18.414184 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-12475-02a120"] Nov 03 23:14:18.418964 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:18.418932 5332 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-12475-02a120"] Nov 03 23:14:18.672514 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:18.672416 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-12475-65b8a9"] Nov 03 23:14:18.672825 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:18.672810 5332 cpu_manager.go:414] "containerMap: removing container" podUID="4e297c16-4f7d-4a22-906e-2ff383020cee" containerName="test-curl-12475-02a120" Nov 03 23:14:18.672879 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:18.672825 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4e297c16-4f7d-4a22-906e-2ff383020cee" containerName="test-curl-12475-02a120" Nov 03 23:14:18.672926 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:18.672906 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="4e297c16-4f7d-4a22-906e-2ff383020cee" containerName="test-curl-12475-02a120" Nov 03 23:14:18.675992 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:18.675975 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-12475-65b8a9" Nov 03 23:14:18.680518 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:18.680494 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-12475-65b8a9"] Nov 03 23:14:18.791889 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:18.791850 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm22s\" (UniqueName: \"kubernetes.io/projected/cc796103-4c94-4b49-8884-4cbf03f196c6-kube-api-access-nm22s\") pod \"test-curl-12475-65b8a9\" (UID: \"cc796103-4c94-4b49-8884-4cbf03f196c6\") " pod="opendatahub/test-curl-12475-65b8a9" Nov 03 23:14:18.892737 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:18.892697 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm22s\" (UniqueName: \"kubernetes.io/projected/cc796103-4c94-4b49-8884-4cbf03f196c6-kube-api-access-nm22s\") pod \"test-curl-12475-65b8a9\" (UID: \"cc796103-4c94-4b49-8884-4cbf03f196c6\") " pod="opendatahub/test-curl-12475-65b8a9" Nov 03 23:14:18.899828 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:18.899803 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm22s\" (UniqueName: \"kubernetes.io/projected/cc796103-4c94-4b49-8884-4cbf03f196c6-kube-api-access-nm22s\") pod \"test-curl-12475-65b8a9\" (UID: \"cc796103-4c94-4b49-8884-4cbf03f196c6\") " pod="opendatahub/test-curl-12475-65b8a9" Nov 03 23:14:18.989672 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:18.989642 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-12475-65b8a9" Nov 03 23:14:19.259444 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:19.259418 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-12475-65b8a9"] Nov 03 23:14:19.261422 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:14:19.261391 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc796103_4c94_4b49_8884_4cbf03f196c6.slice/crio-216d28d5ce4802f5cde71f8a97780dcb986bfee3a2e5be847fcc9e2885011a8f WatchSource:0}: Error finding container 216d28d5ce4802f5cde71f8a97780dcb986bfee3a2e5be847fcc9e2885011a8f: Status 404 returned error can't find the container with id 216d28d5ce4802f5cde71f8a97780dcb986bfee3a2e5be847fcc9e2885011a8f Nov 03 23:14:19.762528 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:19.762490 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-12475-65b8a9" event={"ID":"cc796103-4c94-4b49-8884-4cbf03f196c6","Type":"ContainerStarted","Data":"6cb62a1614189ef637b07ad82c8e1b4be40f033cd7fc480f8d815ebf354a85ab"} Nov 03 23:14:19.762938 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:19.762549 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-12475-65b8a9" event={"ID":"cc796103-4c94-4b49-8884-4cbf03f196c6","Type":"ContainerStarted","Data":"216d28d5ce4802f5cde71f8a97780dcb986bfee3a2e5be847fcc9e2885011a8f"} Nov 03 23:14:19.762938 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:19.762555 5332 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-12475-02a120" podUID="4e297c16-4f7d-4a22-906e-2ff383020cee" containerName="test-curl-12475-02a120" containerID="cri-o://0817345d1a2d549a8003ab8d3f65aa62a4cf06231d8ffc02168fa14c36990543" gracePeriod=2 Nov 03 23:14:19.774967 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:19.774841 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-12475-65b8a9" podStartSLOduration=1.7748276079999998 podStartE2EDuration="1.774827608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:14:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:14:19.774105308 +0000 UTC m=+1366.304212471" watchObservedRunningTime="2026-11-03 23:14:19.774827608 +0000 UTC m=+1366.304934776" Nov 03 23:14:19.923495 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:19.923464 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-12475-f2203b" Nov 03 23:14:20.104019 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:20.103934 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5730ac53-aeaf-45c7-be7d-5f38dbd420d3-kube-api-access-2pvnn\" (UniqueName: \"kubernetes.io/projected/5730ac53-aeaf-45c7-be7d-5f38dbd420d3-kube-api-access-2pvnn\") pod \"5730ac53-aeaf-45c7-be7d-5f38dbd420d3\" (UID: \"5730ac53-aeaf-45c7-be7d-5f38dbd420d3\") " Nov 03 23:14:20.106226 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:20.106197 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5730ac53-aeaf-45c7-be7d-5f38dbd420d3-kube-api-access-2pvnn" pod "5730ac53-aeaf-45c7-be7d-5f38dbd420d3" (UID: "5730ac53-aeaf-45c7-be7d-5f38dbd420d3"). InnerVolumeSpecName "kube-api-access-2pvnn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:14:20.205571 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:20.205541 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pvnn\" (UniqueName: \"kubernetes.io/projected/5730ac53-aeaf-45c7-be7d-5f38dbd420d3-kube-api-access-2pvnn\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:14:20.453288 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:20.453246 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-12475-65b8a9"] Nov 03 23:14:20.457312 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:20.457285 5332 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-12475-65b8a9"] Nov 03 23:14:20.770027 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:20.769943 5332 generic.go:356] "Generic (PLEG): container finished" podID="5730ac53-aeaf-45c7-be7d-5f38dbd420d3" containerID="7865622ff46ddbf84d629d06c922bfb5f57dfcdbb64a86552f77db846bcd75d5" exitCode=137 Nov 03 23:14:20.770027 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:20.769983 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-12475-f2203b" Nov 03 23:14:20.770508 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:20.770033 5332 scope.go:122] "RemoveContainer" containerID="7865622ff46ddbf84d629d06c922bfb5f57dfcdbb64a86552f77db846bcd75d5" Nov 03 23:14:20.779272 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:20.779255 5332 scope.go:122] "RemoveContainer" containerID="7865622ff46ddbf84d629d06c922bfb5f57dfcdbb64a86552f77db846bcd75d5" Nov 03 23:14:20.779622 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:14:20.779596 5332 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7865622ff46ddbf84d629d06c922bfb5f57dfcdbb64a86552f77db846bcd75d5\": container with ID starting with 7865622ff46ddbf84d629d06c922bfb5f57dfcdbb64a86552f77db846bcd75d5 not found: ID does not exist" containerID="7865622ff46ddbf84d629d06c922bfb5f57dfcdbb64a86552f77db846bcd75d5" Nov 03 23:14:20.779686 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:20.779634 5332 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7865622ff46ddbf84d629d06c922bfb5f57dfcdbb64a86552f77db846bcd75d5"} err="failed to get container status \"7865622ff46ddbf84d629d06c922bfb5f57dfcdbb64a86552f77db846bcd75d5\": rpc error: code = NotFound desc = could not find container \"7865622ff46ddbf84d629d06c922bfb5f57dfcdbb64a86552f77db846bcd75d5\": container with ID starting with 7865622ff46ddbf84d629d06c922bfb5f57dfcdbb64a86552f77db846bcd75d5 not found: ID does not exist" Nov 03 23:14:20.779759 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:14:20.779738 5332 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-12475-f2203b\" is forbidden: User \"system:node:ip-10-0-138-89.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-89.us-east-2.compute.internal' and this object" podUID="5730ac53-aeaf-45c7-be7d-5f38dbd420d3" pod="opendatahub/test-curl-12475-f2203b" Nov 03 23:14:21.002791 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.002757 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:21.375404 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.375373 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n"] Nov 03 23:14:21.375869 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.375852 5332 cpu_manager.go:414] "containerMap: removing container" podUID="cc796103-4c94-4b49-8884-4cbf03f196c6" containerName="test-curl-12475-65b8a9" Nov 03 23:14:21.375945 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.375870 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc796103-4c94-4b49-8884-4cbf03f196c6" containerName="test-curl-12475-65b8a9" Nov 03 23:14:21.375945 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.375935 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="cc796103-4c94-4b49-8884-4cbf03f196c6" containerName="test-curl-12475-65b8a9" Nov 03 23:14:21.379188 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.379167 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.381132 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:14:21.381104 5332 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-12475-f2203b\" is forbidden: User \"system:node:ip-10-0-138-89.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-89.us-east-2.compute.internal' and this object" podUID="5730ac53-aeaf-45c7-be7d-5f38dbd420d3" pod="opendatahub/test-curl-12475-f2203b" Nov 03 23:14:21.387938 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.387901 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-main-70a7bf-openshift-default-dockercfg-8ml25\"" Nov 03 23:14:21.391908 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.391872 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n"] Nov 03 23:14:21.442336 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.442299 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:21.524141 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.524095 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-workload-certs\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.524345 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.524159 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-credential-socket\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.524415 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.524306 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-token\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.524495 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.524424 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-data\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.524559 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.524513 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-podinfo\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.524623 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.524602 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-envoy\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.524865 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.524656 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-workload-socket\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.524865 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.524740 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2408104b-5d53-48b8-8df4-f68e94248c4f-istiod-ca-cert\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.524865 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.524795 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrtb9\" (UniqueName: \"kubernetes.io/projected/2408104b-5d53-48b8-8df4-f68e94248c4f-kube-api-access-mrtb9\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.597203 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.597163 5332 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5730ac53-aeaf-45c7-be7d-5f38dbd420d3" path="/var/lib/kubelet/pods/5730ac53-aeaf-45c7-be7d-5f38dbd420d3/volumes" Nov 03 23:14:21.626410 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.626334 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2408104b-5d53-48b8-8df4-f68e94248c4f-istiod-ca-cert\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.626410 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.626382 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrtb9\" (UniqueName: \"kubernetes.io/projected/2408104b-5d53-48b8-8df4-f68e94248c4f-kube-api-access-mrtb9\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.626623 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.626424 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-workload-certs\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.626623 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.626440 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-credential-socket\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.626623 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.626605 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-token\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.626782 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.626655 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-data\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.626782 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.626704 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-podinfo\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.626782 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.626744 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-envoy\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.626921 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.626777 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-workload-socket\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.626921 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.626873 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-credential-socket\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.626921 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.626903 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-workload-certs\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.627071 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.626983 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-data\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.627131 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.627107 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2408104b-5d53-48b8-8df4-f68e94248c4f-istiod-ca-cert\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.627184 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.627148 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-workload-socket\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.629163 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.629134 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-envoy\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.629346 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.629329 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-podinfo\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.635085 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.635020 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:21.636022 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.636000 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrtb9\" (UniqueName: \"kubernetes.io/projected/2408104b-5d53-48b8-8df4-f68e94248c4f-kube-api-access-mrtb9\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.636303 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.636283 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-token\") pod \"e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.694066 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.694028 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:21.779137 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.779088 5332 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-12475-65b8a9" podUID="cc796103-4c94-4b49-8884-4cbf03f196c6" containerName="test-curl-12475-65b8a9" containerID="cri-o://6cb62a1614189ef637b07ad82c8e1b4be40f033cd7fc480f8d815ebf354a85ab" gracePeriod=2 Nov 03 23:14:21.924948 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.924919 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-12475-02a120" Nov 03 23:14:21.970202 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.970180 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n"] Nov 03 23:14:21.972236 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:14:21.972208 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2408104b_5d53_48b8_8df4_f68e94248c4f.slice/crio-7d8ff728d019a2eeee53292f61a4f9d4df025b0ed4251cfda0fa0fa25486624e WatchSource:0}: Error finding container 7d8ff728d019a2eeee53292f61a4f9d4df025b0ed4251cfda0fa0fa25486624e: Status 404 returned error can't find the container with id 7d8ff728d019a2eeee53292f61a4f9d4df025b0ed4251cfda0fa0fa25486624e Nov 03 23:14:21.974578 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.974544 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:14:21.974686 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.974612 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:14:21.974686 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:21.974642 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:14:22.029522 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:22.029496 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4e297c16-4f7d-4a22-906e-2ff383020cee-kube-api-access-k4ddq\" (UniqueName: \"kubernetes.io/projected/4e297c16-4f7d-4a22-906e-2ff383020cee-kube-api-access-k4ddq\") pod \"4e297c16-4f7d-4a22-906e-2ff383020cee\" (UID: \"4e297c16-4f7d-4a22-906e-2ff383020cee\") " Nov 03 23:14:22.031543 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:22.031517 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e297c16-4f7d-4a22-906e-2ff383020cee-kube-api-access-k4ddq" pod "4e297c16-4f7d-4a22-906e-2ff383020cee" (UID: "4e297c16-4f7d-4a22-906e-2ff383020cee"). InnerVolumeSpecName "kube-api-access-k4ddq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:14:22.130322 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:22.130289 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4ddq\" (UniqueName: \"kubernetes.io/projected/4e297c16-4f7d-4a22-906e-2ff383020cee-kube-api-access-k4ddq\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:14:22.786112 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:22.786071 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" event={"ID":"2408104b-5d53-48b8-8df4-f68e94248c4f","Type":"ContainerStarted","Data":"26d73cff4a2b90a143961cbef9e67e23b627642da31bfd65deae8613b558cf89"} Nov 03 23:14:22.786598 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:22.786178 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" event={"ID":"2408104b-5d53-48b8-8df4-f68e94248c4f","Type":"ContainerStarted","Data":"7d8ff728d019a2eeee53292f61a4f9d4df025b0ed4251cfda0fa0fa25486624e"} Nov 03 23:14:22.787567 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:22.787538 5332 generic.go:356] "Generic (PLEG): container finished" podID="4e297c16-4f7d-4a22-906e-2ff383020cee" containerID="0817345d1a2d549a8003ab8d3f65aa62a4cf06231d8ffc02168fa14c36990543" exitCode=137 Nov 03 23:14:22.787707 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:22.787587 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-12475-02a120" Nov 03 23:14:22.787707 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:22.787637 5332 scope.go:122] "RemoveContainer" containerID="0817345d1a2d549a8003ab8d3f65aa62a4cf06231d8ffc02168fa14c36990543" Nov 03 23:14:22.796697 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:22.796679 5332 scope.go:122] "RemoveContainer" containerID="0817345d1a2d549a8003ab8d3f65aa62a4cf06231d8ffc02168fa14c36990543" Nov 03 23:14:22.796976 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:14:22.796960 5332 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0817345d1a2d549a8003ab8d3f65aa62a4cf06231d8ffc02168fa14c36990543\": container with ID starting with 0817345d1a2d549a8003ab8d3f65aa62a4cf06231d8ffc02168fa14c36990543 not found: ID does not exist" containerID="0817345d1a2d549a8003ab8d3f65aa62a4cf06231d8ffc02168fa14c36990543" Nov 03 23:14:22.797018 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:22.796987 5332 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0817345d1a2d549a8003ab8d3f65aa62a4cf06231d8ffc02168fa14c36990543"} err="failed to get container status \"0817345d1a2d549a8003ab8d3f65aa62a4cf06231d8ffc02168fa14c36990543\": rpc error: code = NotFound desc = could not find container \"0817345d1a2d549a8003ab8d3f65aa62a4cf06231d8ffc02168fa14c36990543\": container with ID starting with 0817345d1a2d549a8003ab8d3f65aa62a4cf06231d8ffc02168fa14c36990543 not found: ID does not exist" Nov 03 23:14:22.804534 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:14:22.804506 5332 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-12475-02a120\" is forbidden: User \"system:node:ip-10-0-138-89.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-89.us-east-2.compute.internal' and this object" podUID="4e297c16-4f7d-4a22-906e-2ff383020cee" pod="opendatahub/test-curl-12475-02a120" Nov 03 23:14:22.805085 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:22.805045 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" podStartSLOduration=1.805032749 podStartE2EDuration="1.805032749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:14:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:14:22.802776739 +0000 UTC m=+1369.332883906" watchObservedRunningTime="2026-11-03 23:14:22.805032749 +0000 UTC m=+1369.335139982" Nov 03 23:14:23.595038 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:14:23.595002 5332 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-12475-02a120\" is forbidden: User \"system:node:ip-10-0-138-89.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-89.us-east-2.compute.internal' and this object" podUID="4e297c16-4f7d-4a22-906e-2ff383020cee" pod="opendatahub/test-curl-12475-02a120" Nov 03 23:14:23.596711 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:23.596690 5332 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4e297c16-4f7d-4a22-906e-2ff383020cee" path="/var/lib/kubelet/pods/4e297c16-4f7d-4a22-906e-2ff383020cee/volumes" Nov 03 23:14:23.694864 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:23.694830 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:23.699913 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:23.699887 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:23.794710 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:23.794686 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:23.795596 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:23.795577 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:23.968131 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:23.968105 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-12475-65b8a9" Nov 03 23:14:24.048750 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:24.048721 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc796103-4c94-4b49-8884-4cbf03f196c6-kube-api-access-nm22s\" (UniqueName: \"kubernetes.io/projected/cc796103-4c94-4b49-8884-4cbf03f196c6-kube-api-access-nm22s\") pod \"cc796103-4c94-4b49-8884-4cbf03f196c6\" (UID: \"cc796103-4c94-4b49-8884-4cbf03f196c6\") " Nov 03 23:14:24.051241 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:24.051211 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc796103-4c94-4b49-8884-4cbf03f196c6-kube-api-access-nm22s" pod "cc796103-4c94-4b49-8884-4cbf03f196c6" (UID: "cc796103-4c94-4b49-8884-4cbf03f196c6"). InnerVolumeSpecName "kube-api-access-nm22s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:14:24.149647 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:24.149568 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm22s\" (UniqueName: \"kubernetes.io/projected/cc796103-4c94-4b49-8884-4cbf03f196c6-kube-api-access-nm22s\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:14:24.800805 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:24.800766 5332 generic.go:356] "Generic (PLEG): container finished" podID="cc796103-4c94-4b49-8884-4cbf03f196c6" containerID="6cb62a1614189ef637b07ad82c8e1b4be40f033cd7fc480f8d815ebf354a85ab" exitCode=137 Nov 03 23:14:24.801237 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:24.800815 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-12475-65b8a9" Nov 03 23:14:24.801237 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:24.800873 5332 scope.go:122] "RemoveContainer" containerID="6cb62a1614189ef637b07ad82c8e1b4be40f033cd7fc480f8d815ebf354a85ab" Nov 03 23:14:24.809601 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:24.809578 5332 scope.go:122] "RemoveContainer" containerID="6cb62a1614189ef637b07ad82c8e1b4be40f033cd7fc480f8d815ebf354a85ab" Nov 03 23:14:24.809901 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:14:24.809880 5332 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cb62a1614189ef637b07ad82c8e1b4be40f033cd7fc480f8d815ebf354a85ab\": container with ID starting with 6cb62a1614189ef637b07ad82c8e1b4be40f033cd7fc480f8d815ebf354a85ab not found: ID does not exist" containerID="6cb62a1614189ef637b07ad82c8e1b4be40f033cd7fc480f8d815ebf354a85ab" Nov 03 23:14:24.809979 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:24.809912 5332 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cb62a1614189ef637b07ad82c8e1b4be40f033cd7fc480f8d815ebf354a85ab"} err="failed to get container status \"6cb62a1614189ef637b07ad82c8e1b4be40f033cd7fc480f8d815ebf354a85ab\": rpc error: code = NotFound desc = could not find container \"6cb62a1614189ef637b07ad82c8e1b4be40f033cd7fc480f8d815ebf354a85ab\": container with ID starting with 6cb62a1614189ef637b07ad82c8e1b4be40f033cd7fc480f8d815ebf354a85ab not found: ID does not exist" Nov 03 23:14:24.810975 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:14:24.810949 5332 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-12475-65b8a9\" is forbidden: User \"system:node:ip-10-0-138-89.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-89.us-east-2.compute.internal' and this object" podUID="cc796103-4c94-4b49-8884-4cbf03f196c6" pod="opendatahub/test-curl-12475-65b8a9" Nov 03 23:14:25.020469 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:25.020430 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:25.143229 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:25.143142 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:25.596625 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:25.596585 5332 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cc796103-4c94-4b49-8884-4cbf03f196c6" path="/var/lib/kubelet/pods/cc796103-4c94-4b49-8884-4cbf03f196c6/volumes" Nov 03 23:14:26.123224 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.123190 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n"] Nov 03 23:14:26.128217 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.128192 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" Nov 03 23:14:26.134153 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.133982 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sbbdp\"" Nov 03 23:14:26.134153 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.134060 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Nov 03 23:14:26.134153 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.133989 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-main-70a7bf-serving-cert\"" Nov 03 23:14:26.134153 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.134120 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 23:14:26.134491 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.134287 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 23:14:26.137079 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.137057 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n"] Nov 03 23:14:26.168672 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.168642 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr82b\" (UniqueName: \"kubernetes.io/projected/ff4c43a1-94aa-4b83-a259-90294fac7cb6-kube-api-access-kr82b\") pod \"maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n\" (UID: \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" Nov 03 23:14:26.168672 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.168672 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff4c43a1-94aa-4b83-a259-90294fac7cb6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n\" (UID: \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" Nov 03 23:14:26.168846 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.168702 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4c43a1-94aa-4b83-a259-90294fac7cb6-metrics-certs\") pod \"maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n\" (UID: \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" Nov 03 23:14:26.168846 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.168824 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff4c43a1-94aa-4b83-a259-90294fac7cb6-maas-api-tls\") pod \"maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n\" (UID: \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" Nov 03 23:14:26.270516 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.270337 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr82b\" (UniqueName: \"kubernetes.io/projected/ff4c43a1-94aa-4b83-a259-90294fac7cb6-kube-api-access-kr82b\") pod \"maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n\" (UID: \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" Nov 03 23:14:26.270735 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.270544 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff4c43a1-94aa-4b83-a259-90294fac7cb6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n\" (UID: \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" Nov 03 23:14:26.270735 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.270623 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4c43a1-94aa-4b83-a259-90294fac7cb6-metrics-certs\") pod \"maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n\" (UID: \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" Nov 03 23:14:26.270735 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.270681 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff4c43a1-94aa-4b83-a259-90294fac7cb6-maas-api-tls\") pod \"maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n\" (UID: \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" Nov 03 23:14:26.271753 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:14:26.271730 5332 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-serving-cert: secret "maas-api-e2e-shared-a-main-70a7bf-serving-cert" not found Nov 03 23:14:26.271873 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:14:26.271817 5332 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4c43a1-94aa-4b83-a259-90294fac7cb6-maas-api-tls podName:ff4c43a1-94aa-4b83-a259-90294fac7cb6 nodeName:}" failed. No retries permitted until 2026-11-03 23:14:26.77179609 +0000 UTC m=+1373.301903254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ff4c43a1-94aa-4b83-a259-90294fac7cb6-maas-api-tls") pod "maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" (UID: "ff4c43a1-94aa-4b83-a259-90294fac7cb6") : secret "maas-api-e2e-shared-a-main-70a7bf-serving-cert" not found Nov 03 23:14:26.272072 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.272049 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff4c43a1-94aa-4b83-a259-90294fac7cb6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n\" (UID: \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" Nov 03 23:14:26.274349 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.274322 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4c43a1-94aa-4b83-a259-90294fac7cb6-metrics-certs\") pod \"maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n\" (UID: \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" Nov 03 23:14:26.297864 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.297831 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr82b\" (UniqueName: \"kubernetes.io/projected/ff4c43a1-94aa-4b83-a259-90294fac7cb6-kube-api-access-kr82b\") pod \"maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n\" (UID: \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" Nov 03 23:14:26.309529 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.309500 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:26.389036 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.388953 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs"] Nov 03 23:14:26.392756 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.392736 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs" Nov 03 23:14:26.399987 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.399818 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-main-70a7bf\"" Nov 03 23:14:26.401495 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.399795 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-main-70a7bf-dockercfg-dzb9c\"" Nov 03 23:14:26.402903 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.402879 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5"] Nov 03 23:14:26.406847 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.406828 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs"] Nov 03 23:14:26.406948 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.406924 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5" Nov 03 23:14:26.427414 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.426328 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:26.431025 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.430995 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5"] Nov 03 23:14:26.486478 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.483280 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz8xx\" (UniqueName: \"kubernetes.io/projected/6686ef05-9aa2-4ac1-88d7-151003c35d3b-kube-api-access-fz8xx\") pod \"payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs\" (UID: \"6686ef05-9aa2-4ac1-88d7-151003c35d3b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs" Nov 03 23:14:26.486478 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.483330 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6686ef05-9aa2-4ac1-88d7-151003c35d3b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs\" (UID: \"6686ef05-9aa2-4ac1-88d7-151003c35d3b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs" Nov 03 23:14:26.486478 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.483363 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zrw6\" (UniqueName: \"kubernetes.io/projected/35410cd5-778a-4fa2-9e72-79eccbcb50ee-kube-api-access-4zrw6\") pod \"payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5\" (UID: \"35410cd5-778a-4fa2-9e72-79eccbcb50ee\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5" Nov 03 23:14:26.486478 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.483404 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35410cd5-778a-4fa2-9e72-79eccbcb50ee-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5\" (UID: \"35410cd5-778a-4fa2-9e72-79eccbcb50ee\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5" Nov 03 23:14:26.584853 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.584802 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz8xx\" (UniqueName: \"kubernetes.io/projected/6686ef05-9aa2-4ac1-88d7-151003c35d3b-kube-api-access-fz8xx\") pod \"payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs\" (UID: \"6686ef05-9aa2-4ac1-88d7-151003c35d3b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs" Nov 03 23:14:26.585043 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.584864 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6686ef05-9aa2-4ac1-88d7-151003c35d3b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs\" (UID: \"6686ef05-9aa2-4ac1-88d7-151003c35d3b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs" Nov 03 23:14:26.585043 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.584897 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zrw6\" (UniqueName: \"kubernetes.io/projected/35410cd5-778a-4fa2-9e72-79eccbcb50ee-kube-api-access-4zrw6\") pod \"payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5\" (UID: \"35410cd5-778a-4fa2-9e72-79eccbcb50ee\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5" Nov 03 23:14:26.585043 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.584946 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35410cd5-778a-4fa2-9e72-79eccbcb50ee-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5\" (UID: \"35410cd5-778a-4fa2-9e72-79eccbcb50ee\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5" Nov 03 23:14:26.585579 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.585559 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6686ef05-9aa2-4ac1-88d7-151003c35d3b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs\" (UID: \"6686ef05-9aa2-4ac1-88d7-151003c35d3b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs" Nov 03 23:14:26.585684 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.585665 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35410cd5-778a-4fa2-9e72-79eccbcb50ee-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5\" (UID: \"35410cd5-778a-4fa2-9e72-79eccbcb50ee\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5" Nov 03 23:14:26.593256 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.593224 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz8xx\" (UniqueName: \"kubernetes.io/projected/6686ef05-9aa2-4ac1-88d7-151003c35d3b-kube-api-access-fz8xx\") pod \"payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs\" (UID: \"6686ef05-9aa2-4ac1-88d7-151003c35d3b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs" Nov 03 23:14:26.593849 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.593830 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zrw6\" (UniqueName: \"kubernetes.io/projected/35410cd5-778a-4fa2-9e72-79eccbcb50ee-kube-api-access-4zrw6\") pod \"payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5\" (UID: \"35410cd5-778a-4fa2-9e72-79eccbcb50ee\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5" Nov 03 23:14:26.708829 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.708797 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs" Nov 03 23:14:26.731648 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.731614 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5" Nov 03 23:14:26.789605 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.787773 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff4c43a1-94aa-4b83-a259-90294fac7cb6-maas-api-tls\") pod \"maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n\" (UID: \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" Nov 03 23:14:26.804384 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:26.803758 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff4c43a1-94aa-4b83-a259-90294fac7cb6-maas-api-tls\") pod \"maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n\" (UID: \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" Nov 03 23:14:27.007237 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:27.007143 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:27.012590 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:27.012569 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs"] Nov 03 23:14:27.014985 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:14:27.014957 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6686ef05_9aa2_4ac1_88d7_151003c35d3b.slice/crio-f1ca31bba98a8435b96415c0cfde347bc9e97a192adac2ea9ac814b842d42d9a WatchSource:0}: Error finding container f1ca31bba98a8435b96415c0cfde347bc9e97a192adac2ea9ac814b842d42d9a: Status 404 returned error can't find the container with id f1ca31bba98a8435b96415c0cfde347bc9e97a192adac2ea9ac814b842d42d9a Nov 03 23:14:27.050343 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:27.048729 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" Nov 03 23:14:27.070524 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:27.064895 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5"] Nov 03 23:14:27.075633 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:14:27.075609 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35410cd5_778a_4fa2_9e72_79eccbcb50ee.slice/crio-ada7b1217f65e74a8159ada2c52f4f778fabd18723bb43d008676559fde0df28 WatchSource:0}: Error finding container ada7b1217f65e74a8159ada2c52f4f778fabd18723bb43d008676559fde0df28: Status 404 returned error can't find the container with id ada7b1217f65e74a8159ada2c52f4f778fabd18723bb43d008676559fde0df28 Nov 03 23:14:27.335216 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:27.335193 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n"] Nov 03 23:14:27.336418 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:14:27.336395 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff4c43a1_94aa_4b83_a259_90294fac7cb6.slice/crio-4e0dd30636611ebc96d5a7eec277769a26424379dbb58c46ffb4c4e9dd2b3543 WatchSource:0}: Error finding container 4e0dd30636611ebc96d5a7eec277769a26424379dbb58c46ffb4c4e9dd2b3543: Status 404 returned error can't find the container with id 4e0dd30636611ebc96d5a7eec277769a26424379dbb58c46ffb4c4e9dd2b3543 Nov 03 23:14:27.794379 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:27.794337 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:27.834872 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:27.829980 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5" event={"ID":"35410cd5-778a-4fa2-9e72-79eccbcb50ee","Type":"ContainerStarted","Data":"afe0d897fb79dfacb51651214a56de177d434fc479500a17521165f877abe267"} Nov 03 23:14:27.834872 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:27.830169 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5" event={"ID":"35410cd5-778a-4fa2-9e72-79eccbcb50ee","Type":"ContainerStarted","Data":"ada7b1217f65e74a8159ada2c52f4f778fabd18723bb43d008676559fde0df28"} Nov 03 23:14:27.834872 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:27.830542 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5" Nov 03 23:14:27.849543 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:27.849446 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs" event={"ID":"6686ef05-9aa2-4ac1-88d7-151003c35d3b","Type":"ContainerStarted","Data":"ce1bf2b02647cc628b55575f65a2db757ffc201ad52fd5dcd4077ff614b312f1"} Nov 03 23:14:27.849818 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:27.849796 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs" event={"ID":"6686ef05-9aa2-4ac1-88d7-151003c35d3b","Type":"ContainerStarted","Data":"f1ca31bba98a8435b96415c0cfde347bc9e97a192adac2ea9ac814b842d42d9a"} Nov 03 23:14:27.852597 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:27.852573 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs" Nov 03 23:14:27.854811 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:27.854768 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" event={"ID":"ff4c43a1-94aa-4b83-a259-90294fac7cb6","Type":"ContainerStarted","Data":"4e0dd30636611ebc96d5a7eec277769a26424379dbb58c46ffb4c4e9dd2b3543"} Nov 03 23:14:27.873915 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:27.873849 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5" podStartSLOduration=1.8738324240000002 podStartE2EDuration="1.873832424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:14:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:14:27.859257396 +0000 UTC m=+1374.389364576" watchObservedRunningTime="2026-11-03 23:14:27.873832424 +0000 UTC m=+1374.403939591" Nov 03 23:14:27.874217 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:27.874195 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs" podStartSLOduration=1.874189112 podStartE2EDuration="1.874189112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:14:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:14:27.872014011 +0000 UTC m=+1374.402121189" watchObservedRunningTime="2026-11-03 23:14:27.874189112 +0000 UTC m=+1374.404296279" Nov 03 23:14:28.529021 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:28.528987 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:29.303334 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:29.303198 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:29.985227 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:29.985191 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:30.687250 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:30.687154 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:30.875586 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:30.875552 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" event={"ID":"ff4c43a1-94aa-4b83-a259-90294fac7cb6","Type":"ContainerStarted","Data":"3d0392399c40ac578d37065b9bd03e0f2de1e5bac31e3127ac1cf3472f698691"} Nov 03 23:14:30.875742 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:30.875696 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" Nov 03 23:14:30.914479 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:30.909753 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" podStartSLOduration=1.913489856 podStartE2EDuration="4.909731682s" totalImagesPullingTime="2.996241826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:14:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:14:30.890944757 +0000 UTC m=+1377.421051921" watchObservedRunningTime="2026-11-03 23:14:30.909731682 +0000 UTC m=+1377.439838850" Nov 03 23:14:31.381814 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:31.381773 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:32.115995 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:32.115957 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:32.775919 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:32.775883 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:33.415076 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:33.415040 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:34.076787 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:34.076682 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:34.776583 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:34.776541 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:35.383519 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:35.383374 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:36.008379 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:36.008323 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:36.699967 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:36.699935 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:36.887608 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:36.887584 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" Nov 03 23:14:37.408581 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:37.408521 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:38.164628 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:38.164579 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:38.796206 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:38.796113 5332 patch_prober.go:29] interesting pod/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Nov 03 23:14:38.796206 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:38.796178 5332 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" podUID="2408104b-5d53-48b8-8df4-f68e94248c4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Nov 03 23:14:38.864793 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:38.864767 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5" Nov 03 23:14:38.888819 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:38.888769 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:38.943775 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:38.943747 5332 generic.go:356] "Generic (PLEG): container finished" podID="2408104b-5d53-48b8-8df4-f68e94248c4f" containerID="26d73cff4a2b90a143961cbef9e67e23b627642da31bfd65deae8613b558cf89" exitCode=0 Nov 03 23:14:38.943934 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:38.943821 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" event={"ID":"2408104b-5d53-48b8-8df4-f68e94248c4f","Type":"ContainerDied","Data":"26d73cff4a2b90a143961cbef9e67e23b627642da31bfd65deae8613b558cf89"} Nov 03 23:14:38.944223 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:38.944206 5332 scope.go:122] "RemoveContainer" containerID="26d73cff4a2b90a143961cbef9e67e23b627642da31bfd65deae8613b558cf89" Nov 03 23:14:38.945368 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:38.945341 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:14:38.945427 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:38.945404 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:14:38.945493 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:38.945436 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:14:39.518766 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:14:39.518722 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:14:39.617273 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:39.617230 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:39.871193 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:39.871116 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs" Nov 03 23:14:39.952036 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:39.952005 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" event={"ID":"2408104b-5d53-48b8-8df4-f68e94248c4f","Type":"ContainerStarted","Data":"4c32a49d0dda71f7abc2bf495c8532e395a2f44bac2e9f357b27f7459316190e"} Nov 03 23:14:39.991332 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:39.991280 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:40.414482 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:40.413038 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:40.518016 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:40.517979 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:40.695254 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:40.695162 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:40.695957 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:40.695569 5332 patch_prober.go:29] interesting pod/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Nov 03 23:14:40.696109 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:40.696082 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" podUID="2408104b-5d53-48b8-8df4-f68e94248c4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Nov 03 23:14:40.838775 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:40.838738 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b"] Nov 03 23:14:40.844546 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:40.844508 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b"] Nov 03 23:14:40.844692 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:40.844612 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:40.847745 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:40.847722 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-main-8235df-openshift-default-dockercfg-hbtp4\"" Nov 03 23:14:40.873078 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:40.873051 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:40.951091 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:40.951001 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-token\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:40.951405 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:40.951366 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-envoy\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:40.951625 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:40.951603 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xljxj\" (UniqueName: \"kubernetes.io/projected/761dd000-675b-4ed9-93d7-3f23fda02a87-kube-api-access-xljxj\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:40.951809 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:40.951792 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-credential-socket\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:40.951942 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:40.951919 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/761dd000-675b-4ed9-93d7-3f23fda02a87-istiod-ca-cert\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:40.952083 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:40.952059 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-data\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:40.952230 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:40.952203 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-workload-socket\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:40.952354 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:40.952338 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-workload-certs\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:40.952589 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:40.952572 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-podinfo\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:41.060429 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.060395 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-podinfo\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:41.060635 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.060448 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-token\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:41.060635 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.060495 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-envoy\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:41.060770 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.060649 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xljxj\" (UniqueName: \"kubernetes.io/projected/761dd000-675b-4ed9-93d7-3f23fda02a87-kube-api-access-xljxj\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:41.060834 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.060770 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-credential-socket\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:41.060834 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.060801 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/761dd000-675b-4ed9-93d7-3f23fda02a87-istiod-ca-cert\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:41.060939 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.060838 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-data\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:41.060939 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.060867 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-workload-socket\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:41.061023 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.060995 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-workload-certs\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:41.061146 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.061117 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-credential-socket\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:41.061314 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.061296 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-workload-socket\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:41.061401 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.061226 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-data\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:41.061485 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.061442 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-workload-certs\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:41.061574 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.061558 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/761dd000-675b-4ed9-93d7-3f23fda02a87-istiod-ca-cert\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:41.063097 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.063080 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-envoy\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:41.063221 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.063204 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-podinfo\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:41.067672 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.067650 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-token\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:41.067992 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.067964 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xljxj\" (UniqueName: \"kubernetes.io/projected/761dd000-675b-4ed9-93d7-3f23fda02a87-kube-api-access-xljxj\") pod \"e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:41.068820 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.068797 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:41.158880 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.158846 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:41.179221 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.179185 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:41.518479 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.517507 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b"] Nov 03 23:14:41.522496 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:14:41.522407 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod761dd000_675b_4ed9_93d7_3f23fda02a87.slice/crio-83934efaa60b2cfbb897eda62dd4ddf83b6ab1f2346fdb1dcbf3d695635a11ca WatchSource:0}: Error finding container 83934efaa60b2cfbb897eda62dd4ddf83b6ab1f2346fdb1dcbf3d695635a11ca: Status 404 returned error can't find the container with id 83934efaa60b2cfbb897eda62dd4ddf83b6ab1f2346fdb1dcbf3d695635a11ca Nov 03 23:14:41.524744 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.524712 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:14:41.524829 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.524782 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:14:41.524829 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.524812 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:14:41.706509 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.704941 5332 patch_prober.go:29] interesting pod/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Nov 03 23:14:41.706509 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.705014 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" podUID="2408104b-5d53-48b8-8df4-f68e94248c4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Nov 03 23:14:41.891295 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.891215 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:41.974826 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.974787 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" event={"ID":"761dd000-675b-4ed9-93d7-3f23fda02a87","Type":"ContainerStarted","Data":"4c1b1a354f04743731dcad48b11920fcb109252ee800e7cc7526dbfe3f6b945f"} Nov 03 23:14:41.975027 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:41.974841 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" event={"ID":"761dd000-675b-4ed9-93d7-3f23fda02a87","Type":"ContainerStarted","Data":"83934efaa60b2cfbb897eda62dd4ddf83b6ab1f2346fdb1dcbf3d695635a11ca"} Nov 03 23:14:42.160575 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:42.159688 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:42.164709 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:42.164686 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:42.200483 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:42.186982 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" podStartSLOduration=2.186965307 podStartE2EDuration="2.186965307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:14:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:14:42.017817278 +0000 UTC m=+1388.547924465" watchObservedRunningTime="2026-11-03 23:14:42.186965307 +0000 UTC m=+1388.717072475" Nov 03 23:14:42.661329 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:42.661292 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:42.704481 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:42.695868 5332 patch_prober.go:29] interesting pod/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Nov 03 23:14:42.704481 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:42.695929 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" podUID="2408104b-5d53-48b8-8df4-f68e94248c4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Nov 03 23:14:42.981153 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:42.981124 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:42.982042 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:42.982022 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:14:43.512481 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:43.511392 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:43.716802 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:43.716766 5332 patch_prober.go:29] interesting pod/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Nov 03 23:14:43.716987 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:43.716835 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" podUID="2408104b-5d53-48b8-8df4-f68e94248c4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Nov 03 23:14:44.213989 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:44.213955 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:44.346078 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:44.346042 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:44.463338 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:44.463298 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:44.718479 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:44.715575 5332 patch_prober.go:29] interesting pod/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Nov 03 23:14:44.718479 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:44.715642 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" podUID="2408104b-5d53-48b8-8df4-f68e94248c4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Nov 03 23:14:45.101777 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:45.101679 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:45.421579 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:45.421491 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:45.538461 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:45.538427 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:45.699649 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:45.699569 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:45.699995 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:45.699976 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:45.700631 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:45.700609 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:14:45.895033 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:45.894992 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:46.603913 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:46.603854 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:47.327800 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.327765 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp"] Nov 03 23:14:47.334591 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.334560 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" Nov 03 23:14:47.340727 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.340398 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-main-8235df-serving-cert\"" Nov 03 23:14:47.341177 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.340932 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp"] Nov 03 23:14:47.399235 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.399199 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:47.471210 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.471167 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff1c9014-ba16-414f-b590-de97f694d667-maas-api-tls\") pod \"maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp\" (UID: \"ff1c9014-ba16-414f-b590-de97f694d667\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" Nov 03 23:14:47.471399 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.471228 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff1c9014-ba16-414f-b590-de97f694d667-openshift-service-ca\") pod \"maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp\" (UID: \"ff1c9014-ba16-414f-b590-de97f694d667\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" Nov 03 23:14:47.471399 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.471351 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99zhq\" (UniqueName: \"kubernetes.io/projected/ff1c9014-ba16-414f-b590-de97f694d667-kube-api-access-99zhq\") pod \"maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp\" (UID: \"ff1c9014-ba16-414f-b590-de97f694d667\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" Nov 03 23:14:47.471494 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.471405 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff1c9014-ba16-414f-b590-de97f694d667-metrics-certs\") pod \"maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp\" (UID: \"ff1c9014-ba16-414f-b590-de97f694d667\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" Nov 03 23:14:47.503575 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.503540 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:47.572208 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.572167 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff1c9014-ba16-414f-b590-de97f694d667-openshift-service-ca\") pod \"maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp\" (UID: \"ff1c9014-ba16-414f-b590-de97f694d667\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" Nov 03 23:14:47.572413 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.572292 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99zhq\" (UniqueName: \"kubernetes.io/projected/ff1c9014-ba16-414f-b590-de97f694d667-kube-api-access-99zhq\") pod \"maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp\" (UID: \"ff1c9014-ba16-414f-b590-de97f694d667\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" Nov 03 23:14:47.572413 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.572388 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff1c9014-ba16-414f-b590-de97f694d667-metrics-certs\") pod \"maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp\" (UID: \"ff1c9014-ba16-414f-b590-de97f694d667\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" Nov 03 23:14:47.572562 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.572514 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff1c9014-ba16-414f-b590-de97f694d667-maas-api-tls\") pod \"maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp\" (UID: \"ff1c9014-ba16-414f-b590-de97f694d667\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" Nov 03 23:14:47.572974 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.572954 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff1c9014-ba16-414f-b590-de97f694d667-openshift-service-ca\") pod \"maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp\" (UID: \"ff1c9014-ba16-414f-b590-de97f694d667\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" Nov 03 23:14:47.576113 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.576075 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff1c9014-ba16-414f-b590-de97f694d667-maas-api-tls\") pod \"maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp\" (UID: \"ff1c9014-ba16-414f-b590-de97f694d667\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" Nov 03 23:14:47.576831 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.576803 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff1c9014-ba16-414f-b590-de97f694d667-metrics-certs\") pod \"maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp\" (UID: \"ff1c9014-ba16-414f-b590-de97f694d667\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" Nov 03 23:14:47.579927 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.579869 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99zhq\" (UniqueName: \"kubernetes.io/projected/ff1c9014-ba16-414f-b590-de97f694d667-kube-api-access-99zhq\") pod \"maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp\" (UID: \"ff1c9014-ba16-414f-b590-de97f694d667\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" Nov 03 23:14:47.606149 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.606118 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:47.655138 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.655107 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" Nov 03 23:14:47.931213 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:47.931182 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp"] Nov 03 23:14:47.933146 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:14:47.933119 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff1c9014_ba16_414f_b590_de97f694d667.slice/crio-c0cf779cfcfd98b258fec30867f6a337d947afbe0a8794c8d6736bfd355d16f2 WatchSource:0}: Error finding container c0cf779cfcfd98b258fec30867f6a337d947afbe0a8794c8d6736bfd355d16f2: Status 404 returned error can't find the container with id c0cf779cfcfd98b258fec30867f6a337d947afbe0a8794c8d6736bfd355d16f2 Nov 03 23:14:48.008283 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:48.008246 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" event={"ID":"ff1c9014-ba16-414f-b590-de97f694d667","Type":"ContainerStarted","Data":"c0cf779cfcfd98b258fec30867f6a337d947afbe0a8794c8d6736bfd355d16f2"} Nov 03 23:14:48.178691 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:48.178649 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:48.891821 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:48.891766 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:49.022398 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:49.022349 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" event={"ID":"ff1c9014-ba16-414f-b590-de97f694d667","Type":"ContainerStarted","Data":"68f670a72558f8bfd0bebdddc9fb575b0a16f422d3538cb64df7077cd5228f56"} Nov 03 23:14:49.022600 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:49.022584 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" Nov 03 23:14:49.040427 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:49.040372 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" podStartSLOduration=1.583119414 podStartE2EDuration="2.040358464s" totalImagesPullingTime="457.23905ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:14:49.038914654 +0000 UTC m=+1395.569021822" watchObservedRunningTime="2026-11-03 23:14:49.040358464 +0000 UTC m=+1395.570465630" Nov 03 23:14:49.544710 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:49.544674 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:50.317173 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:50.317136 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:51.088295 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:51.088253 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:51.784387 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:51.784332 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:52.510477 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:52.509052 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:53.207031 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:53.206998 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:53.888926 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:53.888887 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:54.575758 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:54.575723 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:55.034339 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:55.034310 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" Nov 03 23:14:55.412038 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:55.411874 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:56.032185 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:56.032150 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:56.747589 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:56.747550 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:57.494477 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:57.494425 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:58.173759 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:58.173726 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:58.901502 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:58.901446 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:58.970768 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:58.970660 5332 patch_prober.go:29] interesting pod/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": read tcp 10.133.0.2:40616->10.133.0.53:15021: read: connection reset by peer" start-of-body= Nov 03 23:14:58.970768 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:58.970738 5332 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" podUID="761dd000-675b-4ed9-93d7-3f23fda02a87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": read tcp 10.133.0.2:40616->10.133.0.53:15021: read: connection reset by peer" Nov 03 23:14:59.096660 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:59.096627 5332 generic.go:356] "Generic (PLEG): container finished" podID="761dd000-675b-4ed9-93d7-3f23fda02a87" containerID="4c1b1a354f04743731dcad48b11920fcb109252ee800e7cc7526dbfe3f6b945f" exitCode=0 Nov 03 23:14:59.096838 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:59.096714 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" event={"ID":"761dd000-675b-4ed9-93d7-3f23fda02a87","Type":"ContainerDied","Data":"4c1b1a354f04743731dcad48b11920fcb109252ee800e7cc7526dbfe3f6b945f"} Nov 03 23:14:59.097145 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:59.097130 5332 scope.go:122] "RemoveContainer" containerID="4c1b1a354f04743731dcad48b11920fcb109252ee800e7cc7526dbfe3f6b945f" Nov 03 23:14:59.098515 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:59.098445 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:14:59.098608 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:59.098556 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:14:59.098646 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:59.098606 5332 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:14:59.179073 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:59.178981 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:14:59.590303 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:14:59.590270 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:00.125077 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:00.125032 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" event={"ID":"761dd000-675b-4ed9-93d7-3f23fda02a87","Type":"ContainerStarted","Data":"317189d2398e8eebbfc0eab871b89f22301d1f84e2f9af4edc55666f47779b91"} Nov 03 23:15:00.160071 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:00.160043 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:15:00.161585 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:00.161557 5332 patch_prober.go:29] interesting pod/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Nov 03 23:15:00.161807 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:00.161771 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" podUID="761dd000-675b-4ed9-93d7-3f23fda02a87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Nov 03 23:15:00.318366 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:00.318330 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:01.017213 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:01.017177 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:01.159912 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:01.159871 5332 patch_prober.go:29] interesting pod/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Nov 03 23:15:01.160293 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:01.159935 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" podUID="761dd000-675b-4ed9-93d7-3f23fda02a87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Nov 03 23:15:01.418068 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:01.417981 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:01.725764 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:01.725725 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:02.160250 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:02.160164 5332 patch_prober.go:29] interesting pod/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Nov 03 23:15:02.160250 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:02.160218 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" podUID="761dd000-675b-4ed9-93d7-3f23fda02a87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Nov 03 23:15:02.620226 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:02.620168 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:03.160018 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:03.159985 5332 patch_prober.go:29] interesting pod/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Nov 03 23:15:03.160237 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:03.160034 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" podUID="761dd000-675b-4ed9-93d7-3f23fda02a87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Nov 03 23:15:03.469805 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:03.469766 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:04.160242 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:04.160203 5332 patch_prober.go:29] interesting pod/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Nov 03 23:15:04.160429 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:04.160266 5332 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" podUID="761dd000-675b-4ed9-93d7-3f23fda02a87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Nov 03 23:15:04.419593 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:04.419478 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:05.099218 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:05.099157 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:05.651990 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:05.651954 5332 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:15:05.652621 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:05.652594 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:15:05.654057 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:05.654027 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:15:05.818947 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:05.818912 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:06.510017 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:06.509983 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:07.287467 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:07.287426 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:07.983973 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:07.983938 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:08.687694 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:08.687663 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:09.472478 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:09.455751 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:09.503388 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:15:09.503354 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:15:10.192277 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:10.192246 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:10.808447 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:10.808417 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:11.488332 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:11.488279 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:12.191819 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:12.191785 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:12.876780 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:12.876745 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:13.606321 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:13.606281 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:14.403329 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:14.403286 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:15.094119 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:15.094077 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:15.799212 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:15.799176 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:16.506597 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:16.506557 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:17.201528 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:17.201480 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:17.900626 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:17.900590 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:18.594801 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:18.594762 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:19.503827 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:19.503785 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:20.197227 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:20.197188 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:21.016485 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:21.016421 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:21.718401 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:21.718366 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:22.399157 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:22.399128 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:23.098737 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:23.098696 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:23.794970 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:23.794933 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:24.603690 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:24.603656 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:25.373167 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:25.373135 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:26.079894 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:26.079859 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:26.762317 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:26.762283 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:27.497307 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:27.497263 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:28.202762 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:28.202724 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:28.898939 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:28.898906 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:29.508561 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:29.508516 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:30.273831 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:30.273794 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:30.895994 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:30.895963 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:31.589781 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:31.589746 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:32.389601 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:32.389545 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:32.746005 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:32.745975 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-12475-4c2467"] Nov 03 23:15:32.749964 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:32.749936 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-12475-4c2467" Nov 03 23:15:32.752393 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:32.752365 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-12475-4c2467"] Nov 03 23:15:32.752752 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:32.752732 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qjwd6\"" Nov 03 23:15:32.869395 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:32.869351 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zchwn\" (UniqueName: \"kubernetes.io/projected/4dcc0d9a-3f66-434e-a94e-0042b276cb1b-kube-api-access-zchwn\") pod \"test-curl-12475-4c2467\" (UID: \"4dcc0d9a-3f66-434e-a94e-0042b276cb1b\") " pod="opendatahub/test-curl-12475-4c2467" Nov 03 23:15:32.970847 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:32.970809 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zchwn\" (UniqueName: \"kubernetes.io/projected/4dcc0d9a-3f66-434e-a94e-0042b276cb1b-kube-api-access-zchwn\") pod \"test-curl-12475-4c2467\" (UID: \"4dcc0d9a-3f66-434e-a94e-0042b276cb1b\") " pod="opendatahub/test-curl-12475-4c2467" Nov 03 23:15:32.978105 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:32.978083 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zchwn\" (UniqueName: \"kubernetes.io/projected/4dcc0d9a-3f66-434e-a94e-0042b276cb1b-kube-api-access-zchwn\") pod \"test-curl-12475-4c2467\" (UID: \"4dcc0d9a-3f66-434e-a94e-0042b276cb1b\") " pod="opendatahub/test-curl-12475-4c2467" Nov 03 23:15:33.064698 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:33.064614 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-12475-4c2467" Nov 03 23:15:33.083689 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:33.083639 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:33.370881 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:33.370850 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-12475-4c2467"] Nov 03 23:15:33.373027 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:15:33.372994 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4dcc0d9a_3f66_434e_a94e_0042b276cb1b.slice/crio-1b2930b61ad7bb6a09d8126c3ac84ce73a31a1247c033452d437361b95cbaa08 WatchSource:0}: Error finding container 1b2930b61ad7bb6a09d8126c3ac84ce73a31a1247c033452d437361b95cbaa08: Status 404 returned error can't find the container with id 1b2930b61ad7bb6a09d8126c3ac84ce73a31a1247c033452d437361b95cbaa08 Nov 03 23:15:33.789384 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:33.789348 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:34.348702 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:34.348670 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-12475-4c2467" event={"ID":"4dcc0d9a-3f66-434e-a94e-0042b276cb1b","Type":"ContainerStarted","Data":"8157cc20fa6013e400a4e25ea480a81e9d9effff34d2831fae73992d2c013bb1"} Nov 03 23:15:34.348702 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:34.348710 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-12475-4c2467" event={"ID":"4dcc0d9a-3f66-434e-a94e-0042b276cb1b","Type":"ContainerStarted","Data":"1b2930b61ad7bb6a09d8126c3ac84ce73a31a1247c033452d437361b95cbaa08"} Nov 03 23:15:34.363507 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:34.363430 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-12475-4c2467" podStartSLOduration=2.363418576 podStartE2EDuration="2.363418576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:15:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:15:34.361496498 +0000 UTC m=+1440.891603667" watchObservedRunningTime="2026-11-03 23:15:34.363418576 +0000 UTC m=+1440.893525743" Nov 03 23:15:34.491303 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:34.491270 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:35.003978 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:35.003945 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-12475-4c2467"] Nov 03 23:15:35.007909 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:35.007884 5332 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-12475-4c2467"] Nov 03 23:15:35.187581 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:35.187544 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:35.889186 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:35.889153 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:36.366719 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:36.366676 5332 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-12475-4c2467" podUID="4dcc0d9a-3f66-434e-a94e-0042b276cb1b" containerName="test-curl-12475-4c2467" containerID="cri-o://8157cc20fa6013e400a4e25ea480a81e9d9effff34d2831fae73992d2c013bb1" gracePeriod=2 Nov 03 23:15:36.615001 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:36.614968 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:37.401244 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:37.401209 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:38.092643 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:38.092610 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:38.543682 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:38.543659 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-12475-4c2467" Nov 03 23:15:38.729095 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:38.729063 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4dcc0d9a-3f66-434e-a94e-0042b276cb1b-kube-api-access-zchwn\" (UniqueName: \"kubernetes.io/projected/4dcc0d9a-3f66-434e-a94e-0042b276cb1b-kube-api-access-zchwn\") pod \"4dcc0d9a-3f66-434e-a94e-0042b276cb1b\" (UID: \"4dcc0d9a-3f66-434e-a94e-0042b276cb1b\") " Nov 03 23:15:38.731592 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:38.731566 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dcc0d9a-3f66-434e-a94e-0042b276cb1b-kube-api-access-zchwn" pod "4dcc0d9a-3f66-434e-a94e-0042b276cb1b" (UID: "4dcc0d9a-3f66-434e-a94e-0042b276cb1b"). InnerVolumeSpecName "kube-api-access-zchwn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:15:38.810062 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:38.810013 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:38.834198 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:38.834131 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zchwn\" (UniqueName: \"kubernetes.io/projected/4dcc0d9a-3f66-434e-a94e-0042b276cb1b-kube-api-access-zchwn\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:15:39.387923 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:39.387893 5332 generic.go:356] "Generic (PLEG): container finished" podID="4dcc0d9a-3f66-434e-a94e-0042b276cb1b" containerID="8157cc20fa6013e400a4e25ea480a81e9d9effff34d2831fae73992d2c013bb1" exitCode=137 Nov 03 23:15:39.388122 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:39.387937 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-12475-4c2467" Nov 03 23:15:39.388122 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:39.387955 5332 scope.go:122] "RemoveContainer" containerID="8157cc20fa6013e400a4e25ea480a81e9d9effff34d2831fae73992d2c013bb1" Nov 03 23:15:39.397154 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:39.397128 5332 scope.go:122] "RemoveContainer" containerID="8157cc20fa6013e400a4e25ea480a81e9d9effff34d2831fae73992d2c013bb1" Nov 03 23:15:39.397444 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:15:39.397424 5332 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8157cc20fa6013e400a4e25ea480a81e9d9effff34d2831fae73992d2c013bb1\": container with ID starting with 8157cc20fa6013e400a4e25ea480a81e9d9effff34d2831fae73992d2c013bb1 not found: ID does not exist" containerID="8157cc20fa6013e400a4e25ea480a81e9d9effff34d2831fae73992d2c013bb1" Nov 03 23:15:39.397522 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:39.397471 5332 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8157cc20fa6013e400a4e25ea480a81e9d9effff34d2831fae73992d2c013bb1"} err="failed to get container status \"8157cc20fa6013e400a4e25ea480a81e9d9effff34d2831fae73992d2c013bb1\": rpc error: code = NotFound desc = could not find container \"8157cc20fa6013e400a4e25ea480a81e9d9effff34d2831fae73992d2c013bb1\": container with ID starting with 8157cc20fa6013e400a4e25ea480a81e9d9effff34d2831fae73992d2c013bb1 not found: ID does not exist" Nov 03 23:15:39.397571 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:15:39.397535 5332 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-12475-4c2467\" is forbidden: User \"system:node:ip-10-0-138-89.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-89.us-east-2.compute.internal' and this object" podUID="4dcc0d9a-3f66-434e-a94e-0042b276cb1b" pod="opendatahub/test-curl-12475-4c2467" Nov 03 23:15:39.495285 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:15:39.495246 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:15:39.578889 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:39.578856 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:39.596228 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:39.596188 5332 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4dcc0d9a-3f66-434e-a94e-0042b276cb1b" path="/var/lib/kubelet/pods/4dcc0d9a-3f66-434e-a94e-0042b276cb1b/volumes" Nov 03 23:15:40.281264 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:40.281229 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:40.905784 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:40.905752 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:41.573531 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:41.573498 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:42.193344 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:42.193311 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:42.886743 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:42.886702 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:43.593901 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:43.593867 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:44.295132 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:44.295098 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:44.468742 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:44.468701 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:44.913027 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:44.912990 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:45.593330 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:45.593294 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:46.301602 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:46.301567 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:47.043036 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:47.042930 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:47.167481 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:47.166200 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:47.899278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:47.899233 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:48.695174 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:48.695140 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:49.607320 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:49.607283 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:50.296870 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:50.296833 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:50.948928 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:50.948892 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:51.602129 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:51.602099 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:52.294857 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:52.294826 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:53.088014 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:53.087973 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:53.787670 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:53.787629 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:54.729128 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:54.729094 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:55.726399 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:55.726350 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:56.490332 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:56.490288 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:57.182347 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:57.182315 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:57.803409 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:57.803374 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:58.502019 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:58.501983 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:59.194748 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:59.194714 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:15:59.899132 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:15:59.899101 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:00.782287 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:00.782249 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:01.682287 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:01.681338 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:02.798530 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:02.798493 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:03.794374 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:03.794300 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:03.994412 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:03.994376 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:04.783938 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:04.783888 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:05.795481 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:05.793853 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:06.813399 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:06.813354 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:07.973607 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:07.973561 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:08.388293 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:08.388193 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:09.216343 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:09.216299 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:09.494601 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:16:09.494511 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:16:09.912757 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:09.912667 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:10.597786 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:10.597751 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:11.314648 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:11.314598 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:11.996904 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:11.996874 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:12.692818 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:12.692781 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:13.434691 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:13.434597 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:14.118726 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:14.118695 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:14.236218 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:14.236179 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:14.906414 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:14.906383 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:15.698975 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:15.698941 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:16.392558 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:16.392524 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:17.101254 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:17.101215 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:17.940972 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:17.940913 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:18.613988 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:18.613946 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:19.370611 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:19.370576 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:20.076370 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:20.076319 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:20.795144 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:20.795055 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:21.496489 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:21.496419 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:22.432784 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:22.432738 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:23.464480 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:23.463870 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:23.557774 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:23.557718 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-ddn95 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 23:16:23.558128 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:23.558094 5332 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" podUID="e8f0c433-9c57-4b4c-9094-6b618981f530" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 23:16:24.214978 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:24.214941 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:24.888861 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:24.888828 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:25.605375 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:25.605330 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:26.469290 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:26.469255 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:27.230098 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:27.230054 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:27.905806 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:27.905772 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:28.680033 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:28.679999 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:29.452439 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:29.452400 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:30.098303 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:30.098269 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:30.797437 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:30.797403 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:31.559265 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:31.559221 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:32.511476 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:32.511424 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:33.443550 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:33.443513 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:34.311634 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:34.311583 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 23:16:34.312341 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:34.312280 5332 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" podUID="d2968f41-e062-475f-b3ca-22c20073f2f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 23:16:34.349978 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:34.347309 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:35.007172 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:35.007135 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:35.692867 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:35.692825 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:36.171371 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:36.171334 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:36.272052 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:36.272020 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:36.380212 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:36.380171 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:37.112213 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:37.112177 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:37.371320 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:37.371242 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:37.805216 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:37.805175 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:38.501319 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:38.501264 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:39.201375 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:39.201317 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:39.495171 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:16:39.495135 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:16:39.890925 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:39.890839 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:40.607431 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:40.607400 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:41.388171 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:41.388082 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:41.886569 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:41.886488 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:42.190356 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:42.190265 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:42.984501 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:42.984139 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:43.341076 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:43.340988 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:44.573479 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:44.572848 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:44.675512 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:44.675473 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:45.808212 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:45.808180 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:46.757431 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:46.757385 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:47.122722 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:47.122598 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:48.284476 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:48.284412 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:48.989615 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:48.989572 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:49.918601 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:49.918546 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:50.050495 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:50.043434 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:50.905133 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:50.901980 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:51.013481 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:51.012908 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:52.040551 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:52.040512 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:52.991047 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:52.991009 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:53.964406 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:53.964375 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:54.890084 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:54.890049 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:55.768155 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:55.768109 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:56.803389 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:56.803342 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:57.815264 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:57.815212 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:58.587141 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:58.587107 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:59.275536 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:59.275504 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:16:59.988742 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:16:59.988710 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:00.780983 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:00.780952 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:01.781749 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:01.781716 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:02.424697 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:02.424636 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:03.089663 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:03.089628 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:03.790267 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:03.790230 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:04.502998 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:04.502964 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:05.206881 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:05.206849 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:05.360530 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:05.360481 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:05.902796 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:05.902750 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:06.597478 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:06.597428 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:07.404295 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:07.404262 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:08.087344 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:08.087315 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:08.712267 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:08.712209 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:09.388309 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:09.388276 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:09.494424 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:17:09.494390 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:17:10.108619 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:10.108579 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:10.799219 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:10.799186 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:11.492223 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:11.492187 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:12.194037 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:12.194004 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:12.892975 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:12.892947 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:13.589234 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:13.589202 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:14.279841 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:14.279791 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:15.006733 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:15.006697 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:15.694941 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:15.694910 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:16.487255 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:16.487216 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:17.245693 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:17.245658 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:17.976265 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:17.976230 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:18.693139 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:18.693108 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:19.461124 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:19.461070 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:20.108493 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:20.108435 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:20.802718 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:20.802682 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:21.494159 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:21.494122 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:22.189495 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:22.189439 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:22.805804 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:22.805773 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:23.488509 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:23.488475 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:24.192901 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:24.192866 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:24.876921 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:24.876882 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:25.582853 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:25.582813 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:26.278063 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:26.278032 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:27.018820 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:27.018789 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:27.701724 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:27.701693 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:28.389214 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:28.389182 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:29.083252 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:29.083216 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:29.783759 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:29.783724 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:30.491521 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:30.491491 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:31.199209 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:31.199171 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:31.899735 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:31.899648 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:32.610778 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:32.610746 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:33.314207 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:33.314172 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:33.981133 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:33.981100 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:34.687895 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:34.687854 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:35.339944 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:35.339908 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:35.988841 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:35.988788 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:36.689073 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:36.689042 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:37.598259 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:37.598227 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:38.212815 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:38.212783 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:38.346490 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:38.346236 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:39.006359 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:39.006329 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:39.494638 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:17:39.494604 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:17:39.704692 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:39.704646 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:40.398370 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:40.398341 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:41.100153 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:41.100109 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:41.797884 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:41.797846 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:42.484722 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:42.484689 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:43.105039 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:43.105005 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:43.786884 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:43.786853 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:44.598031 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:44.597999 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:44.702002 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:44.701966 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:45.393721 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:45.393679 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:46.087022 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:46.086983 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:46.976594 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:46.976486 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:47.784561 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:47.784525 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:48.792310 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:48.792275 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:49.318635 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:49.318594 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 23:17:49.318983 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:49.318932 5332 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" podUID="d2968f41-e062-475f-b3ca-22c20073f2f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 23:17:49.515481 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:49.514578 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 23:17:49.515481 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:49.514660 5332 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" podUID="1521f713-eb6c-4d6b-b2bc-8aa05430fd6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 23:17:49.730481 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:49.728430 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:50.675325 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:50.675288 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:51.667870 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:51.667825 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:52.728487 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:52.725498 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:53.558661 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:53.558599 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-ddn95 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 23:17:53.558962 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:53.558925 5332 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-ddn95" podUID="e8f0c433-9c57-4b4c-9094-6b618981f530" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 23:17:53.682475 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:53.667571 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:54.293016 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:54.292977 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:55.007165 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:55.007133 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:55.688577 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:55.688539 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:56.394756 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:56.394721 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:57.053890 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:57.053843 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:57.701693 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:57.701635 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:58.418419 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:58.418369 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:59.096037 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:59.096005 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:17:59.786091 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:17:59.786055 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:00.413362 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:00.413306 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:01.110950 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:01.110916 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:01.787049 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:01.787014 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:02.495756 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:02.495716 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:03.023738 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:03.023690 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv"] Nov 03 23:18:03.025761 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:03.025736 5332 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6daac75e-kv8cv"] Nov 03 23:18:03.161213 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:03.161171 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:03.603500 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:03.603466 5332 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8" path="/var/lib/kubelet/pods/ee3dcd2c-2d42-4618-b9d2-c8d0b8814cc8/volumes" Nov 03 23:18:03.788496 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:03.788441 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:04.486048 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:04.486009 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:05.290471 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:05.290429 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:06.091789 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:06.091751 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:06.849310 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:06.849269 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:07.609036 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:07.609003 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:08.497558 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:08.497520 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:09.537481 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:09.534362 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:09.752699 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:18:09.752658 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:18:10.307570 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:10.307541 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:10.983487 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:10.983428 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:11.029540 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:11.029507 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7"] Nov 03 23:18:11.033298 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:11.033270 5332 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e997c91e-nksc7"] Nov 03 23:18:11.596529 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:11.596495 5332 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1f16e236-c713-4c67-afaf-932072a1da24" path="/var/lib/kubelet/pods/1f16e236-c713-4c67-afaf-932072a1da24/volumes" Nov 03 23:18:11.638443 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:11.638412 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:12.291125 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:12.291087 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:12.993867 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:12.993829 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:13.611601 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:13.611561 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:14.297948 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:14.297910 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:14.978779 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:14.978741 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:15.711347 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:15.711314 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:16.519026 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:16.518990 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:17.354342 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:17.354302 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:18.188588 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:18.188557 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:19.144003 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:19.143929 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:19.321026 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:19.320540 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 23:18:19.321026 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:19.320618 5332 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-kjjnb" podUID="d2968f41-e062-475f-b3ca-22c20073f2f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 23:18:19.481644 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:19.481592 5332 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 23:18:19.482034 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:19.481989 5332 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-gpnwl" podUID="1521f713-eb6c-4d6b-b2bc-8aa05430fd6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 23:18:20.026694 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:20.026653 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:20.687473 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:20.687415 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:21.019715 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:21.019668 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq"] Nov 03 23:18:21.021557 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:21.021536 5332 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-36f677f4-dprpq"] Nov 03 23:18:21.386427 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:21.386342 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:21.596209 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:21.596174 5332 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="697bc6ee-0994-49a2-b2fc-9156bb4d9341" path="/var/lib/kubelet/pods/697bc6ee-0994-49a2-b2fc-9156bb4d9341/volumes" Nov 03 23:18:22.085899 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:22.085866 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:22.705694 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:22.705656 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:23.493412 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:23.493373 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:24.175053 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:24.175021 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:24.878278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:24.878244 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:25.674236 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:25.674197 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:26.442478 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:26.442367 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:27.205386 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:27.205338 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:27.835861 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:27.835822 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:28.232480 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:28.228157 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:29.392548 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:29.392512 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:30.421476 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:30.417928 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:30.665730 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:30.665683 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:31.206292 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:31.206257 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:32.118374 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:32.118340 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:33.020479 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:33.020357 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv"] Nov 03 23:18:33.040613 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:33.040044 5332 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4fef5ae8-5l4dv"] Nov 03 23:18:33.057485 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:33.056929 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:33.674493 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:33.668787 5332 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7eacc1cf-8651-4201-83a5-73733722489c" path="/var/lib/kubelet/pods/7eacc1cf-8651-4201-83a5-73733722489c/volumes" Nov 03 23:18:34.007039 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:34.007001 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:34.789260 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:34.789227 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:35.691640 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:35.690983 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:36.778355 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:36.778319 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:37.607810 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:37.607779 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:38.292442 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:38.292401 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:38.975812 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:38.975777 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:39.494612 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:18:39.494575 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:18:39.605821 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:39.605788 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:40.296756 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:40.296715 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:40.976959 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:40.976919 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:41.801048 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:41.801019 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:42.021065 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:42.021031 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws"] Nov 03 23:18:42.022972 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:42.022949 5332 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9c85b486-msnws"] Nov 03 23:18:42.493891 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:42.493835 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:43.206897 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:43.206807 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:43.596690 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:43.596613 5332 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e6b44c24-1f30-4e6c-8409-404b0cbd575e" path="/var/lib/kubelet/pods/e6b44c24-1f30-4e6c-8409-404b0cbd575e/volumes" Nov 03 23:18:43.899046 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:43.898967 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:44.678194 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:44.678158 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:44.787195 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:44.787164 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:45.380096 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:45.380062 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:46.075584 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:46.075524 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:46.711833 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:46.711788 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:47.385575 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:47.385538 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:48.074671 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:48.074637 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:48.696496 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:48.696463 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:49.393011 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:49.392975 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:50.008326 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:50.008288 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:50.791606 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:50.791569 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:51.484958 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:51.484929 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:52.263414 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:52.263378 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:52.888665 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:52.888628 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:53.598057 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:53.598025 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:54.289031 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:54.289005 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:54.982233 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:54.982199 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:55.594599 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:55.594560 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:56.304168 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:56.304137 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:56.988428 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:56.988399 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:57.606698 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:57.606665 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:58.297634 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:58.297595 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:59.077652 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:59.077612 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:18:59.735710 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:18:59.735684 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:00.393661 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:00.393627 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:00.493753 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:00.493723 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:01.090309 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:01.090279 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:01.780257 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:01.780226 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:02.471180 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:02.471143 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:03.100269 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:03.100233 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:03.784088 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:03.784047 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:04.462007 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:04.461948 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:05.102848 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:05.102808 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:05.775678 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:05.775642 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:06.363587 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:06.363550 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5"] Nov 03 23:19:06.374279 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:06.374250 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs"] Nov 03 23:19:06.453937 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:06.453899 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:06.557863 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:06.557816 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:07.293935 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:07.293891 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:07.957675 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:07.957633 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:08.410125 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.410036 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n"] Nov 03 23:19:08.410372 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.410264 5332 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" podUID="ff4c43a1-94aa-4b83-a259-90294fac7cb6" containerName="maas-api" containerID="cri-o://3d0392399c40ac578d37065b9bd03e0f2de1e5bac31e3127ac1cf3472f698691" gracePeriod=30 Nov 03 23:19:08.518569 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.518537 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:08.666844 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.666782 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" Nov 03 23:19:08.742860 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.742831 5332 generic.go:356] "Generic (PLEG): container finished" podID="ff4c43a1-94aa-4b83-a259-90294fac7cb6" containerID="3d0392399c40ac578d37065b9bd03e0f2de1e5bac31e3127ac1cf3472f698691" exitCode=0 Nov 03 23:19:08.743301 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.743068 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" event={"ID":"ff4c43a1-94aa-4b83-a259-90294fac7cb6","Type":"ContainerDied","Data":"3d0392399c40ac578d37065b9bd03e0f2de1e5bac31e3127ac1cf3472f698691"} Nov 03 23:19:08.743517 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.743338 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" event={"ID":"ff4c43a1-94aa-4b83-a259-90294fac7cb6","Type":"ContainerDied","Data":"4e0dd30636611ebc96d5a7eec277769a26424379dbb58c46ffb4c4e9dd2b3543"} Nov 03 23:19:08.743517 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.743372 5332 scope.go:122] "RemoveContainer" containerID="3d0392399c40ac578d37065b9bd03e0f2de1e5bac31e3127ac1cf3472f698691" Nov 03 23:19:08.743655 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.743103 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n" Nov 03 23:19:08.761725 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.761692 5332 scope.go:122] "RemoveContainer" containerID="3d0392399c40ac578d37065b9bd03e0f2de1e5bac31e3127ac1cf3472f698691" Nov 03 23:19:08.762230 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:19:08.762186 5332 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d0392399c40ac578d37065b9bd03e0f2de1e5bac31e3127ac1cf3472f698691\": container with ID starting with 3d0392399c40ac578d37065b9bd03e0f2de1e5bac31e3127ac1cf3472f698691 not found: ID does not exist" containerID="3d0392399c40ac578d37065b9bd03e0f2de1e5bac31e3127ac1cf3472f698691" Nov 03 23:19:08.762344 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.762254 5332 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d0392399c40ac578d37065b9bd03e0f2de1e5bac31e3127ac1cf3472f698691"} err="failed to get container status \"3d0392399c40ac578d37065b9bd03e0f2de1e5bac31e3127ac1cf3472f698691\": rpc error: code = NotFound desc = could not find container \"3d0392399c40ac578d37065b9bd03e0f2de1e5bac31e3127ac1cf3472f698691\": container with ID starting with 3d0392399c40ac578d37065b9bd03e0f2de1e5bac31e3127ac1cf3472f698691 not found: ID does not exist" Nov 03 23:19:08.804682 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.804657 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:08.843583 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.838277 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ff4c43a1-94aa-4b83-a259-90294fac7cb6-kube-api-access-kr82b\" (UniqueName: \"kubernetes.io/projected/ff4c43a1-94aa-4b83-a259-90294fac7cb6-kube-api-access-kr82b\") pod \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\" (UID: \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\") " Nov 03 23:19:08.843905 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.843876 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ff4c43a1-94aa-4b83-a259-90294fac7cb6-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff4c43a1-94aa-4b83-a259-90294fac7cb6-maas-api-tls\") pod \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\" (UID: \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\") " Nov 03 23:19:08.844116 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.844097 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ff4c43a1-94aa-4b83-a259-90294fac7cb6-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff4c43a1-94aa-4b83-a259-90294fac7cb6-openshift-service-ca\") pod \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\" (UID: \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\") " Nov 03 23:19:08.844394 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.844373 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ff4c43a1-94aa-4b83-a259-90294fac7cb6-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4c43a1-94aa-4b83-a259-90294fac7cb6-metrics-certs\") pod \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\" (UID: \"ff4c43a1-94aa-4b83-a259-90294fac7cb6\") " Nov 03 23:19:08.846005 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.845961 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff4c43a1-94aa-4b83-a259-90294fac7cb6-openshift-service-ca" pod "ff4c43a1-94aa-4b83-a259-90294fac7cb6" (UID: "ff4c43a1-94aa-4b83-a259-90294fac7cb6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:19:08.849993 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.849970 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff4c43a1-94aa-4b83-a259-90294fac7cb6-metrics-certs" pod "ff4c43a1-94aa-4b83-a259-90294fac7cb6" (UID: "ff4c43a1-94aa-4b83-a259-90294fac7cb6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:19:08.853954 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.850218 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff4c43a1-94aa-4b83-a259-90294fac7cb6-maas-api-tls" pod "ff4c43a1-94aa-4b83-a259-90294fac7cb6" (UID: "ff4c43a1-94aa-4b83-a259-90294fac7cb6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:19:08.854732 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.854703 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff4c43a1-94aa-4b83-a259-90294fac7cb6-kube-api-access-kr82b" pod "ff4c43a1-94aa-4b83-a259-90294fac7cb6" (UID: "ff4c43a1-94aa-4b83-a259-90294fac7cb6"). InnerVolumeSpecName "kube-api-access-kr82b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:19:08.945811 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.945722 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr82b\" (UniqueName: \"kubernetes.io/projected/ff4c43a1-94aa-4b83-a259-90294fac7cb6-kube-api-access-kr82b\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:08.945811 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.945751 5332 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff4c43a1-94aa-4b83-a259-90294fac7cb6-maas-api-tls\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:08.945811 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.945761 5332 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff4c43a1-94aa-4b83-a259-90294fac7cb6-openshift-service-ca\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:08.945811 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:08.945772 5332 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4c43a1-94aa-4b83-a259-90294fac7cb6-metrics-certs\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:09.066095 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:09.066068 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n"] Nov 03 23:19:09.069499 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:09.069476 5332 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-main-70a7bf-6ccccc4bbc-ld54n"] Nov 03 23:19:09.494313 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:19:09.494267 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:19:09.501704 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:09.501671 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:09.596662 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:09.596627 5332 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ff4c43a1-94aa-4b83-a259-90294fac7cb6" path="/var/lib/kubelet/pods/ff4c43a1-94aa-4b83-a259-90294fac7cb6/volumes" Nov 03 23:19:10.189902 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:10.189866 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:10.881629 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:10.881594 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:11.364507 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.364432 5332 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5" podUID="35410cd5-778a-4fa2-9e72-79eccbcb50ee" containerName="payload-processing" containerID="cri-o://afe0d897fb79dfacb51651214a56de177d434fc479500a17521165f877abe267" gracePeriod=25 Nov 03 23:19:11.375122 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.375088 5332 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs" podUID="6686ef05-9aa2-4ac1-88d7-151003c35d3b" containerName="payload-pre-processing" containerID="cri-o://ce1bf2b02647cc628b55575f65a2db757ffc201ad52fd5dcd4077ff614b312f1" gracePeriod=25 Nov 03 23:19:11.563439 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.558868 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:11.657951 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.657927 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5" Nov 03 23:19:11.688413 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.688387 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs" Nov 03 23:19:11.762299 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.762270 5332 generic.go:356] "Generic (PLEG): container finished" podID="35410cd5-778a-4fa2-9e72-79eccbcb50ee" containerID="afe0d897fb79dfacb51651214a56de177d434fc479500a17521165f877abe267" exitCode=0 Nov 03 23:19:11.762529 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.762321 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5" Nov 03 23:19:11.762529 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.762347 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5" event={"ID":"35410cd5-778a-4fa2-9e72-79eccbcb50ee","Type":"ContainerDied","Data":"afe0d897fb79dfacb51651214a56de177d434fc479500a17521165f877abe267"} Nov 03 23:19:11.762529 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.762395 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5" event={"ID":"35410cd5-778a-4fa2-9e72-79eccbcb50ee","Type":"ContainerDied","Data":"ada7b1217f65e74a8159ada2c52f4f778fabd18723bb43d008676559fde0df28"} Nov 03 23:19:11.762529 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.762423 5332 scope.go:122] "RemoveContainer" containerID="afe0d897fb79dfacb51651214a56de177d434fc479500a17521165f877abe267" Nov 03 23:19:11.763621 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.763603 5332 generic.go:356] "Generic (PLEG): container finished" podID="6686ef05-9aa2-4ac1-88d7-151003c35d3b" containerID="ce1bf2b02647cc628b55575f65a2db757ffc201ad52fd5dcd4077ff614b312f1" exitCode=0 Nov 03 23:19:11.763706 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.763643 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs" Nov 03 23:19:11.763706 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.763662 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs" event={"ID":"6686ef05-9aa2-4ac1-88d7-151003c35d3b","Type":"ContainerDied","Data":"ce1bf2b02647cc628b55575f65a2db757ffc201ad52fd5dcd4077ff614b312f1"} Nov 03 23:19:11.763706 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.763702 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs" event={"ID":"6686ef05-9aa2-4ac1-88d7-151003c35d3b","Type":"ContainerDied","Data":"f1ca31bba98a8435b96415c0cfde347bc9e97a192adac2ea9ac814b842d42d9a"} Nov 03 23:19:11.772057 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.772039 5332 scope.go:122] "RemoveContainer" containerID="afe0d897fb79dfacb51651214a56de177d434fc479500a17521165f877abe267" Nov 03 23:19:11.772333 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:19:11.772316 5332 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afe0d897fb79dfacb51651214a56de177d434fc479500a17521165f877abe267\": container with ID starting with afe0d897fb79dfacb51651214a56de177d434fc479500a17521165f877abe267 not found: ID does not exist" containerID="afe0d897fb79dfacb51651214a56de177d434fc479500a17521165f877abe267" Nov 03 23:19:11.772387 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.772341 5332 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afe0d897fb79dfacb51651214a56de177d434fc479500a17521165f877abe267"} err="failed to get container status \"afe0d897fb79dfacb51651214a56de177d434fc479500a17521165f877abe267\": rpc error: code = NotFound desc = could not find container \"afe0d897fb79dfacb51651214a56de177d434fc479500a17521165f877abe267\": container with ID starting with afe0d897fb79dfacb51651214a56de177d434fc479500a17521165f877abe267 not found: ID does not exist" Nov 03 23:19:11.772387 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.772360 5332 scope.go:122] "RemoveContainer" containerID="ce1bf2b02647cc628b55575f65a2db757ffc201ad52fd5dcd4077ff614b312f1" Nov 03 23:19:11.775964 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.775941 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/35410cd5-778a-4fa2-9e72-79eccbcb50ee-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35410cd5-778a-4fa2-9e72-79eccbcb50ee-plugins-config-volume\") pod \"35410cd5-778a-4fa2-9e72-79eccbcb50ee\" (UID: \"35410cd5-778a-4fa2-9e72-79eccbcb50ee\") " Nov 03 23:19:11.776044 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.775996 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/35410cd5-778a-4fa2-9e72-79eccbcb50ee-kube-api-access-4zrw6\" (UniqueName: \"kubernetes.io/projected/35410cd5-778a-4fa2-9e72-79eccbcb50ee-kube-api-access-4zrw6\") pod \"35410cd5-778a-4fa2-9e72-79eccbcb50ee\" (UID: \"35410cd5-778a-4fa2-9e72-79eccbcb50ee\") " Nov 03 23:19:11.776918 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.776359 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35410cd5-778a-4fa2-9e72-79eccbcb50ee-plugins-config-volume" pod "35410cd5-778a-4fa2-9e72-79eccbcb50ee" (UID: "35410cd5-778a-4fa2-9e72-79eccbcb50ee"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:19:11.776918 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.776572 5332 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35410cd5-778a-4fa2-9e72-79eccbcb50ee-plugins-config-volume\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:11.778394 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.778374 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35410cd5-778a-4fa2-9e72-79eccbcb50ee-kube-api-access-4zrw6" pod "35410cd5-778a-4fa2-9e72-79eccbcb50ee" (UID: "35410cd5-778a-4fa2-9e72-79eccbcb50ee"). InnerVolumeSpecName "kube-api-access-4zrw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:19:11.781007 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.780991 5332 scope.go:122] "RemoveContainer" containerID="ce1bf2b02647cc628b55575f65a2db757ffc201ad52fd5dcd4077ff614b312f1" Nov 03 23:19:11.781318 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:19:11.781297 5332 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce1bf2b02647cc628b55575f65a2db757ffc201ad52fd5dcd4077ff614b312f1\": container with ID starting with ce1bf2b02647cc628b55575f65a2db757ffc201ad52fd5dcd4077ff614b312f1 not found: ID does not exist" containerID="ce1bf2b02647cc628b55575f65a2db757ffc201ad52fd5dcd4077ff614b312f1" Nov 03 23:19:11.781417 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.781328 5332 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce1bf2b02647cc628b55575f65a2db757ffc201ad52fd5dcd4077ff614b312f1"} err="failed to get container status \"ce1bf2b02647cc628b55575f65a2db757ffc201ad52fd5dcd4077ff614b312f1\": rpc error: code = NotFound desc = could not find container \"ce1bf2b02647cc628b55575f65a2db757ffc201ad52fd5dcd4077ff614b312f1\": container with ID starting with ce1bf2b02647cc628b55575f65a2db757ffc201ad52fd5dcd4077ff614b312f1 not found: ID does not exist" Nov 03 23:19:11.877658 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.877630 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6686ef05-9aa2-4ac1-88d7-151003c35d3b-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6686ef05-9aa2-4ac1-88d7-151003c35d3b-plugins-config-volume\") pod \"6686ef05-9aa2-4ac1-88d7-151003c35d3b\" (UID: \"6686ef05-9aa2-4ac1-88d7-151003c35d3b\") " Nov 03 23:19:11.877824 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.877726 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6686ef05-9aa2-4ac1-88d7-151003c35d3b-kube-api-access-fz8xx\" (UniqueName: \"kubernetes.io/projected/6686ef05-9aa2-4ac1-88d7-151003c35d3b-kube-api-access-fz8xx\") pod \"6686ef05-9aa2-4ac1-88d7-151003c35d3b\" (UID: \"6686ef05-9aa2-4ac1-88d7-151003c35d3b\") " Nov 03 23:19:11.877966 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.877954 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zrw6\" (UniqueName: \"kubernetes.io/projected/35410cd5-778a-4fa2-9e72-79eccbcb50ee-kube-api-access-4zrw6\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:11.878003 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.877974 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6686ef05-9aa2-4ac1-88d7-151003c35d3b-plugins-config-volume" pod "6686ef05-9aa2-4ac1-88d7-151003c35d3b" (UID: "6686ef05-9aa2-4ac1-88d7-151003c35d3b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:19:11.879782 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.879760 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6686ef05-9aa2-4ac1-88d7-151003c35d3b-kube-api-access-fz8xx" pod "6686ef05-9aa2-4ac1-88d7-151003c35d3b" (UID: "6686ef05-9aa2-4ac1-88d7-151003c35d3b"). InnerVolumeSpecName "kube-api-access-fz8xx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:19:11.978858 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.978826 5332 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6686ef05-9aa2-4ac1-88d7-151003c35d3b-plugins-config-volume\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:11.978858 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:11.978854 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fz8xx\" (UniqueName: \"kubernetes.io/projected/6686ef05-9aa2-4ac1-88d7-151003c35d3b-kube-api-access-fz8xx\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:12.084574 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:12.084527 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5"] Nov 03 23:19:12.088655 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:12.088630 5332 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-70a7bf-555878474-6vls5"] Nov 03 23:19:12.095810 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:12.095786 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs"] Nov 03 23:19:12.098979 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:12.098958 5332 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-70a7bf-5d8fd6cddch7tzs"] Nov 03 23:19:12.210008 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:12.209966 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:12.422973 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:12.422944 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:12.528925 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:12.528888 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:13.049954 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:13.049920 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:13.154228 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:13.154193 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:13.367975 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:13.367899 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n"] Nov 03 23:19:13.368149 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:13.368128 5332 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" podUID="2408104b-5d53-48b8-8df4-f68e94248c4f" containerName="istio-proxy" containerID="cri-o://4c32a49d0dda71f7abc2bf495c8532e395a2f44bac2e9f357b27f7459316190e" gracePeriod=30 Nov 03 23:19:13.422119 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:13.422080 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:13.596014 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:13.595971 5332 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="35410cd5-778a-4fa2-9e72-79eccbcb50ee" path="/var/lib/kubelet/pods/35410cd5-778a-4fa2-9e72-79eccbcb50ee/volumes" Nov 03 23:19:13.596550 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:13.596527 5332 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6686ef05-9aa2-4ac1-88d7-151003c35d3b" path="/var/lib/kubelet/pods/6686ef05-9aa2-4ac1-88d7-151003c35d3b/volumes" Nov 03 23:19:13.807685 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:13.807656 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:14.165221 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:14.165114 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:14.503327 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:14.503295 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:15.288901 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:15.288870 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:15.703364 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:15.703330 5332 patch_prober.go:29] interesting pod/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 03 23:19:15.703534 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:15.703397 5332 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" podUID="2408104b-5d53-48b8-8df4-f68e94248c4f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 03 23:19:16.066975 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:16.066887 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:16.704988 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:16.704951 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:17.509170 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:17.509138 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:18.300806 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.300773 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:18.612480 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.612440 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:19:18.667717 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.667691 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-envoy\") pod \"2408104b-5d53-48b8-8df4-f68e94248c4f\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " Nov 03 23:19:18.667877 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.667749 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-token\" (UniqueName: \"kubernetes.io/projected/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-token\") pod \"2408104b-5d53-48b8-8df4-f68e94248c4f\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " Nov 03 23:19:18.667877 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.667774 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-workload-certs\") pod \"2408104b-5d53-48b8-8df4-f68e94248c4f\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " Nov 03 23:19:18.667877 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.667793 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-data\") pod \"2408104b-5d53-48b8-8df4-f68e94248c4f\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " Nov 03 23:19:18.667877 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.667813 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2408104b-5d53-48b8-8df4-f68e94248c4f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2408104b-5d53-48b8-8df4-f68e94248c4f-istiod-ca-cert\") pod \"2408104b-5d53-48b8-8df4-f68e94248c4f\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " Nov 03 23:19:18.667877 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.667856 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-credential-socket\") pod \"2408104b-5d53-48b8-8df4-f68e94248c4f\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " Nov 03 23:19:18.668206 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.667905 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-podinfo\") pod \"2408104b-5d53-48b8-8df4-f68e94248c4f\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " Nov 03 23:19:18.668206 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.667951 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-workload-socket\") pod \"2408104b-5d53-48b8-8df4-f68e94248c4f\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " Nov 03 23:19:18.668206 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.667987 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2408104b-5d53-48b8-8df4-f68e94248c4f-kube-api-access-mrtb9\" (UniqueName: \"kubernetes.io/projected/2408104b-5d53-48b8-8df4-f68e94248c4f-kube-api-access-mrtb9\") pod \"2408104b-5d53-48b8-8df4-f68e94248c4f\" (UID: \"2408104b-5d53-48b8-8df4-f68e94248c4f\") " Nov 03 23:19:18.668206 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.668079 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-workload-certs" pod "2408104b-5d53-48b8-8df4-f68e94248c4f" (UID: "2408104b-5d53-48b8-8df4-f68e94248c4f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:19:18.668387 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.668364 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2408104b-5d53-48b8-8df4-f68e94248c4f-istiod-ca-cert" pod "2408104b-5d53-48b8-8df4-f68e94248c4f" (UID: "2408104b-5d53-48b8-8df4-f68e94248c4f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:19:18.668427 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.668387 5332 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-workload-certs\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:18.668552 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.668534 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-data" pod "2408104b-5d53-48b8-8df4-f68e94248c4f" (UID: "2408104b-5d53-48b8-8df4-f68e94248c4f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:19:18.668600 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.668564 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-workload-socket" pod "2408104b-5d53-48b8-8df4-f68e94248c4f" (UID: "2408104b-5d53-48b8-8df4-f68e94248c4f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:19:18.668771 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.668739 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-credential-socket" pod "2408104b-5d53-48b8-8df4-f68e94248c4f" (UID: "2408104b-5d53-48b8-8df4-f68e94248c4f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:19:18.670621 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.670588 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-podinfo" pod "2408104b-5d53-48b8-8df4-f68e94248c4f" (UID: "2408104b-5d53-48b8-8df4-f68e94248c4f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 03 23:19:18.670698 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.670596 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2408104b-5d53-48b8-8df4-f68e94248c4f-kube-api-access-mrtb9" pod "2408104b-5d53-48b8-8df4-f68e94248c4f" (UID: "2408104b-5d53-48b8-8df4-f68e94248c4f"). InnerVolumeSpecName "kube-api-access-mrtb9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:19:18.670698 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.670636 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-envoy" pod "2408104b-5d53-48b8-8df4-f68e94248c4f" (UID: "2408104b-5d53-48b8-8df4-f68e94248c4f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:19:18.670941 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.670918 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-token" pod "2408104b-5d53-48b8-8df4-f68e94248c4f" (UID: "2408104b-5d53-48b8-8df4-f68e94248c4f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:19:18.768937 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.768895 5332 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-credential-socket\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:18.768937 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.768931 5332 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-podinfo\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:18.768937 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.768944 5332 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-workload-socket\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:18.769176 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.768957 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrtb9\" (UniqueName: \"kubernetes.io/projected/2408104b-5d53-48b8-8df4-f68e94248c4f-kube-api-access-mrtb9\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:18.769176 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.768970 5332 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-envoy\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:18.769176 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.768981 5332 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-token\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:18.769176 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.768993 5332 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2408104b-5d53-48b8-8df4-f68e94248c4f-istio-data\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:18.769176 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.769004 5332 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2408104b-5d53-48b8-8df4-f68e94248c4f-istiod-ca-cert\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:18.807462 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.807427 5332 generic.go:356] "Generic (PLEG): container finished" podID="2408104b-5d53-48b8-8df4-f68e94248c4f" containerID="4c32a49d0dda71f7abc2bf495c8532e395a2f44bac2e9f357b27f7459316190e" exitCode=0 Nov 03 23:19:18.807596 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.807512 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" Nov 03 23:19:18.807596 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.807513 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" event={"ID":"2408104b-5d53-48b8-8df4-f68e94248c4f","Type":"ContainerDied","Data":"4c32a49d0dda71f7abc2bf495c8532e395a2f44bac2e9f357b27f7459316190e"} Nov 03 23:19:18.807690 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.807606 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n" event={"ID":"2408104b-5d53-48b8-8df4-f68e94248c4f","Type":"ContainerDied","Data":"7d8ff728d019a2eeee53292f61a4f9d4df025b0ed4251cfda0fa0fa25486624e"} Nov 03 23:19:18.807690 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.807638 5332 scope.go:122] "RemoveContainer" containerID="4c32a49d0dda71f7abc2bf495c8532e395a2f44bac2e9f357b27f7459316190e" Nov 03 23:19:18.817342 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.817326 5332 scope.go:122] "RemoveContainer" containerID="26d73cff4a2b90a143961cbef9e67e23b627642da31bfd65deae8613b558cf89" Nov 03 23:19:18.827137 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.827112 5332 scope.go:122] "RemoveContainer" containerID="4c32a49d0dda71f7abc2bf495c8532e395a2f44bac2e9f357b27f7459316190e" Nov 03 23:19:18.827428 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:19:18.827395 5332 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c32a49d0dda71f7abc2bf495c8532e395a2f44bac2e9f357b27f7459316190e\": container with ID starting with 4c32a49d0dda71f7abc2bf495c8532e395a2f44bac2e9f357b27f7459316190e not found: ID does not exist" containerID="4c32a49d0dda71f7abc2bf495c8532e395a2f44bac2e9f357b27f7459316190e" Nov 03 23:19:18.827549 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.827426 5332 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c32a49d0dda71f7abc2bf495c8532e395a2f44bac2e9f357b27f7459316190e"} err="failed to get container status \"4c32a49d0dda71f7abc2bf495c8532e395a2f44bac2e9f357b27f7459316190e\": rpc error: code = NotFound desc = could not find container \"4c32a49d0dda71f7abc2bf495c8532e395a2f44bac2e9f357b27f7459316190e\": container with ID starting with 4c32a49d0dda71f7abc2bf495c8532e395a2f44bac2e9f357b27f7459316190e not found: ID does not exist" Nov 03 23:19:18.827549 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.827445 5332 scope.go:122] "RemoveContainer" containerID="26d73cff4a2b90a143961cbef9e67e23b627642da31bfd65deae8613b558cf89" Nov 03 23:19:18.827742 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:19:18.827714 5332 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26d73cff4a2b90a143961cbef9e67e23b627642da31bfd65deae8613b558cf89\": container with ID starting with 26d73cff4a2b90a143961cbef9e67e23b627642da31bfd65deae8613b558cf89 not found: ID does not exist" containerID="26d73cff4a2b90a143961cbef9e67e23b627642da31bfd65deae8613b558cf89" Nov 03 23:19:18.827810 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.827750 5332 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26d73cff4a2b90a143961cbef9e67e23b627642da31bfd65deae8613b558cf89"} err="failed to get container status \"26d73cff4a2b90a143961cbef9e67e23b627642da31bfd65deae8613b558cf89\": rpc error: code = NotFound desc = could not find container \"26d73cff4a2b90a143961cbef9e67e23b627642da31bfd65deae8613b558cf89\": container with ID starting with 26d73cff4a2b90a143961cbef9e67e23b627642da31bfd65deae8613b558cf89 not found: ID does not exist" Nov 03 23:19:18.828999 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.828974 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n"] Nov 03 23:19:18.832591 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:18.832568 5332 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-main-70a7bf-openshift-default-f9b56f4df-klf9n"] Nov 03 23:19:19.104703 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:19.104673 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:19.326919 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:19.326887 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:19.445771 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:19.445680 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:19.597848 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:19.597809 5332 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2408104b-5d53-48b8-8df4-f68e94248c4f" path="/var/lib/kubelet/pods/2408104b-5d53-48b8-8df4-f68e94248c4f/volumes" Nov 03 23:19:19.903709 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:19.903668 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:20.193823 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.193723 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:20.381687 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.381643 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp"] Nov 03 23:19:20.382195 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.381897 5332 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" podUID="ff1c9014-ba16-414f-b590-de97f694d667" containerName="maas-api" containerID="cri-o://68f670a72558f8bfd0bebdddc9fb575b0a16f422d3538cb64df7077cd5228f56" gracePeriod=30 Nov 03 23:19:20.443576 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.443535 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:20.679778 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.679751 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" Nov 03 23:19:20.799719 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.799625 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ff1c9014-ba16-414f-b590-de97f694d667-kube-api-access-99zhq\" (UniqueName: \"kubernetes.io/projected/ff1c9014-ba16-414f-b590-de97f694d667-kube-api-access-99zhq\") pod \"ff1c9014-ba16-414f-b590-de97f694d667\" (UID: \"ff1c9014-ba16-414f-b590-de97f694d667\") " Nov 03 23:19:20.799719 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.799688 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ff1c9014-ba16-414f-b590-de97f694d667-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff1c9014-ba16-414f-b590-de97f694d667-maas-api-tls\") pod \"ff1c9014-ba16-414f-b590-de97f694d667\" (UID: \"ff1c9014-ba16-414f-b590-de97f694d667\") " Nov 03 23:19:20.799954 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.799749 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ff1c9014-ba16-414f-b590-de97f694d667-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff1c9014-ba16-414f-b590-de97f694d667-openshift-service-ca\") pod \"ff1c9014-ba16-414f-b590-de97f694d667\" (UID: \"ff1c9014-ba16-414f-b590-de97f694d667\") " Nov 03 23:19:20.799954 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.799816 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ff1c9014-ba16-414f-b590-de97f694d667-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff1c9014-ba16-414f-b590-de97f694d667-metrics-certs\") pod \"ff1c9014-ba16-414f-b590-de97f694d667\" (UID: \"ff1c9014-ba16-414f-b590-de97f694d667\") " Nov 03 23:19:20.800135 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.800111 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff1c9014-ba16-414f-b590-de97f694d667-openshift-service-ca" pod "ff1c9014-ba16-414f-b590-de97f694d667" (UID: "ff1c9014-ba16-414f-b590-de97f694d667"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:19:20.800250 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.800233 5332 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff1c9014-ba16-414f-b590-de97f694d667-openshift-service-ca\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:20.802010 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.801976 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff1c9014-ba16-414f-b590-de97f694d667-maas-api-tls" pod "ff1c9014-ba16-414f-b590-de97f694d667" (UID: "ff1c9014-ba16-414f-b590-de97f694d667"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:19:20.802010 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.801996 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff1c9014-ba16-414f-b590-de97f694d667-kube-api-access-99zhq" pod "ff1c9014-ba16-414f-b590-de97f694d667" (UID: "ff1c9014-ba16-414f-b590-de97f694d667"). InnerVolumeSpecName "kube-api-access-99zhq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:19:20.802199 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.802038 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff1c9014-ba16-414f-b590-de97f694d667-metrics-certs" pod "ff1c9014-ba16-414f-b590-de97f694d667" (UID: "ff1c9014-ba16-414f-b590-de97f694d667"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:19:20.820259 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.820228 5332 generic.go:356] "Generic (PLEG): container finished" podID="ff1c9014-ba16-414f-b590-de97f694d667" containerID="68f670a72558f8bfd0bebdddc9fb575b0a16f422d3538cb64df7077cd5228f56" exitCode=0 Nov 03 23:19:20.820390 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.820286 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" Nov 03 23:19:20.820390 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.820307 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" event={"ID":"ff1c9014-ba16-414f-b590-de97f694d667","Type":"ContainerDied","Data":"68f670a72558f8bfd0bebdddc9fb575b0a16f422d3538cb64df7077cd5228f56"} Nov 03 23:19:20.820390 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.820370 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp" event={"ID":"ff1c9014-ba16-414f-b590-de97f694d667","Type":"ContainerDied","Data":"c0cf779cfcfd98b258fec30867f6a337d947afbe0a8794c8d6736bfd355d16f2"} Nov 03 23:19:20.820517 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.820403 5332 scope.go:122] "RemoveContainer" containerID="68f670a72558f8bfd0bebdddc9fb575b0a16f422d3538cb64df7077cd5228f56" Nov 03 23:19:20.830745 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.830727 5332 scope.go:122] "RemoveContainer" containerID="68f670a72558f8bfd0bebdddc9fb575b0a16f422d3538cb64df7077cd5228f56" Nov 03 23:19:20.831038 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:19:20.831019 5332 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68f670a72558f8bfd0bebdddc9fb575b0a16f422d3538cb64df7077cd5228f56\": container with ID starting with 68f670a72558f8bfd0bebdddc9fb575b0a16f422d3538cb64df7077cd5228f56 not found: ID does not exist" containerID="68f670a72558f8bfd0bebdddc9fb575b0a16f422d3538cb64df7077cd5228f56" Nov 03 23:19:20.831117 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.831045 5332 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68f670a72558f8bfd0bebdddc9fb575b0a16f422d3538cb64df7077cd5228f56"} err="failed to get container status \"68f670a72558f8bfd0bebdddc9fb575b0a16f422d3538cb64df7077cd5228f56\": rpc error: code = NotFound desc = could not find container \"68f670a72558f8bfd0bebdddc9fb575b0a16f422d3538cb64df7077cd5228f56\": container with ID starting with 68f670a72558f8bfd0bebdddc9fb575b0a16f422d3538cb64df7077cd5228f56 not found: ID does not exist" Nov 03 23:19:20.840908 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.840885 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp"] Nov 03 23:19:20.844169 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.844148 5332 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-main-8235df-58886f4445-szdpp"] Nov 03 23:19:20.901103 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.901071 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99zhq\" (UniqueName: \"kubernetes.io/projected/ff1c9014-ba16-414f-b590-de97f694d667-kube-api-access-99zhq\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:20.901103 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.901098 5332 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff1c9014-ba16-414f-b590-de97f694d667-maas-api-tls\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:20.901103 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:20.901112 5332 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff1c9014-ba16-414f-b590-de97f694d667-metrics-certs\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:21.602578 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:21.602541 5332 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ff1c9014-ba16-414f-b590-de97f694d667" path="/var/lib/kubelet/pods/ff1c9014-ba16-414f-b590-de97f694d667/volumes" Nov 03 23:19:25.828542 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:25.828501 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:25.936768 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:25.936738 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:26.257383 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:26.257354 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:26.527512 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:26.527410 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b"] Nov 03 23:19:26.527786 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:26.527755 5332 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" podUID="761dd000-675b-4ed9-93d7-3f23fda02a87" containerName="istio-proxy" containerID="cri-o://317189d2398e8eebbfc0eab871b89f22301d1f84e2f9af4edc55666f47779b91" gracePeriod=30 Nov 03 23:19:26.589560 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:26.589525 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:31.781216 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.781187 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:19:31.805145 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.805072 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-credential-socket\") pod \"761dd000-675b-4ed9-93d7-3f23fda02a87\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " Nov 03 23:19:31.805145 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.805133 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-workload-socket\") pod \"761dd000-675b-4ed9-93d7-3f23fda02a87\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " Nov 03 23:19:31.805357 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.805195 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-podinfo\") pod \"761dd000-675b-4ed9-93d7-3f23fda02a87\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " Nov 03 23:19:31.805357 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.805225 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-data\") pod \"761dd000-675b-4ed9-93d7-3f23fda02a87\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " Nov 03 23:19:31.805357 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.805256 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/761dd000-675b-4ed9-93d7-3f23fda02a87-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/761dd000-675b-4ed9-93d7-3f23fda02a87-istiod-ca-cert\") pod \"761dd000-675b-4ed9-93d7-3f23fda02a87\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " Nov 03 23:19:31.805357 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.805289 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-token\" (UniqueName: \"kubernetes.io/projected/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-token\") pod \"761dd000-675b-4ed9-93d7-3f23fda02a87\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " Nov 03 23:19:31.805357 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.805344 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-envoy\") pod \"761dd000-675b-4ed9-93d7-3f23fda02a87\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " Nov 03 23:19:31.805623 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.805378 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/761dd000-675b-4ed9-93d7-3f23fda02a87-kube-api-access-xljxj\" (UniqueName: \"kubernetes.io/projected/761dd000-675b-4ed9-93d7-3f23fda02a87-kube-api-access-xljxj\") pod \"761dd000-675b-4ed9-93d7-3f23fda02a87\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " Nov 03 23:19:31.805623 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.805425 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-credential-socket" pod "761dd000-675b-4ed9-93d7-3f23fda02a87" (UID: "761dd000-675b-4ed9-93d7-3f23fda02a87"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:19:31.805623 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.805499 5332 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-workload-certs\") pod \"761dd000-675b-4ed9-93d7-3f23fda02a87\" (UID: \"761dd000-675b-4ed9-93d7-3f23fda02a87\") " Nov 03 23:19:31.805623 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.805549 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-data" pod "761dd000-675b-4ed9-93d7-3f23fda02a87" (UID: "761dd000-675b-4ed9-93d7-3f23fda02a87"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:19:31.805828 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.805761 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-workload-socket" pod "761dd000-675b-4ed9-93d7-3f23fda02a87" (UID: "761dd000-675b-4ed9-93d7-3f23fda02a87"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:19:31.806240 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.805922 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/761dd000-675b-4ed9-93d7-3f23fda02a87-istiod-ca-cert" pod "761dd000-675b-4ed9-93d7-3f23fda02a87" (UID: "761dd000-675b-4ed9-93d7-3f23fda02a87"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:19:31.806240 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.806211 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-workload-certs" pod "761dd000-675b-4ed9-93d7-3f23fda02a87" (UID: "761dd000-675b-4ed9-93d7-3f23fda02a87"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:19:31.806442 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.806271 5332 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-credential-socket\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:31.806442 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.806287 5332 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-workload-socket\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:31.806442 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.806300 5332 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-data\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:31.806442 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.806312 5332 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/761dd000-675b-4ed9-93d7-3f23fda02a87-istiod-ca-cert\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:31.811488 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.809946 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-token" pod "761dd000-675b-4ed9-93d7-3f23fda02a87" (UID: "761dd000-675b-4ed9-93d7-3f23fda02a87"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:19:31.811488 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.809960 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/761dd000-675b-4ed9-93d7-3f23fda02a87-kube-api-access-xljxj" pod "761dd000-675b-4ed9-93d7-3f23fda02a87" (UID: "761dd000-675b-4ed9-93d7-3f23fda02a87"). InnerVolumeSpecName "kube-api-access-xljxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:19:31.811488 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.810082 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-envoy" pod "761dd000-675b-4ed9-93d7-3f23fda02a87" (UID: "761dd000-675b-4ed9-93d7-3f23fda02a87"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:19:31.811488 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.810144 5332 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-podinfo" pod "761dd000-675b-4ed9-93d7-3f23fda02a87" (UID: "761dd000-675b-4ed9-93d7-3f23fda02a87"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 03 23:19:31.880723 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.880692 5332 generic.go:356] "Generic (PLEG): container finished" podID="761dd000-675b-4ed9-93d7-3f23fda02a87" containerID="317189d2398e8eebbfc0eab871b89f22301d1f84e2f9af4edc55666f47779b91" exitCode=0 Nov 03 23:19:31.880890 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.880755 5332 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" Nov 03 23:19:31.880890 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.880757 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" event={"ID":"761dd000-675b-4ed9-93d7-3f23fda02a87","Type":"ContainerDied","Data":"317189d2398e8eebbfc0eab871b89f22301d1f84e2f9af4edc55666f47779b91"} Nov 03 23:19:31.880991 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.880892 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b" event={"ID":"761dd000-675b-4ed9-93d7-3f23fda02a87","Type":"ContainerDied","Data":"83934efaa60b2cfbb897eda62dd4ddf83b6ab1f2346fdb1dcbf3d695635a11ca"} Nov 03 23:19:31.880991 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.880915 5332 scope.go:122] "RemoveContainer" containerID="317189d2398e8eebbfc0eab871b89f22301d1f84e2f9af4edc55666f47779b91" Nov 03 23:19:31.890233 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.890215 5332 scope.go:122] "RemoveContainer" containerID="4c1b1a354f04743731dcad48b11920fcb109252ee800e7cc7526dbfe3f6b945f" Nov 03 23:19:31.898521 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.898492 5332 scope.go:122] "RemoveContainer" containerID="317189d2398e8eebbfc0eab871b89f22301d1f84e2f9af4edc55666f47779b91" Nov 03 23:19:31.899053 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:19:31.898830 5332 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"317189d2398e8eebbfc0eab871b89f22301d1f84e2f9af4edc55666f47779b91\": container with ID starting with 317189d2398e8eebbfc0eab871b89f22301d1f84e2f9af4edc55666f47779b91 not found: ID does not exist" containerID="317189d2398e8eebbfc0eab871b89f22301d1f84e2f9af4edc55666f47779b91" Nov 03 23:19:31.899053 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.898861 5332 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"317189d2398e8eebbfc0eab871b89f22301d1f84e2f9af4edc55666f47779b91"} err="failed to get container status \"317189d2398e8eebbfc0eab871b89f22301d1f84e2f9af4edc55666f47779b91\": rpc error: code = NotFound desc = could not find container \"317189d2398e8eebbfc0eab871b89f22301d1f84e2f9af4edc55666f47779b91\": container with ID starting with 317189d2398e8eebbfc0eab871b89f22301d1f84e2f9af4edc55666f47779b91 not found: ID does not exist" Nov 03 23:19:31.899053 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.898884 5332 scope.go:122] "RemoveContainer" containerID="4c1b1a354f04743731dcad48b11920fcb109252ee800e7cc7526dbfe3f6b945f" Nov 03 23:19:31.899281 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:19:31.899234 5332 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c1b1a354f04743731dcad48b11920fcb109252ee800e7cc7526dbfe3f6b945f\": container with ID starting with 4c1b1a354f04743731dcad48b11920fcb109252ee800e7cc7526dbfe3f6b945f not found: ID does not exist" containerID="4c1b1a354f04743731dcad48b11920fcb109252ee800e7cc7526dbfe3f6b945f" Nov 03 23:19:31.899281 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.899264 5332 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c1b1a354f04743731dcad48b11920fcb109252ee800e7cc7526dbfe3f6b945f"} err="failed to get container status \"4c1b1a354f04743731dcad48b11920fcb109252ee800e7cc7526dbfe3f6b945f\": rpc error: code = NotFound desc = could not find container \"4c1b1a354f04743731dcad48b11920fcb109252ee800e7cc7526dbfe3f6b945f\": container with ID starting with 4c1b1a354f04743731dcad48b11920fcb109252ee800e7cc7526dbfe3f6b945f not found: ID does not exist" Nov 03 23:19:31.901626 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.901605 5332 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b"] Nov 03 23:19:31.905996 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.905977 5332 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-main-8235df-openshift-default-7b66c97d45-t2m7b"] Nov 03 23:19:31.907317 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.907299 5332 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-podinfo\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:31.907375 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.907320 5332 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-token\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:31.907375 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.907332 5332 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-istio-envoy\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:31.907375 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.907341 5332 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xljxj\" (UniqueName: \"kubernetes.io/projected/761dd000-675b-4ed9-93d7-3f23fda02a87-kube-api-access-xljxj\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:31.907375 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.907351 5332 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/761dd000-675b-4ed9-93d7-3f23fda02a87-workload-certs\") on node \"ip-10-0-138-89.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:31.993510 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:31.993480 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:33.596295 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:33.596259 5332 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="761dd000-675b-4ed9-93d7-3f23fda02a87" path="/var/lib/kubelet/pods/761dd000-675b-4ed9-93d7-3f23fda02a87/volumes" Nov 03 23:19:34.047799 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:34.047766 5332 scope.go:122] "RemoveContainer" containerID="883031bafea9133840600bca1a9d3ff8dd55c3bfa82e1b81b4c23a636ea532b4" Nov 03 23:19:34.056586 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:34.056566 5332 scope.go:122] "RemoveContainer" containerID="5b9a8c2560d2a51314161dd4cdc204ed26e010df17496d673cc10be2aaf604ff" Nov 03 23:19:34.064933 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:34.064915 5332 scope.go:122] "RemoveContainer" containerID="184a1c9adb83b8385e5189c1223e0f05de0bc613adfea9a60d3d4ca5db4c1aa3" Nov 03 23:19:34.072717 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:34.072698 5332 scope.go:122] "RemoveContainer" containerID="80bee4cc064e07ee1b431a1214b83cfd46f9ac8596a5741cc5dd01f18d09dfb6" Nov 03 23:19:38.510669 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:38.510634 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-95895fbfc-2qtm9_891c9f5c-8c84-41d6-81fb-89d3af025123/manager/0.log" Nov 03 23:19:39.493645 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:19:39.493603 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:19:44.732945 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:44.732907 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:19:45.036191 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:45.036106 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-xgv72_05c1e9af-42b0-481f-ace5-fbee95f30055/manager/0.log" Nov 03 23:19:45.207539 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:45.207512 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-j5bdq_c975c60e-f871-4058-b060-d46deab53914/kuadrant-console-plugin/0.log" Nov 03 23:19:46.754002 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:46.753966 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2_93cceb7b-521b-43e9-b440-abf2f2926a0d/istio-proxy/0.log" Nov 03 23:19:46.936077 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:46.936044 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-hww68_774a1c32-380d-4046-b391-cecf1bf44bec/discovery/0.log" Nov 03 23:19:47.112745 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:47.112664 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685596c46f-cvm95_e23bcd28-9f87-4446-8e6b-98d06af0647a/kube-auth-proxy/0.log" Nov 03 23:19:47.987744 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:47.987708 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-ddn95_e8f0c433-9c57-4b4c-9094-6b618981f530/istio-proxy/0.log" Nov 03 23:19:48.341579 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:48.341489 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-gpnwl_1521f713-eb6c-4d6b-b2bc-8aa05430fd6f/istio-proxy/0.log" Nov 03 23:19:48.690770 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:48.690661 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-jtf6f_0e954b77-1065-4605-9acc-4dadcc4c42ad/istio-proxy/1.log" Nov 03 23:19:48.866812 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:48.866785 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-kjjnb_d2968f41-e062-475f-b3ca-22c20073f2f1/istio-proxy/0.log" Nov 03 23:19:49.226299 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:49.226260 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b_8f8d9e3c-1335-4726-aec4-b2c6fbc05b93/istio-proxy/0.log" Nov 03 23:19:49.396426 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:49.396398 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-mrg4r_8c4d252c-8f2c-42ee-a443-617c1ed3f5a2/payload-pre-processing/0.log" Nov 03 23:19:50.312147 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:50.312111 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-jtf6f_0e954b77-1065-4605-9acc-4dadcc4c42ad/istio-proxy/0.log" Nov 03 23:19:51.021668 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:51.021616 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-6nbz5_fc63c523-9c57-4273-93a1-ce5bbe4de920/main/0.log" Nov 03 23:19:51.211022 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:51.210989 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-pkjh4_1a7e5c7b-f80f-4ce1-aef5-2da9b0cc9459/main/0.log" Nov 03 23:19:51.594596 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:19:51.594564 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87gnr6_4d9ddb43-4e3c-459b-9bf2-ba6e422d414e/main/0.log" Nov 03 23:20:02.319729 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.319699 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k7vht/must-gather-2gjnm"] Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320066 5332 cpu_manager.go:414] "containerMap: removing container" podUID="4dcc0d9a-3f66-434e-a94e-0042b276cb1b" containerName="test-curl-12475-4c2467" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320076 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4dcc0d9a-3f66-434e-a94e-0042b276cb1b" containerName="test-curl-12475-4c2467" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320091 5332 cpu_manager.go:414] "containerMap: removing container" podUID="35410cd5-778a-4fa2-9e72-79eccbcb50ee" containerName="payload-processing" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320096 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="35410cd5-778a-4fa2-9e72-79eccbcb50ee" containerName="payload-processing" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320105 5332 cpu_manager.go:414] "containerMap: removing container" podUID="761dd000-675b-4ed9-93d7-3f23fda02a87" containerName="istio-proxy" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320124 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="761dd000-675b-4ed9-93d7-3f23fda02a87" containerName="istio-proxy" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320145 5332 cpu_manager.go:414] "containerMap: removing container" podUID="761dd000-675b-4ed9-93d7-3f23fda02a87" containerName="istio-proxy" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320150 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="761dd000-675b-4ed9-93d7-3f23fda02a87" containerName="istio-proxy" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320161 5332 cpu_manager.go:414] "containerMap: removing container" podUID="2408104b-5d53-48b8-8df4-f68e94248c4f" containerName="istio-proxy" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320166 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2408104b-5d53-48b8-8df4-f68e94248c4f" containerName="istio-proxy" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320172 5332 cpu_manager.go:414] "containerMap: removing container" podUID="6686ef05-9aa2-4ac1-88d7-151003c35d3b" containerName="payload-pre-processing" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320177 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6686ef05-9aa2-4ac1-88d7-151003c35d3b" containerName="payload-pre-processing" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320186 5332 cpu_manager.go:414] "containerMap: removing container" podUID="ff4c43a1-94aa-4b83-a259-90294fac7cb6" containerName="maas-api" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320191 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ff4c43a1-94aa-4b83-a259-90294fac7cb6" containerName="maas-api" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320197 5332 cpu_manager.go:414] "containerMap: removing container" podUID="2408104b-5d53-48b8-8df4-f68e94248c4f" containerName="istio-proxy" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320202 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2408104b-5d53-48b8-8df4-f68e94248c4f" containerName="istio-proxy" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320214 5332 cpu_manager.go:414] "containerMap: removing container" podUID="ff1c9014-ba16-414f-b590-de97f694d667" containerName="maas-api" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320219 5332 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ff1c9014-ba16-414f-b590-de97f694d667" containerName="maas-api" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320271 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="ff1c9014-ba16-414f-b590-de97f694d667" containerName="maas-api" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320279 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="4dcc0d9a-3f66-434e-a94e-0042b276cb1b" containerName="test-curl-12475-4c2467" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320285 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="35410cd5-778a-4fa2-9e72-79eccbcb50ee" containerName="payload-processing" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320292 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="761dd000-675b-4ed9-93d7-3f23fda02a87" containerName="istio-proxy" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320299 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="761dd000-675b-4ed9-93d7-3f23fda02a87" containerName="istio-proxy" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320305 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="2408104b-5d53-48b8-8df4-f68e94248c4f" containerName="istio-proxy" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320310 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="6686ef05-9aa2-4ac1-88d7-151003c35d3b" containerName="payload-pre-processing" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320316 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="ff4c43a1-94aa-4b83-a259-90294fac7cb6" containerName="maas-api" Nov 03 23:20:02.322278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.320321 5332 memory_manager.go:365] "RemoveStaleState removing state" podUID="2408104b-5d53-48b8-8df4-f68e94248c4f" containerName="istio-proxy" Nov 03 23:20:02.323550 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.323533 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k7vht/must-gather-2gjnm" Nov 03 23:20:02.330875 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.330321 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k7vht\"/\"openshift-service-ca.crt\"" Nov 03 23:20:02.331262 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.331237 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-k7vht\"/\"default-dockercfg-7c8sx\"" Nov 03 23:20:02.331681 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.331591 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k7vht\"/\"kube-root-ca.crt\"" Nov 03 23:20:02.333489 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.333466 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k7vht/must-gather-2gjnm"] Nov 03 23:20:02.349166 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.349123 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:20:02.474017 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.473935 5332 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" limit=1024 Nov 03 23:20:02.508757 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.508716 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlhlg\" (UniqueName: \"kubernetes.io/projected/e44cf2d5-f7aa-4fda-95db-7f2b89e5b363-kube-api-access-rlhlg\") pod \"must-gather-2gjnm\" (UID: \"e44cf2d5-f7aa-4fda-95db-7f2b89e5b363\") " pod="openshift-must-gather-k7vht/must-gather-2gjnm" Nov 03 23:20:02.508757 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.508765 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e44cf2d5-f7aa-4fda-95db-7f2b89e5b363-must-gather-output\") pod \"must-gather-2gjnm\" (UID: \"e44cf2d5-f7aa-4fda-95db-7f2b89e5b363\") " pod="openshift-must-gather-k7vht/must-gather-2gjnm" Nov 03 23:20:02.609857 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.609779 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlhlg\" (UniqueName: \"kubernetes.io/projected/e44cf2d5-f7aa-4fda-95db-7f2b89e5b363-kube-api-access-rlhlg\") pod \"must-gather-2gjnm\" (UID: \"e44cf2d5-f7aa-4fda-95db-7f2b89e5b363\") " pod="openshift-must-gather-k7vht/must-gather-2gjnm" Nov 03 23:20:02.609857 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.609814 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e44cf2d5-f7aa-4fda-95db-7f2b89e5b363-must-gather-output\") pod \"must-gather-2gjnm\" (UID: \"e44cf2d5-f7aa-4fda-95db-7f2b89e5b363\") " pod="openshift-must-gather-k7vht/must-gather-2gjnm" Nov 03 23:20:02.610126 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.610110 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e44cf2d5-f7aa-4fda-95db-7f2b89e5b363-must-gather-output\") pod \"must-gather-2gjnm\" (UID: \"e44cf2d5-f7aa-4fda-95db-7f2b89e5b363\") " pod="openshift-must-gather-k7vht/must-gather-2gjnm" Nov 03 23:20:02.618170 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.618139 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlhlg\" (UniqueName: \"kubernetes.io/projected/e44cf2d5-f7aa-4fda-95db-7f2b89e5b363-kube-api-access-rlhlg\") pod \"must-gather-2gjnm\" (UID: \"e44cf2d5-f7aa-4fda-95db-7f2b89e5b363\") " pod="openshift-must-gather-k7vht/must-gather-2gjnm" Nov 03 23:20:02.639155 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.639131 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k7vht/must-gather-2gjnm" Nov 03 23:20:02.908570 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.908547 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k7vht/must-gather-2gjnm"] Nov 03 23:20:02.910505 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:20:02.910419 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode44cf2d5_f7aa_4fda_95db_7f2b89e5b363.slice/crio-7730bbb6dcdabcf3309ef93b1ff66367cf767ac63eabbdc5692e713558bf5bb5 WatchSource:0}: Error finding container 7730bbb6dcdabcf3309ef93b1ff66367cf767ac63eabbdc5692e713558bf5bb5: Status 404 returned error can't find the container with id 7730bbb6dcdabcf3309ef93b1ff66367cf767ac63eabbdc5692e713558bf5bb5 Nov 03 23:20:02.912276 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:02.912253 5332 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 23:20:03.037975 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:03.037939 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k7vht/must-gather-2gjnm" event={"ID":"e44cf2d5-f7aa-4fda-95db-7f2b89e5b363","Type":"ContainerStarted","Data":"7730bbb6dcdabcf3309ef93b1ff66367cf767ac63eabbdc5692e713558bf5bb5"} Nov 03 23:20:05.471687 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:05.471647 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r2kpn_7354598a-9d87-4762-9633-da3d96ff063b/global-pull-secret-syncer/0.log" Nov 03 23:20:05.625611 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:05.625578 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kpt2c_adc37e3e-9f5d-4eba-8b13-6f467c3060d3/konnectivity-agent/0.log" Nov 03 23:20:05.743484 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:05.743351 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-89.us-east-2.compute.internal_9d92d59dc723695c8e39db4d586eeb52/haproxy/0.log" Nov 03 23:20:09.080477 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:09.080422 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k7vht/must-gather-2gjnm" event={"ID":"e44cf2d5-f7aa-4fda-95db-7f2b89e5b363","Type":"ContainerStarted","Data":"780d752923eccbe5191985c7a346531a06be3d31a66d338b07cc81364286c458"} Nov 03 23:20:09.080889 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:09.080510 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k7vht/must-gather-2gjnm" event={"ID":"e44cf2d5-f7aa-4fda-95db-7f2b89e5b363","Type":"ContainerStarted","Data":"90bbf8c2d10c2ceaa32c660614e57656b4ab7be4e6815c6be9b88e31d859fb7e"} Nov 03 23:20:09.095286 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:09.095229 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-k7vht/must-gather-2gjnm" podStartSLOduration=1.367946764 podStartE2EDuration="7.095216025s" totalImagesPullingTime="5.727269261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:20:09.093327594 +0000 UTC m=+1715.623434760" watchObservedRunningTime="2026-11-03 23:20:09.095216025 +0000 UTC m=+1715.625323193" Nov 03 23:20:09.505587 ip-10-0-138-89 kubenswrapper[5332]: E1103 23:20:09.505545 5332 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-krm6s" containerName="extractor" Nov 03 23:20:09.774039 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:09.773950 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-95895fbfc-2qtm9_891c9f5c-8c84-41d6-81fb-89d3af025123/manager/0.log" Nov 03 23:20:10.815917 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:10.815882 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-95895fbfc-2qtm9_891c9f5c-8c84-41d6-81fb-89d3af025123/manager/0.log" Nov 03 23:20:11.871880 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:11.871850 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-95895fbfc-2qtm9_891c9f5c-8c84-41d6-81fb-89d3af025123/manager/0.log" Nov 03 23:20:12.332315 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:12.332283 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-xgv72_05c1e9af-42b0-481f-ace5-fbee95f30055/manager/0.log" Nov 03 23:20:12.361144 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:12.361107 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-j5bdq_c975c60e-f871-4058-b060-d46deab53914/kuadrant-console-plugin/0.log" Nov 03 23:20:13.111180 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:13.111149 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2_93cceb7b-521b-43e9-b440-abf2f2926a0d/istio-proxy/0.log" Nov 03 23:20:13.927931 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:13.927894 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-hww68_774a1c32-380d-4046-b391-cecf1bf44bec/discovery/0.log" Nov 03 23:20:13.939761 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:13.939735 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685596c46f-cvm95_e23bcd28-9f87-4446-8e6b-98d06af0647a/kube-auth-proxy/0.log" Nov 03 23:20:14.041992 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.041966 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-ddn95_e8f0c433-9c57-4b4c-9094-6b618981f530/istio-proxy/0.log" Nov 03 23:20:14.081315 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.081275 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-gpnwl_1521f713-eb6c-4d6b-b2bc-8aa05430fd6f/istio-proxy/0.log" Nov 03 23:20:14.121089 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.121058 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-jtf6f_0e954b77-1065-4605-9acc-4dadcc4c42ad/istio-proxy/0.log" Nov 03 23:20:14.122314 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.122286 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-jtf6f_0e954b77-1065-4605-9acc-4dadcc4c42ad/istio-proxy/1.log" Nov 03 23:20:14.137340 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.137312 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-kjjnb_d2968f41-e062-475f-b3ca-22c20073f2f1/istio-proxy/0.log" Nov 03 23:20:14.175345 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.175319 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b_8f8d9e3c-1335-4726-aec4-b2c6fbc05b93/istio-proxy/0.log" Nov 03 23:20:14.192682 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.192605 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-mrg4r_8c4d252c-8f2c-42ee-a443-617c1ed3f5a2/payload-pre-processing/0.log" Nov 03 23:20:14.228563 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.228538 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-sw2xs_d8b1a575-54e2-46d5-b23a-4ad16eab259a/kube-state-metrics/0.log" Nov 03 23:20:14.246342 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.246318 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-sw2xs_d8b1a575-54e2-46d5-b23a-4ad16eab259a/kube-rbac-proxy-main/0.log" Nov 03 23:20:14.276136 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.276104 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-sw2xs_d8b1a575-54e2-46d5-b23a-4ad16eab259a/kube-rbac-proxy-self/0.log" Nov 03 23:20:14.352372 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.352347 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-htd5b_78ad8bbb-3cb2-431c-aa87-a77ff23792c4/monitoring-plugin/0.log" Nov 03 23:20:14.471123 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.471093 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bzt6m_0128a08f-b777-40e1-bf05-f79d772fd926/node-exporter/0.log" Nov 03 23:20:14.497609 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.497583 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bzt6m_0128a08f-b777-40e1-bf05-f79d772fd926/kube-rbac-proxy/0.log" Nov 03 23:20:14.526750 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.526714 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bzt6m_0128a08f-b777-40e1-bf05-f79d772fd926/init-textfile/0.log" Nov 03 23:20:14.748943 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.748864 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c1c2bfa9-24cc-4052-a655-2a97131d5503/prometheus/0.log" Nov 03 23:20:14.773937 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.773912 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c1c2bfa9-24cc-4052-a655-2a97131d5503/config-reloader/0.log" Nov 03 23:20:14.798266 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.798230 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c1c2bfa9-24cc-4052-a655-2a97131d5503/thanos-sidecar/0.log" Nov 03 23:20:14.827568 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.827543 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c1c2bfa9-24cc-4052-a655-2a97131d5503/kube-rbac-proxy-web/0.log" Nov 03 23:20:14.854911 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.854883 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c1c2bfa9-24cc-4052-a655-2a97131d5503/kube-rbac-proxy/0.log" Nov 03 23:20:14.878628 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.878605 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c1c2bfa9-24cc-4052-a655-2a97131d5503/kube-rbac-proxy-thanos/0.log" Nov 03 23:20:14.905154 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.905129 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c1c2bfa9-24cc-4052-a655-2a97131d5503/init-config-reloader/0.log" Nov 03 23:20:14.938175 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.938145 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-qxbqw_8adef5d4-9a99-4a16-a052-aca39fc961b3/prometheus-operator/0.log" Nov 03 23:20:14.957813 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:14.957787 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-qxbqw_8adef5d4-9a99-4a16-a052-aca39fc961b3/kube-rbac-proxy/0.log" Nov 03 23:20:15.408713 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:15.408682 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-xgv72_05c1e9af-42b0-481f-ace5-fbee95f30055/manager/0.log" Nov 03 23:20:15.426119 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:15.426095 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-j5bdq_c975c60e-f871-4058-b060-d46deab53914/kuadrant-console-plugin/0.log" Nov 03 23:20:15.851585 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:15.851551 5332 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k"] Nov 03 23:20:15.862562 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:15.862534 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" Nov 03 23:20:15.865448 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:15.865422 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k"] Nov 03 23:20:15.865888 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:15.865869 5332 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-97w7c\"/\"default-dockercfg-hphws\"" Nov 03 23:20:15.918975 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:15.918946 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-97w7c\"/\"openshift-service-ca.crt\"" Nov 03 23:20:15.919143 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:15.919042 5332 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-97w7c\"/\"kube-root-ca.crt\"" Nov 03 23:20:15.977483 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:15.977426 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36d8bba9-0b53-470f-9e64-fd3bc24cb2cd-lib-modules\") pod \"perf-node-gather-daemonset-fd79k\" (UID: \"36d8bba9-0b53-470f-9e64-fd3bc24cb2cd\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" Nov 03 23:20:15.977483 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:15.977483 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36d8bba9-0b53-470f-9e64-fd3bc24cb2cd-podres\") pod \"perf-node-gather-daemonset-fd79k\" (UID: \"36d8bba9-0b53-470f-9e64-fd3bc24cb2cd\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" Nov 03 23:20:15.977723 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:15.977619 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f92ks\" (UniqueName: \"kubernetes.io/projected/36d8bba9-0b53-470f-9e64-fd3bc24cb2cd-kube-api-access-f92ks\") pod \"perf-node-gather-daemonset-fd79k\" (UID: \"36d8bba9-0b53-470f-9e64-fd3bc24cb2cd\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" Nov 03 23:20:15.977797 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:15.977775 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36d8bba9-0b53-470f-9e64-fd3bc24cb2cd-proc\") pod \"perf-node-gather-daemonset-fd79k\" (UID: \"36d8bba9-0b53-470f-9e64-fd3bc24cb2cd\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" Nov 03 23:20:15.977869 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:15.977847 5332 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36d8bba9-0b53-470f-9e64-fd3bc24cb2cd-sys\") pod \"perf-node-gather-daemonset-fd79k\" (UID: \"36d8bba9-0b53-470f-9e64-fd3bc24cb2cd\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" Nov 03 23:20:16.079346 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:16.079303 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36d8bba9-0b53-470f-9e64-fd3bc24cb2cd-proc\") pod \"perf-node-gather-daemonset-fd79k\" (UID: \"36d8bba9-0b53-470f-9e64-fd3bc24cb2cd\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" Nov 03 23:20:16.079555 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:16.079361 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36d8bba9-0b53-470f-9e64-fd3bc24cb2cd-sys\") pod \"perf-node-gather-daemonset-fd79k\" (UID: \"36d8bba9-0b53-470f-9e64-fd3bc24cb2cd\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" Nov 03 23:20:16.079555 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:16.079402 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36d8bba9-0b53-470f-9e64-fd3bc24cb2cd-lib-modules\") pod \"perf-node-gather-daemonset-fd79k\" (UID: \"36d8bba9-0b53-470f-9e64-fd3bc24cb2cd\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" Nov 03 23:20:16.079555 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:16.079420 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36d8bba9-0b53-470f-9e64-fd3bc24cb2cd-proc\") pod \"perf-node-gather-daemonset-fd79k\" (UID: \"36d8bba9-0b53-470f-9e64-fd3bc24cb2cd\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" Nov 03 23:20:16.079555 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:16.079429 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36d8bba9-0b53-470f-9e64-fd3bc24cb2cd-podres\") pod \"perf-node-gather-daemonset-fd79k\" (UID: \"36d8bba9-0b53-470f-9e64-fd3bc24cb2cd\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" Nov 03 23:20:16.079555 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:16.079512 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36d8bba9-0b53-470f-9e64-fd3bc24cb2cd-podres\") pod \"perf-node-gather-daemonset-fd79k\" (UID: \"36d8bba9-0b53-470f-9e64-fd3bc24cb2cd\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" Nov 03 23:20:16.079555 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:16.079525 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36d8bba9-0b53-470f-9e64-fd3bc24cb2cd-sys\") pod \"perf-node-gather-daemonset-fd79k\" (UID: \"36d8bba9-0b53-470f-9e64-fd3bc24cb2cd\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" Nov 03 23:20:16.079781 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:16.079595 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36d8bba9-0b53-470f-9e64-fd3bc24cb2cd-lib-modules\") pod \"perf-node-gather-daemonset-fd79k\" (UID: \"36d8bba9-0b53-470f-9e64-fd3bc24cb2cd\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" Nov 03 23:20:16.079781 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:16.079597 5332 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f92ks\" (UniqueName: \"kubernetes.io/projected/36d8bba9-0b53-470f-9e64-fd3bc24cb2cd-kube-api-access-f92ks\") pod \"perf-node-gather-daemonset-fd79k\" (UID: \"36d8bba9-0b53-470f-9e64-fd3bc24cb2cd\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" Nov 03 23:20:16.088157 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:16.088132 5332 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f92ks\" (UniqueName: \"kubernetes.io/projected/36d8bba9-0b53-470f-9e64-fd3bc24cb2cd-kube-api-access-f92ks\") pod \"perf-node-gather-daemonset-fd79k\" (UID: \"36d8bba9-0b53-470f-9e64-fd3bc24cb2cd\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" Nov 03 23:20:16.180034 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:16.179941 5332 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" Nov 03 23:20:16.460718 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:16.460597 5332 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k"] Nov 03 23:20:16.463202 ip-10-0-138-89 kubenswrapper[5332]: W1103 23:20:16.463165 5332 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod36d8bba9_0b53_470f_9e64_fd3bc24cb2cd.slice/crio-5072999fdcf86b4c8105411b48a524a370925cdfd7ebd59bef23d888136b7f40 WatchSource:0}: Error finding container 5072999fdcf86b4c8105411b48a524a370925cdfd7ebd59bef23d888136b7f40: Status 404 returned error can't find the container with id 5072999fdcf86b4c8105411b48a524a370925cdfd7ebd59bef23d888136b7f40 Nov 03 23:20:17.130392 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:17.130351 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" event={"ID":"36d8bba9-0b53-470f-9e64-fd3bc24cb2cd","Type":"ContainerStarted","Data":"512b109573aadbd23ac550de9c9d2f8002ac762a6e563e803de18f33eef4311c"} Nov 03 23:20:17.130573 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:17.130446 5332 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" event={"ID":"36d8bba9-0b53-470f-9e64-fd3bc24cb2cd","Type":"ContainerStarted","Data":"5072999fdcf86b4c8105411b48a524a370925cdfd7ebd59bef23d888136b7f40"} Nov 03 23:20:17.130573 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:17.130507 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" Nov 03 23:20:17.148476 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:17.147281 5332 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" podStartSLOduration=2.14726599 podStartE2EDuration="2.14726599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 23:20:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:20:17.146763134 +0000 UTC m=+1723.676870305" watchObservedRunningTime="2026-11-03 23:20:17.14726599 +0000 UTC m=+1723.677373161" Nov 03 23:20:19.400744 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:19.400678 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jqh5x_858089de-9bce-4497-bf0a-9c756f0aa702/dns/0.log" Nov 03 23:20:19.425091 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:19.425061 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jqh5x_858089de-9bce-4497-bf0a-9c756f0aa702/kube-rbac-proxy/0.log" Nov 03 23:20:19.617152 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:19.617123 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mjl2l_f40c765d-cb44-4835-a41d-8cfb35f73f40/dns-node-resolver/0.log" Nov 03 23:20:20.007606 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:20.007579 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-cainjector-5c57bbd4fc-59v6p_b9edc475-fd48-4ab2-be52-db41fa1a5b3b/cert-manager-cainjector/0.log" Nov 03 23:20:20.191787 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:20.191762 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2frcd_c7b36354-ea7c-4f8c-a96e-f9ba840f2036/node-ca/0.log" Nov 03 23:20:20.533523 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:20.533493 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-8b65dd898-w5dkz_6f7d6490-e663-4016-a80a-32e5df0b4894/manager/0.log" Nov 03 23:20:20.547312 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:20.547287 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-8b65dd898-w5dkz_6f7d6490-e663-4016-a80a-32e5df0b4894/copy-manifests/0.log" Nov 03 23:20:21.063299 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:21.063266 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-95895fbfc-2qtm9_891c9f5c-8c84-41d6-81fb-89d3af025123/manager/0.log" Nov 03 23:20:21.275513 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:21.275481 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2_93cceb7b-521b-43e9-b440-abf2f2926a0d/istio-proxy/0.log" Nov 03 23:20:22.086287 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:22.086255 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-hww68_774a1c32-380d-4046-b391-cecf1bf44bec/discovery/0.log" Nov 03 23:20:22.108447 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:22.108419 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685596c46f-cvm95_e23bcd28-9f87-4446-8e6b-98d06af0647a/kube-auth-proxy/0.log" Nov 03 23:20:22.263283 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:22.263242 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-ddn95_e8f0c433-9c57-4b4c-9094-6b618981f530/istio-proxy/0.log" Nov 03 23:20:22.268708 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:22.268682 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2_93cceb7b-521b-43e9-b440-abf2f2926a0d/istio-proxy/0.log" Nov 03 23:20:22.325563 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:22.325532 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-gpnwl_1521f713-eb6c-4d6b-b2bc-8aa05430fd6f/istio-proxy/0.log" Nov 03 23:20:22.388892 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:22.388818 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-jtf6f_0e954b77-1065-4605-9acc-4dadcc4c42ad/istio-proxy/0.log" Nov 03 23:20:22.390822 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:22.390788 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-jtf6f_0e954b77-1065-4605-9acc-4dadcc4c42ad/istio-proxy/1.log" Nov 03 23:20:22.418768 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:22.418741 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-kjjnb_d2968f41-e062-475f-b3ca-22c20073f2f1/istio-proxy/0.log" Nov 03 23:20:22.475424 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:22.475399 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b_8f8d9e3c-1335-4726-aec4-b2c6fbc05b93/istio-proxy/0.log" Nov 03 23:20:22.501964 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:22.501941 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-mrg4r_8c4d252c-8f2c-42ee-a443-617c1ed3f5a2/payload-pre-processing/0.log" Nov 03 23:20:23.097673 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:23.097638 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-hww68_774a1c32-380d-4046-b391-cecf1bf44bec/discovery/0.log" Nov 03 23:20:23.114009 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:23.113984 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685596c46f-cvm95_e23bcd28-9f87-4446-8e6b-98d06af0647a/kube-auth-proxy/0.log" Nov 03 23:20:23.147869 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:23.147843 5332 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-fd79k" Nov 03 23:20:23.214945 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:23.214911 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-ddn95_e8f0c433-9c57-4b4c-9094-6b618981f530/istio-proxy/0.log" Nov 03 23:20:23.256170 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:23.256140 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-gpnwl_1521f713-eb6c-4d6b-b2bc-8aa05430fd6f/istio-proxy/0.log" Nov 03 23:20:23.295566 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:23.295529 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-jtf6f_0e954b77-1065-4605-9acc-4dadcc4c42ad/istio-proxy/0.log" Nov 03 23:20:23.296796 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:23.296756 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-jtf6f_0e954b77-1065-4605-9acc-4dadcc4c42ad/istio-proxy/1.log" Nov 03 23:20:23.311076 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:23.311031 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-kjjnb_d2968f41-e062-475f-b3ca-22c20073f2f1/istio-proxy/0.log" Nov 03 23:20:23.346281 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:23.346257 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b_8f8d9e3c-1335-4726-aec4-b2c6fbc05b93/istio-proxy/0.log" Nov 03 23:20:23.362220 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:23.362161 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-mrg4r_8c4d252c-8f2c-42ee-a443-617c1ed3f5a2/payload-pre-processing/0.log" Nov 03 23:20:23.408978 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:23.408946 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xl9vv_8ed2871d-bcc6-4319-a486-e68c0969a292/serve-healthcheck-canary/0.log" Nov 03 23:20:24.060736 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:24.060707 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-krm6s_72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd/kube-rbac-proxy/0.log" Nov 03 23:20:24.086492 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:24.086466 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-krm6s_72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd/exporter/0.log" Nov 03 23:20:24.087991 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:24.087968 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-674cd59dc5-5s8w9_7a60f345-5f0f-4a95-a6cb-1cc7936a4f67/jobset-operator/0.log" Nov 03 23:20:24.116554 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:24.116527 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-krm6s_72a6a07a-05f8-45ae-b5ff-0dfa4cbb8ddd/extractor/0.log" Nov 03 23:20:26.406479 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:26.406042 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2_93cceb7b-521b-43e9-b440-abf2f2926a0d/istio-proxy/0.log" Nov 03 23:20:27.047518 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:27.047435 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-8b65dd898-w5dkz_6f7d6490-e663-4016-a80a-32e5df0b4894/manager/0.log" Nov 03 23:20:27.102274 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:27.102236 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-8b65dd898-w5dkz_6f7d6490-e663-4016-a80a-32e5df0b4894/copy-manifests/0.log" Nov 03 23:20:27.717278 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:27.717248 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-hww68_774a1c32-380d-4046-b391-cecf1bf44bec/discovery/0.log" Nov 03 23:20:27.732044 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:27.732017 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685596c46f-cvm95_e23bcd28-9f87-4446-8e6b-98d06af0647a/kube-auth-proxy/0.log" Nov 03 23:20:27.833720 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:27.833687 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-ddn95_e8f0c433-9c57-4b4c-9094-6b618981f530/istio-proxy/0.log" Nov 03 23:20:27.880059 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:27.880030 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-gpnwl_1521f713-eb6c-4d6b-b2bc-8aa05430fd6f/istio-proxy/0.log" Nov 03 23:20:27.924014 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:27.923989 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-jtf6f_0e954b77-1065-4605-9acc-4dadcc4c42ad/istio-proxy/0.log" Nov 03 23:20:27.926901 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:27.926874 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-jtf6f_0e954b77-1065-4605-9acc-4dadcc4c42ad/istio-proxy/1.log" Nov 03 23:20:27.952494 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:27.945384 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-kjjnb_d2968f41-e062-475f-b3ca-22c20073f2f1/istio-proxy/0.log" Nov 03 23:20:27.987798 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:27.985234 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b_8f8d9e3c-1335-4726-aec4-b2c6fbc05b93/istio-proxy/0.log" Nov 03 23:20:28.002978 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:28.002890 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-mrg4r_8c4d252c-8f2c-42ee-a443-617c1ed3f5a2/payload-pre-processing/0.log" Nov 03 23:20:28.372782 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:28.372695 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-674cd59dc5-5s8w9_7a60f345-5f0f-4a95-a6cb-1cc7936a4f67/jobset-operator/0.log" Nov 03 23:20:29.211473 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:29.203510 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-95895fbfc-2qtm9_891c9f5c-8c84-41d6-81fb-89d3af025123/manager/0.log" Nov 03 23:20:29.343478 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:29.341377 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7d4ffc574fm2gs2_93cceb7b-521b-43e9-b440-abf2f2926a0d/istio-proxy/0.log" Nov 03 23:20:30.443523 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:30.438929 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-hww68_774a1c32-380d-4046-b391-cecf1bf44bec/discovery/0.log" Nov 03 23:20:30.466545 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:30.465949 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685596c46f-cvm95_e23bcd28-9f87-4446-8e6b-98d06af0647a/kube-auth-proxy/0.log" Nov 03 23:20:30.562670 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:30.562640 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-ddn95_e8f0c433-9c57-4b4c-9094-6b618981f530/istio-proxy/0.log" Nov 03 23:20:30.609264 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:30.609233 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-gpnwl_1521f713-eb6c-4d6b-b2bc-8aa05430fd6f/istio-proxy/0.log" Nov 03 23:20:30.645910 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:30.645880 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-jtf6f_0e954b77-1065-4605-9acc-4dadcc4c42ad/istio-proxy/1.log" Nov 03 23:20:30.649165 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:30.649132 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-jtf6f_0e954b77-1065-4605-9acc-4dadcc4c42ad/istio-proxy/0.log" Nov 03 23:20:30.663711 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:30.663678 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-kjjnb_d2968f41-e062-475f-b3ca-22c20073f2f1/istio-proxy/0.log" Nov 03 23:20:30.711524 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:30.710359 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-864cbfbb6c-n758b_8f8d9e3c-1335-4726-aec4-b2c6fbc05b93/istio-proxy/0.log" Nov 03 23:20:30.726365 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:30.726334 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-mrg4r_8c4d252c-8f2c-42ee-a443-617c1ed3f5a2/payload-pre-processing/0.log" Nov 03 23:20:32.821802 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:32.821769 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-xgv72_05c1e9af-42b0-481f-ace5-fbee95f30055/manager/0.log" Nov 03 23:20:32.840693 ip-10-0-138-89 kubenswrapper[5332]: I1103 23:20:32.840656 5332 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-j5bdq_c975c60e-f871-4058-b060-d46deab53914/kuadrant-console-plugin/0.log"