Nov 03 21:42:22.029363 ip-10-0-128-183 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Nov 03 21:42:22.029377 ip-10-0-128-183 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Nov 03 21:42:22.029386 ip-10-0-128-183 systemd[1]: kubelet.service: Failed with result 'resources'.
Nov 03 21:42:22.029691 ip-10-0-128-183 systemd[1]: Failed to start Kubernetes Kubelet.
Nov 03 21:42:32.206624 ip-10-0-128-183 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Nov 03 21:42:32.206641 ip-10-0-128-183 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6ef32b6e1abf480c84d00ba8d47df8a8 --
Nov 03 21:44:22.979526 ip-10-0-128-183 systemd[1]: Starting Kubernetes Kubelet...
Nov 03 21:44:23.397360 ip-10-0-128-183 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 21:44:23.397360 ip-10-0-128-183 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 03 21:44:23.397360 ip-10-0-128-183 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 21:44:23.397360 ip-10-0-128-183 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 21:44:23.403814 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403723    2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:44:23.403814 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403810    2572 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:44:23.403814 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403814    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:44:23.403814 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403817    2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:44:23.403814 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403820    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:44:23.403814 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403824    2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:44:23.404039 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403828    2572 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:44:23.404039 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403831    2572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:44:23.404039 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403833    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:44:23.404039 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403836    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:44:23.404039 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403839    2572 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:44:23.404039 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403841    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:44:23.404039 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403844    2572 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:44:23.404039 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403847    2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:44:23.404039 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403850    2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:44:23.404039 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403852    2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:44:23.404039 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403855    2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:44:23.404039 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403857    2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:44:23.404039 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403860    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:44:23.404039 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403862    2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:44:23.404039 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403865    2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:44:23.404039 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403867    2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:44:23.404039 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403870    2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:44:23.404039 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403872    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:44:23.404039 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403875    2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:44:23.404039 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403878    2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:44:23.404517 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403880    2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:44:23.404517 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403883    2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:44:23.404517 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403885    2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:44:23.404517 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403888    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:44:23.404517 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403890    2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:44:23.404517 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403893    2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:44:23.404517 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403895    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:44:23.404517 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403898    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:44:23.404517 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403900    2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:44:23.404517 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403902    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:44:23.404517 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403905    2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:44:23.404517 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403907    2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:44:23.404517 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403910    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:44:23.404517 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403913    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:44:23.404517 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403916    2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:44:23.404517 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403919    2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:44:23.404517 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403921    2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:44:23.404517 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403924    2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:44:23.404517 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403926    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:44:23.404966 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403929    2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:44:23.404966 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403931    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:44:23.404966 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403934    2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:44:23.404966 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403936    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:44:23.404966 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403940    2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:44:23.404966 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403945    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:44:23.404966 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403948    2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:44:23.404966 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403951    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:44:23.404966 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403953    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:44:23.404966 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403956    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:44:23.404966 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403959    2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:44:23.404966 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403961    2572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:44:23.404966 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403963    2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:44:23.404966 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403966    2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:44:23.404966 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403968    2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:44:23.404966 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403971    2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:44:23.404966 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403973    2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:44:23.404966 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403975    2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:44:23.404966 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403978    2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:44:23.405421 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403980    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:44:23.405421 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403983    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:44:23.405421 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403985    2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:44:23.405421 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403988    2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:44:23.405421 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403990    2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:44:23.405421 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403992    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:44:23.405421 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403995    2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:44:23.405421 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.403998    2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:44:23.405421 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404001    2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:44:23.405421 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404004    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:44:23.405421 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404006    2572 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:44:23.405421 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404009    2572 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:44:23.405421 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404011    2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:44:23.405421 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404014    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:44:23.405421 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404016    2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:44:23.405421 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404019    2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:44:23.405421 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404022    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:44:23.405421 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404024    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:44:23.405421 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404027    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:44:23.405421 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404030    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:44:23.405889 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404033    2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:44:23.405889 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404035    2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:44:23.405889 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404038    2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:44:23.405889 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404041    2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:44:23.405889 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404043    2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:44:23.405889 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404046    2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:44:23.405889 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404048    2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:44:23.405889 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404051    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:44:23.405889 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404053    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:44:23.405889 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404056    2572 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:44:23.405889 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404059    2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:44:23.405889 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404062    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:44:23.405889 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404065    2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:44:23.405889 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404067    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:44:23.405889 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404069    2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:44:23.405889 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404072    2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:44:23.405889 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404074    2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:44:23.405889 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404077    2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:44:23.405889 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404081    2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:44:23.406379 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404086    2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:44:23.406379 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404089    2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:44:23.406379 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404092    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:44:23.406379 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404876    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:44:23.406379 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404884    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:44:23.406379 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404887    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:44:23.406379 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404889    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:44:23.406379 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404892    2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:44:23.406379 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404894    2572 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:44:23.406379 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404897    2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:44:23.406379 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404900    2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:44:23.406379 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404902    2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:44:23.406379 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404904    2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:44:23.406379 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404908    2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:44:23.406379 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404910    2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:44:23.406379 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404913    2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:44:23.406379 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404915    2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:44:23.406379 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404918    2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:44:23.406379 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404921    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:44:23.406379 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404924    2572 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:44:23.406862 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404926    2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:44:23.406862 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404929    2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:44:23.406862 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404933    2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:44:23.406862 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404937    2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:44:23.406862 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404941    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:44:23.406862 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404945    2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:44:23.406862 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404949    2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:44:23.406862 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404952    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:44:23.406862 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404956    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:44:23.406862 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404959    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:44:23.406862 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404961    2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:44:23.406862 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404964    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:44:23.406862 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404967    2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:44:23.406862 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404970    2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:44:23.406862 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404973    2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:44:23.406862 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404975    2572 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:44:23.406862 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404978    2572 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:44:23.406862 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404980    2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:44:23.407302 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404983    2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:44:23.407302 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404986    2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:44:23.407302 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404988    2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:44:23.407302 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404990    2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:44:23.407302 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404993    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:44:23.407302 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404995    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:44:23.407302 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.404998    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:44:23.407302 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405000    2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:44:23.407302 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405003    2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:44:23.407302 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405006    2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:44:23.407302 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405009    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:44:23.407302 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405012    2572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:44:23.407302 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405015    2572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:44:23.407302 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405017    2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:44:23.407302 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405020    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:44:23.407302 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405022    2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:44:23.407302 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405025    2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:44:23.407302 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405027    2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:44:23.407302 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405031    2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:44:23.407750 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405033    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:44:23.407750 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405036    2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:44:23.407750 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405038    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:44:23.407750 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405040    2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:44:23.407750 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405043    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:44:23.407750 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405045    2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:44:23.407750 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405048    2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:44:23.407750 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405050    2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:44:23.407750 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405053    2572 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:44:23.407750 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405055    2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:44:23.407750 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405058    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:44:23.407750 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405060    2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:44:23.407750 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405063    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:44:23.407750 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405065    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:44:23.407750 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405067    2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:44:23.407750 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405071    2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:44:23.407750 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405074    2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:44:23.407750 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405076    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:44:23.407750 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405079    2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:44:23.407750 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405081    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:44:23.408272 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405083    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:44:23.408272 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405086    2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:44:23.408272 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405089    2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:44:23.408272 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405091    2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:44:23.408272 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405094    2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:44:23.408272 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405097    2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:44:23.408272 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405100    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:44:23.408272 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405102    2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:44:23.408272 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405105    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:44:23.408272 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405107    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:44:23.408272 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405110    2572 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:44:23.408272 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405113    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:44:23.408272 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405115    2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:44:23.408272 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405118    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:44:23.408272 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405120    2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:44:23.408272 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405123    2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:44:23.408272 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405125    2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:44:23.408272 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405127    2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:44:23.408272 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405131    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:44:23.408272 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405133    2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:44:23.408737 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405136    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:44:23.408737 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405138    2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:44:23.408737 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405140    2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:44:23.408737 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405143    2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:44:23.408737 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405145    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:44:23.408737 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405148    2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:44:23.408737 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405150    2572 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:44:23.408737 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405152    2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:44:23.408737 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405155    2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:44:23.408737 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405157    2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:44:23.408737 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405160    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:44:23.408737 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405162    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:44:23.408737 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405654    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:44:23.408737 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405659    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:44:23.408737 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405662    2572 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:44:23.408737 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405664    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:44:23.408737 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405667    2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:44:23.408737 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405670    2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:44:23.408737 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405673    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:44:23.409182 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405675    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:44:23.409182 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405678    2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:44:23.409182 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405681    2572 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:44:23.409182 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405683    2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:44:23.409182 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405686    2572 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:44:23.409182 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405689    2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:44:23.409182 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405691    2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:44:23.409182 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405694    2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:44:23.409182 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405697    2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:44:23.409182 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405699    2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:44:23.409182 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405702    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:44:23.409182 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405704    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:44:23.409182 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405707    2572 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:44:23.409182 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405709    2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:44:23.409182 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405712    2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:44:23.409182 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405714    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:44:23.409182 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405716    2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:44:23.409182 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405719    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:44:23.409182 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405722    2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:44:23.409182 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405724    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:44:23.409701 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405727    2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:44:23.409701 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405729    2572 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:44:23.409701 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405732    2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:44:23.409701 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405735    2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:44:23.409701 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405737    2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:44:23.409701 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405740    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:44:23.409701 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405742    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:44:23.409701 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405745    2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:44:23.409701 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405748    2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:44:23.409701 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405751    2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:44:23.409701 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405753    2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:44:23.409701 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405756    2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:44:23.409701 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405758    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:44:23.409701 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405761    2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:44:23.409701 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405763    2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:44:23.409701 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405766    2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:44:23.409701 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405768    2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:44:23.409701 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405771    2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:44:23.409701 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405773    2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:44:23.409701 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405775    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:44:23.410174 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405778    2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:44:23.410174 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405780    2572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:44:23.410174 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405783    2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:44:23.410174 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405785    2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:44:23.410174 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405787    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:44:23.410174 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405790    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:44:23.410174 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405792    2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:44:23.410174 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405795    2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:44:23.410174 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405797    2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:44:23.410174 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405800    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:44:23.410174 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405802    2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:44:23.410174 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405805    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:44:23.410174 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405808    2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:44:23.410174 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405810    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:44:23.410174 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405813    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:44:23.410174 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405815    2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:44:23.410174 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405818    2572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:44:23.410174 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405822    2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:44:23.410174 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405825    2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:44:23.410174 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405827    2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:44:23.410658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405830    2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:44:23.410658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405833    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:44:23.410658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405835    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:44:23.410658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405838    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:44:23.410658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405840    2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:44:23.410658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405843    2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:44:23.410658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405845    2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:44:23.410658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405848    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:44:23.410658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405850    2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:44:23.410658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405852    2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:44:23.410658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405855    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:44:23.410658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405857    2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:44:23.410658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405860    2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:44:23.410658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405862    2572 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:44:23.410658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405864    2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:44:23.410658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405867    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:44:23.410658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405869    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:44:23.410658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405872    2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:44:23.410658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405874    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:44:23.411166 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405876    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:44:23.411166 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405879    2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:44:23.411166 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405881    2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:44:23.411166 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405884    2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:44:23.411166 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405889    2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:44:23.411166 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405893    2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:44:23.411166 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405897    2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:44:23.411166 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405900    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:44:23.411166 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405903    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:44:23.411166 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405905    2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:44:23.411166 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405909    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:44:23.411166 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405911    2572 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:44:23.411166 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405914    2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:44:23.411166 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405916    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:44:23.411166 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405919    2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:44:23.411166 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405922    2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:44:23.411166 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405925    2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:44:23.411166 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405927    2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405930    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.405933    2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407067    2572 flags.go:64] FLAG: --address="0.0.0.0"
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407076    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407083    2572 flags.go:64] FLAG: --anonymous-auth="true"
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407088    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407092    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407095    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407100    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407104    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407109    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407112    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407115    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407118    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407121    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407125    2572 flags.go:64] FLAG: --cgroup-root=""
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407127    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407130    2572 flags.go:64] FLAG: --client-ca-file=""
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407133    2572 flags.go:64] FLAG: --cloud-provider="external"
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407135    2572 flags.go:64] FLAG: --cluster-dns="[]"
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407139    2572 flags.go:64] FLAG: --cluster-domain=""
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407142    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407145    2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 03 21:44:23.411623 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407148    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407152    2572 flags.go:64] FLAG: --container-log-max-files="5"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407156    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407158    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407161    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407164    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407167    2572 flags.go:64] FLAG: --contention-profiling="false"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407171    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407174    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407176    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407179    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407183    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407186    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407189    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407204    2572 flags.go:64] FLAG: --enable-load-reader="false"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407206    2572 flags.go:64] FLAG: --enable-server="true"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407209    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407213    2572 flags.go:64] FLAG: --event-burst="100"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407216    2572 flags.go:64] FLAG: --event-qps="50"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407220    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407223    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407226    2572 flags.go:64] FLAG: --eviction-hard=""
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407230    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407233    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407236    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 03 21:44:23.412178 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407239    2572 flags.go:64] FLAG: --eviction-soft=""
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407242    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407244    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407247    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407250    2572 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407253    2572 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407256    2572 flags.go:64] FLAG: --fail-swap-on="true"
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407258    2572 flags.go:64] FLAG: --feature-gates=""
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407262    2572 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407265    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407268    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407271    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407274    2572 flags.go:64] FLAG: --healthz-port="10248"
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407277    2572 flags.go:64] FLAG: --help="false"
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407280    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407283    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407286    2572 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407289    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407292    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407296    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407298    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407301    2572 flags.go:64] FLAG: --image-service-endpoint=""
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407304    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 03 21:44:23.412806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407306    2572 flags.go:64] FLAG: --kube-api-burst="100"
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407309    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407312    2572 flags.go:64] FLAG: --kube-api-qps="50"
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407316    2572 flags.go:64] FLAG: --kube-reserved=""
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407319    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407322    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407324    2572 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407327    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407330    2572 flags.go:64] FLAG: --lock-file=""
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407333    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407335    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407338    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407344    2572 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407347    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407350    2572 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407352    2572 flags.go:64] FLAG: --logging-format="text"
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407355    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407359    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407361    2572 flags.go:64] FLAG: --manifest-url=""
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407364    2572 flags.go:64] FLAG: --manifest-url-header=""
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407369    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407372    2572 flags.go:64] FLAG: --max-open-files="1000000"
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407375    2572 flags.go:64] FLAG: --max-pods="110"
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407378    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407381    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 03 21:44:23.413360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407384    2572 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407387    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407390    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407392    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407395    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407402    2572 flags.go:64] FLAG: --node-status-max-images="50"
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407405    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407408    2572 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407411    2572 flags.go:64] FLAG: --pod-cidr=""
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407414    2572 flags.go:64] FLAG: --pod-manifest-path=""
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407417    2572 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407420    2572 flags.go:64] FLAG: --pods-per-core="0"
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407423    2572 flags.go:64] FLAG: --port="10250"
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407426    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407429    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-001d0467afe5566d5"
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407432    2572 flags.go:64] FLAG: --qos-reserved=""
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407435    2572 flags.go:64] FLAG: --read-only-port="10255"
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407438    2572 flags.go:64] FLAG: --register-node="true"
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407440    2572 flags.go:64] FLAG: --register-with-taints=""
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407444    2572 flags.go:64] FLAG: --registry-burst="10"
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407447    2572 flags.go:64] FLAG: --registry-qps="5"
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407449    2572 flags.go:64] FLAG: --reserved-cpus=""
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407452    2572 flags.go:64] FLAG: --reserved-memory=""
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407456    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407459    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407462    2572 flags.go:64] FLAG: --rotate-certificates="false"
Nov 03 21:44:23.413953 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407465    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407467    2572 flags.go:64] FLAG: --runonce="false"
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407470    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407473    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407476    2572 flags.go:64] FLAG: --seccomp-default="false"
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407479    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407481    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407485    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407488    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407490    2572 flags.go:64] FLAG: --storage-driver-password="root"
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407493    2572 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407496    2572 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407498    2572 flags.go:64] FLAG: --storage-driver-user="root"
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407501    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407504    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407507    2572 flags.go:64] FLAG: --system-cgroups=""
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407510    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407515    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407518    2572 flags.go:64] FLAG: --tls-cert-file=""
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407520    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407523    2572 flags.go:64] FLAG: --tls-min-version=""
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407526    2572 flags.go:64] FLAG: --tls-private-key-file=""
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407528    2572 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407531    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407534    2572 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 03 21:44:23.414643 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407536    2572 flags.go:64] FLAG: --v="2"
Nov 03 21:44:23.415240 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407541    2572 flags.go:64] FLAG: --version="false"
Nov 03 21:44:23.415240 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407545    2572 flags.go:64] FLAG: --vmodule=""
Nov 03 21:44:23.415240 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407548    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 03 21:44:23.415240 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407551    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 03 21:44:23.415240 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407684    2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:44:23.415240 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407688    2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:44:23.415240 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407691    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:44:23.415240 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407694    2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:44:23.415240 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407696    2572 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:44:23.415240 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407699    2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:44:23.415240 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407701    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:44:23.415240 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407704    2572 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:44:23.415240 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407707    2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:44:23.415240 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407709    2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:44:23.415240 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407712    2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:44:23.415240 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407715    2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:44:23.415240 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407717    2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:44:23.415240 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407720    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:44:23.415240 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407722    2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:44:23.415240 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407725    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:44:23.415715 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407727    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:44:23.415715 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407730    2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:44:23.415715 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407732    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:44:23.415715 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407735    2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:44:23.415715 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407737    2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:44:23.415715 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407740    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:44:23.415715 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407742    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:44:23.415715 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407745    2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:44:23.415715 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407747    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:44:23.415715 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407750    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:44:23.415715 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407752    2572 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:44:23.415715 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407755    2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:44:23.415715 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407758    2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:44:23.415715 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407760    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:44:23.415715 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407763    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:44:23.415715 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407765    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:44:23.415715 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407769    2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:44:23.415715 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407771    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:44:23.415715 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407774    2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:44:23.416170 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407776    2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:44:23.416170 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407779    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:44:23.416170 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407781    2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:44:23.416170 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407784    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:44:23.416170 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407786    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:44:23.416170 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407789    2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:44:23.416170 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407791    2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:44:23.416170 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407794    2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:44:23.416170 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407798    2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:44:23.416170 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407800    2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:44:23.416170 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407803    2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:44:23.416170 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407805    2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:44:23.416170 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407808    2572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:44:23.416170 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407810    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:44:23.416170 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407812    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:44:23.416170 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407815    2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:44:23.416170 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407817    2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:44:23.416170 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407820    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:44:23.416170 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407822    2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:44:23.416170 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407824    2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:44:23.416658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407827    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:44:23.416658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407829    2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:44:23.416658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407832    2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:44:23.416658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407834    2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:44:23.416658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407838    2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:44:23.416658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407842    2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:44:23.416658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407845    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:44:23.416658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407847    2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:44:23.416658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407850    2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:44:23.416658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407853    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:44:23.416658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407856    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:44:23.416658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407858    2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:44:23.416658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407861    2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:44:23.416658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407864    2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:44:23.416658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407866    2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:44:23.416658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407869    2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:44:23.416658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407871    2572 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:44:23.416658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407874    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:44:23.416658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407876    2572 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:44:23.416658 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407880    2572 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:44:23.417131 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407883    2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:44:23.417131 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407886    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:44:23.417131 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407889    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:44:23.417131 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407891    2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:44:23.417131 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407894    2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:44:23.417131 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407896    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:44:23.417131 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407899    2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:44:23.417131 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407901    2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:44:23.417131 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407905    2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:44:23.417131 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407909    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:44:23.417131 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407912    2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:44:23.417131 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407914    2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:44:23.417131 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407917    2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:44:23.417131 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407919    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:44:23.417131 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407922    2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:44:23.417131 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407924    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:44:23.417131 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407927    2572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:44:23.417131 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407929    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:44:23.417131 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407932    2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:44:23.417587 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407934    2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:44:23.417587 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407937    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:44:23.417587 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407941    2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:44:23.417587 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407943    2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:44:23.417587 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407946    2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:44:23.417587 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407948    2572 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:44:23.417587 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407951    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:44:23.417587 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407953    2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:44:23.417587 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407956    2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:44:23.417587 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407958    2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:44:23.417587 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407961    2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:44:23.417587 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.407963    2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:44:23.417587 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.407990    2572 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 21:44:23.417587 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408031    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:44:23.417587 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408036    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:44:23.417587 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408039    2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:44:23.417982 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408042    2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:44:23.417982 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408045    2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:44:23.417982 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408047    2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:44:23.417982 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408050    2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:44:23.417982 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408052    2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:44:23.417982 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408055    2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:44:23.417982 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408058    2572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:44:23.417982 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408060    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:44:23.417982 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408063    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:44:23.417982 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408065    2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:44:23.417982 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408068    2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:44:23.417982 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408070    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:44:23.417982 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408072    2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:44:23.417982 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408075    2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:44:23.417982 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408078    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:44:23.417982 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408080    2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:44:23.417982 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408083    2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:44:23.417982 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408085    2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:44:23.417982 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408089    2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:44:23.417982 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408094    2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:44:23.418465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408098    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:44:23.418465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408100    2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:44:23.418465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408103    2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:44:23.418465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408105    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:44:23.418465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408108    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:44:23.418465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408110    2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:44:23.418465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408112    2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:44:23.418465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408115    2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:44:23.418465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408118    2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:44:23.418465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408121    2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:44:23.418465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408123    2572 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:44:23.418465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408126    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:44:23.418465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408129    2572 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:44:23.418465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408132    2572 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:44:23.418465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408134    2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:44:23.418465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408137    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:44:23.418465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408139    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:44:23.418465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408142    2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:44:23.418465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408145    2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:44:23.418465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408147    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:44:23.419013 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408150    2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:44:23.419013 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408152    2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:44:23.419013 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408157    2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:44:23.419013 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408160    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:44:23.419013 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408163    2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:44:23.419013 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408166    2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:44:23.419013 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408168    2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:44:23.419013 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408171    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:44:23.419013 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408173    2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:44:23.419013 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408176    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:44:23.419013 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408178    2572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:44:23.419013 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408182    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:44:23.419013 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408185    2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:44:23.419013 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408187    2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:44:23.419013 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408202    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:44:23.419013 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408205    2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:44:23.419013 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408208    2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:44:23.419013 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408211    2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:44:23.419013 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408213    2572 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:44:23.419476 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408216    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:44:23.419476 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408219    2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:44:23.419476 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408222    2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:44:23.419476 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408224    2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:44:23.419476 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408227    2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:44:23.419476 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408229    2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:44:23.419476 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408233    2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:44:23.419476 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408235    2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:44:23.419476 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408238    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:44:23.419476 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408240    2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:44:23.419476 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408243    2572 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:44:23.419476 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408245    2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:44:23.419476 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408248    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:44:23.419476 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408250    2572 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:44:23.419476 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408253    2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:44:23.419476 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408255    2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:44:23.419476 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408258    2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:44:23.419476 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408260    2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:44:23.419476 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408263    2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:44:23.419958 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408265    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:44:23.419958 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408268    2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:44:23.419958 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408270    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:44:23.419958 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408272    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:44:23.419958 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408275    2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:44:23.419958 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408280    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:44:23.419958 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408282    2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:44:23.419958 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408285    2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:44:23.419958 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408288    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:44:23.419958 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408290    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:44:23.419958 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408293    2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:44:23.419958 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408295    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:44:23.419958 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408298    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:44:23.419958 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408300    2572 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:44:23.419958 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408304    2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:44:23.419958 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408306    2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:44:23.419958 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408309    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:44:23.419958 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408311    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:44:23.419958 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408313    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:44:23.421405 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408317    2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:44:23.421405 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408321    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:44:23.421405 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408324    2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:44:23.421405 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408326    2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:44:23.421405 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408328    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:44:23.421405 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.408331    2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:44:23.421405 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.416136    2572 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 03 21:44:23.421405 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.416153    2572 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 03 21:44:23.421405 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.416848    2572 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 03 21:44:23.421405 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.416854    2572 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 03 21:44:23.421405 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416925    2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:44:23.421405 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416932    2572 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:44:23.421405 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416935    2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:44:23.421405 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416938    2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:44:23.421405 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416940    2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:44:23.421405 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416943    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:44:23.421405 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416946    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:44:23.421405 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416948    2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:44:23.421405 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416951    2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:44:23.421405 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416954    2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:44:23.421874 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416956    2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:44:23.421874 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416959    2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:44:23.421874 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416961    2572 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:44:23.421874 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416964    2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:44:23.421874 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416967    2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:44:23.421874 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416970    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:44:23.421874 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416973    2572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:44:23.421874 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416975    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:44:23.421874 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416978    2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:44:23.421874 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416980    2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:44:23.421874 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416983    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:44:23.421874 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416986    2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:44:23.421874 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416989    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:44:23.421874 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416991    2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:44:23.421874 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416994    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:44:23.421874 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.416997    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:44:23.421874 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417000    2572 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:44:23.421874 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417002    2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:44:23.421874 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417005    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:44:23.421874 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417014    2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:44:23.422348 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417017    2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:44:23.422348 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417020    2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:44:23.422348 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417022    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:44:23.422348 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417025    2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:44:23.422348 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417028    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:44:23.422348 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417030    2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:44:23.422348 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417032    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:44:23.422348 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417035    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:44:23.422348 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417037    2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:44:23.422348 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417040    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:44:23.422348 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417043    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:44:23.422348 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417045    2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:44:23.422348 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417047    2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:44:23.422348 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417050    2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:44:23.422348 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417052    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:44:23.422348 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417055    2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:44:23.422348 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417057    2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:44:23.422348 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417060    2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:44:23.422348 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417063    2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:44:23.422348 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417065    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:44:23.422821 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417068    2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:44:23.422821 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417070    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:44:23.422821 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417073    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:44:23.422821 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417075    2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:44:23.422821 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417078    2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:44:23.422821 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417080    2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:44:23.422821 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417083    2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:44:23.422821 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417086    2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:44:23.422821 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417089    2572 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:44:23.422821 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417091    2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:44:23.422821 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417095    2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:44:23.422821 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417100    2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:44:23.422821 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417103    2572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:44:23.422821 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417106    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:44:23.422821 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417109    2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:44:23.422821 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417111    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:44:23.422821 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417114    2572 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:44:23.422821 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417116    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:44:23.422821 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417118    2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:44:23.423274 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417121    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:44:23.423274 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417123    2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:44:23.423274 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417126    2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:44:23.423274 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417128    2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:44:23.423274 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417131    2572 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:44:23.423274 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417134    2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:44:23.423274 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417136    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:44:23.423274 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417140    2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:44:23.423274 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417144    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:44:23.423274 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417147    2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:44:23.423274 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417150    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:44:23.423274 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417153    2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:44:23.423274 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417155    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:44:23.423274 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417158    2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:44:23.423274 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417160    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:44:23.423274 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417163    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:44:23.423274 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417165    2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:44:23.423274 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417168    2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:44:23.423274 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417170    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:44:23.423710 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417173    2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:44:23.423710 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417175    2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:44:23.423710 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417178    2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:44:23.423710 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417181    2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:44:23.423710 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417185    2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:44:23.423710 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417187    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:44:23.423710 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417205    2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:44:23.423710 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417210    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:44:23.423710 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417212    2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:44:23.423710 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417215    2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:44:23.423710 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417218    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:44:23.423710 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417220    2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:44:23.423710 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417223    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:44:23.423710 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417225    2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:44:23.423710 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417228    2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:44:23.423710 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417230    2572 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:44:23.423710 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417233    2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:44:23.423710 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417235    2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:44:23.424135 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.417264    2572 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 21:44:23.424135 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417442    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:44:23.424135 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417446    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:44:23.424135 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417450    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:44:23.424135 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417453    2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:44:23.424135 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417455    2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:44:23.424135 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417458    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:44:23.424135 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417460    2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:44:23.424135 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417463    2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:44:23.424135 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417465    2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:44:23.424135 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417468    2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:44:23.424135 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417470    2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:44:23.424135 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417472    2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:44:23.424135 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417475    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:44:23.424135 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417477    2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:44:23.424135 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417480    2572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:44:23.424529 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417483    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:44:23.424529 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417486    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:44:23.424529 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417488    2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:44:23.424529 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417491    2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:44:23.424529 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417493    2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:44:23.424529 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417495    2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:44:23.424529 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417498    2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:44:23.424529 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417501    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:44:23.424529 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417503    2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:44:23.424529 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417506    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:44:23.424529 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417508    2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:44:23.424529 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417511    2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:44:23.424529 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417513    2572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:44:23.424529 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417516    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:44:23.424529 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417518    2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:44:23.424529 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417520    2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:44:23.424529 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417523    2572 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:44:23.424529 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417525    2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:44:23.424529 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417528    2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:44:23.424529 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417531    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:44:23.425007 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417533    2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:44:23.425007 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417536    2572 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:44:23.425007 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417538    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:44:23.425007 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417540    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:44:23.425007 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417543    2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:44:23.425007 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417545    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:44:23.425007 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417547    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:44:23.425007 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417550    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:44:23.425007 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417553    2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:44:23.425007 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417555    2572 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:44:23.425007 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417558    2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:44:23.425007 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417560    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:44:23.425007 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417563    2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:44:23.425007 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417565    2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:44:23.425007 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417568    2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:44:23.425007 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417570    2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:44:23.425007 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417573    2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:44:23.425007 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417575    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:44:23.425007 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417578    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:44:23.425465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417581    2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:44:23.425465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417583    2572 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:44:23.425465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417586    2572 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:44:23.425465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417588    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:44:23.425465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417591    2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:44:23.425465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417595    2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:44:23.425465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417599    2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:44:23.425465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417602    2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:44:23.425465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417604    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:44:23.425465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417607    2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:44:23.425465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417609    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:44:23.425465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417612    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:44:23.425465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417615    2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:44:23.425465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417617    2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:44:23.425465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417619    2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:44:23.425465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417622    2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:44:23.425465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417624    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:44:23.425465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417627    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:44:23.425465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417629    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:44:23.425465 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417631    2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:44:23.425947 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417634    2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:44:23.425947 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417637    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:44:23.425947 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417640    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:44:23.425947 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417642    2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:44:23.425947 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417644    2572 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:44:23.425947 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417647    2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:44:23.425947 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417649    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:44:23.425947 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417652    2572 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:44:23.425947 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417654    2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:44:23.425947 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417656    2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:44:23.425947 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417658    2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:44:23.425947 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417661    2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:44:23.425947 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417663    2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:44:23.425947 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417666    2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:44:23.425947 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417669    2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:44:23.425947 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417672    2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:44:23.425947 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417674    2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:44:23.425947 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417677    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:44:23.425947 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417679    2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:44:23.425947 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417681    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:44:23.426543 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417685    2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:44:23.426543 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417688    2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:44:23.426543 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417691    2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:44:23.426543 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417694    2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:44:23.426543 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417697    2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:44:23.426543 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417700    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:44:23.426543 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417702    2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:44:23.426543 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417705    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:44:23.426543 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417707    2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:44:23.426543 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417710    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:44:23.426543 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417712    2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:44:23.426543 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417714    2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:44:23.426543 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.417737    2572 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 21:44:23.426543 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417771    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:44:23.426543 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417775    2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:44:23.426905 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417778    2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:44:23.426905 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417781    2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:44:23.426905 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417783    2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:44:23.426905 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417786    2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:44:23.426905 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417790    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:44:23.426905 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417793    2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:44:23.426905 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417795    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:44:23.426905 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417798    2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:44:23.426905 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417801    2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:44:23.426905 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417803    2572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:44:23.426905 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417806    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:44:23.426905 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417808    2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:44:23.426905 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417811    2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:44:23.426905 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417813    2572 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:44:23.426905 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417816    2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:44:23.426905 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417818    2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:44:23.426905 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417820    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:44:23.426905 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417823    2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:44:23.426905 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417826    2572 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:44:23.426905 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417828    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:44:23.427454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417831    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:44:23.427454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417833    2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:44:23.427454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417836    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:44:23.427454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417838    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:44:23.427454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417841    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:44:23.427454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417843    2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:44:23.427454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417846    2572 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:44:23.427454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417848    2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:44:23.427454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417850    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:44:23.427454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417853    2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:44:23.427454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417855    2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:44:23.427454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417857    2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:44:23.427454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417860    2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:44:23.427454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417862    2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:44:23.427454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417864    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:44:23.427454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417867    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:44:23.427454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417870    2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:44:23.427454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417873    2572 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:44:23.427454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417875    2572 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:44:23.427454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417878    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:44:23.428171 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417881    2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:44:23.428171 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417885    2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:44:23.428171 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417888    2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:44:23.428171 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417890    2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:44:23.428171 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417894    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:44:23.428171 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417896    2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:44:23.428171 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417898    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:44:23.428171 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417901    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:44:23.428171 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417903    2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:44:23.428171 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417906    2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:44:23.428171 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417908    2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:44:23.428171 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417910    2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:44:23.428171 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417913    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:44:23.428171 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417915    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:44:23.428171 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417918    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:44:23.428171 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417920    2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:44:23.428171 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417923    2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:44:23.428171 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417925    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:44:23.428171 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417927    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:44:23.428852 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417930    2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:44:23.428852 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417932    2572 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:44:23.428852 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417935    2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:44:23.428852 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417937    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:44:23.428852 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417940    2572 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:44:23.428852 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417942    2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:44:23.428852 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417944    2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:44:23.428852 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417947    2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:44:23.428852 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417949    2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:44:23.428852 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417953    2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:44:23.428852 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417956    2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:44:23.428852 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417958    2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:44:23.428852 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417961    2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:44:23.428852 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417964    2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:44:23.428852 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417966    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:44:23.428852 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417968    2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:44:23.428852 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417971    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:44:23.428852 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417974    2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:44:23.428852 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417978    2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:44:23.428852 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417981    2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:44:23.429365 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417984    2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:44:23.429365 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417988    2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:44:23.429365 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417991    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:44:23.429365 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417994    2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:44:23.429365 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.417996    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:44:23.429365 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.418000    2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:44:23.429365 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.418002    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:44:23.429365 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.418005    2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:44:23.429365 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.418007    2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:44:23.429365 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.418010    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:44:23.429365 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.418012    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:44:23.429365 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.418014    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:44:23.429365 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.418017    2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:44:23.429365 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.418019    2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:44:23.429365 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.418022    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:44:23.429365 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.418024    2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:44:23.429365 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.418027    2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:44:23.429365 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.418029    2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:44:23.429365 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.418031    2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:44:23.429945 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.418034    2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:44:23.429945 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.418037    2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:44:23.429945 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.418040    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:44:23.429945 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.418043    2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:44:23.429945 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.418045    2572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:44:23.429945 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:23.418048    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:44:23.429945 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.418102    2572 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 03 21:44:23.429945 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.420686    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Nov 03 21:44:23.429945 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.421843    2572 server.go:1014] "Starting client certificate rotation"
Nov 03 21:44:23.429945 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.421939    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 03 21:44:23.429945 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.421968    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 03 21:44:23.429945 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.424874    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 03 21:44:23.431506 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.431489    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 03 21:44:23.443808 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.443782    2572 log.go:25] "Validated CRI v1 runtime API"
Nov 03 21:44:23.448593 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.448577    2572 log.go:25] "Validated CRI v1 image API"
Nov 03 21:44:23.449458 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.449405    2572 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 03 21:44:23.452093 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.452070    2572 fs.go:135] Filesystem UUIDs: map[1e9adcb0-83d1-4620-9961-03e1e06a081b:/dev/nvme0n1p3 64a95dff-5915-4f43-8904-d6f764aa3dc2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Nov 03 21:44:23.452150 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.452093    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Nov 03 21:44:23.457537 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.457418    2572 manager.go:217] Machine: {Timestamp:2026-11-03 21:44:23.455925415 +0000 UTC m=+0.377708473 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099546 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dc5b3268a5fa4e91671a859fcd63a SystemUUID:ec2dc5b3-268a-5fa4-e916-71a859fcd63a BootID:6ef32b6e-1abf-480c-84d0-0ba8d47df8a8 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d2:0a:5e:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d2:0a:5e:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:29:8e:70:98:64 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 03 21:44:23.457630 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.457537    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 03 21:44:23.457630 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.457623    2572 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 03 21:44:23.461172 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.461140    2572 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 03 21:44:23.461337 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.461175    2572 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-183.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 03 21:44:23.462010 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.461999    2572 topology_manager.go:143] "Creating topology manager with none policy"
Nov 03 21:44:23.462041 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.462013    2572 container_manager_linux.go:311] "Creating device plugin manager"
Nov 03 21:44:23.462067 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.462040    2572 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 03 21:44:23.462067 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.462053    2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 03 21:44:23.463339 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.463328    2572 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 03 21:44:23.465775 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.465758    2572 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 03 21:44:23.468053 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.468040    2572 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 03 21:44:23.468181 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.468173    2572 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 03 21:44:23.468229 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.468220    2572 kubelet.go:493] "Attempting to sync node with API server"
Nov 03 21:44:23.468257 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.468233    2572 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 03 21:44:23.468257 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.468243    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 03 21:44:23.468257 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.468252    2572 kubelet.go:405] "Adding apiserver pod source"
Nov 03 21:44:23.468360 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.468260    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 03 21:44:23.468650 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.468637    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 03 21:44:23.471114 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.471094    2572 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 03 21:44:23.479680 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.479663    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 03 21:44:23.480579 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.480568    2572 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 03 21:44:23.480616 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.480598    2572 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 03 21:44:23.480774 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.480764    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 03 21:44:23.480811 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.480780    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 03 21:44:23.480811 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.480786    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 03 21:44:23.480811 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.480791    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 03 21:44:23.480811 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.480796    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 03 21:44:23.480811 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.480802    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 03 21:44:23.481557 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.481548    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 03 21:44:23.481595 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.481558    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 03 21:44:23.481595 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.481565    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 03 21:44:23.481595 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.481571    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 03 21:44:23.481595 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.481580    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 03 21:44:23.481595 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.481591    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 03 21:44:23.483229 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.483218    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 03 21:44:23.483229 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.483230    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 03 21:44:23.487458 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.487440    2572 server.go:1263] "Started kubelet"
Nov 03 21:44:23.487577 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.487548    2572 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 03 21:44:23.487704 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.487530    2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 03 21:44:23.487742 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.487730    2572 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 03 21:44:23.488175 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:23.488153    2572 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Nov 03 21:44:23.488269 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:23.488167    2572 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-183.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Nov 03 21:44:23.488224 ip-10-0-128-183 systemd[1]: Started Kubernetes Kubelet.
Nov 03 21:44:23.488807 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.488266    2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-183.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Nov 03 21:44:23.489378 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.489349    2572 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 03 21:44:23.490421 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.490405    2572 server.go:317] "Adding debug handlers to kubelet server"
Nov 03 21:44:23.493851 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:23.493833    2572 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Nov 03 21:44:23.496579 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.496559    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 03 21:44:23.497288 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.497273    2572 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 03 21:44:23.497630 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:23.497599    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-183.us-east-2.compute.internal\" not found"
Nov 03 21:44:23.498089 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.498072    2572 factory.go:55] Registering systemd factory
Nov 03 21:44:23.498089 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.498089    2572 factory.go:223] Registration of the systemd container factory successfully
Nov 03 21:44:23.498238 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.498224    2572 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 03 21:44:23.498324 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.498301    2572 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 03 21:44:23.498324 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.498325    2572 factory.go:153] Registering CRI-O factory
Nov 03 21:44:23.498459 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.498340    2572 factory.go:223] Registration of the crio container factory successfully
Nov 03 21:44:23.498459 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.498346    2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 03 21:44:23.498459 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.498404    2572 reconstruct.go:97] "Volume reconstruction finished"
Nov 03 21:44:23.498459 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.498412    2572 reconciler.go:29] "Reconciler: start to sync state"
Nov 03 21:44:23.498884 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.498391    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 03 21:44:23.498884 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.498869    2572 factory.go:103] Registering Raw factory
Nov 03 21:44:23.498980 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.498889    2572 manager.go:1199] Started watching for new ooms in manager
Nov 03 21:44:23.500035 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.500016    2572 manager.go:319] Starting recovery of all containers
Nov 03 21:44:23.501343 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:23.501317    2572 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-183.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Nov 03 21:44:23.503046 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:23.501382    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-183.us-east-2.compute.internal.18e4a715c1c5b866  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-183.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-183.us-east-2.compute.internal,},FirstTimestamp:2026-11-03 21:44:23.487412326 +0000 UTC m=+0.409195371,LastTimestamp:2026-11-03 21:44:23.487412326 +0000 UTC m=+0.409195371,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-183.us-east-2.compute.internal,}"
Nov 03 21:44:23.507496 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:23.507465    2572 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Nov 03 21:44:23.510262 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.510234    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 03 21:44:23.513173 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.513156    2572 manager.go:324] Recovery completed
Nov 03 21:44:23.514371 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.514348    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gn2bm"
Nov 03 21:44:23.517393 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.517380    2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 21:44:23.519033 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.519016    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 03 21:44:23.519122 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.519050    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 03 21:44:23.519122 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.519064    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 03 21:44:23.519642 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.519629    2572 cpu_manager.go:226] "Starting" policy="none"
Nov 03 21:44:23.519642 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.519641    2572 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 03 21:44:23.519724 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.519658    2572 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 03 21:44:23.519724 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.519671    2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 21:44:23.520399 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.520375    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 03 21:44:23.520443 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.520403    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 03 21:44:23.520443 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.520412    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 03 21:44:23.521697 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:23.521614    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-183.us-east-2.compute.internal.18e4a715c3a8324d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-183.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-183.us-east-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-183.us-east-2.compute.internal,},FirstTimestamp:2026-11-03 21:44:23.519031885 +0000 UTC m=+0.440814932,LastTimestamp:2026-11-03 21:44:23.519031885 +0000 UTC m=+0.440814932,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-183.us-east-2.compute.internal,}"
Nov 03 21:44:23.521789 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.521779    2572 policy_none.go:50] "Start"
Nov 03 21:44:23.521828 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.521793    2572 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 03 21:44:23.521828 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.521807    2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 03 21:44:23.523753 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.523742    2572 policy_none.go:44] "Start"
Nov 03 21:44:23.526359 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.526343    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gn2bm"
Nov 03 21:44:23.561093 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.560820    2572 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 03 21:44:23.588725 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.568698    2572 manager.go:341] "Starting Device Plugin manager"
Nov 03 21:44:23.588725 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:23.569382    2572 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 03 21:44:23.588725 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.569401    2572 server.go:87] "Starting device plugin registration server"
Nov 03 21:44:23.588725 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.569694    2572 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 03 21:44:23.588725 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.569707    2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 03 21:44:23.588725 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.569805    2572 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 03 21:44:23.588725 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.569878    2572 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 03 21:44:23.588725 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.569887    2572 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 03 21:44:23.588725 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:23.570521    2572 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 03 21:44:23.588725 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:23.570591    2572 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-183.us-east-2.compute.internal\" not found"
Nov 03 21:44:23.588725 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.582627    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 03 21:44:23.588725 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.582647    2572 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 03 21:44:23.588725 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.582678    2572 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 03 21:44:23.588725 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:23.582706    2572 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Nov 03 21:44:23.588725 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.586264    2572 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 21:44:23.670140 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.670040    2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 21:44:23.671168 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.671150    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 03 21:44:23.671293 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.671188    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 03 21:44:23.671293 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.671222    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 03 21:44:23.671293 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.671253    2572 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:44:23.681788 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.681770    2572 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:44:23.681861 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:23.681793    2572 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-183.us-east-2.compute.internal\": node \"ip-10-0-128-183.us-east-2.compute.internal\" not found"
Nov 03 21:44:23.682836 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.682818    2572 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal"]
Nov 03 21:44:23.682889 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.682879    2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 21:44:23.683698 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.683681    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 03 21:44:23.683761 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.683713    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 03 21:44:23.683761 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.683724    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 03 21:44:23.685972 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.685959    2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 21:44:23.686112 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.686097    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:44:23.686174 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.686131    2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 21:44:23.686805 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.686789    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 03 21:44:23.686900 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.686814    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 03 21:44:23.686900 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.686838    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 03 21:44:23.686900 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.686841    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 03 21:44:23.686900 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.686870    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 03 21:44:23.686900 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.686885    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 03 21:44:23.689079 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.689062    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:44:23.689159 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.689108    2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 21:44:23.689887 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.689869    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 03 21:44:23.689943 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.689900    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 03 21:44:23.689943 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.689913    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 03 21:44:23.713479 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:23.713453    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-183.us-east-2.compute.internal\" not found"
Nov 03 21:44:23.727320 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:23.727286    2572 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-183.us-east-2.compute.internal\" not found" node="ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:44:23.733712 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:23.733694    2572 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-183.us-east-2.compute.internal\" not found" node="ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:44:23.799258 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.799227    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/512504a651dea6eb0e990f68b3a9a61c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal\" (UID: \"512504a651dea6eb0e990f68b3a9a61c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:44:23.799440 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.799287    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e92af9dfcd386af37bd479e7884242eb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal\" (UID: \"e92af9dfcd386af37bd479e7884242eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:44:23.799440 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.799327    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e92af9dfcd386af37bd479e7884242eb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal\" (UID: \"e92af9dfcd386af37bd479e7884242eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:44:23.814542 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:23.814511    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-183.us-east-2.compute.internal\" not found"
Nov 03 21:44:23.899866 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.899831    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/512504a651dea6eb0e990f68b3a9a61c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal\" (UID: \"512504a651dea6eb0e990f68b3a9a61c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:44:23.899866 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.899870    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e92af9dfcd386af37bd479e7884242eb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal\" (UID: \"e92af9dfcd386af37bd479e7884242eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:44:23.900062 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.899895    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e92af9dfcd386af37bd479e7884242eb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal\" (UID: \"e92af9dfcd386af37bd479e7884242eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:44:23.900062 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.899928    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e92af9dfcd386af37bd479e7884242eb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal\" (UID: \"e92af9dfcd386af37bd479e7884242eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:44:23.900062 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.899928    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/512504a651dea6eb0e990f68b3a9a61c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal\" (UID: \"512504a651dea6eb0e990f68b3a9a61c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:44:23.900062 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:23.899936    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e92af9dfcd386af37bd479e7884242eb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal\" (UID: \"e92af9dfcd386af37bd479e7884242eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:44:23.914939 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:23.914918    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-183.us-east-2.compute.internal\" not found"
Nov 03 21:44:24.015747 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:24.015678    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-183.us-east-2.compute.internal\" not found"
Nov 03 21:44:24.031897 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:24.031859    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:44:24.039104 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:24.039079    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:44:24.116617 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:24.116575    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-183.us-east-2.compute.internal\" not found"
Nov 03 21:44:24.217141 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:24.217106    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-183.us-east-2.compute.internal\" not found"
Nov 03 21:44:24.317725 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:24.317664    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-183.us-east-2.compute.internal\" not found"
Nov 03 21:44:24.418474 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:24.418445    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-183.us-east-2.compute.internal\" not found"
Nov 03 21:44:24.421606 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:24.421585    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Nov 03 21:44:24.421749 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:24.421729    2572 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 03 21:44:24.519179 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:24.519151    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-183.us-east-2.compute.internal\" not found"
Nov 03 21:44:24.532353 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:24.532308    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-02 21:39:24 +0000 UTC" deadline="2028-07-06 19:18:16.830877521 +0000 UTC"
Nov 03 21:44:24.532353 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:24.532350    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14661h33m52.298530158s"
Nov 03 21:44:24.620036 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:24.620008    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-183.us-east-2.compute.internal\" not found"
Nov 03 21:44:24.681278 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:24.681249    2572 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 21:44:24.698285 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:24.698261    2572 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:44:24.705006 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:24.704972    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92af9dfcd386af37bd479e7884242eb.slice/crio-d6a753be9b83bcb04228bfab37ea563efae01bef7cc7b20bea23258f613b96bf WatchSource:0}: Error finding container d6a753be9b83bcb04228bfab37ea563efae01bef7cc7b20bea23258f613b96bf: Status 404 returned error can't find the container with id d6a753be9b83bcb04228bfab37ea563efae01bef7cc7b20bea23258f613b96bf
Nov 03 21:44:24.705806 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:24.705782    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod512504a651dea6eb0e990f68b3a9a61c.slice/crio-205e1a69bc4a13d16b2a19da1e85a0aec68a6cdd415818a444e1abd9d24f94dc WatchSource:0}: Error finding container 205e1a69bc4a13d16b2a19da1e85a0aec68a6cdd415818a444e1abd9d24f94dc: Status 404 returned error can't find the container with id 205e1a69bc4a13d16b2a19da1e85a0aec68a6cdd415818a444e1abd9d24f94dc
Nov 03 21:44:24.708430 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:24.708325    2572 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 03 21:44:24.710393 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:24.710358    2572 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:44:24.710572 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:24.710547    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 21:44:24.721937 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:24.721920    2572 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 21:44:24.723394 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:24.723380    2572 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 03 21:44:24.929365 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:24.929289    2572 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 21:44:25.263549 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:25.263465    2572 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 21:44:26.684892 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.684853    2572 apiserver.go:52] "Watching apiserver"
Nov 03 21:44:26.694746 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.693929    2572 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 03 21:44:26.694746 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.694348    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-lmjlz","kube-system/global-pull-secret-syncer-dndpk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd","openshift-multus/multus-pg6ql","kube-system/konnectivity-agent-mrf9j","openshift-multus/network-metrics-daemon-kjp2c","openshift-network-diagnostics/network-check-target-ztd6j","openshift-ovn-kubernetes/ovnkube-node-hgk2l","kube-system/kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal","openshift-dns/node-resolver-4jznx","openshift-image-registry/node-ca-txllc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal","openshift-cluster-node-tuning-operator/tuned-85lqj","openshift-multus/multus-additional-cni-plugins-r964d"]
Nov 03 21:44:26.696944 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.696919    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.699221 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.699196    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.701543 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.701525    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 03 21:44:26.702419 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.702402    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 03 21:44:26.702542 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.702405    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 03 21:44:26.702542 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.702522    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-rdd92\""
Nov 03 21:44:26.702542 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.702524    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 03 21:44:26.702724 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.702613    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:26.702724 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:26.702668    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd6j" podUID="7b22f42e-7346-4165-b4ea-99e12837742c"
Nov 03 21:44:26.703344 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.702965    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 03 21:44:26.703344 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.702985    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 03 21:44:26.703344 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.703032    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 03 21:44:26.703344 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.703038    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 03 21:44:26.703344 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.703059    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 03 21:44:26.703344 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.703076    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-52n7c\""
Nov 03 21:44:26.703344 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.703318    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 03 21:44:26.703802 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.703787    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.706305 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.706287    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mrf9j"
Nov 03 21:44:26.711451 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.710366    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lqk2r\""
Nov 03 21:44:26.712378 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.712355    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Nov 03 21:44:26.712991 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.712667    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:26.712991 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:26.712747    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kjp2c" podUID="8915bffd-4628-4aee-994b-81de7d1ad7c6"
Nov 03 21:44:26.714845 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.714823    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lmjlz"
Nov 03 21:44:26.717029 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.717011    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:26.717093 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:26.717077    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dndpk" podUID="7b1bc67e-f876-4fec-b9bf-a3a8906d8d94"
Nov 03 21:44:26.721098 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.721081    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4jznx"
Nov 03 21:44:26.722638 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.722384    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-run-k8s-cni-cncf-io\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.722638 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.722421    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-run-netns\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.722638 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.722446    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-systemd-units\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.722638 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.722470    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/380a7770-3519-404b-927c-dd6754a9ccfb-cni-binary-copy\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.722638 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.722518    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-multus-socket-dir-parent\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.722638 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.722581    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-var-lib-cni-multus\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.722638 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.722605    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-multus-conf-dir\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.722935 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.722665    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2vxr\" (UniqueName: \"kubernetes.io/projected/380a7770-3519-404b-927c-dd6754a9ccfb-kube-api-access-l2vxr\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.722935 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.722694    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-run-ovn\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.722935 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.722718    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-etc-kubernetes\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.722935 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.722741    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbs2h\" (UniqueName: \"kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h\") pod \"network-check-target-ztd6j\" (UID: \"7b22f42e-7346-4165-b4ea-99e12837742c\") " pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:26.722935 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.722807    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs\") pod \"network-metrics-daemon-kjp2c\" (UID: \"8915bffd-4628-4aee-994b-81de7d1ad7c6\") " pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:26.722935 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.722843    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgtg6\" (UniqueName: \"kubernetes.io/projected/8915bffd-4628-4aee-994b-81de7d1ad7c6-kube-api-access-zgtg6\") pod \"network-metrics-daemon-kjp2c\" (UID: \"8915bffd-4628-4aee-994b-81de7d1ad7c6\") " pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:26.722935 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.722868    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-run-netns\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.723160 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.722946    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-log-socket\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.723160 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.722972    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.723160 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.722988    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a1471771-c3a3-4c38-a124-455ab7e5e2d5-env-overrides\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.723160 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723001    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-var-lib-cni-bin\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.723160 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723016    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-var-lib-kubelet\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.723160 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723038    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-run-multus-certs\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.723160 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723075    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb453169-964e-4e16-a300-a54f2f3e74a2-agent-certs\") pod \"konnectivity-agent-mrf9j\" (UID: \"eb453169-964e-4e16-a300-a54f2f3e74a2\") " pod="kube-system/konnectivity-agent-mrf9j"
Nov 03 21:44:26.723160 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723089    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb453169-964e-4e16-a300-a54f2f3e74a2-konnectivity-ca\") pod \"konnectivity-agent-mrf9j\" (UID: \"eb453169-964e-4e16-a300-a54f2f3e74a2\") " pod="kube-system/konnectivity-agent-mrf9j"
Nov 03 21:44:26.723160 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723104    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-var-lib-openvswitch\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.723160 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723117    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-run-openvswitch\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.723160 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723131    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a1471771-c3a3-4c38-a124-455ab7e5e2d5-ovnkube-config\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.723160 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723148    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-system-cni-dir\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.723806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723167    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-hostroot\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.723806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723184    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0995c467-d41c-43e9-ab5a-0609a3a7cf83-host-slash\") pod \"iptables-alerter-lmjlz\" (UID: \"0995c467-d41c-43e9-ab5a-0609a3a7cf83\") " pod="openshift-network-operator/iptables-alerter-lmjlz"
Nov 03 21:44:26.723806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723206    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk7lz\" (UniqueName: \"kubernetes.io/projected/0995c467-d41c-43e9-ab5a-0609a3a7cf83-kube-api-access-lk7lz\") pod \"iptables-alerter-lmjlz\" (UID: \"0995c467-d41c-43e9-ab5a-0609a3a7cf83\") " pod="openshift-network-operator/iptables-alerter-lmjlz"
Nov 03 21:44:26.723806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723230    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zwtz\" (UniqueName: \"kubernetes.io/projected/a1471771-c3a3-4c38-a124-455ab7e5e2d5-kube-api-access-9zwtz\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.723806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723351    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-registration-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.723806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723378    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-device-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.723806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723455    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-multus-cni-dir\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.723806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723480    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0995c467-d41c-43e9-ab5a-0609a3a7cf83-iptables-alerter-script\") pod \"iptables-alerter-lmjlz\" (UID: \"0995c467-d41c-43e9-ab5a-0609a3a7cf83\") " pod="openshift-network-operator/iptables-alerter-lmjlz"
Nov 03 21:44:26.723806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723527    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-etc-openvswitch\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.723806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723551    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-cni-bin\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.723806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723603    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.723806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723639    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-socket-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.723806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723663    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-cnibin\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.723806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723684    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-txllc"
Nov 03 21:44:26.723806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723697    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/380a7770-3519-404b-927c-dd6754a9ccfb-multus-daemon-config\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.723806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723719    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-node-log\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.723806 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723760    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.724621 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723789    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a1471771-c3a3-4c38-a124-455ab7e5e2d5-ovnkube-script-lib\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.724621 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723811    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-etc-selinux\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.724621 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723837    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-sys-fs\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.724621 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723860    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tftr4\" (UniqueName: \"kubernetes.io/projected/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-kube-api-access-tftr4\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.724621 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723962    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-kubelet\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.724621 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.723988    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-slash\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.724621 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.724014    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-run-systemd\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.724621 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.724038    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-cni-netd\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.724621 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.724060    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1471771-c3a3-4c38-a124-455ab7e5e2d5-ovn-node-metrics-cert\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.726391 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.725964    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.728003 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.727935    2572 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 03 21:44:26.730103 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.730055    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.747357 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.747334    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8d4c5"
Nov 03 21:44:26.762388 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.762364    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8d4c5"
Nov 03 21:44:26.802491 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.802463    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 03 21:44:26.802633 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.802624    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 03 21:44:26.802704 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.802654    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 03 21:44:26.802704 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.802674    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 03 21:44:26.802803 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.802749    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 03 21:44:26.802857 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.802831    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 03 21:44:26.802906 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.802857    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 03 21:44:26.802996 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.802917    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jbpmc\""
Nov 03 21:44:26.803060 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.803022    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 03 21:44:26.803200 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.803163    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 03 21:44:26.803775 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.803755    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 03 21:44:26.803860 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.803839    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 03 21:44:26.803860 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.803847    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 03 21:44:26.803860 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.803847    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 03 21:44:26.803998 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.803956    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lbb62\""
Nov 03 21:44:26.804048 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.804005    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 03 21:44:26.804048 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.804014    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-txfgg\""
Nov 03 21:44:26.804048 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.804011    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 03 21:44:26.804185 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.803958    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fc4bx\""
Nov 03 21:44:26.804185 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.804102    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 03 21:44:26.804185 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.804120    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bc4mv\""
Nov 03 21:44:26.804185 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.804124    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-hgwjm\""
Nov 03 21:44:26.804185 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.804108    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 03 21:44:26.805527 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.805477    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal" event={"ID":"512504a651dea6eb0e990f68b3a9a61c","Type":"ContainerStarted","Data":"205e1a69bc4a13d16b2a19da1e85a0aec68a6cdd415818a444e1abd9d24f94dc"}
Nov 03 21:44:26.807077 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.807012    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal" event={"ID":"e92af9dfcd386af37bd479e7884242eb","Type":"ContainerStarted","Data":"d6a753be9b83bcb04228bfab37ea563efae01bef7cc7b20bea23258f613b96bf"}
Nov 03 21:44:26.814123 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.814104    2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 03 21:44:26.824412 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824387    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a1471771-c3a3-4c38-a124-455ab7e5e2d5-env-overrides\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.824524 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824424    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.824524 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824449    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-var-lib-cni-bin\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.824524 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824472    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-var-lib-kubelet\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.824524 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824494    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-run-multus-certs\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.824793 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824550    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb453169-964e-4e16-a300-a54f2f3e74a2-agent-certs\") pod \"konnectivity-agent-mrf9j\" (UID: \"eb453169-964e-4e16-a300-a54f2f3e74a2\") " pod="kube-system/konnectivity-agent-mrf9j"
Nov 03 21:44:26.824793 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824558    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-var-lib-cni-bin\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.824793 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824568    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-var-lib-kubelet\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.824793 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824558    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.824793 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824573    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb453169-964e-4e16-a300-a54f2f3e74a2-konnectivity-ca\") pod \"konnectivity-agent-mrf9j\" (UID: \"eb453169-964e-4e16-a300-a54f2f3e74a2\") " pod="kube-system/konnectivity-agent-mrf9j"
Nov 03 21:44:26.824793 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824598    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-run-multus-certs\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.824793 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824626    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-run-openvswitch\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.824793 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824654    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a1471771-c3a3-4c38-a124-455ab7e5e2d5-ovnkube-config\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.824793 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824689    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-registration-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.824793 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824701    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-run-openvswitch\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.824793 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824762    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-hostroot\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.824793 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824714    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-hostroot\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.825383 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824801    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0995c467-d41c-43e9-ab5a-0609a3a7cf83-host-slash\") pod \"iptables-alerter-lmjlz\" (UID: \"0995c467-d41c-43e9-ab5a-0609a3a7cf83\") " pod="openshift-network-operator/iptables-alerter-lmjlz"
Nov 03 21:44:26.825383 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824828    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk7lz\" (UniqueName: \"kubernetes.io/projected/0995c467-d41c-43e9-ab5a-0609a3a7cf83-kube-api-access-lk7lz\") pod \"iptables-alerter-lmjlz\" (UID: \"0995c467-d41c-43e9-ab5a-0609a3a7cf83\") " pod="openshift-network-operator/iptables-alerter-lmjlz"
Nov 03 21:44:26.825383 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824855    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw8bb\" (UniqueName: \"kubernetes.io/projected/736d15ff-56b5-40cf-b19a-38564c93d8b2-kube-api-access-bw8bb\") pod \"node-ca-txllc\" (UID: \"736d15ff-56b5-40cf-b19a-38564c93d8b2\") " pod="openshift-image-registry/node-ca-txllc"
Nov 03 21:44:26.825383 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824883    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-sysctl-d\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.825383 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824903    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-systemd\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.825383 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824924    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-dbus\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:26.825383 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824929    2572 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 03 21:44:26.825383 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824950    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-cni-bin\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.825383 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824956    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a1471771-c3a3-4c38-a124-455ab7e5e2d5-env-overrides\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.825383 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824976    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-socket-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.825383 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.824773    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-registration-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.825383 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825010    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3313fc5-6c47-4d16-8289-80b781a413cd-tmp\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.825383 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825056    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-cni-bin\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.825383 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825067    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0995c467-d41c-43e9-ab5a-0609a3a7cf83-host-slash\") pod \"iptables-alerter-lmjlz\" (UID: \"0995c467-d41c-43e9-ab5a-0609a3a7cf83\") " pod="openshift-network-operator/iptables-alerter-lmjlz"
Nov 03 21:44:26.825383 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825099    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/380a7770-3519-404b-927c-dd6754a9ccfb-multus-daemon-config\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.825383 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825128    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a1471771-c3a3-4c38-a124-455ab7e5e2d5-ovnkube-script-lib\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.825383 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825153    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-sys\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.826155 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825173    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-tuned\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.826155 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825197    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72792cfa-71f1-418a-a59d-40d2f5c392d9-system-cni-dir\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.826155 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825234    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb453169-964e-4e16-a300-a54f2f3e74a2-konnectivity-ca\") pod \"konnectivity-agent-mrf9j\" (UID: \"eb453169-964e-4e16-a300-a54f2f3e74a2\") " pod="kube-system/konnectivity-agent-mrf9j"
Nov 03 21:44:26.826155 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825283    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a1471771-c3a3-4c38-a124-455ab7e5e2d5-ovnkube-config\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.826155 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825296    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/72792cfa-71f1-418a-a59d-40d2f5c392d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.826155 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825324    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tkqm\" (UniqueName: \"kubernetes.io/projected/a4982959-0762-44eb-a382-a510881805aa-kube-api-access-9tkqm\") pod \"node-resolver-4jznx\" (UID: \"a4982959-0762-44eb-a382-a510881805aa\") " pod="openshift-dns/node-resolver-4jznx"
Nov 03 21:44:26.826155 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825355    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-run-systemd\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.826155 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825364    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-socket-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.826155 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825395    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-run-systemd\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.826155 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825421    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-cni-netd\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.826155 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825466    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-run-netns\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.826155 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825468    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-cni-netd\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.826155 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825501    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-run-netns\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.826155 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825536    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72792cfa-71f1-418a-a59d-40d2f5c392d9-cnibin\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.826155 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825584    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72792cfa-71f1-418a-a59d-40d2f5c392d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.826155 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825617    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/72792cfa-71f1-418a-a59d-40d2f5c392d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.826155 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825642    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/380a7770-3519-404b-927c-dd6754a9ccfb-cni-binary-copy\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.826976 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825659    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2vxr\" (UniqueName: \"kubernetes.io/projected/380a7770-3519-404b-927c-dd6754a9ccfb-kube-api-access-l2vxr\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.826976 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825681    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-run-ovn\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.826976 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825707    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:26.826976 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825765    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-etc-kubernetes\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.826976 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825793    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgtg6\" (UniqueName: \"kubernetes.io/projected/8915bffd-4628-4aee-994b-81de7d1ad7c6-kube-api-access-zgtg6\") pod \"network-metrics-daemon-kjp2c\" (UID: \"8915bffd-4628-4aee-994b-81de7d1ad7c6\") " pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:26.826976 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825817    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.826976 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825844    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-kubelet-config\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:26.826976 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825864    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4982959-0762-44eb-a382-a510881805aa-tmp-dir\") pod \"node-resolver-4jznx\" (UID: \"a4982959-0762-44eb-a382-a510881805aa\") " pod="openshift-dns/node-resolver-4jznx"
Nov 03 21:44:26.826976 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825880    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-var-lib-openvswitch\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.826976 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825899    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-modprobe-d\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.826976 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825917    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-kubernetes\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.826976 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825978    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-lib-modules\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.826976 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.825994    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-system-cni-dir\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.826976 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826011    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zwtz\" (UniqueName: \"kubernetes.io/projected/a1471771-c3a3-4c38-a124-455ab7e5e2d5-kube-api-access-9zwtz\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.826976 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826037    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-device-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.826976 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826074    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-var-lib-kubelet\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.826976 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826132    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4982959-0762-44eb-a382-a510881805aa-hosts-file\") pod \"node-resolver-4jznx\" (UID: \"a4982959-0762-44eb-a382-a510881805aa\") " pod="openshift-dns/node-resolver-4jznx"
Nov 03 21:44:26.827763 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826157    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-multus-cni-dir\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.827763 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826182    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0995c467-d41c-43e9-ab5a-0609a3a7cf83-iptables-alerter-script\") pod \"iptables-alerter-lmjlz\" (UID: \"0995c467-d41c-43e9-ab5a-0609a3a7cf83\") " pod="openshift-network-operator/iptables-alerter-lmjlz"
Nov 03 21:44:26.827763 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826205    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-etc-openvswitch\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.827763 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826230    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tftr4\" (UniqueName: \"kubernetes.io/projected/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-kube-api-access-tftr4\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.827763 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826265    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.827763 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826270    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/736d15ff-56b5-40cf-b19a-38564c93d8b2-host\") pod \"node-ca-txllc\" (UID: \"736d15ff-56b5-40cf-b19a-38564c93d8b2\") " pod="openshift-image-registry/node-ca-txllc"
Nov 03 21:44:26.827763 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826389    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-system-cni-dir\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.827763 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826404    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-run-ovn\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.827763 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826535    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a1471771-c3a3-4c38-a124-455ab7e5e2d5-ovnkube-script-lib\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.827763 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826572    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-multus-cni-dir\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.827763 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826588    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-etc-kubernetes\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.827763 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826633    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-etc-openvswitch\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.827763 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826681    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-device-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.827763 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826701    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/380a7770-3519-404b-927c-dd6754a9ccfb-multus-daemon-config\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.827763 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826708    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-run\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.827763 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826737    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-var-lib-openvswitch\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.827763 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826810    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/380a7770-3519-404b-927c-dd6754a9ccfb-cni-binary-copy\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.827763 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826843    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-cnibin\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.828487 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826888    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-cnibin\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.828487 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826897    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0995c467-d41c-43e9-ab5a-0609a3a7cf83-iptables-alerter-script\") pod \"iptables-alerter-lmjlz\" (UID: \"0995c467-d41c-43e9-ab5a-0609a3a7cf83\") " pod="openshift-network-operator/iptables-alerter-lmjlz"
Nov 03 21:44:26.828487 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826931    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-node-log\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.828487 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.826991    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-node-log\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.828487 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827030    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.828487 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827074    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.828487 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827107    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-etc-selinux\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.828487 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827140    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-sys-fs\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.828487 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827174    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-kubelet\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.828487 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827205    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-slash\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.828487 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827211    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-sys-fs\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.828487 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827269    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1471771-c3a3-4c38-a124-455ab7e5e2d5-ovn-node-metrics-cert\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.828487 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827278    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-kubelet\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.828487 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827299    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-host\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.828487 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827312    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-slash\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.828487 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827360    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg7z2\" (UniqueName: \"kubernetes.io/projected/e3313fc5-6c47-4d16-8289-80b781a413cd-kube-api-access-wg7z2\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.828487 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827388    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72792cfa-71f1-418a-a59d-40d2f5c392d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.829506 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827413    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-run-k8s-cni-cncf-io\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.829506 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827452    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-systemd-units\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.829506 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827467    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-etc-selinux\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.829506 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827480    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xck8c\" (UniqueName: \"kubernetes.io/projected/72792cfa-71f1-418a-a59d-40d2f5c392d9-kube-api-access-xck8c\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.829506 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827507    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-run-k8s-cni-cncf-io\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.829506 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827508    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-multus-socket-dir-parent\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.829506 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827560    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-multus-socket-dir-parent\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.829506 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827594    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-systemd-units\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.829506 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827633    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-var-lib-cni-multus\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.829506 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827663    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-multus-conf-dir\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.829506 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827690    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/736d15ff-56b5-40cf-b19a-38564c93d8b2-serviceca\") pod \"node-ca-txllc\" (UID: \"736d15ff-56b5-40cf-b19a-38564c93d8b2\") " pod="openshift-image-registry/node-ca-txllc"
Nov 03 21:44:26.829506 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827731    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-sysconfig\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.829506 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827757    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-sysctl-conf\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.829506 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827784    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbs2h\" (UniqueName: \"kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h\") pod \"network-check-target-ztd6j\" (UID: \"7b22f42e-7346-4165-b4ea-99e12837742c\") " pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:26.829506 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827812    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs\") pod \"network-metrics-daemon-kjp2c\" (UID: \"8915bffd-4628-4aee-994b-81de7d1ad7c6\") " pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:26.829506 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:26.827895    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:44:26.829506 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827887    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-var-lib-cni-multus\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.830331 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:26.827984    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs podName:8915bffd-4628-4aee-994b-81de7d1ad7c6 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:27.327953778 +0000 UTC m=+3.034684811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs") pod "network-metrics-daemon-kjp2c" (UID: "8915bffd-4628-4aee-994b-81de7d1ad7c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:44:26.830331 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.827987    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-multus-conf-dir\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.830331 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.828024    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-run-netns\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.830331 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.828062    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-log-socket\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.830331 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.828137    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-log-socket\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.830331 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.828224    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-run-netns\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.831093 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.831037    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb453169-964e-4e16-a300-a54f2f3e74a2-agent-certs\") pod \"konnectivity-agent-mrf9j\" (UID: \"eb453169-964e-4e16-a300-a54f2f3e74a2\") " pod="kube-system/konnectivity-agent-mrf9j"
Nov 03 21:44:26.831093 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.831079    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1471771-c3a3-4c38-a124-455ab7e5e2d5-ovn-node-metrics-cert\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.838048 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.837984    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk7lz\" (UniqueName: \"kubernetes.io/projected/0995c467-d41c-43e9-ab5a-0609a3a7cf83-kube-api-access-lk7lz\") pod \"iptables-alerter-lmjlz\" (UID: \"0995c467-d41c-43e9-ab5a-0609a3a7cf83\") " pod="openshift-network-operator/iptables-alerter-lmjlz"
Nov 03 21:44:26.839212 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.839187    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2vxr\" (UniqueName: \"kubernetes.io/projected/380a7770-3519-404b-927c-dd6754a9ccfb-kube-api-access-l2vxr\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:26.839649 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.839628    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgtg6\" (UniqueName: \"kubernetes.io/projected/8915bffd-4628-4aee-994b-81de7d1ad7c6-kube-api-access-zgtg6\") pod \"network-metrics-daemon-kjp2c\" (UID: \"8915bffd-4628-4aee-994b-81de7d1ad7c6\") " pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:26.839794 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:26.839778    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 21:44:26.839853 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:26.839807    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 21:44:26.839853 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:26.839828    2572 projected.go:196] Error preparing data for projected volume kube-api-access-lbs2h for pod openshift-network-diagnostics/network-check-target-ztd6j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:44:26.839954 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:26.839881    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h podName:7b22f42e-7346-4165-b4ea-99e12837742c nodeName:}" failed. No retries permitted until 2026-11-03 21:44:27.339863963 +0000 UTC m=+3.046595008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lbs2h" (UniqueName: "kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h") pod "network-check-target-ztd6j" (UID: "7b22f42e-7346-4165-b4ea-99e12837742c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:44:26.840434 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.840413    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zwtz\" (UniqueName: \"kubernetes.io/projected/a1471771-c3a3-4c38-a124-455ab7e5e2d5-kube-api-access-9zwtz\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:26.848296 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.848270    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tftr4\" (UniqueName: \"kubernetes.io/projected/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-kube-api-access-tftr4\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:26.931364 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.928570    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:26.931364 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.928616    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-kubelet-config\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:26.931364 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.928642    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4982959-0762-44eb-a382-a510881805aa-tmp-dir\") pod \"node-resolver-4jznx\" (UID: \"a4982959-0762-44eb-a382-a510881805aa\") " pod="openshift-dns/node-resolver-4jznx"
Nov 03 21:44:26.931364 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.928666    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-modprobe-d\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.931364 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.928684    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-kubernetes\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.931364 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.928706    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-lib-modules\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.931364 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.928727    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-var-lib-kubelet\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.931364 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.928741    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4982959-0762-44eb-a382-a510881805aa-hosts-file\") pod \"node-resolver-4jznx\" (UID: \"a4982959-0762-44eb-a382-a510881805aa\") " pod="openshift-dns/node-resolver-4jznx"
Nov 03 21:44:26.931364 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.928760    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/736d15ff-56b5-40cf-b19a-38564c93d8b2-host\") pod \"node-ca-txllc\" (UID: \"736d15ff-56b5-40cf-b19a-38564c93d8b2\") " pod="openshift-image-registry/node-ca-txllc"
Nov 03 21:44:26.931364 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.928778    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-run\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.931364 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.928796    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-host\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.931364 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.928810    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg7z2\" (UniqueName: \"kubernetes.io/projected/e3313fc5-6c47-4d16-8289-80b781a413cd-kube-api-access-wg7z2\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.931364 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.928826    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72792cfa-71f1-418a-a59d-40d2f5c392d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.931364 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.928854    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xck8c\" (UniqueName: \"kubernetes.io/projected/72792cfa-71f1-418a-a59d-40d2f5c392d9-kube-api-access-xck8c\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.931364 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.928881    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/736d15ff-56b5-40cf-b19a-38564c93d8b2-serviceca\") pod \"node-ca-txllc\" (UID: \"736d15ff-56b5-40cf-b19a-38564c93d8b2\") " pod="openshift-image-registry/node-ca-txllc"
Nov 03 21:44:26.931364 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.928902    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-sysconfig\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.931364 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.928916    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-sysctl-conf\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.932161 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.928963    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw8bb\" (UniqueName: \"kubernetes.io/projected/736d15ff-56b5-40cf-b19a-38564c93d8b2-kube-api-access-bw8bb\") pod \"node-ca-txllc\" (UID: \"736d15ff-56b5-40cf-b19a-38564c93d8b2\") " pod="openshift-image-registry/node-ca-txllc"
Nov 03 21:44:26.932161 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.928977    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-sysctl-d\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.932161 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.928990    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-systemd\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.932161 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.929005    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-dbus\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:26.932161 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.929031    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3313fc5-6c47-4d16-8289-80b781a413cd-tmp\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.932161 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.929048    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-sys\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.932161 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.929072    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-tuned\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.932161 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.929096    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72792cfa-71f1-418a-a59d-40d2f5c392d9-system-cni-dir\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.932161 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.929113    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/72792cfa-71f1-418a-a59d-40d2f5c392d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.932161 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.929129    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tkqm\" (UniqueName: \"kubernetes.io/projected/a4982959-0762-44eb-a382-a510881805aa-kube-api-access-9tkqm\") pod \"node-resolver-4jznx\" (UID: \"a4982959-0762-44eb-a382-a510881805aa\") " pod="openshift-dns/node-resolver-4jznx"
Nov 03 21:44:26.932161 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.929156    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72792cfa-71f1-418a-a59d-40d2f5c392d9-cnibin\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.932161 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.929232    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72792cfa-71f1-418a-a59d-40d2f5c392d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.932161 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.929275    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/72792cfa-71f1-418a-a59d-40d2f5c392d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.932161 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.930042    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/72792cfa-71f1-418a-a59d-40d2f5c392d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.932161 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:26.930166    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 21:44:26.932161 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:26.930232    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret podName:7b1bc67e-f876-4fec-b9bf-a3a8906d8d94 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:27.430216159 +0000 UTC m=+3.136947202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret") pod "global-pull-secret-syncer-dndpk" (UID: "7b1bc67e-f876-4fec-b9bf-a3a8906d8d94") : object "kube-system"/"original-pull-secret" not registered
Nov 03 21:44:26.932161 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.930326    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/736d15ff-56b5-40cf-b19a-38564c93d8b2-host\") pod \"node-ca-txllc\" (UID: \"736d15ff-56b5-40cf-b19a-38564c93d8b2\") " pod="openshift-image-registry/node-ca-txllc"
Nov 03 21:44:26.933073 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.930341    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4982959-0762-44eb-a382-a510881805aa-hosts-file\") pod \"node-resolver-4jznx\" (UID: \"a4982959-0762-44eb-a382-a510881805aa\") " pod="openshift-dns/node-resolver-4jznx"
Nov 03 21:44:26.933073 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.930398    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-var-lib-kubelet\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.933073 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.930408    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-run\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.933073 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.930473    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-host\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.933073 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.930520    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-lib-modules\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.933073 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.930526    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-kubelet-config\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:26.933073 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.930825    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4982959-0762-44eb-a382-a510881805aa-tmp-dir\") pod \"node-resolver-4jznx\" (UID: \"a4982959-0762-44eb-a382-a510881805aa\") " pod="openshift-dns/node-resolver-4jznx"
Nov 03 21:44:26.933073 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.930921    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-modprobe-d\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.933073 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.930949    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72792cfa-71f1-418a-a59d-40d2f5c392d9-system-cni-dir\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.933073 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.930418    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-kubernetes\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.933073 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.931016    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/736d15ff-56b5-40cf-b19a-38564c93d8b2-serviceca\") pod \"node-ca-txllc\" (UID: \"736d15ff-56b5-40cf-b19a-38564c93d8b2\") " pod="openshift-image-registry/node-ca-txllc"
Nov 03 21:44:26.933073 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.931019    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-sysconfig\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.933073 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.931119    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-sysctl-d\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.933073 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.931126    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-sysctl-conf\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.933073 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.931119    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72792cfa-71f1-418a-a59d-40d2f5c392d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.933073 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.931185    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-systemd\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.933073 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.931228    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-dbus\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:26.933073 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.931279    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72792cfa-71f1-418a-a59d-40d2f5c392d9-cnibin\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.934429 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.931402    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-sys\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.934429 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.933717    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72792cfa-71f1-418a-a59d-40d2f5c392d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.934429 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.933749    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3313fc5-6c47-4d16-8289-80b781a413cd-tmp\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.934429 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.933790    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-tuned\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.934429 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.933835    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/72792cfa-71f1-418a-a59d-40d2f5c392d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.943404 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.943380    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg7z2\" (UniqueName: \"kubernetes.io/projected/e3313fc5-6c47-4d16-8289-80b781a413cd-kube-api-access-wg7z2\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:26.943521 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.943414    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xck8c\" (UniqueName: \"kubernetes.io/projected/72792cfa-71f1-418a-a59d-40d2f5c392d9-kube-api-access-xck8c\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:26.943955 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.943931    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw8bb\" (UniqueName: \"kubernetes.io/projected/736d15ff-56b5-40cf-b19a-38564c93d8b2-kube-api-access-bw8bb\") pod \"node-ca-txllc\" (UID: \"736d15ff-56b5-40cf-b19a-38564c93d8b2\") " pod="openshift-image-registry/node-ca-txllc"
Nov 03 21:44:26.944667 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:26.944649    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tkqm\" (UniqueName: \"kubernetes.io/projected/a4982959-0762-44eb-a382-a510881805aa-kube-api-access-9tkqm\") pod \"node-resolver-4jznx\" (UID: \"a4982959-0762-44eb-a382-a510881805aa\") " pod="openshift-dns/node-resolver-4jznx"
Nov 03 21:44:27.014239 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.014166    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pg6ql"
Nov 03 21:44:27.025366 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:27.025333    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod380a7770_3519_404b_927c_dd6754a9ccfb.slice/crio-6dfd29e14aaaf59752e08786e0371aaa8b47fb230cc545c494f15a097f6122ef WatchSource:0}: Error finding container 6dfd29e14aaaf59752e08786e0371aaa8b47fb230cc545c494f15a097f6122ef: Status 404 returned error can't find the container with id 6dfd29e14aaaf59752e08786e0371aaa8b47fb230cc545c494f15a097f6122ef
Nov 03 21:44:27.043593 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.043570    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:27.047307 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.047259    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mrf9j"
Nov 03 21:44:27.047372 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.047319    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:44:27.049639 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.049624    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lmjlz"
Nov 03 21:44:27.054354 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:27.054328    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1471771_c3a3_4c38_a124_455ab7e5e2d5.slice/crio-ac45b1452a5a2eab5e649027acd1beaa6c94881f56387773cc7ddafee57da38b WatchSource:0}: Error finding container ac45b1452a5a2eab5e649027acd1beaa6c94881f56387773cc7ddafee57da38b: Status 404 returned error can't find the container with id ac45b1452a5a2eab5e649027acd1beaa6c94881f56387773cc7ddafee57da38b
Nov 03 21:44:27.057143 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.057005    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4jznx"
Nov 03 21:44:27.059194 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:27.059164    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb453169_964e_4e16_a300_a54f2f3e74a2.slice/crio-991829626d8cb2c44828df6a0be61b9f870c53505c6e9f498713a9635bb625f2 WatchSource:0}: Error finding container 991829626d8cb2c44828df6a0be61b9f870c53505c6e9f498713a9635bb625f2: Status 404 returned error can't find the container with id 991829626d8cb2c44828df6a0be61b9f870c53505c6e9f498713a9635bb625f2
Nov 03 21:44:27.066230 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:27.066200    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2abaabbc_57ab_4afa_99f5_17eaeb9c23b8.slice/crio-7ec0d5932964902f8592b5884502ede39045faffa102a8d95108b66192b66469 WatchSource:0}: Error finding container 7ec0d5932964902f8592b5884502ede39045faffa102a8d95108b66192b66469: Status 404 returned error can't find the container with id 7ec0d5932964902f8592b5884502ede39045faffa102a8d95108b66192b66469
Nov 03 21:44:27.067525 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:27.067488    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0995c467_d41c_43e9_ab5a_0609a3a7cf83.slice/crio-44d234fd81d474c08f6af409d87ab4f9aac197d382658f93682aef15ef4a8600 WatchSource:0}: Error finding container 44d234fd81d474c08f6af409d87ab4f9aac197d382658f93682aef15ef4a8600: Status 404 returned error can't find the container with id 44d234fd81d474c08f6af409d87ab4f9aac197d382658f93682aef15ef4a8600
Nov 03 21:44:27.072719 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.072615    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-txllc"
Nov 03 21:44:27.082338 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.082313    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:44:27.084199 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:27.084027    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod736d15ff_56b5_40cf_b19a_38564c93d8b2.slice/crio-173fe4f979fb91439e66255672f886b5aacc3cdce09b2be43b40f92c4883a9e4 WatchSource:0}: Error finding container 173fe4f979fb91439e66255672f886b5aacc3cdce09b2be43b40f92c4883a9e4: Status 404 returned error can't find the container with id 173fe4f979fb91439e66255672f886b5aacc3cdce09b2be43b40f92c4883a9e4
Nov 03 21:44:27.092998 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:27.092972    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3313fc5_6c47_4d16_8289_80b781a413cd.slice/crio-6077fac045a4ac0b9563983d382dca3e9d84d3a5e0fe3b11b4e8bb84e212b8f5 WatchSource:0}: Error finding container 6077fac045a4ac0b9563983d382dca3e9d84d3a5e0fe3b11b4e8bb84e212b8f5: Status 404 returned error can't find the container with id 6077fac045a4ac0b9563983d382dca3e9d84d3a5e0fe3b11b4e8bb84e212b8f5
Nov 03 21:44:27.100620 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.100163    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:44:27.111904 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:27.111876    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72792cfa_71f1_418a_a59d_40d2f5c392d9.slice/crio-b357a98f35b01ad756fbc6711ceb483c4111b17c28cd2d862cbdc24216acac69 WatchSource:0}: Error finding container b357a98f35b01ad756fbc6711ceb483c4111b17c28cd2d862cbdc24216acac69: Status 404 returned error can't find the container with id b357a98f35b01ad756fbc6711ceb483c4111b17c28cd2d862cbdc24216acac69
Nov 03 21:44:27.333171 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.333085    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs\") pod \"network-metrics-daemon-kjp2c\" (UID: \"8915bffd-4628-4aee-994b-81de7d1ad7c6\") " pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:27.333337 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:27.333284    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:44:27.333460 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:27.333361    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs podName:8915bffd-4628-4aee-994b-81de7d1ad7c6 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:28.33334161 +0000 UTC m=+4.040072648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs") pod "network-metrics-daemon-kjp2c" (UID: "8915bffd-4628-4aee-994b-81de7d1ad7c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:44:27.434079 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.434046    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:27.434259 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.434113    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbs2h\" (UniqueName: \"kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h\") pod \"network-check-target-ztd6j\" (UID: \"7b22f42e-7346-4165-b4ea-99e12837742c\") " pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:27.434259 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:27.434213    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 21:44:27.434259 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:27.434227    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 21:44:27.434422 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:27.434267    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 21:44:27.434422 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:27.434282    2572 projected.go:196] Error preparing data for projected volume kube-api-access-lbs2h for pod openshift-network-diagnostics/network-check-target-ztd6j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:44:27.434422 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:27.434303    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret podName:7b1bc67e-f876-4fec-b9bf-a3a8906d8d94 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:28.434284293 +0000 UTC m=+4.141015322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret") pod "global-pull-secret-syncer-dndpk" (UID: "7b1bc67e-f876-4fec-b9bf-a3a8906d8d94") : object "kube-system"/"original-pull-secret" not registered
Nov 03 21:44:27.434422 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:27.434332    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h podName:7b22f42e-7346-4165-b4ea-99e12837742c nodeName:}" failed. No retries permitted until 2026-11-03 21:44:28.434316543 +0000 UTC m=+4.141047586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbs2h" (UniqueName: "kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h") pod "network-check-target-ztd6j" (UID: "7b22f42e-7346-4165-b4ea-99e12837742c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:44:27.789431 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.789366    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 21:39:26 +0000 UTC" deadline="2028-06-02 21:57:05.285796258 +0000 UTC"
Nov 03 21:44:27.789431 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.789428    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13848h12m37.496371739s"
Nov 03 21:44:27.822273 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.821755    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4jznx" event={"ID":"a4982959-0762-44eb-a382-a510881805aa","Type":"ContainerStarted","Data":"d46b9b62e9ba891ea3ab09a9892a0bfe4d24944e784ca0f93a59719f7d06553b"}
Nov 03 21:44:27.828225 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.828194    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd" event={"ID":"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8","Type":"ContainerStarted","Data":"7ec0d5932964902f8592b5884502ede39045faffa102a8d95108b66192b66469"}
Nov 03 21:44:27.836936 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.836903    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mrf9j" event={"ID":"eb453169-964e-4e16-a300-a54f2f3e74a2","Type":"ContainerStarted","Data":"991829626d8cb2c44828df6a0be61b9f870c53505c6e9f498713a9635bb625f2"}
Nov 03 21:44:27.838637 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.838611    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pg6ql" event={"ID":"380a7770-3519-404b-927c-dd6754a9ccfb","Type":"ContainerStarted","Data":"6dfd29e14aaaf59752e08786e0371aaa8b47fb230cc545c494f15a097f6122ef"}
Nov 03 21:44:27.841476 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.841447    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r964d" event={"ID":"72792cfa-71f1-418a-a59d-40d2f5c392d9","Type":"ContainerStarted","Data":"b357a98f35b01ad756fbc6711ceb483c4111b17c28cd2d862cbdc24216acac69"}
Nov 03 21:44:27.849323 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.849219    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-85lqj" event={"ID":"e3313fc5-6c47-4d16-8289-80b781a413cd","Type":"ContainerStarted","Data":"6077fac045a4ac0b9563983d382dca3e9d84d3a5e0fe3b11b4e8bb84e212b8f5"}
Nov 03 21:44:27.853426 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.853347    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lmjlz" event={"ID":"0995c467-d41c-43e9-ab5a-0609a3a7cf83","Type":"ContainerStarted","Data":"44d234fd81d474c08f6af409d87ab4f9aac197d382658f93682aef15ef4a8600"}
Nov 03 21:44:27.869268 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.869162    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l" event={"ID":"a1471771-c3a3-4c38-a124-455ab7e5e2d5","Type":"ContainerStarted","Data":"ac45b1452a5a2eab5e649027acd1beaa6c94881f56387773cc7ddafee57da38b"}
Nov 03 21:44:27.872216 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:27.872192    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-txllc" event={"ID":"736d15ff-56b5-40cf-b19a-38564c93d8b2","Type":"ContainerStarted","Data":"173fe4f979fb91439e66255672f886b5aacc3cdce09b2be43b40f92c4883a9e4"}
Nov 03 21:44:28.343466 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:28.342682    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs\") pod \"network-metrics-daemon-kjp2c\" (UID: \"8915bffd-4628-4aee-994b-81de7d1ad7c6\") " pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:28.343466 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:28.342898    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:44:28.343466 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:28.343080    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs podName:8915bffd-4628-4aee-994b-81de7d1ad7c6 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:30.343059798 +0000 UTC m=+6.049790829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs") pod "network-metrics-daemon-kjp2c" (UID: "8915bffd-4628-4aee-994b-81de7d1ad7c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:44:28.443548 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:28.443512    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbs2h\" (UniqueName: \"kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h\") pod \"network-check-target-ztd6j\" (UID: \"7b22f42e-7346-4165-b4ea-99e12837742c\") " pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:28.443700 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:28.443590    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:28.443771 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:28.443705    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 21:44:28.443771 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:28.443765    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret podName:7b1bc67e-f876-4fec-b9bf-a3a8906d8d94 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:30.443748382 +0000 UTC m=+6.150479431 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret") pod "global-pull-secret-syncer-dndpk" (UID: "7b1bc67e-f876-4fec-b9bf-a3a8906d8d94") : object "kube-system"/"original-pull-secret" not registered
Nov 03 21:44:28.444186 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:28.444145    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 21:44:28.444297 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:28.444191    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 21:44:28.444297 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:28.444205    2572 projected.go:196] Error preparing data for projected volume kube-api-access-lbs2h for pod openshift-network-diagnostics/network-check-target-ztd6j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:44:28.444297 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:28.444270    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h podName:7b22f42e-7346-4165-b4ea-99e12837742c nodeName:}" failed. No retries permitted until 2026-11-03 21:44:30.444236401 +0000 UTC m=+6.150967438 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbs2h" (UniqueName: "kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h") pod "network-check-target-ztd6j" (UID: "7b22f42e-7346-4165-b4ea-99e12837742c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:44:28.790151 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:28.790054    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 21:39:26 +0000 UTC" deadline="2028-06-14 14:36:22.629649424 +0000 UTC"
Nov 03 21:44:28.790151 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:28.790098    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14128h51m53.839556446s"
Nov 03 21:44:28.802543 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:28.800714    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:28.802543 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:28.800840    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd6j" podUID="7b22f42e-7346-4165-b4ea-99e12837742c"
Nov 03 21:44:28.802543 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:28.801363    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:28.802543 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:28.801471    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kjp2c" podUID="8915bffd-4628-4aee-994b-81de7d1ad7c6"
Nov 03 21:44:28.802543 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:28.801539    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:28.802543 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:28.801616    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dndpk" podUID="7b1bc67e-f876-4fec-b9bf-a3a8906d8d94"
Nov 03 21:44:28.883462 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:28.883370    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal" event={"ID":"512504a651dea6eb0e990f68b3a9a61c","Type":"ContainerStarted","Data":"32e24c180649443814862e95290bce7c396284b46eeb4c86e60c7121df7ae71e"}
Nov 03 21:44:28.899263 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:28.899209    2572 generic.go:356] "Generic (PLEG): container finished" podID="e92af9dfcd386af37bd479e7884242eb" containerID="7f84e556692c0ccc33ce4901d9b007481bc7537533cb10359d70e320d905964f" exitCode=0
Nov 03 21:44:28.899432 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:28.899289    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal" event={"ID":"e92af9dfcd386af37bd479e7884242eb","Type":"ContainerDied","Data":"7f84e556692c0ccc33ce4901d9b007481bc7537533cb10359d70e320d905964f"}
Nov 03 21:44:28.902775 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:28.902723    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal" podStartSLOduration=3.90270587 podStartE2EDuration="3.90270587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:44:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:44:28.901363766 +0000 UTC m=+4.608094819" watchObservedRunningTime="2026-11-03 21:44:28.90270587 +0000 UTC m=+4.609436952"
Nov 03 21:44:29.909018 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:29.908980    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal" event={"ID":"e92af9dfcd386af37bd479e7884242eb","Type":"ContainerStarted","Data":"03fdb0069b9b8d3c9d8ff6aa6196354aaed3dc680a9cd807707b4aff6aadaeff"}
Nov 03 21:44:30.359849 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:30.359768    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs\") pod \"network-metrics-daemon-kjp2c\" (UID: \"8915bffd-4628-4aee-994b-81de7d1ad7c6\") " pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:30.360034 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:30.359941    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:44:30.360034 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:30.360021    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs podName:8915bffd-4628-4aee-994b-81de7d1ad7c6 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:34.360001071 +0000 UTC m=+10.066732108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs") pod "network-metrics-daemon-kjp2c" (UID: "8915bffd-4628-4aee-994b-81de7d1ad7c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:44:30.460267 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:30.460160    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:30.460485 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:30.460302    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbs2h\" (UniqueName: \"kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h\") pod \"network-check-target-ztd6j\" (UID: \"7b22f42e-7346-4165-b4ea-99e12837742c\") " pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:30.460584 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:30.460485    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 21:44:30.460584 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:30.460508    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 21:44:30.460584 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:30.460523    2572 projected.go:196] Error preparing data for projected volume kube-api-access-lbs2h for pod openshift-network-diagnostics/network-check-target-ztd6j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:44:30.460755 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:30.460595    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h podName:7b22f42e-7346-4165-b4ea-99e12837742c nodeName:}" failed. No retries permitted until 2026-11-03 21:44:34.460576357 +0000 UTC m=+10.167307389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbs2h" (UniqueName: "kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h") pod "network-check-target-ztd6j" (UID: "7b22f42e-7346-4165-b4ea-99e12837742c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:44:30.461051 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:30.461018    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 21:44:30.461148 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:30.461076    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret podName:7b1bc67e-f876-4fec-b9bf-a3a8906d8d94 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:34.46106139 +0000 UTC m=+10.167792439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret") pod "global-pull-secret-syncer-dndpk" (UID: "7b1bc67e-f876-4fec-b9bf-a3a8906d8d94") : object "kube-system"/"original-pull-secret" not registered
Nov 03 21:44:30.801006 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:30.800932    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:30.801312 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:30.801058    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kjp2c" podUID="8915bffd-4628-4aee-994b-81de7d1ad7c6"
Nov 03 21:44:30.801494 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:30.801475    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:30.801494 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:30.801487    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:30.801631 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:30.801589    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dndpk" podUID="7b1bc67e-f876-4fec-b9bf-a3a8906d8d94"
Nov 03 21:44:30.801814 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:30.801674    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd6j" podUID="7b22f42e-7346-4165-b4ea-99e12837742c"
Nov 03 21:44:30.918122 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:30.918088    2572 generic.go:356] "Generic (PLEG): container finished" podID="72792cfa-71f1-418a-a59d-40d2f5c392d9" containerID="1f03e6704625f5b176f74d5a407974a6232a2406cb65f02d9cdf47d5f29939f8" exitCode=0
Nov 03 21:44:30.919298 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:30.919221    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r964d" event={"ID":"72792cfa-71f1-418a-a59d-40d2f5c392d9","Type":"ContainerDied","Data":"1f03e6704625f5b176f74d5a407974a6232a2406cb65f02d9cdf47d5f29939f8"}
Nov 03 21:44:30.946340 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:30.946282    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal" podStartSLOduration=5.94626276 podStartE2EDuration="5.94626276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:44:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:44:29.927923895 +0000 UTC m=+5.634654954" watchObservedRunningTime="2026-11-03 21:44:30.94626276 +0000 UTC m=+6.652993810"
Nov 03 21:44:31.929453 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:31.929413    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mrf9j" event={"ID":"eb453169-964e-4e16-a300-a54f2f3e74a2","Type":"ContainerStarted","Data":"ecc460b41c8cc418ae65a9cdb9bbfdae5b5716cb538297ba5781fa80b0a0d2d2"}
Nov 03 21:44:31.947690 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:31.947632    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mrf9j" podStartSLOduration=3.100680328 podStartE2EDuration="6.947614609s" totalImagesPullingTime="3.846934281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:44:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:44:31.947499597 +0000 UTC m=+7.654230649" watchObservedRunningTime="2026-11-03 21:44:31.947614609 +0000 UTC m=+7.654345668"
Nov 03 21:44:32.801314 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:32.801259    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:32.801557 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:32.801388    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd6j" podUID="7b22f42e-7346-4165-b4ea-99e12837742c"
Nov 03 21:44:32.801557 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:32.801459    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:32.801557 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:32.801543    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kjp2c" podUID="8915bffd-4628-4aee-994b-81de7d1ad7c6"
Nov 03 21:44:32.801678 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:32.801607    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:32.801678 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:32.801654    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dndpk" podUID="7b1bc67e-f876-4fec-b9bf-a3a8906d8d94"
Nov 03 21:44:32.936418 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:32.936376    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-txllc" event={"ID":"736d15ff-56b5-40cf-b19a-38564c93d8b2","Type":"ContainerStarted","Data":"4d05d627e98a751410ddda0b83342d06f397ef201c64515f4dcb0d57dba8e013"}
Nov 03 21:44:33.259489 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:33.259400    2572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mrf9j"
Nov 03 21:44:33.259933 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:33.259912    2572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mrf9j"
Nov 03 21:44:33.278523 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:33.278469    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-txllc" podStartSLOduration=3.221604159 podStartE2EDuration="8.278452404s" totalImagesPullingTime="5.056848245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:44:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:44:32.954548583 +0000 UTC m=+8.661279659" watchObservedRunningTime="2026-11-03 21:44:33.278452404 +0000 UTC m=+8.985183458"
Nov 03 21:44:33.940482 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:33.940448    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd" event={"ID":"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8","Type":"ContainerStarted","Data":"632ce7c8fd2355ec82fb6cf5baadfacd198661074e88a1f40647d0c1ba5d3451"}
Nov 03 21:44:33.940982 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:33.940789    2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mrf9j"
Nov 03 21:44:33.941329 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:33.941309    2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mrf9j"
Nov 03 21:44:34.399841 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:34.399374    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs\") pod \"network-metrics-daemon-kjp2c\" (UID: \"8915bffd-4628-4aee-994b-81de7d1ad7c6\") " pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:34.399841 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:34.399548    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:44:34.399841 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:34.399618    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs podName:8915bffd-4628-4aee-994b-81de7d1ad7c6 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:42.399598872 +0000 UTC m=+18.106329924 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs") pod "network-metrics-daemon-kjp2c" (UID: "8915bffd-4628-4aee-994b-81de7d1ad7c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:44:34.500637 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:34.500607    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbs2h\" (UniqueName: \"kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h\") pod \"network-check-target-ztd6j\" (UID: \"7b22f42e-7346-4165-b4ea-99e12837742c\") " pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:34.500796 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:34.500671    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:34.500796 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:34.500792    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 21:44:34.500916 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:34.500846    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret podName:7b1bc67e-f876-4fec-b9bf-a3a8906d8d94 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:42.500827813 +0000 UTC m=+18.207558859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret") pod "global-pull-secret-syncer-dndpk" (UID: "7b1bc67e-f876-4fec-b9bf-a3a8906d8d94") : object "kube-system"/"original-pull-secret" not registered
Nov 03 21:44:34.501239 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:34.501221    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 21:44:34.501324 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:34.501263    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 21:44:34.501324 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:34.501277    2572 projected.go:196] Error preparing data for projected volume kube-api-access-lbs2h for pod openshift-network-diagnostics/network-check-target-ztd6j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:44:34.501424 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:34.501326    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h podName:7b22f42e-7346-4165-b4ea-99e12837742c nodeName:}" failed. No retries permitted until 2026-11-03 21:44:42.501311079 +0000 UTC m=+18.208042123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbs2h" (UniqueName: "kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h") pod "network-check-target-ztd6j" (UID: "7b22f42e-7346-4165-b4ea-99e12837742c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:44:34.797847 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:34.797825    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:34.797976 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:34.797917    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kjp2c" podUID="8915bffd-4628-4aee-994b-81de7d1ad7c6"
Nov 03 21:44:34.797976 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:34.797952    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:34.798103 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:34.798017    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dndpk" podUID="7b1bc67e-f876-4fec-b9bf-a3a8906d8d94"
Nov 03 21:44:34.798103 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:34.798064    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:34.798210 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:34.798130    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd6j" podUID="7b22f42e-7346-4165-b4ea-99e12837742c"
Nov 03 21:44:34.948576 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:34.948495    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pg6ql" event={"ID":"380a7770-3519-404b-927c-dd6754a9ccfb","Type":"ContainerStarted","Data":"7c7ef2b3abfcdbe309d3ffecbf4bfcd000ee9763834b3c70459e61839ea80075"}
Nov 03 21:44:34.970688 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:34.970627    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-pg6ql" podStartSLOduration=3.315907943 podStartE2EDuration="10.970610444s" totalImagesPullingTime="7.654702501s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:44:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:44:34.970428249 +0000 UTC m=+10.677159299" watchObservedRunningTime="2026-11-03 21:44:34.970610444 +0000 UTC m=+10.677341515"
Nov 03 21:44:35.059525 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:35.059464    2572 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 03 21:44:35.797097 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:35.796973    2572 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-03T21:44:35.059481187Z","UUID":"63703f58-bb51-4bfe-8a64-dc47ada2ed13","Handler":null,"Name":"","Endpoint":""}
Nov 03 21:44:35.799128 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:35.798726    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 03 21:44:35.799128 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:35.798756    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 03 21:44:35.954306 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:35.954041    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4jznx" event={"ID":"a4982959-0762-44eb-a382-a510881805aa","Type":"ContainerStarted","Data":"61b6db839c5979cb3b6be87a881aad96d0cb1718e77396618ab05b1649005d93"}
Nov 03 21:44:35.958849 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:35.958817    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd" event={"ID":"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8","Type":"ContainerStarted","Data":"7271e26b2c7f7562769d4c368387a70d3481f34608ba3e91a61172e7bdbcc991"}
Nov 03 21:44:35.961978 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:35.961456    2572 generic.go:356] "Generic (PLEG): container finished" podID="72792cfa-71f1-418a-a59d-40d2f5c392d9" containerID="11903edfba14c5d2af2015adf7b48fde9c3442dcf6a91bdb69c1e4f01f77e78c" exitCode=0
Nov 03 21:44:35.961978 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:35.961538    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r964d" event={"ID":"72792cfa-71f1-418a-a59d-40d2f5c392d9","Type":"ContainerDied","Data":"11903edfba14c5d2af2015adf7b48fde9c3442dcf6a91bdb69c1e4f01f77e78c"}
Nov 03 21:44:35.998835 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:35.998792    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-4jznx" podStartSLOduration=3.090593354 podStartE2EDuration="10.998777412s" totalImagesPullingTime="7.908184058s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:44:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:44:35.973334792 +0000 UTC m=+11.680065845" watchObservedRunningTime="2026-11-03 21:44:35.998777412 +0000 UTC m=+11.705508464"
Nov 03 21:44:36.802472 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:36.802005    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:36.802472 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:36.802049    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:36.802472 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:36.802131    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dndpk" podUID="7b1bc67e-f876-4fec-b9bf-a3a8906d8d94"
Nov 03 21:44:36.802472 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:36.802205    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:36.802472 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:36.802333    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kjp2c" podUID="8915bffd-4628-4aee-994b-81de7d1ad7c6"
Nov 03 21:44:36.802472 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:36.802405    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd6j" podUID="7b22f42e-7346-4165-b4ea-99e12837742c"
Nov 03 21:44:36.967228 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:36.967149    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd" event={"ID":"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8","Type":"ContainerStarted","Data":"0205d48d4ce03efa21c17c10a4d7707198f536c98c2eae95caf585c571f8d943"}
Nov 03 21:44:36.988994 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:36.988928    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd" podStartSLOduration=3.316613992 podStartE2EDuration="11.988909222s" totalImagesPullingTime="8.67229523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:44:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:44:36.988473592 +0000 UTC m=+12.695204645" watchObservedRunningTime="2026-11-03 21:44:36.988909222 +0000 UTC m=+12.695640276"
Nov 03 21:44:37.971207 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:37.971162    2572 generic.go:356] "Generic (PLEG): container finished" podID="72792cfa-71f1-418a-a59d-40d2f5c392d9" containerID="1c373587a4d8c7e2829315cc8a2aec531c5dc6be4802fd862ec257008ab52a14" exitCode=0
Nov 03 21:44:37.971783 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:37.971273    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r964d" event={"ID":"72792cfa-71f1-418a-a59d-40d2f5c392d9","Type":"ContainerDied","Data":"1c373587a4d8c7e2829315cc8a2aec531c5dc6be4802fd862ec257008ab52a14"}
Nov 03 21:44:37.973190 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:37.973098    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-85lqj" event={"ID":"e3313fc5-6c47-4d16-8289-80b781a413cd","Type":"ContainerStarted","Data":"d9a7e1dfa4640200c34db86943413b8e3f76fe5f5c361682196a9737db7e96aa"}
Nov 03 21:44:37.974869 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:37.974847    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lmjlz" event={"ID":"0995c467-d41c-43e9-ab5a-0609a3a7cf83","Type":"ContainerStarted","Data":"4817e1c69b9ad30f98dcc5a117d60df9d49362fc8b8d8fe3f5fc0362422964aa"}
Nov 03 21:44:38.016112 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:38.016055    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-85lqj" podStartSLOduration=2.625575655 podStartE2EDuration="13.016037548s" totalImagesPullingTime="10.390461893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:44:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:44:38.015462336 +0000 UTC m=+13.722193388" watchObservedRunningTime="2026-11-03 21:44:38.016037548 +0000 UTC m=+13.722768602"
Nov 03 21:44:38.032163 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:38.032115    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lmjlz" podStartSLOduration=4.172875845 podStartE2EDuration="13.032100069s" totalImagesPullingTime="8.859224224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:44:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:44:38.03135606 +0000 UTC m=+13.738087114" watchObservedRunningTime="2026-11-03 21:44:38.032100069 +0000 UTC m=+13.738831122"
Nov 03 21:44:38.801951 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:38.801462    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:38.801951 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:38.801492    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:38.801951 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:38.801631    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dndpk" podUID="7b1bc67e-f876-4fec-b9bf-a3a8906d8d94"
Nov 03 21:44:38.801951 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:38.801679    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:38.801951 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:38.801793    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd6j" podUID="7b22f42e-7346-4165-b4ea-99e12837742c"
Nov 03 21:44:38.801951 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:38.801859    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kjp2c" podUID="8915bffd-4628-4aee-994b-81de7d1ad7c6"
Nov 03 21:44:39.981488 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:39.981448    2572 generic.go:356] "Generic (PLEG): container finished" podID="72792cfa-71f1-418a-a59d-40d2f5c392d9" containerID="321b993df7344145bf05d37dd4c63329e20dae4abc918f4537962b1f8d429c98" exitCode=0
Nov 03 21:44:39.982231 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:39.981514    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r964d" event={"ID":"72792cfa-71f1-418a-a59d-40d2f5c392d9","Type":"ContainerDied","Data":"321b993df7344145bf05d37dd4c63329e20dae4abc918f4537962b1f8d429c98"}
Nov 03 21:44:40.798221 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:40.798184    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:40.798434 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:40.798337    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dndpk" podUID="7b1bc67e-f876-4fec-b9bf-a3a8906d8d94"
Nov 03 21:44:40.798724 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:40.798703    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:40.798823 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:40.798802    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd6j" podUID="7b22f42e-7346-4165-b4ea-99e12837742c"
Nov 03 21:44:40.798901 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:40.798877    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:40.798986 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:40.798972    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kjp2c" podUID="8915bffd-4628-4aee-994b-81de7d1ad7c6"
Nov 03 21:44:41.989384 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:41.988950    2572 generic.go:356] "Generic (PLEG): container finished" podID="72792cfa-71f1-418a-a59d-40d2f5c392d9" containerID="802ba13bce7c87616ccaa01536319df20bf2f3734cde0288aa14f6bcb92a8780" exitCode=0
Nov 03 21:44:41.989829 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:41.989023    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r964d" event={"ID":"72792cfa-71f1-418a-a59d-40d2f5c392d9","Type":"ContainerDied","Data":"802ba13bce7c87616ccaa01536319df20bf2f3734cde0288aa14f6bcb92a8780"}
Nov 03 21:44:41.992539 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:41.992482    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l" event={"ID":"a1471771-c3a3-4c38-a124-455ab7e5e2d5","Type":"ContainerStarted","Data":"d91f2505934254d0c3cb050ec25e120b0ae061b62cee95f471886d21c4528239"}
Nov 03 21:44:41.992635 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:41.992572    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l" event={"ID":"a1471771-c3a3-4c38-a124-455ab7e5e2d5","Type":"ContainerStarted","Data":"7b88e361aafc1c02d9b44cb6ccaec9285787e0ed991e257fbbf5c4127e7f167c"}
Nov 03 21:44:41.992635 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:41.992622    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l" event={"ID":"a1471771-c3a3-4c38-a124-455ab7e5e2d5","Type":"ContainerStarted","Data":"96790b4264c1bdb0f66cbe11052fbd27ab8299ac063249b0f4afd731e9297c85"}
Nov 03 21:44:41.992693 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:41.992665    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l" event={"ID":"a1471771-c3a3-4c38-a124-455ab7e5e2d5","Type":"ContainerStarted","Data":"a163c50b992b17803265c4c110ac7f2147539addcdb2fcf99cad615817b5c52e"}
Nov 03 21:44:41.992721 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:41.992705    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l" event={"ID":"a1471771-c3a3-4c38-a124-455ab7e5e2d5","Type":"ContainerStarted","Data":"0aa27191815aed995f2c8bf6885c8c9842336b48fd1bdd44314540d909a91bab"}
Nov 03 21:44:41.992760 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:41.992748    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l" event={"ID":"a1471771-c3a3-4c38-a124-455ab7e5e2d5","Type":"ContainerStarted","Data":"849c72614ab1cd47a3584a2e5edba08c0299c79f83669d67e2d33b0085ea6869"}
Nov 03 21:44:42.462651 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:42.462613    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs\") pod \"network-metrics-daemon-kjp2c\" (UID: \"8915bffd-4628-4aee-994b-81de7d1ad7c6\") " pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:42.462793 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:42.462734    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:44:42.462793 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:42.462789    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs podName:8915bffd-4628-4aee-994b-81de7d1ad7c6 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:58.462777012 +0000 UTC m=+34.169508054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs") pod "network-metrics-daemon-kjp2c" (UID: "8915bffd-4628-4aee-994b-81de7d1ad7c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:44:42.563116 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:42.563088    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:42.563285 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:42.563129    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbs2h\" (UniqueName: \"kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h\") pod \"network-check-target-ztd6j\" (UID: \"7b22f42e-7346-4165-b4ea-99e12837742c\") " pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:42.563285 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:42.563218    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 21:44:42.563285 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:42.563228    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 21:44:42.563285 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:42.563266    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 21:44:42.563285 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:42.563279    2572 projected.go:196] Error preparing data for projected volume kube-api-access-lbs2h for pod openshift-network-diagnostics/network-check-target-ztd6j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:44:42.563453 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:42.563309    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret podName:7b1bc67e-f876-4fec-b9bf-a3a8906d8d94 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:58.56329025 +0000 UTC m=+34.270021298 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret") pod "global-pull-secret-syncer-dndpk" (UID: "7b1bc67e-f876-4fec-b9bf-a3a8906d8d94") : object "kube-system"/"original-pull-secret" not registered
Nov 03 21:44:42.563453 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:42.563329    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h podName:7b22f42e-7346-4165-b4ea-99e12837742c nodeName:}" failed. No retries permitted until 2026-11-03 21:44:58.563316013 +0000 UTC m=+34.270047044 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbs2h" (UniqueName: "kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h") pod "network-check-target-ztd6j" (UID: "7b22f42e-7346-4165-b4ea-99e12837742c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:44:42.798418 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:42.798328    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:42.798418 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:42.798354    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:42.798586 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:42.798440    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:42.798586 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:42.798455    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kjp2c" podUID="8915bffd-4628-4aee-994b-81de7d1ad7c6"
Nov 03 21:44:42.798586 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:42.798506    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd6j" podUID="7b22f42e-7346-4165-b4ea-99e12837742c"
Nov 03 21:44:42.798673 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:42.798599    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dndpk" podUID="7b1bc67e-f876-4fec-b9bf-a3a8906d8d94"
Nov 03 21:44:42.997765 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:42.997732    2572 generic.go:356] "Generic (PLEG): container finished" podID="72792cfa-71f1-418a-a59d-40d2f5c392d9" containerID="7d24b3d045225f381b92cbcdca064fcc484d15486acc203e2dd0392221923518" exitCode=0
Nov 03 21:44:42.998113 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:42.997788    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r964d" event={"ID":"72792cfa-71f1-418a-a59d-40d2f5c392d9","Type":"ContainerDied","Data":"7d24b3d045225f381b92cbcdca064fcc484d15486acc203e2dd0392221923518"}
Nov 03 21:44:44.004762 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:44.004729    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r964d" event={"ID":"72792cfa-71f1-418a-a59d-40d2f5c392d9","Type":"ContainerStarted","Data":"33fd431e64d64fc4453632295c8db56737d43570c9ed04e43f947efa42912eee"}
Nov 03 21:44:44.009208 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:44.009179    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l" event={"ID":"a1471771-c3a3-4c38-a124-455ab7e5e2d5","Type":"ContainerStarted","Data":"ce2b1750b0d0e33343bc517d9861bacd7802ab81fa89b9fbfb875466d68d8716"}
Nov 03 21:44:44.031155 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:44.031107    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r964d" podStartSLOduration=7.679448596 podStartE2EDuration="19.031096257s" totalImagesPullingTime="11.351647661s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:44:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:44:44.030617764 +0000 UTC m=+19.737348815" watchObservedRunningTime="2026-11-03 21:44:44.031096257 +0000 UTC m=+19.737827309"
Nov 03 21:44:44.799683 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:44.799653    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:44.799872 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:44.799808    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:44.799872 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:44.799829    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd6j" podUID="7b22f42e-7346-4165-b4ea-99e12837742c"
Nov 03 21:44:44.799982 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:44.799894    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kjp2c" podUID="8915bffd-4628-4aee-994b-81de7d1ad7c6"
Nov 03 21:44:44.799982 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:44.799915    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:44.800070 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:44.800007    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dndpk" podUID="7b1bc67e-f876-4fec-b9bf-a3a8906d8d94"
Nov 03 21:44:46.799106 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:46.798909    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:46.799831 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:46.799010    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:46.799831 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:46.799173    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd6j" podUID="7b22f42e-7346-4165-b4ea-99e12837742c"
Nov 03 21:44:46.799831 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:46.799294    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kjp2c" podUID="8915bffd-4628-4aee-994b-81de7d1ad7c6"
Nov 03 21:44:46.799831 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:46.799054    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:46.799831 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:46.799391    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dndpk" podUID="7b1bc67e-f876-4fec-b9bf-a3a8906d8d94"
Nov 03 21:44:47.018537 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:47.018503    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l" event={"ID":"a1471771-c3a3-4c38-a124-455ab7e5e2d5","Type":"ContainerStarted","Data":"8dbebd5d5eaa28b9acdd43ee301f1847758731785028369f01c49b07351b074e"}
Nov 03 21:44:47.018761 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:47.018743    2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:47.018831 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:47.018812    2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:47.036209 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:47.036187    2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:47.086221 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:47.086172    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l" podStartSLOduration=8.674695107 podStartE2EDuration="23.086158783s" totalImagesPullingTime="14.411463676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:44:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:44:47.053077274 +0000 UTC m=+22.759808326" watchObservedRunningTime="2026-11-03 21:44:47.086158783 +0000 UTC m=+22.792889835"
Nov 03 21:44:47.751393 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:47.751363    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dndpk"]
Nov 03 21:44:47.751713 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:47.751483    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:47.751713 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:47.751576    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dndpk" podUID="7b1bc67e-f876-4fec-b9bf-a3a8906d8d94"
Nov 03 21:44:47.754368 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:47.754341    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ztd6j"]
Nov 03 21:44:47.754494 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:47.754426    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:47.754542 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:47.754513    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd6j" podUID="7b22f42e-7346-4165-b4ea-99e12837742c"
Nov 03 21:44:47.757259 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:47.757219    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kjp2c"]
Nov 03 21:44:47.757386 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:47.757325    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:47.757488 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:47.757404    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kjp2c" podUID="8915bffd-4628-4aee-994b-81de7d1ad7c6"
Nov 03 21:44:48.021059 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:48.020982    2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:48.036356 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:48.036330    2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:44:49.798750 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:49.798695    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:49.799172 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:49.798772    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:49.799172 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:49.798864    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:49.799172 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:49.798869    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dndpk" podUID="7b1bc67e-f876-4fec-b9bf-a3a8906d8d94"
Nov 03 21:44:49.799172 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:49.798936    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kjp2c" podUID="8915bffd-4628-4aee-994b-81de7d1ad7c6"
Nov 03 21:44:49.799172 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:49.799011    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd6j" podUID="7b22f42e-7346-4165-b4ea-99e12837742c"
Nov 03 21:44:51.798174 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:51.798136    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:51.798704 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:51.798181    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:51.798704 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:51.798260    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:51.798704 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:51.798288    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dndpk" podUID="7b1bc67e-f876-4fec-b9bf-a3a8906d8d94"
Nov 03 21:44:51.798704 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:51.798346    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kjp2c" podUID="8915bffd-4628-4aee-994b-81de7d1ad7c6"
Nov 03 21:44:51.798704 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:51.798416    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd6j" podUID="7b22f42e-7346-4165-b4ea-99e12837742c"
Nov 03 21:44:53.798173 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:53.798135    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:53.798173 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:53.798162    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:53.798590 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:53.798264    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:53.798590 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:53.798277    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd6j" podUID="7b22f42e-7346-4165-b4ea-99e12837742c"
Nov 03 21:44:53.798590 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:53.798357    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kjp2c" podUID="8915bffd-4628-4aee-994b-81de7d1ad7c6"
Nov 03 21:44:53.798590 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:53.798400    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dndpk" podUID="7b1bc67e-f876-4fec-b9bf-a3a8906d8d94"
Nov 03 21:44:54.587983 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.587954    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeReady"
Nov 03 21:44:54.588167 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.588114    2572 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Nov 03 21:44:54.622386 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.622353    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-p7l88"]
Nov 03 21:44:54.624564 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.624549    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-p7l88"
Nov 03 21:44:54.626846 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.626411    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-wd97l"]
Nov 03 21:44:54.628734 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.628711    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-f5kct"]
Nov 03 21:44:54.628853 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.628831    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-wd97l"
Nov 03 21:44:54.632920 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.632899    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"]
Nov 03 21:44:54.633039 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.633019    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-f5kct"
Nov 03 21:44:54.634848 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.634830    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"]
Nov 03 21:44:54.634933 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.634918    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"
Nov 03 21:44:54.637063 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.637049    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-pspgs"]
Nov 03 21:44:54.637182 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.637165    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:44:54.639346 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.639327    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-kmt8d"]
Nov 03 21:44:54.639467 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.639449    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:44:54.642640 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.641601    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Nov 03 21:44:54.642640 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.641738    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Nov 03 21:44:54.642640 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.642030    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5b77b9dbdf-rbjh5"]
Nov 03 21:44:54.642640 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.642220    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:44:54.644319 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.644302    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Nov 03 21:44:54.646705 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.646628    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-5w6h4"]
Nov 03 21:44:54.647613 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.647190    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:44:54.652316 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.650887    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg"]
Nov 03 21:44:54.652614 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.651321    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-5w6h4"
Nov 03 21:44:54.654363 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.654343    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng"]
Nov 03 21:44:54.656649 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.656627    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg"
Nov 03 21:44:54.670090 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.667884    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d56fbb4cf-57p87"]
Nov 03 21:44:54.670090 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.668005    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng"
Nov 03 21:44:54.670687 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.670664    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"]
Nov 03 21:44:54.670911 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.670894    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.674579 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.674089    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9b86b7998-kbxzw"]
Nov 03 21:44:54.674579 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.674238    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:44:54.677867 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.677850    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-vhbjg"]
Nov 03 21:44:54.677984 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.677968    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.681161 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.681144    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-p7l88"]
Nov 03 21:44:54.681283 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.681173    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-f5kct"]
Nov 03 21:44:54.681283 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.681186    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"]
Nov 03 21:44:54.681283 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.681200    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-pspgs"]
Nov 03 21:44:54.681283 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.681214    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-wd97l"]
Nov 03 21:44:54.681283 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.681225    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d56fbb4cf-57p87"]
Nov 03 21:44:54.681283 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.681238    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b77b9dbdf-rbjh5"]
Nov 03 21:44:54.681283 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.681272    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg"]
Nov 03 21:44:54.681283 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.681285    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-kmt8d"]
Nov 03 21:44:54.681658 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.681299    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bmvnd"]
Nov 03 21:44:54.681658 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.681301    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-vhbjg"
Nov 03 21:44:54.684574 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.684554    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tqldf"]
Nov 03 21:44:54.684709 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.684692    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:44:54.687630 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.687613    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"]
Nov 03 21:44:54.687720 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.687662    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-vhbjg"]
Nov 03 21:44:54.687720 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.687685    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-5w6h4"]
Nov 03 21:44:54.687720 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.687708    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng"]
Nov 03 21:44:54.687881 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.687723    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tqldf"
Nov 03 21:44:54.687881 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.687729    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tqldf"]
Nov 03 21:44:54.687881 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.687832    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"]
Nov 03 21:44:54.687881 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.687857    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9b86b7998-kbxzw"]
Nov 03 21:44:54.687881 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.687877    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bmvnd"]
Nov 03 21:44:54.742323 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.742298    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-installation-pull-secrets\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.742441 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.742340    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-5dl8c\" (UID: \"b3746624-9331-4bfa-81ed-3a6f37c8d0e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:44:54.742622 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.742433    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-ca-trust-extracted\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.742622 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.742462    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x472s\" (UniqueName: \"kubernetes.io/projected/e5a6f4cf-6f6f-4195-8304-aa0648e43ad9-kube-api-access-x472s\") pod \"kas-connection-checker-685895c7c9-f5kct\" (UID: \"e5a6f4cf-6f6f-4195-8304-aa0648e43ad9\") " pod="kube-system/kas-connection-checker-685895c7c9-f5kct"
Nov 03 21:44:54.742622 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.742484    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnmx6\" (UniqueName: \"kubernetes.io/projected/6c07fa44-702c-4e55-afe3-451696e76f82-kube-api-access-qnmx6\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg\" (UID: \"6c07fa44-702c-4e55-afe3-451696e76f82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg"
Nov 03 21:44:54.742622 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.742500    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/289044f0-b173-489e-971f-3dff8aaf9aaa-metrics-tls\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:44:54.742622 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.742552    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a526c1-84f8-41a0-8dee-0ed08bddc5da-serving-cert\") pod \"service-ca-operator-544d749c8c-xzhng\" (UID: \"b3a526c1-84f8-41a0-8dee-0ed08bddc5da\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng"
Nov 03 21:44:54.742622 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.742618    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cbdd163-bfdd-4fda-8141-21b969a3aa08-cert\") pod \"ingress-canary-tqldf\" (UID: \"5cbdd163-bfdd-4fda-8141-21b969a3aa08\") " pod="openshift-ingress-canary/ingress-canary-tqldf"
Nov 03 21:44:54.742840 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.742661    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82fzq\" (UniqueName: \"kubernetes.io/projected/5cbdd163-bfdd-4fda-8141-21b969a3aa08-kube-api-access-82fzq\") pod \"ingress-canary-tqldf\" (UID: \"5cbdd163-bfdd-4fda-8141-21b969a3aa08\") " pod="openshift-ingress-canary/ingress-canary-tqldf"
Nov 03 21:44:54.742840 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.742687    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-metrics-certs\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:44:54.742840 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.742741    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.742840 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.742774    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/289044f0-b173-489e-971f-3dff8aaf9aaa-tmp-dir\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:44:54.742840 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.742800    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzqqr\" (UniqueName: \"kubernetes.io/projected/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-kube-api-access-lzqqr\") pod \"cluster-samples-operator-6ddb6c8b94-5dl8c\" (UID: \"b3746624-9331-4bfa-81ed-3a6f37c8d0e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:44:54.743019 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.742849    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk4z7\" (UniqueName: \"kubernetes.io/projected/b3a526c1-84f8-41a0-8dee-0ed08bddc5da-kube-api-access-jk4z7\") pod \"service-ca-operator-544d749c8c-xzhng\" (UID: \"b3a526c1-84f8-41a0-8dee-0ed08bddc5da\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng"
Nov 03 21:44:54.743019 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.742938    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a3d055a-397e-436d-99bd-e82541b4ce57-tmp\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:44:54.743019 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.742969    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36598f65-5a1d-43e3-acc2-71c1e56f112c-serving-cert\") pod \"console-operator-7cd56b8dbc-pspgs\" (UID: \"36598f65-5a1d-43e3-acc2-71c1e56f112c\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:44:54.743019 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743003    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ddc108c9-ccd3-462a-8694-2421004791cd-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-wvc4j\" (UID: \"ddc108c9-ccd3-462a-8694-2421004791cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:44:54.743164 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743060    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzn4j\" (UniqueName: \"kubernetes.io/projected/ddc108c9-ccd3-462a-8694-2421004791cd-kube-api-access-zzn4j\") pod \"cluster-monitoring-operator-884576c57-wvc4j\" (UID: \"ddc108c9-ccd3-462a-8694-2421004791cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:44:54.743164 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743115    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r8kc\" (UniqueName: \"kubernetes.io/projected/fe9f47b3-180f-4485-b611-a66abe1974db-kube-api-access-2r8kc\") pod \"network-check-source-6f78d59f99-vhbjg\" (UID: \"fe9f47b3-180f-4485-b611-a66abe1974db\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-vhbjg"
Nov 03 21:44:54.743164 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743135    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-certificates\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.743376 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743210    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-image-registry-private-configuration\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.743376 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743263    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/588bc17e-1307-4055-96a4-cbd60ba48541-registry-certificates\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.743376 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743291    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-bound-sa-token\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.743376 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743314    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-wvc4j\" (UID: \"ddc108c9-ccd3-462a-8694-2421004791cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:44:54.743376 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743340    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85njj\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-kube-api-access-85njj\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.743376 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743371    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-default-certificate\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:44:54.743584 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743413    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/588bc17e-1307-4055-96a4-cbd60ba48541-image-registry-private-configuration\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.743584 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743456    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/588bc17e-1307-4055-96a4-cbd60ba48541-ca-trust-extracted\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.743584 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743520    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhxb4\" (UniqueName: \"kubernetes.io/projected/45862374-6557-46b1-9982-4b77670216df-kube-api-access-dhxb4\") pod \"volume-data-source-validator-58c9f5f46d-5w6h4\" (UID: \"45862374-6557-46b1-9982-4b77670216df\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-5w6h4"
Nov 03 21:44:54.743584 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743579    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g8bm\" (UniqueName: \"kubernetes.io/projected/b53d4190-50d2-4994-b730-a593c5133702-kube-api-access-7g8bm\") pod \"kas-connection-checker-685895c7c9-p7l88\" (UID: \"b53d4190-50d2-4994-b730-a593c5133702\") " pod="kube-system/kas-connection-checker-685895c7c9-p7l88"
Nov 03 21:44:54.743714 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743648    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-stats-auth\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:44:54.743714 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743679    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-5dl8c\" (UID: \"b3746624-9331-4bfa-81ed-3a6f37c8d0e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:44:54.743714 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743704    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-trusted-ca\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.743847 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743728    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq9sj\" (UniqueName: \"kubernetes.io/projected/3a3d055a-397e-436d-99bd-e82541b4ce57-kube-api-access-mq9sj\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:44:54.743847 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743751    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36598f65-5a1d-43e3-acc2-71c1e56f112c-config\") pod \"console-operator-7cd56b8dbc-pspgs\" (UID: \"36598f65-5a1d-43e3-acc2-71c1e56f112c\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:44:54.743847 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743787    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c07fa44-702c-4e55-afe3-451696e76f82-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg\" (UID: \"6c07fa44-702c-4e55-afe3-451696e76f82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg"
Nov 03 21:44:54.743932 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743851    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36598f65-5a1d-43e3-acc2-71c1e56f112c-trusted-ca\") pod \"console-operator-7cd56b8dbc-pspgs\" (UID: \"36598f65-5a1d-43e3-acc2-71c1e56f112c\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:44:54.743932 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743881    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9k4d\" (UniqueName: \"kubernetes.io/projected/d6afb4de-bd45-4038-a6a9-9ff8671eb430-kube-api-access-b9k4d\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:44:54.743932 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743914    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3ebc2e42-6892-480b-a793-4f224d09f45d-nginx-conf\") pod \"networking-console-plugin-86c478bb88-fv6vx\" (UID: \"3ebc2e42-6892-480b-a793-4f224d09f45d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"
Nov 03 21:44:54.744026 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743936    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/289044f0-b173-489e-971f-3dff8aaf9aaa-config-volume\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:44:54.744026 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.743972    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a3d055a-397e-436d-99bd-e82541b4ce57-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:44:54.744026 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.744006    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m57g\" (UniqueName: \"kubernetes.io/projected/36598f65-5a1d-43e3-acc2-71c1e56f112c-kube-api-access-7m57g\") pod \"console-operator-7cd56b8dbc-pspgs\" (UID: \"36598f65-5a1d-43e3-acc2-71c1e56f112c\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:44:54.744126 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.744026    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/588bc17e-1307-4055-96a4-cbd60ba48541-trusted-ca\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.744126 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.744052    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg58s\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-kube-api-access-kg58s\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.744126 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.744076    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:44:54.744126 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.744117    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3a3d055a-397e-436d-99bd-e82541b4ce57-snapshots\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:44:54.744267 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.744150    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fv6vx\" (UID: \"3ebc2e42-6892-480b-a793-4f224d09f45d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"
Nov 03 21:44:54.744267 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.744166    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-bound-sa-token\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.744267 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.744180    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a3d055a-397e-436d-99bd-e82541b4ce57-serving-cert\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:44:54.744267 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.744201    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.744267 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.744234    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gqqq\" (UniqueName: \"kubernetes.io/projected/439cdf28-89f2-47eb-9a61-b63f4db9237b-kube-api-access-6gqqq\") pod \"kas-connection-checker-685895c7c9-wd97l\" (UID: \"439cdf28-89f2-47eb-9a61-b63f4db9237b\") " pod="kube-system/kas-connection-checker-685895c7c9-wd97l"
Nov 03 21:44:54.744431 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.744281    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/588bc17e-1307-4055-96a4-cbd60ba48541-installation-pull-secrets\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.744431 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.744315    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpslp\" (UniqueName: \"kubernetes.io/projected/289044f0-b173-489e-971f-3dff8aaf9aaa-kube-api-access-tpslp\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:44:54.744431 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.744338    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a3d055a-397e-436d-99bd-e82541b4ce57-service-ca-bundle\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:44:54.744431 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.744368    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c07fa44-702c-4e55-afe3-451696e76f82-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg\" (UID: \"6c07fa44-702c-4e55-afe3-451696e76f82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg"
Nov 03 21:44:54.744431 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.744405    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3a526c1-84f8-41a0-8dee-0ed08bddc5da-config\") pod \"service-ca-operator-544d749c8c-xzhng\" (UID: \"b3a526c1-84f8-41a0-8dee-0ed08bddc5da\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng"
Nov 03 21:44:54.744592 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.744573    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Nov 03 21:44:54.744856 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.744836    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Nov 03 21:44:54.745094 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.745064    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rn6dh\""
Nov 03 21:44:54.745212 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.745096    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Nov 03 21:44:54.745212 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.745104    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Nov 03 21:44:54.745212 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.745105    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Nov 03 21:44:54.745212 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.745118    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 03 21:44:54.745417 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.745310    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Nov 03 21:44:54.745417 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.745333    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Nov 03 21:44:54.745594 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.745564    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 03 21:44:54.745691 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.745675    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Nov 03 21:44:54.745747 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.745739    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Nov 03 21:44:54.745866 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.745844    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 03 21:44:54.745971 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.745892    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Nov 03 21:44:54.745971 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.745911    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 03 21:44:54.745971 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.745911    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Nov 03 21:44:54.745971 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.745941    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 03 21:44:54.745971 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.745944    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 03 21:44:54.745971 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.745951    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-92tpk\""
Nov 03 21:44:54.746167 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.745983    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Nov 03 21:44:54.746507 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.746492    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Nov 03 21:44:54.746579 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.746532    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Nov 03 21:44:54.746890 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.746849    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Nov 03 21:44:54.746890 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.746866    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 03 21:44:54.747043 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.746909    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Nov 03 21:44:54.747043 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.746913    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Nov 03 21:44:54.747043 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.746921    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Nov 03 21:44:54.747043 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.746932    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Nov 03 21:44:54.747043 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.746951    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Nov 03 21:44:54.747043 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.746959    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Nov 03 21:44:54.747043 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.746963    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 03 21:44:54.747043 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.746855    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Nov 03 21:44:54.747043 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.746961    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Nov 03 21:44:54.747043 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.746973    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 03 21:44:54.747043 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.747011    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 03 21:44:54.747416 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.747308    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Nov 03 21:44:54.747449 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.747416    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 03 21:44:54.747449 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.747445    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 03 21:44:54.747520 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.747503    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-wc5kn\""
Nov 03 21:44:54.748404 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.748390    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Nov 03 21:44:54.748682 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.748663    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Nov 03 21:44:54.748769 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.748688    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Nov 03 21:44:54.748769 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.748690    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 03 21:44:54.748769 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.748722    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Nov 03 21:44:54.752491 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.752477    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Nov 03 21:44:54.756072 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.756053    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Nov 03 21:44:54.763627 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.763611    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Nov 03 21:44:54.763817 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.763800    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Nov 03 21:44:54.763817 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.763802    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Nov 03 21:44:54.845410 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.845111    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.845410 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.845388    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/289044f0-b173-489e-971f-3dff8aaf9aaa-tmp-dir\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:44:54.845889 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.845415    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzqqr\" (UniqueName: \"kubernetes.io/projected/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-kube-api-access-lzqqr\") pod \"cluster-samples-operator-6ddb6c8b94-5dl8c\" (UID: \"b3746624-9331-4bfa-81ed-3a6f37c8d0e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:44:54.845889 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:54.845240    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 21:44:54.845889 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:54.845439    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b86b7998-kbxzw: secret "image-registry-tls" not found
Nov 03 21:44:54.845889 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.845444    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk4z7\" (UniqueName: \"kubernetes.io/projected/b3a526c1-84f8-41a0-8dee-0ed08bddc5da-kube-api-access-jk4z7\") pod \"service-ca-operator-544d749c8c-xzhng\" (UID: \"b3a526c1-84f8-41a0-8dee-0ed08bddc5da\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng"
Nov 03 21:44:54.845889 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.845475    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a3d055a-397e-436d-99bd-e82541b4ce57-tmp\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:44:54.845889 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:54.845494    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls podName:d21190d3-0ed6-4c4e-a71f-ca14d48ffd03 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:55.345473929 +0000 UTC m=+31.052204977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls") pod "image-registry-9b86b7998-kbxzw" (UID: "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03") : secret "image-registry-tls" not found
Nov 03 21:44:54.845889 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.845519    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36598f65-5a1d-43e3-acc2-71c1e56f112c-serving-cert\") pod \"console-operator-7cd56b8dbc-pspgs\" (UID: \"36598f65-5a1d-43e3-acc2-71c1e56f112c\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:44:54.845889 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.845545    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ddc108c9-ccd3-462a-8694-2421004791cd-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-wvc4j\" (UID: \"ddc108c9-ccd3-462a-8694-2421004791cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:44:54.845889 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.845602    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzn4j\" (UniqueName: \"kubernetes.io/projected/ddc108c9-ccd3-462a-8694-2421004791cd-kube-api-access-zzn4j\") pod \"cluster-monitoring-operator-884576c57-wvc4j\" (UID: \"ddc108c9-ccd3-462a-8694-2421004791cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:44:54.846231 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846052    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/289044f0-b173-489e-971f-3dff8aaf9aaa-tmp-dir\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:44:54.846231 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846074    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a3d055a-397e-436d-99bd-e82541b4ce57-tmp\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:44:54.846338 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846320    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r8kc\" (UniqueName: \"kubernetes.io/projected/fe9f47b3-180f-4485-b611-a66abe1974db-kube-api-access-2r8kc\") pod \"network-check-source-6f78d59f99-vhbjg\" (UID: \"fe9f47b3-180f-4485-b611-a66abe1974db\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-vhbjg"
Nov 03 21:44:54.846372 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846351    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-certificates\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.846407 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846385    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-image-registry-private-configuration\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.846456 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846414    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/588bc17e-1307-4055-96a4-cbd60ba48541-registry-certificates\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.846456 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846428    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ddc108c9-ccd3-462a-8694-2421004791cd-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-wvc4j\" (UID: \"ddc108c9-ccd3-462a-8694-2421004791cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:44:54.846456 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846438    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-bound-sa-token\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.846604 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846463    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-wvc4j\" (UID: \"ddc108c9-ccd3-462a-8694-2421004791cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:44:54.846604 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846539    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85njj\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-kube-api-access-85njj\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.846604 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846566    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-default-certificate\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:44:54.846604 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846596    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/588bc17e-1307-4055-96a4-cbd60ba48541-image-registry-private-configuration\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.846800 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846620    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/588bc17e-1307-4055-96a4-cbd60ba48541-ca-trust-extracted\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.846800 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846647    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhxb4\" (UniqueName: \"kubernetes.io/projected/45862374-6557-46b1-9982-4b77670216df-kube-api-access-dhxb4\") pod \"volume-data-source-validator-58c9f5f46d-5w6h4\" (UID: \"45862374-6557-46b1-9982-4b77670216df\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-5w6h4"
Nov 03 21:44:54.846800 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846673    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g8bm\" (UniqueName: \"kubernetes.io/projected/b53d4190-50d2-4994-b730-a593c5133702-kube-api-access-7g8bm\") pod \"kas-connection-checker-685895c7c9-p7l88\" (UID: \"b53d4190-50d2-4994-b730-a593c5133702\") " pod="kube-system/kas-connection-checker-685895c7c9-p7l88"
Nov 03 21:44:54.846800 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:54.846703    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 03 21:44:54.846800 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846711    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-stats-auth\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:44:54.846800 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846736    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-5dl8c\" (UID: \"b3746624-9331-4bfa-81ed-3a6f37c8d0e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:44:54.846800 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:54.846748    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls podName:ddc108c9-ccd3-462a-8694-2421004791cd nodeName:}" failed. No retries permitted until 2026-11-03 21:44:55.346733701 +0000 UTC m=+31.053464745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-wvc4j" (UID: "ddc108c9-ccd3-462a-8694-2421004791cd") : secret "cluster-monitoring-operator-tls" not found
Nov 03 21:44:54.846800 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846776    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-trusted-ca\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.846800 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:54.846799    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 03 21:44:54.846800 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846803    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq9sj\" (UniqueName: \"kubernetes.io/projected/3a3d055a-397e-436d-99bd-e82541b4ce57-kube-api-access-mq9sj\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:44:54.847301 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846831    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36598f65-5a1d-43e3-acc2-71c1e56f112c-config\") pod \"console-operator-7cd56b8dbc-pspgs\" (UID: \"36598f65-5a1d-43e3-acc2-71c1e56f112c\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:44:54.847301 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:54.846843    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls podName:b3746624-9331-4bfa-81ed-3a6f37c8d0e6 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:55.346832004 +0000 UTC m=+31.053563050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-5dl8c" (UID: "b3746624-9331-4bfa-81ed-3a6f37c8d0e6") : secret "samples-operator-tls" not found
Nov 03 21:44:54.847301 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846873    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c07fa44-702c-4e55-afe3-451696e76f82-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg\" (UID: \"6c07fa44-702c-4e55-afe3-451696e76f82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg"
Nov 03 21:44:54.847301 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846902    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36598f65-5a1d-43e3-acc2-71c1e56f112c-trusted-ca\") pod \"console-operator-7cd56b8dbc-pspgs\" (UID: \"36598f65-5a1d-43e3-acc2-71c1e56f112c\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:44:54.847301 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846926    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9k4d\" (UniqueName: \"kubernetes.io/projected/d6afb4de-bd45-4038-a6a9-9ff8671eb430-kube-api-access-b9k4d\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:44:54.847301 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846955    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3ebc2e42-6892-480b-a793-4f224d09f45d-nginx-conf\") pod \"networking-console-plugin-86c478bb88-fv6vx\" (UID: \"3ebc2e42-6892-480b-a793-4f224d09f45d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"
Nov 03 21:44:54.847301 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846959    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/588bc17e-1307-4055-96a4-cbd60ba48541-registry-certificates\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.847301 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.846978    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/289044f0-b173-489e-971f-3dff8aaf9aaa-config-volume\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:44:54.847301 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847008    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a3d055a-397e-436d-99bd-e82541b4ce57-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:44:54.847301 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847027    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-certificates\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.847301 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847036    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m57g\" (UniqueName: \"kubernetes.io/projected/36598f65-5a1d-43e3-acc2-71c1e56f112c-kube-api-access-7m57g\") pod \"console-operator-7cd56b8dbc-pspgs\" (UID: \"36598f65-5a1d-43e3-acc2-71c1e56f112c\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:44:54.847301 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847060    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/588bc17e-1307-4055-96a4-cbd60ba48541-trusted-ca\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.847301 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847088    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg58s\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-kube-api-access-kg58s\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.847301 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847113    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:44:54.847301 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847147    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3a3d055a-397e-436d-99bd-e82541b4ce57-snapshots\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:44:54.848021 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847189    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fv6vx\" (UID: \"3ebc2e42-6892-480b-a793-4f224d09f45d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"
Nov 03 21:44:54.848021 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847213    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-bound-sa-token\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.848021 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847238    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a3d055a-397e-436d-99bd-e82541b4ce57-serving-cert\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:44:54.848021 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847340    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.848021 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847372    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gqqq\" (UniqueName: \"kubernetes.io/projected/439cdf28-89f2-47eb-9a61-b63f4db9237b-kube-api-access-6gqqq\") pod \"kas-connection-checker-685895c7c9-wd97l\" (UID: \"439cdf28-89f2-47eb-9a61-b63f4db9237b\") " pod="kube-system/kas-connection-checker-685895c7c9-wd97l"
Nov 03 21:44:54.848021 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847399    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/588bc17e-1307-4055-96a4-cbd60ba48541-installation-pull-secrets\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.848021 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847425    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpslp\" (UniqueName: \"kubernetes.io/projected/289044f0-b173-489e-971f-3dff8aaf9aaa-kube-api-access-tpslp\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:44:54.848021 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847456    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a3d055a-397e-436d-99bd-e82541b4ce57-service-ca-bundle\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:44:54.848021 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847483    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c07fa44-702c-4e55-afe3-451696e76f82-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg\" (UID: \"6c07fa44-702c-4e55-afe3-451696e76f82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg"
Nov 03 21:44:54.848021 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847515    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3a526c1-84f8-41a0-8dee-0ed08bddc5da-config\") pod \"service-ca-operator-544d749c8c-xzhng\" (UID: \"b3a526c1-84f8-41a0-8dee-0ed08bddc5da\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng"
Nov 03 21:44:54.848021 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847521    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36598f65-5a1d-43e3-acc2-71c1e56f112c-config\") pod \"console-operator-7cd56b8dbc-pspgs\" (UID: \"36598f65-5a1d-43e3-acc2-71c1e56f112c\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:44:54.848021 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847542    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-installation-pull-secrets\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.848021 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847568    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-5dl8c\" (UID: \"b3746624-9331-4bfa-81ed-3a6f37c8d0e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:44:54.848021 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847597    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-ca-trust-extracted\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.848021 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847622    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x472s\" (UniqueName: \"kubernetes.io/projected/e5a6f4cf-6f6f-4195-8304-aa0648e43ad9-kube-api-access-x472s\") pod \"kas-connection-checker-685895c7c9-f5kct\" (UID: \"e5a6f4cf-6f6f-4195-8304-aa0648e43ad9\") " pod="kube-system/kas-connection-checker-685895c7c9-f5kct"
Nov 03 21:44:54.848916 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847647    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnmx6\" (UniqueName: \"kubernetes.io/projected/6c07fa44-702c-4e55-afe3-451696e76f82-kube-api-access-qnmx6\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg\" (UID: \"6c07fa44-702c-4e55-afe3-451696e76f82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg"
Nov 03 21:44:54.848916 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847673    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/289044f0-b173-489e-971f-3dff8aaf9aaa-metrics-tls\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:44:54.848916 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847683    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3ebc2e42-6892-480b-a793-4f224d09f45d-nginx-conf\") pod \"networking-console-plugin-86c478bb88-fv6vx\" (UID: \"3ebc2e42-6892-480b-a793-4f224d09f45d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"
Nov 03 21:44:54.848916 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847698    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a526c1-84f8-41a0-8dee-0ed08bddc5da-serving-cert\") pod \"service-ca-operator-544d749c8c-xzhng\" (UID: \"b3a526c1-84f8-41a0-8dee-0ed08bddc5da\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng"
Nov 03 21:44:54.848916 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847753    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cbdd163-bfdd-4fda-8141-21b969a3aa08-cert\") pod \"ingress-canary-tqldf\" (UID: \"5cbdd163-bfdd-4fda-8141-21b969a3aa08\") " pod="openshift-ingress-canary/ingress-canary-tqldf"
Nov 03 21:44:54.848916 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:54.847773    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 21:44:54.848916 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:54.847785    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d56fbb4cf-57p87: secret "image-registry-tls" not found
Nov 03 21:44:54.848916 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847794    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82fzq\" (UniqueName: \"kubernetes.io/projected/5cbdd163-bfdd-4fda-8141-21b969a3aa08-kube-api-access-82fzq\") pod \"ingress-canary-tqldf\" (UID: \"5cbdd163-bfdd-4fda-8141-21b969a3aa08\") " pod="openshift-ingress-canary/ingress-canary-tqldf"
Nov 03 21:44:54.848916 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:54.847825    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls podName:588bc17e-1307-4055-96a4-cbd60ba48541 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:55.347811546 +0000 UTC m=+31.054542577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls") pod "image-registry-5d56fbb4cf-57p87" (UID: "588bc17e-1307-4055-96a4-cbd60ba48541") : secret "image-registry-tls" not found
Nov 03 21:44:54.848916 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847825    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-trusted-ca\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.848916 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.847844    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-metrics-certs\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:44:54.848916 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:54.847966    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 03 21:44:54.848916 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:54.848004    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-metrics-certs podName:d6afb4de-bd45-4038-a6a9-9ff8671eb430 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:55.34799111 +0000 UTC m=+31.054722143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-metrics-certs") pod "router-default-5b77b9dbdf-rbjh5" (UID: "d6afb4de-bd45-4038-a6a9-9ff8671eb430") : secret "router-metrics-certs-default" not found
Nov 03 21:44:54.848916 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:54.848083    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle podName:d6afb4de-bd45-4038-a6a9-9ff8671eb430 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:55.348070728 +0000 UTC m=+31.054801761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle") pod "router-default-5b77b9dbdf-rbjh5" (UID: "d6afb4de-bd45-4038-a6a9-9ff8671eb430") : configmap references non-existent config key: service-ca.crt
Nov 03 21:44:54.848916 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.848477    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/289044f0-b173-489e-971f-3dff8aaf9aaa-config-volume\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:44:54.848916 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.848716    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3a3d055a-397e-436d-99bd-e82541b4ce57-snapshots\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:44:54.849778 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.849044    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/588bc17e-1307-4055-96a4-cbd60ba48541-ca-trust-extracted\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.850681 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.850651    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36598f65-5a1d-43e3-acc2-71c1e56f112c-serving-cert\") pod \"console-operator-7cd56b8dbc-pspgs\" (UID: \"36598f65-5a1d-43e3-acc2-71c1e56f112c\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:44:54.850790 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.850766    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a526c1-84f8-41a0-8dee-0ed08bddc5da-serving-cert\") pod \"service-ca-operator-544d749c8c-xzhng\" (UID: \"b3a526c1-84f8-41a0-8dee-0ed08bddc5da\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng"
Nov 03 21:44:54.850942 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.850918    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-image-registry-private-configuration\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.851137 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.851112    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-default-certificate\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:44:54.851534 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.851509    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-stats-auth\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:44:54.852038 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.852013    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a3d055a-397e-436d-99bd-e82541b4ce57-serving-cert\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:44:54.852120 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.852069    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-5dl8c\" (UID: \"b3746624-9331-4bfa-81ed-3a6f37c8d0e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:44:54.852120 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.852111    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a3d055a-397e-436d-99bd-e82541b4ce57-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:44:54.852294 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.852238    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/588bc17e-1307-4055-96a4-cbd60ba48541-trusted-ca\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.852400 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.852378    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-ca-trust-extracted\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.853301 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.852671    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a3d055a-397e-436d-99bd-e82541b4ce57-service-ca-bundle\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:44:54.853301 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.853014    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/588bc17e-1307-4055-96a4-cbd60ba48541-image-registry-private-configuration\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.853301 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:54.853088    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 03 21:44:54.853301 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:54.853149    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert podName:3ebc2e42-6892-480b-a793-4f224d09f45d nodeName:}" failed. No retries permitted until 2026-11-03 21:44:55.353134106 +0000 UTC m=+31.059865163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fv6vx" (UID: "3ebc2e42-6892-480b-a793-4f224d09f45d") : secret "networking-console-plugin-cert" not found
Nov 03 21:44:54.853538 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:54.853381    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 21:44:54.853538 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:54.853458    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289044f0-b173-489e-971f-3dff8aaf9aaa-metrics-tls podName:289044f0-b173-489e-971f-3dff8aaf9aaa nodeName:}" failed. No retries permitted until 2026-11-03 21:44:55.353442935 +0000 UTC m=+31.060173980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/289044f0-b173-489e-971f-3dff8aaf9aaa-metrics-tls") pod "dns-default-bmvnd" (UID: "289044f0-b173-489e-971f-3dff8aaf9aaa") : secret "dns-default-metrics-tls" not found
Nov 03 21:44:54.853538 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.853491    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/588bc17e-1307-4055-96a4-cbd60ba48541-installation-pull-secrets\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.853834 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.853713    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-installation-pull-secrets\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.854048 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.854002    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3a526c1-84f8-41a0-8dee-0ed08bddc5da-config\") pod \"service-ca-operator-544d749c8c-xzhng\" (UID: \"b3a526c1-84f8-41a0-8dee-0ed08bddc5da\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng"
Nov 03 21:44:54.854175 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.854154    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c07fa44-702c-4e55-afe3-451696e76f82-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg\" (UID: \"6c07fa44-702c-4e55-afe3-451696e76f82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg"
Nov 03 21:44:54.854239 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.854204    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c07fa44-702c-4e55-afe3-451696e76f82-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg\" (UID: \"6c07fa44-702c-4e55-afe3-451696e76f82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg"
Nov 03 21:44:54.854239 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.854216    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36598f65-5a1d-43e3-acc2-71c1e56f112c-trusted-ca\") pod \"console-operator-7cd56b8dbc-pspgs\" (UID: \"36598f65-5a1d-43e3-acc2-71c1e56f112c\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:44:54.855220 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.855204    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cbdd163-bfdd-4fda-8141-21b969a3aa08-cert\") pod \"ingress-canary-tqldf\" (UID: \"5cbdd163-bfdd-4fda-8141-21b969a3aa08\") " pod="openshift-ingress-canary/ingress-canary-tqldf"
Nov 03 21:44:54.862589 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.862564    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzqqr\" (UniqueName: \"kubernetes.io/projected/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-kube-api-access-lzqqr\") pod \"cluster-samples-operator-6ddb6c8b94-5dl8c\" (UID: \"b3746624-9331-4bfa-81ed-3a6f37c8d0e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:44:54.864882 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.864450    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzn4j\" (UniqueName: \"kubernetes.io/projected/ddc108c9-ccd3-462a-8694-2421004791cd-kube-api-access-zzn4j\") pod \"cluster-monitoring-operator-884576c57-wvc4j\" (UID: \"ddc108c9-ccd3-462a-8694-2421004791cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:44:54.864882 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.864464    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq9sj\" (UniqueName: \"kubernetes.io/projected/3a3d055a-397e-436d-99bd-e82541b4ce57-kube-api-access-mq9sj\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:44:54.864882 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.864707    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r8kc\" (UniqueName: \"kubernetes.io/projected/fe9f47b3-180f-4485-b611-a66abe1974db-kube-api-access-2r8kc\") pod \"network-check-source-6f78d59f99-vhbjg\" (UID: \"fe9f47b3-180f-4485-b611-a66abe1974db\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-vhbjg"
Nov 03 21:44:54.867432 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.867407    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk4z7\" (UniqueName: \"kubernetes.io/projected/b3a526c1-84f8-41a0-8dee-0ed08bddc5da-kube-api-access-jk4z7\") pod \"service-ca-operator-544d749c8c-xzhng\" (UID: \"b3a526c1-84f8-41a0-8dee-0ed08bddc5da\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng"
Nov 03 21:44:54.867615 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.867591    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m57g\" (UniqueName: \"kubernetes.io/projected/36598f65-5a1d-43e3-acc2-71c1e56f112c-kube-api-access-7m57g\") pod \"console-operator-7cd56b8dbc-pspgs\" (UID: \"36598f65-5a1d-43e3-acc2-71c1e56f112c\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:44:54.867915 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.867886    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g8bm\" (UniqueName: \"kubernetes.io/projected/b53d4190-50d2-4994-b730-a593c5133702-kube-api-access-7g8bm\") pod \"kas-connection-checker-685895c7c9-p7l88\" (UID: \"b53d4190-50d2-4994-b730-a593c5133702\") " pod="kube-system/kas-connection-checker-685895c7c9-p7l88"
Nov 03 21:44:54.868735 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.868709    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82fzq\" (UniqueName: \"kubernetes.io/projected/5cbdd163-bfdd-4fda-8141-21b969a3aa08-kube-api-access-82fzq\") pod \"ingress-canary-tqldf\" (UID: \"5cbdd163-bfdd-4fda-8141-21b969a3aa08\") " pod="openshift-ingress-canary/ingress-canary-tqldf"
Nov 03 21:44:54.868835 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.868770    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9k4d\" (UniqueName: \"kubernetes.io/projected/d6afb4de-bd45-4038-a6a9-9ff8671eb430-kube-api-access-b9k4d\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:44:54.868920 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.868900    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-bound-sa-token\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.869755 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.869345    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhxb4\" (UniqueName: \"kubernetes.io/projected/45862374-6557-46b1-9982-4b77670216df-kube-api-access-dhxb4\") pod \"volume-data-source-validator-58c9f5f46d-5w6h4\" (UID: \"45862374-6557-46b1-9982-4b77670216df\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-5w6h4"
Nov 03 21:44:54.869755 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.869469    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-bound-sa-token\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.869755 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.869663    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85njj\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-kube-api-access-85njj\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:54.869755 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.869709    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg58s\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-kube-api-access-kg58s\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:54.869986 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.869943    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x472s\" (UniqueName: \"kubernetes.io/projected/e5a6f4cf-6f6f-4195-8304-aa0648e43ad9-kube-api-access-x472s\") pod \"kas-connection-checker-685895c7c9-f5kct\" (UID: \"e5a6f4cf-6f6f-4195-8304-aa0648e43ad9\") " pod="kube-system/kas-connection-checker-685895c7c9-f5kct"
Nov 03 21:44:54.870497 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.870480    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnmx6\" (UniqueName: \"kubernetes.io/projected/6c07fa44-702c-4e55-afe3-451696e76f82-kube-api-access-qnmx6\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg\" (UID: \"6c07fa44-702c-4e55-afe3-451696e76f82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg"
Nov 03 21:44:54.870898 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.870872    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpslp\" (UniqueName: \"kubernetes.io/projected/289044f0-b173-489e-971f-3dff8aaf9aaa-kube-api-access-tpslp\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:44:54.871030 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.871015    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gqqq\" (UniqueName: \"kubernetes.io/projected/439cdf28-89f2-47eb-9a61-b63f4db9237b-kube-api-access-6gqqq\") pod \"kas-connection-checker-685895c7c9-wd97l\" (UID: \"439cdf28-89f2-47eb-9a61-b63f4db9237b\") " pod="kube-system/kas-connection-checker-685895c7c9-wd97l"
Nov 03 21:44:54.941054 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.941026    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-p7l88"
Nov 03 21:44:54.948313 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.948296    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-wd97l"
Nov 03 21:44:54.963958 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.963930    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-f5kct"
Nov 03 21:44:54.992785 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.991399    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:44:54.998419 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:54.997487    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:44:55.009096 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.008911    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-5w6h4"
Nov 03 21:44:55.014680 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.014498    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg"
Nov 03 21:44:55.020942 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.019988    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng"
Nov 03 21:44:55.048379 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.048348    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-vhbjg"
Nov 03 21:44:55.061216 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.061141    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tqldf"
Nov 03 21:44:55.111127 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.109506    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mrf9j_eb453169-964e-4e16-a300-a54f2f3e74a2/konnectivity-agent/0.log" limit=1024
Nov 03 21:44:55.259344 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.259313    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-p7l88"]
Nov 03 21:44:55.264356 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.264331    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-wd97l"]
Nov 03 21:44:55.264534 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:55.264514    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb53d4190_50d2_4994_b730_a593c5133702.slice/crio-224136773b85483d6d6428c897c0dfe9416b7bcc5185e47a50bf3141f89cf51b WatchSource:0}: Error finding container 224136773b85483d6d6428c897c0dfe9416b7bcc5185e47a50bf3141f89cf51b: Status 404 returned error can't find the container with id 224136773b85483d6d6428c897c0dfe9416b7bcc5185e47a50bf3141f89cf51b
Nov 03 21:44:55.265259 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.265225    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-f5kct"]
Nov 03 21:44:55.274517 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:55.274489    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod439cdf28_89f2_47eb_9a61_b63f4db9237b.slice/crio-f8ccb61c415dbd02c5b80ef5f49d22335e29d795a05f67c294f83f9551357155 WatchSource:0}: Error finding container f8ccb61c415dbd02c5b80ef5f49d22335e29d795a05f67c294f83f9551357155: Status 404 returned error can't find the container with id f8ccb61c415dbd02c5b80ef5f49d22335e29d795a05f67c294f83f9551357155
Nov 03 21:44:55.276158 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:55.275773    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a6f4cf_6f6f_4195_8304_aa0648e43ad9.slice/crio-fbf11e61588c3647bbe3aaecd0de27bf27232851500858619e110e2b251e0bdb WatchSource:0}: Error finding container fbf11e61588c3647bbe3aaecd0de27bf27232851500858619e110e2b251e0bdb: Status 404 returned error can't find the container with id fbf11e61588c3647bbe3aaecd0de27bf27232851500858619e110e2b251e0bdb
Nov 03 21:44:55.314719 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.314576    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mrf9j_eb453169-964e-4e16-a300-a54f2f3e74a2/konnectivity-agent/0.log" limit=1024
Nov 03 21:44:55.321437 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.321406    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-pspgs"]
Nov 03 21:44:55.325733 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.325708    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-kmt8d"]
Nov 03 21:44:55.341037 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:55.341005    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a3d055a_397e_436d_99bd_e82541b4ce57.slice/crio-494f57d0d92855b0f36e61b1276c99c609e2d6f683e1b57b2cfc8bbb46bfbf44 WatchSource:0}: Error finding container 494f57d0d92855b0f36e61b1276c99c609e2d6f683e1b57b2cfc8bbb46bfbf44: Status 404 returned error can't find the container with id 494f57d0d92855b0f36e61b1276c99c609e2d6f683e1b57b2cfc8bbb46bfbf44
Nov 03 21:44:55.353742 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.353558    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:55.354189 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:55.353934    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 21:44:55.354189 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:55.353959    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b86b7998-kbxzw: secret "image-registry-tls" not found
Nov 03 21:44:55.354189 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:55.354034    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls podName:d21190d3-0ed6-4c4e-a71f-ca14d48ffd03 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:56.35401341 +0000 UTC m=+32.060744459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls") pod "image-registry-9b86b7998-kbxzw" (UID: "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03") : secret "image-registry-tls" not found
Nov 03 21:44:55.354189 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.354104    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-wvc4j\" (UID: \"ddc108c9-ccd3-462a-8694-2421004791cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:44:55.354189 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.354170    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-5dl8c\" (UID: \"b3746624-9331-4bfa-81ed-3a6f37c8d0e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:44:55.354900 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.354222    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:44:55.354900 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.354292    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fv6vx\" (UID: \"3ebc2e42-6892-480b-a793-4f224d09f45d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"
Nov 03 21:44:55.354900 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.354327    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:55.354900 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.354371    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/289044f0-b173-489e-971f-3dff8aaf9aaa-metrics-tls\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:44:55.354900 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.354401    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-metrics-certs\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:44:55.354900 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:55.354516    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 03 21:44:55.354900 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:55.354564    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-metrics-certs podName:d6afb4de-bd45-4038-a6a9-9ff8671eb430 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:56.354547662 +0000 UTC m=+32.061278705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-metrics-certs") pod "router-default-5b77b9dbdf-rbjh5" (UID: "d6afb4de-bd45-4038-a6a9-9ff8671eb430") : secret "router-metrics-certs-default" not found
Nov 03 21:44:55.354900 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:55.354613    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 03 21:44:55.354900 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:55.354646    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls podName:ddc108c9-ccd3-462a-8694-2421004791cd nodeName:}" failed. No retries permitted until 2026-11-03 21:44:56.354635105 +0000 UTC m=+32.061366150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-wvc4j" (UID: "ddc108c9-ccd3-462a-8694-2421004791cd") : secret "cluster-monitoring-operator-tls" not found
Nov 03 21:44:55.354900 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:55.354700    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 03 21:44:55.354900 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:55.354733    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls podName:b3746624-9331-4bfa-81ed-3a6f37c8d0e6 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:56.354723158 +0000 UTC m=+32.061454201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-5dl8c" (UID: "b3746624-9331-4bfa-81ed-3a6f37c8d0e6") : secret "samples-operator-tls" not found
Nov 03 21:44:55.354900 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:55.354796    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle podName:d6afb4de-bd45-4038-a6a9-9ff8671eb430 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:56.354786235 +0000 UTC m=+32.061517279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle") pod "router-default-5b77b9dbdf-rbjh5" (UID: "d6afb4de-bd45-4038-a6a9-9ff8671eb430") : configmap references non-existent config key: service-ca.crt
Nov 03 21:44:55.354900 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:55.354849    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 03 21:44:55.354900 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:55.354881    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert podName:3ebc2e42-6892-480b-a793-4f224d09f45d nodeName:}" failed. No retries permitted until 2026-11-03 21:44:56.354871781 +0000 UTC m=+32.061602828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fv6vx" (UID: "3ebc2e42-6892-480b-a793-4f224d09f45d") : secret "networking-console-plugin-cert" not found
Nov 03 21:44:55.355569 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:55.354939    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 21:44:55.355569 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:55.354952    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d56fbb4cf-57p87: secret "image-registry-tls" not found
Nov 03 21:44:55.355569 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:55.354984    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls podName:588bc17e-1307-4055-96a4-cbd60ba48541 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:56.354972329 +0000 UTC m=+32.061703374 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls") pod "image-registry-5d56fbb4cf-57p87" (UID: "588bc17e-1307-4055-96a4-cbd60ba48541") : secret "image-registry-tls" not found
Nov 03 21:44:55.355569 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:55.355037    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 21:44:55.355569 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:55.355068    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289044f0-b173-489e-971f-3dff8aaf9aaa-metrics-tls podName:289044f0-b173-489e-971f-3dff8aaf9aaa nodeName:}" failed. No retries permitted until 2026-11-03 21:44:56.355056502 +0000 UTC m=+32.061787545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/289044f0-b173-489e-971f-3dff8aaf9aaa-metrics-tls") pod "dns-default-bmvnd" (UID: "289044f0-b173-489e-971f-3dff8aaf9aaa") : secret "dns-default-metrics-tls" not found
Nov 03 21:44:55.370344 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.370316    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-5w6h4"]
Nov 03 21:44:55.374868 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.374841    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng"]
Nov 03 21:44:55.378519 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.378169    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg"]
Nov 03 21:44:55.391699 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:55.391675    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a526c1_84f8_41a0_8dee_0ed08bddc5da.slice/crio-58b23b1048cea694797201eb85ffb9ff4ce65f997215a15726919c7b58980708 WatchSource:0}: Error finding container 58b23b1048cea694797201eb85ffb9ff4ce65f997215a15726919c7b58980708: Status 404 returned error can't find the container with id 58b23b1048cea694797201eb85ffb9ff4ce65f997215a15726919c7b58980708
Nov 03 21:44:55.392004 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:55.391980    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c07fa44_702c_4e55_afe3_451696e76f82.slice/crio-bfcb6494f3705ded0a8ab9f8ecd0a3df0279cda651e6a658c31984f2d0811da2 WatchSource:0}: Error finding container bfcb6494f3705ded0a8ab9f8ecd0a3df0279cda651e6a658c31984f2d0811da2: Status 404 returned error can't find the container with id bfcb6494f3705ded0a8ab9f8ecd0a3df0279cda651e6a658c31984f2d0811da2
Nov 03 21:44:55.406337 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.406315    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tqldf"]
Nov 03 21:44:55.412277 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.409887    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-vhbjg"]
Nov 03 21:44:55.798735 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.798657    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:55.798735 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.798720    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:55.798916 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.798836    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:55.803187 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.803166    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 03 21:44:55.803348 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.803323    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-p72km\""
Nov 03 21:44:55.803348 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.803332    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t98zr\""
Nov 03 21:44:55.803348 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.803340    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-5xcnq\""
Nov 03 21:44:55.803459 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:55.803406    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 03 21:44:56.057430 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.057340    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-kmt8d" event={"ID":"3a3d055a-397e-436d-99bd-e82541b4ce57","Type":"ContainerStarted","Data":"494f57d0d92855b0f36e61b1276c99c609e2d6f683e1b57b2cfc8bbb46bfbf44"}
Nov 03 21:44:56.064231 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.063373    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-p7l88" event={"ID":"b53d4190-50d2-4994-b730-a593c5133702","Type":"ContainerStarted","Data":"10856a71f299b52af6827a577b33f0200bc4327ff9497d82e06a58d5b4596092"}
Nov 03 21:44:56.064231 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.063440    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-p7l88" event={"ID":"b53d4190-50d2-4994-b730-a593c5133702","Type":"ContainerStarted","Data":"224136773b85483d6d6428c897c0dfe9416b7bcc5185e47a50bf3141f89cf51b"}
Nov 03 21:44:56.070491 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.070444    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-f5kct" event={"ID":"e5a6f4cf-6f6f-4195-8304-aa0648e43ad9","Type":"ContainerStarted","Data":"9730231a0a99aa641521502edd4148f422439d1dffe6e3ce4d14d25b505bdaa4"}
Nov 03 21:44:56.070653 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.070509    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-f5kct" event={"ID":"e5a6f4cf-6f6f-4195-8304-aa0648e43ad9","Type":"ContainerStarted","Data":"fbf11e61588c3647bbe3aaecd0de27bf27232851500858619e110e2b251e0bdb"}
Nov 03 21:44:56.073422 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.073379    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg" event={"ID":"6c07fa44-702c-4e55-afe3-451696e76f82","Type":"ContainerStarted","Data":"bfcb6494f3705ded0a8ab9f8ecd0a3df0279cda651e6a658c31984f2d0811da2"}
Nov 03 21:44:56.075575 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.075546    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-5w6h4" event={"ID":"45862374-6557-46b1-9982-4b77670216df","Type":"ContainerStarted","Data":"d85b28b8973ea1aa43d44c588788ea20b71e1ca18c7d5de3ab0dedc17a42eb8b"}
Nov 03 21:44:56.078867 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.078301    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-wd97l" event={"ID":"439cdf28-89f2-47eb-9a61-b63f4db9237b","Type":"ContainerStarted","Data":"db0c64f2e944ef34e1cf5a36d01cde96f86a5e332cbd150841e907822c68a874"}
Nov 03 21:44:56.078867 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.078344    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-wd97l" event={"ID":"439cdf28-89f2-47eb-9a61-b63f4db9237b","Type":"ContainerStarted","Data":"f8ccb61c415dbd02c5b80ef5f49d22335e29d795a05f67c294f83f9551357155"}
Nov 03 21:44:56.084648 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.084570    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-p7l88" podStartSLOduration=417.084552814 podStartE2EDuration="6m57.084552814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:37:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:44:56.081507688 +0000 UTC m=+31.788238762" watchObservedRunningTime="2026-11-03 21:44:56.084552814 +0000 UTC m=+31.791283866"
Nov 03 21:44:56.085195 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.085168    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tqldf" event={"ID":"5cbdd163-bfdd-4fda-8141-21b969a3aa08","Type":"ContainerStarted","Data":"a5daeb44ff1a28cff9bd2e239be0feab2789cd292da35e64eebbd80e58417d29"}
Nov 03 21:44:56.090899 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.090870    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-vhbjg" event={"ID":"fe9f47b3-180f-4485-b611-a66abe1974db","Type":"ContainerStarted","Data":"ea5f80fdb69989b93327100cb6fcfb2fa8096a7a299f66db1968c8863e20e362"}
Nov 03 21:44:56.093497 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.093420    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng" event={"ID":"b3a526c1-84f8-41a0-8dee-0ed08bddc5da","Type":"ContainerStarted","Data":"58b23b1048cea694797201eb85ffb9ff4ce65f997215a15726919c7b58980708"}
Nov 03 21:44:56.097397 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.097330    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs" event={"ID":"36598f65-5a1d-43e3-acc2-71c1e56f112c","Type":"ContainerStarted","Data":"90cf459c1c1518f337436004a3f0c58e938a75debc1c5a3ca88355cf43d60dce"}
Nov 03 21:44:56.124897 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.124837    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-f5kct" podStartSLOduration=417.124820639 podStartE2EDuration="6m57.124820639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:37:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:44:56.101020408 +0000 UTC m=+31.807751455" watchObservedRunningTime="2026-11-03 21:44:56.124820639 +0000 UTC m=+31.831551692"
Nov 03 21:44:56.128614 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.126475    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-wd97l" podStartSLOduration=417.126460351 podStartE2EDuration="6m57.126460351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:37:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:44:56.122963976 +0000 UTC m=+31.829695030" watchObservedRunningTime="2026-11-03 21:44:56.126460351 +0000 UTC m=+31.833191403"
Nov 03 21:44:56.362941 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.362897    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:44:56.363099 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.362972    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fv6vx\" (UID: \"3ebc2e42-6892-480b-a793-4f224d09f45d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"
Nov 03 21:44:56.363099 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.363007    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:56.363099 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.363052    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/289044f0-b173-489e-971f-3dff8aaf9aaa-metrics-tls\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:44:56.363099 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.363082    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-metrics-certs\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:44:56.363344 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.363110    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:56.363344 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.363171    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-wvc4j\" (UID: \"ddc108c9-ccd3-462a-8694-2421004791cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:44:56.363344 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:56.363217    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-5dl8c\" (UID: \"b3746624-9331-4bfa-81ed-3a6f37c8d0e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:44:56.363484 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:56.363365    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 03 21:44:56.363484 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:56.363428    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls podName:b3746624-9331-4bfa-81ed-3a6f37c8d0e6 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:58.363411445 +0000 UTC m=+34.070142477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-5dl8c" (UID: "b3746624-9331-4bfa-81ed-3a6f37c8d0e6") : secret "samples-operator-tls" not found
Nov 03 21:44:56.363922 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:56.363902    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle podName:d6afb4de-bd45-4038-a6a9-9ff8671eb430 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:58.363884204 +0000 UTC m=+34.070615236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle") pod "router-default-5b77b9dbdf-rbjh5" (UID: "d6afb4de-bd45-4038-a6a9-9ff8671eb430") : configmap references non-existent config key: service-ca.crt
Nov 03 21:44:56.364031 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:56.363987    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 03 21:44:56.364031 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:56.364021    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert podName:3ebc2e42-6892-480b-a793-4f224d09f45d nodeName:}" failed. No retries permitted until 2026-11-03 21:44:58.364010704 +0000 UTC m=+34.070741737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fv6vx" (UID: "3ebc2e42-6892-480b-a793-4f224d09f45d") : secret "networking-console-plugin-cert" not found
Nov 03 21:44:56.364133 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:56.364081    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 21:44:56.364133 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:56.364092    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d56fbb4cf-57p87: secret "image-registry-tls" not found
Nov 03 21:44:56.364133 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:56.364122    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls podName:588bc17e-1307-4055-96a4-cbd60ba48541 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:58.364112364 +0000 UTC m=+34.070843396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls") pod "image-registry-5d56fbb4cf-57p87" (UID: "588bc17e-1307-4055-96a4-cbd60ba48541") : secret "image-registry-tls" not found
Nov 03 21:44:56.364304 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:56.364179    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 21:44:56.364304 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:56.364205    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289044f0-b173-489e-971f-3dff8aaf9aaa-metrics-tls podName:289044f0-b173-489e-971f-3dff8aaf9aaa nodeName:}" failed. No retries permitted until 2026-11-03 21:44:58.364195609 +0000 UTC m=+34.070926643 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/289044f0-b173-489e-971f-3dff8aaf9aaa-metrics-tls") pod "dns-default-bmvnd" (UID: "289044f0-b173-489e-971f-3dff8aaf9aaa") : secret "dns-default-metrics-tls" not found
Nov 03 21:44:56.364304 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:56.364278    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 03 21:44:56.364449 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:56.364309    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-metrics-certs podName:d6afb4de-bd45-4038-a6a9-9ff8671eb430 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:58.36429937 +0000 UTC m=+34.071030404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-metrics-certs") pod "router-default-5b77b9dbdf-rbjh5" (UID: "d6afb4de-bd45-4038-a6a9-9ff8671eb430") : secret "router-metrics-certs-default" not found
Nov 03 21:44:56.364449 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:56.364370    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 21:44:56.364449 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:56.364380    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b86b7998-kbxzw: secret "image-registry-tls" not found
Nov 03 21:44:56.364449 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:56.364407    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls podName:d21190d3-0ed6-4c4e-a71f-ca14d48ffd03 nodeName:}" failed. No retries permitted until 2026-11-03 21:44:58.364397969 +0000 UTC m=+34.071129002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls") pod "image-registry-9b86b7998-kbxzw" (UID: "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03") : secret "image-registry-tls" not found
Nov 03 21:44:56.364635 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:56.364460    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 03 21:44:56.364635 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:56.364488    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls podName:ddc108c9-ccd3-462a-8694-2421004791cd nodeName:}" failed. No retries permitted until 2026-11-03 21:44:58.364479242 +0000 UTC m=+34.071210273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-wvc4j" (UID: "ddc108c9-ccd3-462a-8694-2421004791cd") : secret "cluster-monitoring-operator-tls" not found
Nov 03 21:44:58.109490 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:58.108722    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-5w6h4" event={"ID":"45862374-6557-46b1-9982-4b77670216df","Type":"ContainerStarted","Data":"f0012dd7e7e7710024c821e9ac675044a9b3f16a8591c5baf27244e054470669"}
Nov 03 21:44:58.129292 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:58.128676    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-5w6h4" podStartSLOduration=388.887677194 podStartE2EDuration="6m31.128657374s" totalImagesPullingTime="2.24098018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:38:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:44:58.127110743 +0000 UTC m=+33.833841820" watchObservedRunningTime="2026-11-03 21:44:58.128657374 +0000 UTC m=+33.835388435"
Nov 03 21:44:58.384832 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:58.384713    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/289044f0-b173-489e-971f-3dff8aaf9aaa-metrics-tls\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:44:58.384832 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:58.384766    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-metrics-certs\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:44:58.384832 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:58.384791    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:44:58.385121 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:58.384852    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-wvc4j\" (UID: \"ddc108c9-ccd3-462a-8694-2421004791cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:44:58.385121 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:58.384909    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-5dl8c\" (UID: \"b3746624-9331-4bfa-81ed-3a6f37c8d0e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:44:58.385121 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:58.384922    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 21:44:58.385121 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:58.384956    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:44:58.385121 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:58.385002    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289044f0-b173-489e-971f-3dff8aaf9aaa-metrics-tls podName:289044f0-b173-489e-971f-3dff8aaf9aaa nodeName:}" failed. No retries permitted until 2026-11-03 21:45:02.384982952 +0000 UTC m=+38.091714020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/289044f0-b173-489e-971f-3dff8aaf9aaa-metrics-tls") pod "dns-default-bmvnd" (UID: "289044f0-b173-489e-971f-3dff8aaf9aaa") : secret "dns-default-metrics-tls" not found
Nov 03 21:44:58.385121 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:58.385051    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fv6vx\" (UID: \"3ebc2e42-6892-480b-a793-4f224d09f45d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"
Nov 03 21:44:58.385121 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:58.385075    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle podName:d6afb4de-bd45-4038-a6a9-9ff8671eb430 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:02.385061599 +0000 UTC m=+38.091792629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle") pod "router-default-5b77b9dbdf-rbjh5" (UID: "d6afb4de-bd45-4038-a6a9-9ff8671eb430") : configmap references non-existent config key: service-ca.crt
Nov 03 21:44:58.385121 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:58.385109    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:44:58.385121 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:58.385127    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 03 21:44:58.385744 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:58.385167    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert podName:3ebc2e42-6892-480b-a793-4f224d09f45d nodeName:}" failed. No retries permitted until 2026-11-03 21:45:02.385155423 +0000 UTC m=+38.091886453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fv6vx" (UID: "3ebc2e42-6892-480b-a793-4f224d09f45d") : secret "networking-console-plugin-cert" not found
Nov 03 21:44:58.385744 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:58.385239    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 21:44:58.385744 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:58.385268    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d56fbb4cf-57p87: secret "image-registry-tls" not found
Nov 03 21:44:58.385744 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:58.385308    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls podName:588bc17e-1307-4055-96a4-cbd60ba48541 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:02.385294621 +0000 UTC m=+38.092025656 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls") pod "image-registry-5d56fbb4cf-57p87" (UID: "588bc17e-1307-4055-96a4-cbd60ba48541") : secret "image-registry-tls" not found
Nov 03 21:44:58.385744 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:58.385349    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 21:44:58.385744 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:58.385360    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 03 21:44:58.385744 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:58.385363    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b86b7998-kbxzw: secret "image-registry-tls" not found
Nov 03 21:44:58.385744 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:58.385381    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls podName:ddc108c9-ccd3-462a-8694-2421004791cd nodeName:}" failed. No retries permitted until 2026-11-03 21:45:02.385374813 +0000 UTC m=+38.092105844 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-wvc4j" (UID: "ddc108c9-ccd3-462a-8694-2421004791cd") : secret "cluster-monitoring-operator-tls" not found
Nov 03 21:44:58.385744 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:58.385405    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls podName:d21190d3-0ed6-4c4e-a71f-ca14d48ffd03 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:02.385391865 +0000 UTC m=+38.092122899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls") pod "image-registry-9b86b7998-kbxzw" (UID: "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03") : secret "image-registry-tls" not found
Nov 03 21:44:58.385744 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:58.385418    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 03 21:44:58.385744 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:58.385437    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls podName:b3746624-9331-4bfa-81ed-3a6f37c8d0e6 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:02.385431211 +0000 UTC m=+38.092162240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-5dl8c" (UID: "b3746624-9331-4bfa-81ed-3a6f37c8d0e6") : secret "samples-operator-tls" not found
Nov 03 21:44:58.385744 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:58.385470    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 03 21:44:58.385744 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:58.385506    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-metrics-certs podName:d6afb4de-bd45-4038-a6a9-9ff8671eb430 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:02.385495761 +0000 UTC m=+38.092226793 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-metrics-certs") pod "router-default-5b77b9dbdf-rbjh5" (UID: "d6afb4de-bd45-4038-a6a9-9ff8671eb430") : secret "router-metrics-certs-default" not found
Nov 03 21:44:58.486433 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:58.486393    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs\") pod \"network-metrics-daemon-kjp2c\" (UID: \"8915bffd-4628-4aee-994b-81de7d1ad7c6\") " pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:44:58.486702 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:58.486683    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 03 21:44:58.486793 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:44:58.486749    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs podName:8915bffd-4628-4aee-994b-81de7d1ad7c6 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:30.486732579 +0000 UTC m=+66.193463623 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs") pod "network-metrics-daemon-kjp2c" (UID: "8915bffd-4628-4aee-994b-81de7d1ad7c6") : secret "metrics-daemon-secret" not found
Nov 03 21:44:58.587947 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:58.587383    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:58.587947 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:58.587454    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbs2h\" (UniqueName: \"kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h\") pod \"network-check-target-ztd6j\" (UID: \"7b22f42e-7346-4165-b4ea-99e12837742c\") " pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:58.600147 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:58.600113    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbs2h\" (UniqueName: \"kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h\") pod \"network-check-target-ztd6j\" (UID: \"7b22f42e-7346-4165-b4ea-99e12837742c\") " pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:58.604735 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:58.604675    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:58.814763 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:58.814561    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:44:58.821709 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:58.821625    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:44:59.122104 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:59.122025    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dndpk"]
Nov 03 21:44:59.160196 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:44:59.160124    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ztd6j"]
Nov 03 21:44:59.247023 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:44:59.246995    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b1bc67e_f876_4fec_b9bf_a3a8906d8d94.slice/crio-fed14f7cf3ae3d7ab5f9f3da6fa553395102604ddbe374558ea449827c6b0f02 WatchSource:0}: Error finding container fed14f7cf3ae3d7ab5f9f3da6fa553395102604ddbe374558ea449827c6b0f02: Status 404 returned error can't find the container with id fed14f7cf3ae3d7ab5f9f3da6fa553395102604ddbe374558ea449827c6b0f02
Nov 03 21:45:00.117723 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:00.117018    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pspgs_36598f65-5a1d-43e3-acc2-71c1e56f112c/console-operator/0.log"
Nov 03 21:45:00.117723 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:00.117062    2572 generic.go:356] "Generic (PLEG): container finished" podID="36598f65-5a1d-43e3-acc2-71c1e56f112c" containerID="50cb23ba120a2560694f51a9882aa39b5cc6c27bfd0cd9742c67f27482df4205" exitCode=255
Nov 03 21:45:00.117723 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:00.117156    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs" event={"ID":"36598f65-5a1d-43e3-acc2-71c1e56f112c","Type":"ContainerDied","Data":"50cb23ba120a2560694f51a9882aa39b5cc6c27bfd0cd9742c67f27482df4205"}
Nov 03 21:45:00.117723 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:00.117401    2572 scope.go:122] "RemoveContainer" containerID="50cb23ba120a2560694f51a9882aa39b5cc6c27bfd0cd9742c67f27482df4205"
Nov 03 21:45:00.120749 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:00.120719    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ztd6j" event={"ID":"7b22f42e-7346-4165-b4ea-99e12837742c","Type":"ContainerStarted","Data":"24cc09b481a6341e12171d151216947511774a36c7e685d42e6b13a61b41b757"}
Nov 03 21:45:00.122188 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:00.122161    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dndpk" event={"ID":"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94","Type":"ContainerStarted","Data":"fed14f7cf3ae3d7ab5f9f3da6fa553395102604ddbe374558ea449827c6b0f02"}
Nov 03 21:45:00.966301 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:00.963668    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x7fmc"]
Nov 03 21:45:00.988938 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:00.988546    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-xghgl-bwm6n"]
Nov 03 21:45:00.990348 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:00.990262    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:00.996009 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:00.994363    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 03 21:45:00.996009 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:00.994999    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 03 21:45:00.996499 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:00.996450    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7bvj7\""
Nov 03 21:45:01.007639 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.007615    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x7fmc"]
Nov 03 21:45:01.007736 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.007672    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-xghgl-bwm6n"]
Nov 03 21:45:01.007828 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.007811    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:01.095165 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.095126    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5f6rr\""
Nov 03 21:45:01.117626 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.117583    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:01.117791 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.117655    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-trusted-ca-bundle\") pod \"periodic-gathering-xghgl-bwm6n\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") " pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:01.117791 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.117741    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg9zw\" (UniqueName: \"kubernetes.io/projected/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-api-access-qg9zw\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:01.117791 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.117765    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-service-ca-bundle\") pod \"periodic-gathering-xghgl-bwm6n\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") " pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:01.117962 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.117814    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmf4v\" (UniqueName: \"kubernetes.io/projected/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-kube-api-access-jmf4v\") pod \"periodic-gathering-xghgl-bwm6n\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") " pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:01.118024 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.117948    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-archives-path\") pod \"periodic-gathering-xghgl-bwm6n\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") " pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:01.118199 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.118173    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c61b4b48-0d5d-4c17-9218-c38bf3581e98-data-volume\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:01.118359 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.118298    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c61b4b48-0d5d-4c17-9218-c38bf3581e98-crio-socket\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:01.118418 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.118355    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:01.129226 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.129186    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg" event={"ID":"6c07fa44-702c-4e55-afe3-451696e76f82","Type":"ContainerStarted","Data":"d8ae56b5044a5a1006dadf9c3d1828cdf514fc58b80de4f4351a58325d079e25"}
Nov 03 21:45:01.132542 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.132478    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tqldf" event={"ID":"5cbdd163-bfdd-4fda-8141-21b969a3aa08","Type":"ContainerStarted","Data":"f011319e014d7e62f4c8239c5feb89ab4adb9bf4330f6878e0c4e02df79eea63"}
Nov 03 21:45:01.136397 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.136272    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng" event={"ID":"b3a526c1-84f8-41a0-8dee-0ed08bddc5da","Type":"ContainerStarted","Data":"49a999ac0543cf8fc6b63957de908b7708916e43b205c20e91c756c3d61e3f0e"}
Nov 03 21:45:01.138679 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.138654    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pspgs_36598f65-5a1d-43e3-acc2-71c1e56f112c/console-operator/1.log"
Nov 03 21:45:01.139225 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.139206    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pspgs_36598f65-5a1d-43e3-acc2-71c1e56f112c/console-operator/0.log"
Nov 03 21:45:01.139354 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.139266    2572 generic.go:356] "Generic (PLEG): container finished" podID="36598f65-5a1d-43e3-acc2-71c1e56f112c" containerID="205e56b9b376059dd655d9e4c4c3295d73f1dd1ee6091d03a9936d7434913f5c" exitCode=255
Nov 03 21:45:01.139410 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.139351    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs" event={"ID":"36598f65-5a1d-43e3-acc2-71c1e56f112c","Type":"ContainerDied","Data":"205e56b9b376059dd655d9e4c4c3295d73f1dd1ee6091d03a9936d7434913f5c"}
Nov 03 21:45:01.139488 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.139397    2572 scope.go:122] "RemoveContainer" containerID="50cb23ba120a2560694f51a9882aa39b5cc6c27bfd0cd9742c67f27482df4205"
Nov 03 21:45:01.139593 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.139573    2572 scope.go:122] "RemoveContainer" containerID="205e56b9b376059dd655d9e4c4c3295d73f1dd1ee6091d03a9936d7434913f5c"
Nov 03 21:45:01.139736 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:01.139717    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-pspgs_openshift-console-operator(36598f65-5a1d-43e3-acc2-71c1e56f112c)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs" podUID="36598f65-5a1d-43e3-acc2-71c1e56f112c"
Nov 03 21:45:01.141573 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.141551    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-kmt8d" event={"ID":"3a3d055a-397e-436d-99bd-e82541b4ce57","Type":"ContainerStarted","Data":"10ecca4335ff24d76e5ecc904d3a9c026d96f33a80e319444e02944e61e13bcd"}
Nov 03 21:45:01.150378 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.150325    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg" podStartSLOduration=389.302532525 podStartE2EDuration="6m34.150307685s" totalImagesPullingTime="4.84777516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:38:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:01.148753057 +0000 UTC m=+36.855484112" watchObservedRunningTime="2026-11-03 21:45:01.150307685 +0000 UTC m=+36.857038739"
Nov 03 21:45:01.179269 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.177800    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-kmt8d" podStartSLOduration=389.310801211 podStartE2EDuration="6m34.177780358s" totalImagesPullingTime="4.866979147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:38:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:01.177059683 +0000 UTC m=+36.883790735" watchObservedRunningTime="2026-11-03 21:45:01.177780358 +0000 UTC m=+36.884511411"
Nov 03 21:45:01.196632 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.196574    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng" podStartSLOduration=389.374479834 podStartE2EDuration="6m34.196554651s" totalImagesPullingTime="4.822074817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:38:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:01.195600983 +0000 UTC m=+36.902332053" watchObservedRunningTime="2026-11-03 21:45:01.196554651 +0000 UTC m=+36.903285704"
Nov 03 21:45:01.217045 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.216325    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tqldf" podStartSLOduration=2.105025757 podStartE2EDuration="7.216311929s" totalImagesPullingTime="5.111286172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:44:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:01.215128194 +0000 UTC m=+36.921859248" watchObservedRunningTime="2026-11-03 21:45:01.216311929 +0000 UTC m=+36.923042983"
Nov 03 21:45:01.222966 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.219310    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:01.222966 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.219355    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-trusted-ca-bundle\") pod \"periodic-gathering-xghgl-bwm6n\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") " pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:01.222966 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.219483    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg9zw\" (UniqueName: \"kubernetes.io/projected/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-api-access-qg9zw\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:01.222966 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.219500    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-service-ca-bundle\") pod \"periodic-gathering-xghgl-bwm6n\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") " pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:01.222966 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.219540    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmf4v\" (UniqueName: \"kubernetes.io/projected/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-kube-api-access-jmf4v\") pod \"periodic-gathering-xghgl-bwm6n\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") " pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:01.222966 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.219568    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-archives-path\") pod \"periodic-gathering-xghgl-bwm6n\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") " pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:01.222966 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.219602    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c61b4b48-0d5d-4c17-9218-c38bf3581e98-data-volume\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:01.222966 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.219626    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c61b4b48-0d5d-4c17-9218-c38bf3581e98-crio-socket\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:01.222966 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.219652    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:01.222966 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.221601    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c61b4b48-0d5d-4c17-9218-c38bf3581e98-data-volume\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:01.222966 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.221800    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c61b4b48-0d5d-4c17-9218-c38bf3581e98-crio-socket\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:01.222966 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:01.221901    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 21:45:01.222966 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:01.221956    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls podName:c61b4b48-0d5d-4c17-9218-c38bf3581e98 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:01.721939505 +0000 UTC m=+37.428670560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x7fmc" (UID: "c61b4b48-0d5d-4c17-9218-c38bf3581e98") : secret "insights-runtime-extractor-tls" not found
Nov 03 21:45:01.222966 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.222049    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-service-ca-bundle\") pod \"periodic-gathering-xghgl-bwm6n\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") " pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:01.222966 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:01.222141    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 03 21:45:01.222966 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:01.222228    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-rbac-proxy-cm podName:c61b4b48-0d5d-4c17-9218-c38bf3581e98 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:01.722208902 +0000 UTC m=+37.428939933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x7fmc" (UID: "c61b4b48-0d5d-4c17-9218-c38bf3581e98") : configmap "kube-rbac-proxy" not found
Nov 03 21:45:01.223819 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.222829    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-archives-path\") pod \"periodic-gathering-xghgl-bwm6n\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") " pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:01.223882 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.223838    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-trusted-ca-bundle\") pod \"periodic-gathering-xghgl-bwm6n\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") " pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:01.236150 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.236081    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmf4v\" (UniqueName: \"kubernetes.io/projected/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-kube-api-access-jmf4v\") pod \"periodic-gathering-xghgl-bwm6n\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") " pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:01.236924 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.236903    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg9zw\" (UniqueName: \"kubernetes.io/projected/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-api-access-qg9zw\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:01.334110 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.334055    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:01.366446 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.366154    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-g7kms"]
Nov 03 21:45:01.401603 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.401561    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-g7kms"]
Nov 03 21:45:01.401856 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.401715    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-g7kms"
Nov 03 21:45:01.402447 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.401912    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-zdz8c"]
Nov 03 21:45:01.410209 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.410185    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-zdz8c"]
Nov 03 21:45:01.410500 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.410481    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-zdz8c"
Nov 03 21:45:01.413561 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.412985    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-cvbdp\""
Nov 03 21:45:01.432332 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.432308    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Nov 03 21:45:01.432869 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.432473    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Nov 03 21:45:01.526381 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.525930    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h69t\" (UniqueName: \"kubernetes.io/projected/88ceb339-f96e-45a4-ad35-9691dc70fbd9-kube-api-access-7h69t\") pod \"migrator-66df5d496b-g7kms\" (UID: \"88ceb339-f96e-45a4-ad35-9691dc70fbd9\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-g7kms"
Nov 03 21:45:01.526381 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.526074    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q89j\" (UniqueName: \"kubernetes.io/projected/542a90b4-b01a-4cad-a5bf-e0181fe30586-kube-api-access-8q89j\") pod \"migrator-66df5d496b-zdz8c\" (UID: \"542a90b4-b01a-4cad-a5bf-e0181fe30586\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-zdz8c"
Nov 03 21:45:01.627805 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.627294    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h69t\" (UniqueName: \"kubernetes.io/projected/88ceb339-f96e-45a4-ad35-9691dc70fbd9-kube-api-access-7h69t\") pod \"migrator-66df5d496b-g7kms\" (UID: \"88ceb339-f96e-45a4-ad35-9691dc70fbd9\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-g7kms"
Nov 03 21:45:01.627805 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.627424    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q89j\" (UniqueName: \"kubernetes.io/projected/542a90b4-b01a-4cad-a5bf-e0181fe30586-kube-api-access-8q89j\") pod \"migrator-66df5d496b-zdz8c\" (UID: \"542a90b4-b01a-4cad-a5bf-e0181fe30586\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-zdz8c"
Nov 03 21:45:01.641155 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.641121    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h69t\" (UniqueName: \"kubernetes.io/projected/88ceb339-f96e-45a4-ad35-9691dc70fbd9-kube-api-access-7h69t\") pod \"migrator-66df5d496b-g7kms\" (UID: \"88ceb339-f96e-45a4-ad35-9691dc70fbd9\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-g7kms"
Nov 03 21:45:01.641650 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.641634    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q89j\" (UniqueName: \"kubernetes.io/projected/542a90b4-b01a-4cad-a5bf-e0181fe30586-kube-api-access-8q89j\") pod \"migrator-66df5d496b-zdz8c\" (UID: \"542a90b4-b01a-4cad-a5bf-e0181fe30586\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-zdz8c"
Nov 03 21:45:01.645952 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.645920    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-xghgl-bwm6n"]
Nov 03 21:45:01.652034 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:45:01.651993    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb8c77f_1d9a_4a7d_adde_ff0b851395ed.slice/crio-d9cad674ab6242b49531be8dd0c5c0448d767f682c9a1da4c3ff1bc88bc18cf0 WatchSource:0}: Error finding container d9cad674ab6242b49531be8dd0c5c0448d767f682c9a1da4c3ff1bc88bc18cf0: Status 404 returned error can't find the container with id d9cad674ab6242b49531be8dd0c5c0448d767f682c9a1da4c3ff1bc88bc18cf0
Nov 03 21:45:01.658782 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.658709    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-czxjn"]
Nov 03 21:45:01.665408 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.665385    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-czxjn"
Nov 03 21:45:01.675773 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.671002    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Nov 03 21:45:01.675773 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.671131    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Nov 03 21:45:01.675773 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.671217    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Nov 03 21:45:01.675773 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.671331    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Nov 03 21:45:01.675773 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.672733    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zl56c\""
Nov 03 21:45:01.677163 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.677116    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-czxjn"]
Nov 03 21:45:01.728116 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.728083    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:01.728280 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.728163    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:01.728352 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:01.728288    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 21:45:01.728407 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:01.728352    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls podName:c61b4b48-0d5d-4c17-9218-c38bf3581e98 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:02.728333077 +0000 UTC m=+38.435064107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x7fmc" (UID: "c61b4b48-0d5d-4c17-9218-c38bf3581e98") : secret "insights-runtime-extractor-tls" not found
Nov 03 21:45:01.728407 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:01.728380    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 03 21:45:01.728515 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:01.728430    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-rbac-proxy-cm podName:c61b4b48-0d5d-4c17-9218-c38bf3581e98 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:02.728416369 +0000 UTC m=+38.435147407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x7fmc" (UID: "c61b4b48-0d5d-4c17-9218-c38bf3581e98") : configmap "kube-rbac-proxy" not found
Nov 03 21:45:01.750656 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.750633    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-g7kms"
Nov 03 21:45:01.761680 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.761651    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-zdz8c"
Nov 03 21:45:01.830730 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.830233    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0cd51906-d6ac-438c-8716-7b60d4c9a1e4-signing-key\") pod \"service-ca-5fffc97bdf-czxjn\" (UID: \"0cd51906-d6ac-438c-8716-7b60d4c9a1e4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-czxjn"
Nov 03 21:45:01.830730 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.830307    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp284\" (UniqueName: \"kubernetes.io/projected/0cd51906-d6ac-438c-8716-7b60d4c9a1e4-kube-api-access-hp284\") pod \"service-ca-5fffc97bdf-czxjn\" (UID: \"0cd51906-d6ac-438c-8716-7b60d4c9a1e4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-czxjn"
Nov 03 21:45:01.830730 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.830481    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0cd51906-d6ac-438c-8716-7b60d4c9a1e4-signing-cabundle\") pod \"service-ca-5fffc97bdf-czxjn\" (UID: \"0cd51906-d6ac-438c-8716-7b60d4c9a1e4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-czxjn"
Nov 03 21:45:01.932594 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.932034    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0cd51906-d6ac-438c-8716-7b60d4c9a1e4-signing-cabundle\") pod \"service-ca-5fffc97bdf-czxjn\" (UID: \"0cd51906-d6ac-438c-8716-7b60d4c9a1e4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-czxjn"
Nov 03 21:45:01.932594 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.932142    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0cd51906-d6ac-438c-8716-7b60d4c9a1e4-signing-key\") pod \"service-ca-5fffc97bdf-czxjn\" (UID: \"0cd51906-d6ac-438c-8716-7b60d4c9a1e4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-czxjn"
Nov 03 21:45:01.932594 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.932183    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp284\" (UniqueName: \"kubernetes.io/projected/0cd51906-d6ac-438c-8716-7b60d4c9a1e4-kube-api-access-hp284\") pod \"service-ca-5fffc97bdf-czxjn\" (UID: \"0cd51906-d6ac-438c-8716-7b60d4c9a1e4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-czxjn"
Nov 03 21:45:01.932594 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.933628    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0cd51906-d6ac-438c-8716-7b60d4c9a1e4-signing-cabundle\") pod \"service-ca-5fffc97bdf-czxjn\" (UID: \"0cd51906-d6ac-438c-8716-7b60d4c9a1e4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-czxjn"
Nov 03 21:45:01.937372 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.937325    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0cd51906-d6ac-438c-8716-7b60d4c9a1e4-signing-key\") pod \"service-ca-5fffc97bdf-czxjn\" (UID: \"0cd51906-d6ac-438c-8716-7b60d4c9a1e4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-czxjn"
Nov 03 21:45:01.950561 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:01.950534    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp284\" (UniqueName: \"kubernetes.io/projected/0cd51906-d6ac-438c-8716-7b60d4c9a1e4-kube-api-access-hp284\") pod \"service-ca-5fffc97bdf-czxjn\" (UID: \"0cd51906-d6ac-438c-8716-7b60d4c9a1e4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-czxjn"
Nov 03 21:45:02.016091 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.015826    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-czxjn"
Nov 03 21:45:02.054992 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.054964    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-g7kms"]
Nov 03 21:45:02.060897 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:45:02.060856    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ceb339_f96e_45a4_ad35_9691dc70fbd9.slice/crio-957ce6cd0b35b23d312801ad6e7bb9c80c7681a99cf93c0dcf3f11f18978f9e5 WatchSource:0}: Error finding container 957ce6cd0b35b23d312801ad6e7bb9c80c7681a99cf93c0dcf3f11f18978f9e5: Status 404 returned error can't find the container with id 957ce6cd0b35b23d312801ad6e7bb9c80c7681a99cf93c0dcf3f11f18978f9e5
Nov 03 21:45:02.092897 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.092862    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-zdz8c"]
Nov 03 21:45:02.106454 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:45:02.106420    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod542a90b4_b01a_4cad_a5bf_e0181fe30586.slice/crio-010d9285d681fb1c0f9f5025662927cef701ef59de0a4dcc8e437a10aa7d8eb4 WatchSource:0}: Error finding container 010d9285d681fb1c0f9f5025662927cef701ef59de0a4dcc8e437a10aa7d8eb4: Status 404 returned error can't find the container with id 010d9285d681fb1c0f9f5025662927cef701ef59de0a4dcc8e437a10aa7d8eb4
Nov 03 21:45:02.150760 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.150717    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-g7kms" event={"ID":"88ceb339-f96e-45a4-ad35-9691dc70fbd9","Type":"ContainerStarted","Data":"957ce6cd0b35b23d312801ad6e7bb9c80c7681a99cf93c0dcf3f11f18978f9e5"}
Nov 03 21:45:02.153275 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.153004    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-vhbjg" event={"ID":"fe9f47b3-180f-4485-b611-a66abe1974db","Type":"ContainerStarted","Data":"cc4a86981a296d9693e5614cdff3c30cb70c8f0686b757f9cb9002301365145f"}
Nov 03 21:45:02.155645 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.155622    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pspgs_36598f65-5a1d-43e3-acc2-71c1e56f112c/console-operator/1.log"
Nov 03 21:45:02.156014 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.155998    2572 scope.go:122] "RemoveContainer" containerID="205e56b9b376059dd655d9e4c4c3295d73f1dd1ee6091d03a9936d7434913f5c"
Nov 03 21:45:02.156208 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.156186    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-pspgs_openshift-console-operator(36598f65-5a1d-43e3-acc2-71c1e56f112c)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs" podUID="36598f65-5a1d-43e3-acc2-71c1e56f112c"
Nov 03 21:45:02.157380 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.157356    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-xghgl-bwm6n" event={"ID":"abb8c77f-1d9a-4a7d-adde-ff0b851395ed","Type":"ContainerStarted","Data":"4ee5644d6242e02aa993244c4ed94bb746708073989adf6244c8a06e7cce8813"}
Nov 03 21:45:02.157464 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.157404    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-xghgl-bwm6n" event={"ID":"abb8c77f-1d9a-4a7d-adde-ff0b851395ed","Type":"ContainerStarted","Data":"d9cad674ab6242b49531be8dd0c5c0448d767f682c9a1da4c3ff1bc88bc18cf0"}
Nov 03 21:45:02.159948 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.159929    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-zdz8c" event={"ID":"542a90b4-b01a-4cad-a5bf-e0181fe30586","Type":"ContainerStarted","Data":"010d9285d681fb1c0f9f5025662927cef701ef59de0a4dcc8e437a10aa7d8eb4"}
Nov 03 21:45:02.196457 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.196382    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-vhbjg" podStartSLOduration=386.268966618 podStartE2EDuration="6m32.19636943s" totalImagesPullingTime="5.927402812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:38:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:02.174038535 +0000 UTC m=+37.880769587" watchObservedRunningTime="2026-11-03 21:45:02.19636943 +0000 UTC m=+37.903100482"
Nov 03 21:45:02.219283 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.219205    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-xghgl-bwm6n" podStartSLOduration=2.219187364 podStartE2EDuration="2.219187364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:02.217297757 +0000 UTC m=+37.924028810" watchObservedRunningTime="2026-11-03 21:45:02.219187364 +0000 UTC m=+37.925918417"
Nov 03 21:45:02.337274 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.336924    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-czxjn"]
Nov 03 21:45:02.340090 ip-10-0-128-183 kubenswrapper[2572]: W1103 21:45:02.340056    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cd51906_d6ac_438c_8716_7b60d4c9a1e4.slice/crio-e806da4c9b6cb5741fb45ac6a65e1de0631a2c1d6924212171068605aac0357e WatchSource:0}: Error finding container e806da4c9b6cb5741fb45ac6a65e1de0631a2c1d6924212171068605aac0357e: Status 404 returned error can't find the container with id e806da4c9b6cb5741fb45ac6a65e1de0631a2c1d6924212171068605aac0357e
Nov 03 21:45:02.439261 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.439216    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:02.439377 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.439321    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fv6vx\" (UID: \"3ebc2e42-6892-480b-a793-4f224d09f45d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"
Nov 03 21:45:02.439377 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.439360    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:02.439482 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.439375    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle podName:d6afb4de-bd45-4038-a6a9-9ff8671eb430 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:10.439357674 +0000 UTC m=+46.146088708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle") pod "router-default-5b77b9dbdf-rbjh5" (UID: "d6afb4de-bd45-4038-a6a9-9ff8671eb430") : configmap references non-existent config key: service-ca.crt
Nov 03 21:45:02.439482 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.439439    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/289044f0-b173-489e-971f-3dff8aaf9aaa-metrics-tls\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:45:02.439482 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.439451    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 21:45:02.439482 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.439469    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d56fbb4cf-57p87: secret "image-registry-tls" not found
Nov 03 21:45:02.439482 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.439471    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-metrics-certs\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:02.439728 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.439492    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:02.439728 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.439515    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls podName:588bc17e-1307-4055-96a4-cbd60ba48541 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:10.43949993 +0000 UTC m=+46.146230981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls") pod "image-registry-5d56fbb4cf-57p87" (UID: "588bc17e-1307-4055-96a4-cbd60ba48541") : secret "image-registry-tls" not found
Nov 03 21:45:02.439728 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.439548    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 21:45:02.439728 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.439558    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b86b7998-kbxzw: secret "image-registry-tls" not found
Nov 03 21:45:02.439728 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.439581    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls podName:d21190d3-0ed6-4c4e-a71f-ca14d48ffd03 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:10.439574011 +0000 UTC m=+46.146305041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls") pod "image-registry-9b86b7998-kbxzw" (UID: "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03") : secret "image-registry-tls" not found
Nov 03 21:45:02.439728 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.439601    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-wvc4j\" (UID: \"ddc108c9-ccd3-462a-8694-2421004791cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:45:02.439728 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.439631    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 03 21:45:02.439728 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.439646    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-5dl8c\" (UID: \"b3746624-9331-4bfa-81ed-3a6f37c8d0e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:45:02.439728 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.439669    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert podName:3ebc2e42-6892-480b-a793-4f224d09f45d nodeName:}" failed. No retries permitted until 2026-11-03 21:45:10.439658156 +0000 UTC m=+46.146389201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fv6vx" (UID: "3ebc2e42-6892-480b-a793-4f224d09f45d") : secret "networking-console-plugin-cert" not found
Nov 03 21:45:02.439728 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.439716    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 03 21:45:02.440166 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.439747    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls podName:b3746624-9331-4bfa-81ed-3a6f37c8d0e6 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:10.439737947 +0000 UTC m=+46.146468977 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-5dl8c" (UID: "b3746624-9331-4bfa-81ed-3a6f37c8d0e6") : secret "samples-operator-tls" not found
Nov 03 21:45:02.440166 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.439766    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 21:45:02.440166 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.439794    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 03 21:45:02.440166 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.439800    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289044f0-b173-489e-971f-3dff8aaf9aaa-metrics-tls podName:289044f0-b173-489e-971f-3dff8aaf9aaa nodeName:}" failed. No retries permitted until 2026-11-03 21:45:10.439788773 +0000 UTC m=+46.146519819 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/289044f0-b173-489e-971f-3dff8aaf9aaa-metrics-tls") pod "dns-default-bmvnd" (UID: "289044f0-b173-489e-971f-3dff8aaf9aaa") : secret "dns-default-metrics-tls" not found
Nov 03 21:45:02.440166 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.439816    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-metrics-certs podName:d6afb4de-bd45-4038-a6a9-9ff8671eb430 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:10.43981014 +0000 UTC m=+46.146541170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-metrics-certs") pod "router-default-5b77b9dbdf-rbjh5" (UID: "d6afb4de-bd45-4038-a6a9-9ff8671eb430") : secret "router-metrics-certs-default" not found
Nov 03 21:45:02.440166 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.439846    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 03 21:45:02.440166 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.439874    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls podName:ddc108c9-ccd3-462a-8694-2421004791cd nodeName:}" failed. No retries permitted until 2026-11-03 21:45:10.439867109 +0000 UTC m=+46.146598139 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-wvc4j" (UID: "ddc108c9-ccd3-462a-8694-2421004791cd") : secret "cluster-monitoring-operator-tls" not found
Nov 03 21:45:02.743722 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.743618    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:02.743722 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:02.743698    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:02.743951 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.743844    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 21:45:02.743951 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.743915    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 03 21:45:02.744390 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.744369    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls podName:c61b4b48-0d5d-4c17-9218-c38bf3581e98 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:04.744343499 +0000 UTC m=+40.451074545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x7fmc" (UID: "c61b4b48-0d5d-4c17-9218-c38bf3581e98") : secret "insights-runtime-extractor-tls" not found
Nov 03 21:45:02.744513 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:02.744412    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-rbac-proxy-cm podName:c61b4b48-0d5d-4c17-9218-c38bf3581e98 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:04.744401523 +0000 UTC m=+40.451132586 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x7fmc" (UID: "c61b4b48-0d5d-4c17-9218-c38bf3581e98") : configmap "kube-rbac-proxy" not found
Nov 03 21:45:03.169972 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:03.169409    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-czxjn" event={"ID":"0cd51906-d6ac-438c-8716-7b60d4c9a1e4","Type":"ContainerStarted","Data":"ae78f173095aefe90a1abd67eb1fe4b8b40ecf6acf192ab298699ee5fd5bae1d"}
Nov 03 21:45:03.169972 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:03.169488    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-czxjn" event={"ID":"0cd51906-d6ac-438c-8716-7b60d4c9a1e4","Type":"ContainerStarted","Data":"e806da4c9b6cb5741fb45ac6a65e1de0631a2c1d6924212171068605aac0357e"}
Nov 03 21:45:03.188122 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:03.188069    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-czxjn" podStartSLOduration=2.188051771 podStartE2EDuration="2.188051771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:03.187586195 +0000 UTC m=+38.894317250" watchObservedRunningTime="2026-11-03 21:45:03.188051771 +0000 UTC m=+38.894782824"
Nov 03 21:45:04.173095 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:04.173056    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ztd6j" event={"ID":"7b22f42e-7346-4165-b4ea-99e12837742c","Type":"ContainerStarted","Data":"6adee544675a519200581b2b597ec4cd1d4b35cdadba1638eff72afb9954de60"}
Nov 03 21:45:04.191315 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:04.191242    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ztd6j" podStartSLOduration=35.361157818 podStartE2EDuration="39.191228518s" totalImagesPullingTime="3.8300707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:44:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:04.191015204 +0000 UTC m=+39.897746257" watchObservedRunningTime="2026-11-03 21:45:04.191228518 +0000 UTC m=+39.897959570"
Nov 03 21:45:04.771646 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:04.771562    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:04.771820 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:04.771648    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:04.771820 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:04.771713    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 21:45:04.771820 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:04.771797    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 03 21:45:04.771820 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:04.771810    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls podName:c61b4b48-0d5d-4c17-9218-c38bf3581e98 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:08.771794945 +0000 UTC m=+44.478525995 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x7fmc" (UID: "c61b4b48-0d5d-4c17-9218-c38bf3581e98") : secret "insights-runtime-extractor-tls" not found
Nov 03 21:45:04.772008 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:04.771859    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-rbac-proxy-cm podName:c61b4b48-0d5d-4c17-9218-c38bf3581e98 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:08.771843287 +0000 UTC m=+44.478574330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x7fmc" (UID: "c61b4b48-0d5d-4c17-9218-c38bf3581e98") : configmap "kube-rbac-proxy" not found
Nov 03 21:45:04.992320 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:04.992284    2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:45:04.992506 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:04.992356    2572 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:45:04.992748 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:04.992733    2572 scope.go:122] "RemoveContainer" containerID="205e56b9b376059dd655d9e4c4c3295d73f1dd1ee6091d03a9936d7434913f5c"
Nov 03 21:45:04.992980 ip-10-0-128-183 kubenswrapper[2572]: E1103 21:45:04.992958    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-pspgs_openshift-console-operator(36598f65-5a1d-43e3-acc2-71c1e56f112c)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs" podUID="36598f65-5a1d-43e3-acc2-71c1e56f112c"
Nov 03 21:45:05.179354 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:05.179313    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-zdz8c" event={"ID":"542a90b4-b01a-4cad-a5bf-e0181fe30586","Type":"ContainerStarted","Data":"495382a60dfae32a66c1efcda1325ca88394bcf072803879689c4d94d3df4c42"}
Nov 03 21:45:05.181402 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:05.180993    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-g7kms" event={"ID":"88ceb339-f96e-45a4-ad35-9691dc70fbd9","Type":"ContainerStarted","Data":"c60f728b63ecbbc50c3d4582ed235fb3067b8c84dea9b438bca879f5b4fcb875"}
Nov 03 21:45:05.181402 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:05.181390    2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:45:05.198556 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:05.198498    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-zdz8c" podStartSLOduration=1.883438722 podStartE2EDuration="4.198483572s" totalImagesPullingTime="2.31504485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:05.196639413 +0000 UTC m=+40.903370476" watchObservedRunningTime="2026-11-03 21:45:05.198483572 +0000 UTC m=+40.905214641"
Nov 03 21:45:05.217344 ip-10-0-128-183 kubenswrapper[2572]: I1103 21:45:05.217285    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-g7kms" podStartSLOduration=2.059851044 podStartE2EDuration="4.21726734s" totalImagesPullingTime="2.157416296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:05.216450079 +0000 UTC m=+40.923181130" watchObservedRunningTime="2026-11-03 21:45:05.21726734 +0000 UTC m=+40.923998397"
Nov 03 21:45:06.532385 ip-10-0-128-183 systemd[1]: Stopping Kubernetes Kubelet...
Nov 03 21:45:06.548602 ip-10-0-128-183 systemd[1]: kubelet.service: Deactivated successfully.
Nov 03 21:45:06.548769 ip-10-0-128-183 systemd[1]: Stopped Kubernetes Kubelet.
Nov 03 21:45:06.548819 ip-10-0-128-183 systemd[1]: kubelet.service: Consumed 3.280s CPU time.
Nov 03 21:45:06.564010 ip-10-0-128-183 systemd[1]: Starting Kubernetes Kubelet...
Nov 03 21:45:06.643727 ip-10-0-128-183 kubenswrapper[5077]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 21:45:06.643727 ip-10-0-128-183 kubenswrapper[5077]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 03 21:45:06.643727 ip-10-0-128-183 kubenswrapper[5077]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 21:45:06.643727 ip-10-0-128-183 kubenswrapper[5077]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 21:45:06.646020 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.645939    5077 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:45:06.646020 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646021    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:45:06.646097 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646026    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:45:06.646097 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646030    5077 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:45:06.646097 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646033    5077 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:45:06.646097 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646036    5077 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:45:06.646097 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646038    5077 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:45:06.646097 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646041    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:45:06.646097 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646043    5077 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:45:06.646097 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646046    5077 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:45:06.646097 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646048    5077 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:45:06.646097 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646051    5077 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:45:06.646097 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646053    5077 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:45:06.646097 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646055    5077 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:45:06.646097 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646058    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:45:06.646097 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646061    5077 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:45:06.646097 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646064    5077 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:45:06.646097 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646067    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:45:06.646097 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646069    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:45:06.646097 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646072    5077 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:45:06.646097 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646082    5077 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:45:06.646097 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646085    5077 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:45:06.646588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646088    5077 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:45:06.646588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646090    5077 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:45:06.646588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646093    5077 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:45:06.646588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646095    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:45:06.646588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646098    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:45:06.646588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646101    5077 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:45:06.646588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646103    5077 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:45:06.646588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646106    5077 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:45:06.646588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646108    5077 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:45:06.646588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646111    5077 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:45:06.646588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646114    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:45:06.646588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646117    5077 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:45:06.646588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646119    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:45:06.646588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646121    5077 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:45:06.646588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646126    5077 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:45:06.646588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646130    5077 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:45:06.646588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646132    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:45:06.646588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646136    5077 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:45:06.646588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646138    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:45:06.647037 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646141    5077 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:45:06.647037 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646143    5077 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:45:06.647037 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646146    5077 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:45:06.647037 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646148    5077 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:45:06.647037 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646151    5077 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:45:06.647037 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646153    5077 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:45:06.647037 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646155    5077 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:45:06.647037 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646158    5077 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:45:06.647037 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646160    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:45:06.647037 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646163    5077 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:45:06.647037 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646166    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:45:06.647037 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646169    5077 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:45:06.647037 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646172    5077 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:45:06.647037 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646174    5077 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:45:06.647037 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646177    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:45:06.647037 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646179    5077 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:45:06.647037 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646182    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:45:06.647037 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646184    5077 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:45:06.647037 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646186    5077 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:45:06.647508 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646190    5077 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:45:06.647508 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646194    5077 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:45:06.647508 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646197    5077 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:45:06.647508 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646199    5077 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:45:06.647508 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646202    5077 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:45:06.647508 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646204    5077 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:45:06.647508 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646208    5077 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:45:06.647508 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646210    5077 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:45:06.647508 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646213    5077 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:45:06.647508 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646215    5077 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:45:06.647508 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646218    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:45:06.647508 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646220    5077 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:45:06.647508 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646223    5077 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:45:06.647508 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646225    5077 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:45:06.647508 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646228    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:45:06.647508 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646230    5077 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:45:06.647508 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646233    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:45:06.647508 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646235    5077 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:45:06.647508 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646238    5077 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:45:06.647942 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646240    5077 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:45:06.647942 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646257    5077 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:45:06.647942 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646260    5077 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:45:06.647942 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646263    5077 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:45:06.647942 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646266    5077 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:45:06.647942 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646268    5077 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:45:06.647942 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646271    5077 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:45:06.647942 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646274    5077 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:45:06.647942 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646277    5077 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:45:06.647942 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646279    5077 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:45:06.647942 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646282    5077 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:45:06.647942 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646284    5077 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:45:06.647942 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646287    5077 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:45:06.647942 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646289    5077 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:45:06.647942 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646292    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:45:06.647942 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646294    5077 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:45:06.647942 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646296    5077 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:45:06.647942 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646299    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:45:06.647942 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646301    5077 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:45:06.648422 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646303    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:45:06.648422 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646306    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:45:06.648422 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646308    5077 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:45:06.648422 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646311    5077 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:45:06.648422 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646313    5077 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:45:06.648422 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646316    5077 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:45:06.648422 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646320    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:45:06.648422 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.646323    5077 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:45:06.648422 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647049    5077 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:45:06.648422 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647055    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:45:06.648422 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647058    5077 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:45:06.648422 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647061    5077 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:45:06.648422 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647064    5077 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:45:06.648422 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647066    5077 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:45:06.648422 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647069    5077 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:45:06.648422 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647071    5077 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:45:06.648422 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647074    5077 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:45:06.648422 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647077    5077 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:45:06.648422 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647080    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:45:06.648877 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647082    5077 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:45:06.648877 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647084    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:45:06.648877 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647087    5077 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:45:06.648877 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647089    5077 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:45:06.648877 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647092    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:45:06.648877 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647094    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:45:06.648877 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647097    5077 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:45:06.648877 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647099    5077 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:45:06.648877 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647102    5077 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:45:06.648877 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647104    5077 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:45:06.648877 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647107    5077 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:45:06.648877 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647109    5077 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:45:06.648877 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647112    5077 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:45:06.648877 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647115    5077 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:45:06.648877 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647118    5077 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:45:06.648877 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647122    5077 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:45:06.648877 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647128    5077 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:45:06.648877 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647132    5077 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:45:06.648877 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647135    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:45:06.649357 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647138    5077 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:45:06.649357 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647141    5077 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:45:06.649357 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647144    5077 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:45:06.649357 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647146    5077 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:45:06.649357 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647149    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:45:06.649357 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647152    5077 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:45:06.649357 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647155    5077 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:45:06.649357 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647157    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:45:06.649357 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647160    5077 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:45:06.649357 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647163    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:45:06.649357 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647165    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:45:06.649357 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647168    5077 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:45:06.649357 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647170    5077 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:45:06.649357 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647172    5077 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:45:06.649357 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647175    5077 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:45:06.649357 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647177    5077 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:45:06.649357 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647180    5077 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:45:06.649357 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647182    5077 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:45:06.649357 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647184    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:45:06.649357 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647187    5077 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:45:06.649880 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647190    5077 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:45:06.649880 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647192    5077 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:45:06.649880 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647195    5077 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:45:06.649880 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647197    5077 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:45:06.649880 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647199    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:45:06.649880 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647202    5077 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:45:06.649880 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647205    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:45:06.649880 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647207    5077 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:45:06.649880 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647210    5077 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:45:06.649880 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647212    5077 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:45:06.649880 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647215    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:45:06.649880 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647225    5077 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:45:06.649880 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647228    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:45:06.649880 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647230    5077 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:45:06.649880 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647233    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:45:06.649880 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647240    5077 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:45:06.649880 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647258    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:45:06.649880 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647261    5077 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:45:06.649880 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647264    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:45:06.650356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647267    5077 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:45:06.650356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647269    5077 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:45:06.650356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647272    5077 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:45:06.650356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647274    5077 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:45:06.650356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647277    5077 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:45:06.650356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647279    5077 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:45:06.650356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647282    5077 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:45:06.650356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647285    5077 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:45:06.650356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647288    5077 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:45:06.650356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647291    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:45:06.650356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647293    5077 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:45:06.650356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647296    5077 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:45:06.650356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647298    5077 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:45:06.650356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647301    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:45:06.650356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647311    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:45:06.650356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647314    5077 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:45:06.650356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647318    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:45:06.650356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647320    5077 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:45:06.650356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647323    5077 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:45:06.650356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647325    5077 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:45:06.650844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647328    5077 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:45:06.650844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647331    5077 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:45:06.650844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647333    5077 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:45:06.650844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647336    5077 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:45:06.650844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647338    5077 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:45:06.650844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647341    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:45:06.650844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647343    5077 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:45:06.650844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647346    5077 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:45:06.650844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647349    5077 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:45:06.650844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647357    5077 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:45:06.650844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647360    5077 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:45:06.650844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647364    5077 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:45:06.650844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647367    5077 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:45:06.650844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647369    5077 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:45:06.650844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647371    5077 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:45:06.650844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647374    5077 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:45:06.650844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647376    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:45:06.650844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647890    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:45:06.650844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647896    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:45:06.650844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647898    5077 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:45:06.651356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647901    5077 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:45:06.651356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647904    5077 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:45:06.651356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647907    5077 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:45:06.651356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647909    5077 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:45:06.651356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647912    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:45:06.651356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647915    5077 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:45:06.651356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647918    5077 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:45:06.651356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647920    5077 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:45:06.651356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647923    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:45:06.651356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647926    5077 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:45:06.651356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647928    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:45:06.651356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647931    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:45:06.651356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647933    5077 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:45:06.651356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647936    5077 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:45:06.651356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647938    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:45:06.651356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647941    5077 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:45:06.651356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647944    5077 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:45:06.651356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647946    5077 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:45:06.651356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647950    5077 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:45:06.651356 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647952    5077 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:45:06.651851 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647955    5077 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:45:06.651851 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647959    5077 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:45:06.651851 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647963    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:45:06.651851 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647967    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:45:06.651851 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647969    5077 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:45:06.651851 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647972    5077 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:45:06.651851 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647975    5077 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:45:06.651851 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647977    5077 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:45:06.651851 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647980    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:45:06.651851 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647982    5077 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:45:06.651851 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647985    5077 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:45:06.651851 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647987    5077 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:45:06.651851 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647993    5077 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:45:06.651851 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647996    5077 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:45:06.651851 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.647998    5077 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:45:06.651851 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648001    5077 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:45:06.651851 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648003    5077 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:45:06.651851 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648006    5077 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:45:06.651851 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648009    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:45:06.652370 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648012    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:45:06.652370 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648014    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:45:06.652370 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648017    5077 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:45:06.652370 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648019    5077 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:45:06.652370 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648022    5077 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:45:06.652370 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648024    5077 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:45:06.652370 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648027    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:45:06.652370 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648029    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:45:06.652370 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648032    5077 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:45:06.652370 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648034    5077 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:45:06.652370 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648037    5077 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:45:06.652370 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648040    5077 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:45:06.652370 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648042    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:45:06.652370 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648045    5077 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:45:06.652370 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648047    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:45:06.652370 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648051    5077 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:45:06.652370 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648053    5077 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:45:06.652370 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648056    5077 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:45:06.652370 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648058    5077 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:45:06.652370 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648061    5077 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:45:06.652863 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648063    5077 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:45:06.652863 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648066    5077 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:45:06.652863 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648070    5077 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:45:06.652863 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648074    5077 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:45:06.652863 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648077    5077 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:45:06.652863 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648081    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:45:06.652863 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648083    5077 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:45:06.652863 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648085    5077 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:45:06.652863 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648088    5077 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:45:06.652863 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648091    5077 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:45:06.652863 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648093    5077 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:45:06.652863 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648096    5077 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:45:06.652863 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648099    5077 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:45:06.652863 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648101    5077 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:45:06.652863 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648103    5077 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:45:06.652863 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648106    5077 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:45:06.652863 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648108    5077 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:45:06.652863 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648111    5077 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:45:06.652863 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648113    5077 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:45:06.652863 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648115    5077 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:45:06.653351 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648118    5077 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:45:06.653351 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648120    5077 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:45:06.653351 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648123    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:45:06.653351 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648126    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:45:06.653351 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648128    5077 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:45:06.653351 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648130    5077 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:45:06.653351 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648133    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:45:06.653351 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648135    5077 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:45:06.653351 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648144    5077 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:45:06.653351 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648147    5077 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:45:06.653351 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648149    5077 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:45:06.653351 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648152    5077 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:45:06.653351 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648154    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:45:06.653351 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648156    5077 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:45:06.653351 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648159    5077 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:45:06.653351 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648161    5077 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:45:06.653351 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648164    5077 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:45:06.653351 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648167    5077 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:45:06.653351 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648170    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648172    5077 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648175    5077 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648178    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648180    5077 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648183    5077 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648295    5077 flags.go:64] FLAG: --address="0.0.0.0"
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648305    5077 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648314    5077 flags.go:64] FLAG: --anonymous-auth="true"
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648319    5077 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648323    5077 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648326    5077 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648330    5077 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648335    5077 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648338    5077 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648341    5077 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648344    5077 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648347    5077 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648351    5077 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648353    5077 flags.go:64] FLAG: --cgroup-root=""
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648356    5077 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648359    5077 flags.go:64] FLAG: --client-ca-file=""
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648362    5077 flags.go:64] FLAG: --cloud-provider="external"
Nov 03 21:45:06.653803 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648370    5077 flags.go:64] FLAG: --cluster-dns="[]"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648376    5077 flags.go:64] FLAG: --cluster-domain=""
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648379    5077 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648382    5077 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648385    5077 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648388    5077 flags.go:64] FLAG: --container-log-max-files="5"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648392    5077 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648394    5077 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648399    5077 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648402    5077 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648405    5077 flags.go:64] FLAG: --contention-profiling="false"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648408    5077 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648410    5077 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648413    5077 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648416    5077 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648420    5077 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648424    5077 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648428    5077 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648431    5077 flags.go:64] FLAG: --enable-load-reader="false"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648434    5077 flags.go:64] FLAG: --enable-server="true"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648437    5077 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648444    5077 flags.go:64] FLAG: --event-burst="100"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648447    5077 flags.go:64] FLAG: --event-qps="50"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648450    5077 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 03 21:45:06.654522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648452    5077 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648455    5077 flags.go:64] FLAG: --eviction-hard=""
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648459    5077 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648462    5077 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648465    5077 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648468    5077 flags.go:64] FLAG: --eviction-soft=""
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648471    5077 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648474    5077 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648477    5077 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648485    5077 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648488    5077 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648491    5077 flags.go:64] FLAG: --fail-swap-on="true"
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648494    5077 flags.go:64] FLAG: --feature-gates=""
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648498    5077 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648501    5077 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648504    5077 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648508    5077 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648511    5077 flags.go:64] FLAG: --healthz-port="10248"
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648514    5077 flags.go:64] FLAG: --help="false"
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648516    5077 flags.go:64] FLAG: --hostname-override="ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648520    5077 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648522    5077 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648525    5077 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 03 21:45:06.655442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648528    5077 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648533    5077 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648536    5077 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648538    5077 flags.go:64] FLAG: --image-service-endpoint=""
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648541    5077 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648544    5077 flags.go:64] FLAG: --kube-api-burst="100"
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648546    5077 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648549    5077 flags.go:64] FLAG: --kube-api-qps="50"
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648552    5077 flags.go:64] FLAG: --kube-reserved=""
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648555    5077 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648558    5077 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648561    5077 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648563    5077 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648566    5077 flags.go:64] FLAG: --lock-file=""
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648568    5077 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648571    5077 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648574    5077 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648579    5077 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648582    5077 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648592    5077 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648595    5077 flags.go:64] FLAG: --logging-format="text"
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648598    5077 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648601    5077 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648604    5077 flags.go:64] FLAG: --manifest-url=""
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648606    5077 flags.go:64] FLAG: --manifest-url-header=""
Nov 03 21:45:06.655999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648611    5077 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648614    5077 flags.go:64] FLAG: --max-open-files="1000000"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648617    5077 flags.go:64] FLAG: --max-pods="110"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648620    5077 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648623    5077 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648626    5077 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648628    5077 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648631    5077 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648635    5077 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648638    5077 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648644    5077 flags.go:64] FLAG: --node-status-max-images="50"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648648    5077 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648651    5077 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648654    5077 flags.go:64] FLAG: --pod-cidr=""
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648657    5077 flags.go:64] FLAG: --pod-manifest-path=""
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648659    5077 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648662    5077 flags.go:64] FLAG: --pods-per-core="0"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648665    5077 flags.go:64] FLAG: --port="10250"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648668    5077 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648671    5077 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-001d0467afe5566d5"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648674    5077 flags.go:64] FLAG: --qos-reserved=""
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648677    5077 flags.go:64] FLAG: --read-only-port="10255"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648679    5077 flags.go:64] FLAG: --register-node="true"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648682    5077 flags.go:64] FLAG: --register-with-taints=""
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648686    5077 flags.go:64] FLAG: --registry-burst="10"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648688    5077 flags.go:64] FLAG: --registry-qps="5"
Nov 03 21:45:06.656645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648691    5077 flags.go:64] FLAG: --reserved-cpus=""
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648700    5077 flags.go:64] FLAG: --reserved-memory=""
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648704    5077 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648706    5077 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648709    5077 flags.go:64] FLAG: --rotate-certificates="false"
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648712    5077 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648715    5077 flags.go:64] FLAG: --runonce="false"
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648718    5077 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648721    5077 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648723    5077 flags.go:64] FLAG: --seccomp-default="false"
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648726    5077 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648729    5077 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648732    5077 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648735    5077 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648740    5077 flags.go:64] FLAG: --storage-driver-password="root"
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648743    5077 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648746    5077 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648748    5077 flags.go:64] FLAG: --storage-driver-user="root"
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648751    5077 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648754    5077 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648756    5077 flags.go:64] FLAG: --system-cgroups=""
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648759    5077 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648764    5077 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648767    5077 flags.go:64] FLAG: --tls-cert-file=""
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648770    5077 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 03 21:45:06.657272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648776    5077 flags.go:64] FLAG: --tls-min-version=""
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648778    5077 flags.go:64] FLAG: --tls-private-key-file=""
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648781    5077 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648784    5077 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648786    5077 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648789    5077 flags.go:64] FLAG: --v="2"
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648793    5077 flags.go:64] FLAG: --version="false"
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648798    5077 flags.go:64] FLAG: --vmodule=""
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648802    5077 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.648811    5077 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648970    5077 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648975    5077 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648978    5077 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648982    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648985    5077 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648988    5077 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648990    5077 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648993    5077 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648995    5077 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.648998    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649000    5077 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649004    5077 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:45:06.657902 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649007    5077 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:45:06.658563 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649009    5077 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:45:06.658563 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649012    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:45:06.658563 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649015    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:45:06.658563 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649017    5077 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:45:06.658563 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649020    5077 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:45:06.658563 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649022    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:45:06.658563 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649025    5077 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:45:06.658563 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649029    5077 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:45:06.658563 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649032    5077 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:45:06.658563 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649035    5077 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:45:06.658563 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649038    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:45:06.658563 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649040    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:45:06.658563 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649043    5077 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:45:06.658563 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649045    5077 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:45:06.658563 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649048    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:45:06.658563 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649050    5077 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:45:06.658563 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649053    5077 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:45:06.658563 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649056    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:45:06.658563 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649058    5077 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:45:06.659062 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649061    5077 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:45:06.659062 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649064    5077 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:45:06.659062 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649066    5077 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:45:06.659062 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649069    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:45:06.659062 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649071    5077 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:45:06.659062 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649074    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:45:06.659062 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649076    5077 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:45:06.659062 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649078    5077 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:45:06.659062 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649081    5077 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:45:06.659062 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649083    5077 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:45:06.659062 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649086    5077 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:45:06.659062 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649090    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:45:06.659062 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649093    5077 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:45:06.659062 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649095    5077 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:45:06.659062 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649098    5077 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:45:06.659062 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649100    5077 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:45:06.659062 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649102    5077 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:45:06.659062 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649105    5077 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:45:06.659062 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649107    5077 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:45:06.659588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649110    5077 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:45:06.659588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649112    5077 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:45:06.659588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649115    5077 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:45:06.659588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649117    5077 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:45:06.659588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649120    5077 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:45:06.659588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649122    5077 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:45:06.659588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649124    5077 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:45:06.659588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649127    5077 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:45:06.659588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649129    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:45:06.659588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649132    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:45:06.659588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649135    5077 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:45:06.659588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649138    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:45:06.659588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649140    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:45:06.659588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649143    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:45:06.659588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649145    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:45:06.659588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649148    5077 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:45:06.659588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649150    5077 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:45:06.659588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649153    5077 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:45:06.659588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649155    5077 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:45:06.659588 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649158    5077 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:45:06.660210 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649160    5077 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:45:06.660210 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649163    5077 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:45:06.660210 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649165    5077 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:45:06.660210 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649167    5077 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:45:06.660210 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649171    5077 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:45:06.660210 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649173    5077 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:45:06.660210 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649175    5077 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:45:06.660210 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649178    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:45:06.660210 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649180    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:45:06.660210 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649183    5077 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:45:06.660210 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649185    5077 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:45:06.660210 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649189    5077 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:45:06.660210 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649193    5077 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:45:06.660210 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649196    5077 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:45:06.660210 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649200    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:45:06.660210 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649202    5077 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:45:06.660210 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649205    5077 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:45:06.660210 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649208    5077 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:45:06.660210 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649212    5077 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:45:06.660746 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649215    5077 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:45:06.660746 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649219    5077 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:45:06.660746 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649223    5077 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:45:06.660746 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649229    5077 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:45:06.660746 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649232    5077 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:45:06.660746 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649236    5077 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:45:06.660746 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649241    5077 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:45:06.660746 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649257    5077 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:45:06.660746 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649260    5077 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:45:06.660746 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649263    5077 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:45:06.660746 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649266    5077 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:45:06.660746 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649269    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:45:06.660746 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649271    5077 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:45:06.660746 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649274    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:45:06.660746 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649276    5077 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:45:06.660746 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649278    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:45:06.661142 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.649307    5077 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 21:45:06.661142 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649351    5077 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:45:06.661142 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649355    5077 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:45:06.661142 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649358    5077 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:45:06.661142 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649362    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:45:06.661142 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649365    5077 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:45:06.661142 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649367    5077 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:45:06.661142 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649370    5077 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:45:06.661142 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649373    5077 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:45:06.661142 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649375    5077 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:45:06.661142 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649378    5077 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:45:06.661142 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649380    5077 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:45:06.661142 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649382    5077 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:45:06.661142 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649385    5077 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:45:06.661142 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649387    5077 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:45:06.661142 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649390    5077 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:45:06.661564 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649392    5077 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:45:06.661564 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649395    5077 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:45:06.661564 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649397    5077 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:45:06.661564 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649400    5077 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:45:06.661564 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649403    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:45:06.661564 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649406    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:45:06.661564 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649408    5077 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:45:06.661564 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649411    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:45:06.661564 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649413    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:45:06.661564 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649417    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:45:06.661564 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649420    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:45:06.661564 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649422    5077 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:45:06.661564 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649424    5077 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:45:06.661564 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649427    5077 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:45:06.661564 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649429    5077 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:45:06.661564 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649432    5077 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:45:06.661564 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649434    5077 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:45:06.661564 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649438    5077 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:45:06.661564 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649440    5077 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:45:06.661564 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649442    5077 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:45:06.662185 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649445    5077 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:45:06.662185 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649447    5077 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:45:06.662185 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649450    5077 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:45:06.662185 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649452    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:45:06.662185 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649454    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:45:06.662185 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649457    5077 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:45:06.662185 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649459    5077 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:45:06.662185 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649463    5077 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:45:06.662185 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649467    5077 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:45:06.662185 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649470    5077 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:45:06.662185 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649473    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:45:06.662185 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649476    5077 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:45:06.662185 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649478    5077 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:45:06.662185 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649481    5077 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:45:06.662185 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649483    5077 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:45:06.662185 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649486    5077 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:45:06.662185 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649490    5077 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:45:06.662185 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649492    5077 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:45:06.662185 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649495    5077 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:45:06.662844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649497    5077 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:45:06.662844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649500    5077 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:45:06.662844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649502    5077 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:45:06.662844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649505    5077 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:45:06.662844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649508    5077 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:45:06.662844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649510    5077 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:45:06.662844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649514    5077 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:45:06.662844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649517    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:45:06.662844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649519    5077 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:45:06.662844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649521    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:45:06.662844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649526    5077 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:45:06.662844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649528    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:45:06.662844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649531    5077 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:45:06.662844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649533    5077 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:45:06.662844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649535    5077 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:45:06.662844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649538    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:45:06.662844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649540    5077 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:45:06.662844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649543    5077 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:45:06.662844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649545    5077 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:45:06.662844 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649547    5077 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:45:06.663392 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649550    5077 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:45:06.663392 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649552    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:45:06.663392 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649555    5077 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:45:06.663392 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649557    5077 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:45:06.663392 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649560    5077 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:45:06.663392 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649562    5077 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:45:06.663392 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649565    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:45:06.663392 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649567    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:45:06.663392 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649570    5077 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:45:06.663392 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649580    5077 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:45:06.663392 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649584    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:45:06.663392 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649588    5077 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:45:06.663392 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649591    5077 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:45:06.663392 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649595    5077 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:45:06.663392 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649599    5077 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:45:06.663392 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649602    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:45:06.663392 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649605    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:45:06.663392 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649608    5077 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:45:06.663392 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649611    5077 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:45:06.663834 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649614    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:45:06.663834 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649616    5077 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:45:06.663834 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649619    5077 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:45:06.663834 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649622    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:45:06.663834 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649625    5077 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:45:06.663834 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649628    5077 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:45:06.663834 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649630    5077 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:45:06.663834 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649632    5077 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:45:06.663834 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649635    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:45:06.663834 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649637    5077 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:45:06.663834 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649640    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:45:06.663834 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649643    5077 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:45:06.663834 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.649645    5077 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:45:06.663834 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.653894    5077 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 03 21:45:06.663834 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.653910    5077 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 03 21:45:06.663834 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.653929    5077 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 03 21:45:06.663834 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.653934    5077 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 03 21:45:06.663834 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.653993    5077 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:45:06.663834 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.653998    5077 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:45:06.664311 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654001    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:45:06.664311 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654004    5077 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:45:06.664311 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654006    5077 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:45:06.664311 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654009    5077 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:45:06.664311 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654012    5077 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:45:06.664311 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654014    5077 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:45:06.664311 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654017    5077 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:45:06.664311 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654020    5077 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:45:06.664311 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654022    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:45:06.664311 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654025    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:45:06.664311 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654028    5077 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:45:06.664311 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654030    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:45:06.664311 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654033    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:45:06.664311 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654036    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:45:06.664311 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654038    5077 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:45:06.664311 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654041    5077 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:45:06.664311 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654043    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:45:06.664311 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654046    5077 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:45:06.664311 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654048    5077 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:45:06.664780 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654051    5077 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:45:06.664780 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654053    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:45:06.664780 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654056    5077 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:45:06.664780 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654059    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:45:06.664780 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654062    5077 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:45:06.664780 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654064    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:45:06.664780 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654067    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:45:06.664780 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654069    5077 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:45:06.664780 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654108    5077 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:45:06.664780 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654258    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:45:06.664780 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654266    5077 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:45:06.664780 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654273    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:45:06.664780 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654277    5077 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:45:06.664780 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654281    5077 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:45:06.664780 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654286    5077 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:45:06.664780 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654290    5077 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:45:06.664780 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654297    5077 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:45:06.664780 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654303    5077 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:45:06.664780 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654309    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:45:06.664780 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654313    5077 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:45:06.665269 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654324    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:45:06.665269 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654328    5077 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:45:06.665269 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654332    5077 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:45:06.665269 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654336    5077 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:45:06.665269 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654343    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:45:06.665269 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654348    5077 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:45:06.665269 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654352    5077 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:45:06.665269 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654356    5077 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:45:06.665269 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654361    5077 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:45:06.665269 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654365    5077 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:45:06.665269 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654369    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:45:06.665269 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654374    5077 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:45:06.665269 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654378    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:45:06.665269 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654387    5077 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:45:06.665269 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654391    5077 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:45:06.665269 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654395    5077 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:45:06.665269 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654399    5077 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:45:06.665269 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654403    5077 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:45:06.665269 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654408    5077 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:45:06.665269 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654412    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:45:06.665779 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654416    5077 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:45:06.665779 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654460    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:45:06.665779 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654466    5077 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:45:06.665779 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654470    5077 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:45:06.665779 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654474    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:45:06.665779 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654483    5077 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:45:06.665779 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654487    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:45:06.665779 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654491    5077 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:45:06.665779 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654498    5077 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:45:06.665779 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654503    5077 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:45:06.665779 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654508    5077 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:45:06.665779 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654512    5077 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:45:06.665779 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654516    5077 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:45:06.665779 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654520    5077 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:45:06.665779 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654524    5077 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:45:06.665779 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654528    5077 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:45:06.665779 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654533    5077 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:45:06.665779 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654537    5077 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:45:06.665779 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654547    5077 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:45:06.671533 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654552    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:45:06.671533 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654557    5077 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:45:06.671533 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654591    5077 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:45:06.671533 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654596    5077 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:45:06.671533 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654599    5077 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:45:06.671533 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654604    5077 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:45:06.671533 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654608    5077 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:45:06.671533 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654612    5077 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:45:06.671533 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654616    5077 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:45:06.671533 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654620    5077 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:45:06.671533 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654624    5077 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:45:06.671533 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654633    5077 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:45:06.671533 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654637    5077 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:45:06.671533 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654641    5077 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:45:06.671533 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654645    5077 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:45:06.671533 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654678    5077 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:45:06.671533 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654683    5077 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:45:06.671533 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654687    5077 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:45:06.671533 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654691    5077 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:45:06.671533 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654696    5077 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:45:06.672008 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654700    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:45:06.672008 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654704    5077 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:45:06.672008 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654708    5077 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:45:06.672008 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654712    5077 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:45:06.672008 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654720    5077 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:45:06.672008 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.654725    5077 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:45:06.672008 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.654788    5077 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 21:45:06.672008 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655521    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:45:06.672008 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655532    5077 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:45:06.672008 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655535    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:45:06.672008 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655538    5077 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:45:06.672008 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655541    5077 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:45:06.672008 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655543    5077 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:45:06.672008 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655546    5077 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:45:06.672008 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655549    5077 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:45:06.672008 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655552    5077 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:45:06.672468 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655555    5077 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:45:06.672468 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655557    5077 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:45:06.672468 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655560    5077 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:45:06.672468 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655562    5077 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:45:06.672468 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655565    5077 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:45:06.672468 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655567    5077 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:45:06.672468 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655571    5077 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:45:06.672468 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655573    5077 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:45:06.672468 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655576    5077 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:45:06.672468 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655578    5077 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:45:06.672468 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655581    5077 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:45:06.672468 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655583    5077 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:45:06.672468 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655586    5077 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:45:06.672468 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655590    5077 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:45:06.672468 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655592    5077 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:45:06.672468 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655595    5077 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:45:06.672468 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655597    5077 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:45:06.672468 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655599    5077 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:45:06.672468 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655602    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:45:06.672468 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655604    5077 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:45:06.672932 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655607    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:45:06.672932 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655610    5077 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:45:06.672932 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655612    5077 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:45:06.672932 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655614    5077 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:45:06.672932 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655617    5077 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:45:06.672932 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655619    5077 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:45:06.672932 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655622    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:45:06.672932 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655624    5077 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:45:06.672932 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655626    5077 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:45:06.672932 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655629    5077 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:45:06.672932 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655631    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:45:06.672932 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655633    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:45:06.672932 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655636    5077 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:45:06.672932 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655638    5077 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:45:06.672932 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655641    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:45:06.672932 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655644    5077 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:45:06.672932 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655646    5077 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:45:06.672932 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655648    5077 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:45:06.672932 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655651    5077 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:45:06.673581 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655655    5077 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:45:06.673581 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655658    5077 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:45:06.673581 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655661    5077 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:45:06.673581 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655663    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:45:06.673581 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655667    5077 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:45:06.673581 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655669    5077 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:45:06.673581 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655672    5077 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:45:06.673581 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655674    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:45:06.673581 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655677    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:45:06.673581 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655679    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:45:06.673581 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655682    5077 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:45:06.673581 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655684    5077 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:45:06.673581 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655687    5077 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:45:06.673581 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655689    5077 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:45:06.673581 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655691    5077 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:45:06.673581 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655694    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:45:06.673581 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655696    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:45:06.673581 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655698    5077 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:45:06.673581 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655701    5077 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:45:06.674405 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655703    5077 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:45:06.674405 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655706    5077 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:45:06.674405 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655710    5077 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:45:06.674405 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655713    5077 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:45:06.674405 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655716    5077 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:45:06.674405 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655720    5077 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:45:06.674405 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655724    5077 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:45:06.674405 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655726    5077 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:45:06.674405 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655729    5077 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:45:06.674405 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655731    5077 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:45:06.674405 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655734    5077 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:45:06.674405 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655737    5077 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:45:06.674405 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655739    5077 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:45:06.674405 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655742    5077 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:45:06.674405 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655744    5077 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:45:06.674405 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655747    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:45:06.674405 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655750    5077 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:45:06.674405 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655752    5077 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:45:06.674405 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655755    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:45:06.675036 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655757    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:45:06.675036 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655760    5077 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:45:06.675036 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655762    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:45:06.675036 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655765    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:45:06.675036 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655767    5077 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:45:06.675036 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655770    5077 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:45:06.675036 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655772    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:45:06.675036 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655775    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:45:06.675036 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655777    5077 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:45:06.675036 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655779    5077 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:45:06.675036 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655782    5077 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:45:06.675036 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655784    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:45:06.675036 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655787    5077 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:45:06.675036 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655789    5077 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:45:06.675036 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655791    5077 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:45:06.675036 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655795    5077 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:45:06.675036 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655798    5077 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:45:06.675036 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655800    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:45:06.675036 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655803    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:45:06.675504 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655805    5077 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:45:06.675504 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.655835    5077 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 21:45:06.675504 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655869    5077 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:45:06.675504 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655874    5077 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:45:06.675504 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655877    5077 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:45:06.675504 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655879    5077 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:45:06.675504 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655883    5077 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:45:06.675504 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655888    5077 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:45:06.675504 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655891    5077 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:45:06.675504 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655894    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:45:06.675504 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655896    5077 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:45:06.675504 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655899    5077 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:45:06.675504 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655901    5077 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:45:06.675504 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655904    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:45:06.675504 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655906    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:45:06.675906 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655909    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:45:06.675906 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655912    5077 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:45:06.675906 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655914    5077 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:45:06.675906 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655916    5077 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:45:06.675906 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655919    5077 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:45:06.675906 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655921    5077 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:45:06.675906 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655924    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:45:06.675906 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655926    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:45:06.675906 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655928    5077 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:45:06.675906 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655931    5077 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:45:06.675906 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655933    5077 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:45:06.675906 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655936    5077 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:45:06.675906 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655938    5077 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:45:06.675906 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655941    5077 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:45:06.675906 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655944    5077 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:45:06.675906 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655948    5077 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:45:06.675906 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655952    5077 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:45:06.675906 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655956    5077 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:45:06.675906 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655958    5077 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:45:06.675906 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655961    5077 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:45:06.676639 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655963    5077 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:45:06.676639 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655966    5077 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:45:06.676639 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655968    5077 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:45:06.676639 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655971    5077 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:45:06.676639 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655973    5077 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:45:06.676639 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655976    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:45:06.676639 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655979    5077 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:45:06.676639 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655981    5077 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:45:06.676639 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655984    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:45:06.676639 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655986    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:45:06.676639 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655989    5077 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:45:06.676639 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655991    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:45:06.676639 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655994    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:45:06.676639 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655996    5077 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:45:06.676639 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.655999    5077 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:45:06.676639 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656001    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:45:06.676639 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656004    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:45:06.676639 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656006    5077 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:45:06.676639 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656009    5077 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:45:06.677449 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656012    5077 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:45:06.677449 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656014    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:45:06.677449 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656017    5077 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:45:06.677449 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656019    5077 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:45:06.677449 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656022    5077 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:45:06.677449 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656024    5077 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:45:06.677449 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656027    5077 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:45:06.677449 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656030    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:45:06.677449 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656033    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:45:06.677449 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656035    5077 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:45:06.677449 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656037    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:45:06.677449 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656040    5077 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:45:06.677449 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656043    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:45:06.677449 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656045    5077 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:45:06.677449 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656048    5077 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:45:06.677449 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656050    5077 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:45:06.677449 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656053    5077 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:45:06.677449 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656055    5077 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:45:06.677449 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656058    5077 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:45:06.677449 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656060    5077 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:45:06.678378 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656063    5077 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:45:06.678378 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656065    5077 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:45:06.678378 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656067    5077 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:45:06.678378 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656070    5077 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:45:06.678378 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656072    5077 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:45:06.678378 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656075    5077 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:45:06.678378 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656078    5077 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:45:06.678378 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656080    5077 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:45:06.678378 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656083    5077 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:45:06.678378 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656086    5077 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:45:06.678378 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656088    5077 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:45:06.678378 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656090    5077 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:45:06.678378 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656093    5077 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:45:06.678378 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656095    5077 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:45:06.678378 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656097    5077 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:45:06.678378 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656100    5077 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:45:06.678378 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656102    5077 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:45:06.678378 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656105    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:45:06.678378 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656107    5077 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:45:06.678378 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656112    5077 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:45:06.679228 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656115    5077 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:45:06.679228 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656119    5077 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:45:06.679228 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656122    5077 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:45:06.679228 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656124    5077 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:45:06.679228 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656128    5077 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:45:06.679228 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656130    5077 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:45:06.679228 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656133    5077 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:45:06.679228 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656135    5077 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:45:06.679228 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656138    5077 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:45:06.679228 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656141    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:45:06.679228 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656143    5077 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:45:06.679228 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656145    5077 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:45:06.679228 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656148    5077 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:45:06.679228 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:06.656150    5077 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:45:06.679228 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.656200    5077 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 03 21:45:06.679228 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.657187    5077 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Nov 03 21:45:06.679228 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.657236    5077 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Nov 03 21:45:06.679228 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.657447    5077 server.go:1014] "Starting client certificate rotation"
Nov 03 21:45:06.679228 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.657595    5077 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 03 21:45:06.680030 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.657637    5077 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-02 21:39:24 +0000 UTC" deadline="2028-05-24 16:26:11.330759072 +0000 UTC"
Nov 03 21:45:06.680030 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.657686    5077 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13626h41m4.673075616s"
Nov 03 21:45:06.680030 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.657903    5077 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 03 21:45:06.680030 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.658959    5077 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 03 21:45:06.680030 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.660158    5077 log.go:25] "Validated CRI v1 runtime API"
Nov 03 21:45:06.680030 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.661835    5077 log.go:25] "Validated CRI v1 image API"
Nov 03 21:45:06.680030 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.662655    5077 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 03 21:45:06.680030 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.664760    5077 fs.go:135] Filesystem UUIDs: map[1e9adcb0-83d1-4620-9961-03e1e06a081b:/dev/nvme0n1p3 64a95dff-5915-4f43-8904-d6f764aa3dc2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Nov 03 21:45:06.680453 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.664779    5077 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/010d9285d681fb1c0f9f5025662927cef701ef59de0a4dcc8e437a10aa7d8eb4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/010d9285d681fb1c0f9f5025662927cef701ef59de0a4dcc8e437a10aa7d8eb4/userdata/shm major:0 minor:348 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/173fe4f979fb91439e66255672f886b5aacc3cdce09b2be43b40f92c4883a9e4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/173fe4f979fb91439e66255672f886b5aacc3cdce09b2be43b40f92c4883a9e4/userdata/shm major:0 minor:92 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/205e1a69bc4a13d16b2a19da1e85a0aec68a6cdd415818a444e1abd9d24f94dc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/205e1a69bc4a13d16b2a19da1e85a0aec68a6cdd415818a444e1abd9d24f94dc/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/224136773b85483d6d6428c897c0dfe9416b7bcc5185e47a50bf3141f89cf51b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/224136773b85483d6d6428c897c0dfe9416b7bcc5185e47a50bf3141f89cf51b/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/24cc09b481a6341e12171d151216947511774a36c7e685d42e6b13a61b41b757/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/24cc09b481a6341e12171d151216947511774a36c7e685d42e6b13a61b41b757/userdata/shm major:0 minor:296 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/44d234fd81d474c08f6af409d87ab4f9aac197d382658f93682aef15ef4a8600/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/44d234fd81d474c08f6af409d87ab4f9aac197d382658f93682aef15ef4a8600/userdata/shm major:0 minor:81 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/494f57d0d92855b0f36e61b1276c99c609e2d6f683e1b57b2cfc8bbb46bfbf44/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/494f57d0d92855b0f36e61b1276c99c609e2d6f683e1b57b2cfc8bbb46bfbf44/userdata/shm major:0 minor:235 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/58b23b1048cea694797201eb85ffb9ff4ce65f997215a15726919c7b58980708/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/58b23b1048cea694797201eb85ffb9ff4ce65f997215a15726919c7b58980708/userdata/shm major:0 minor:241 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6dfd29e14aaaf59752e08786e0371aaa8b47fb230cc545c494f15a097f6122ef/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6dfd29e14aaaf59752e08786e0371aaa8b47fb230cc545c494f15a097f6122ef/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7ec0d5932964902f8592b5884502ede39045faffa102a8d95108b66192b66469/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7ec0d5932964902f8592b5884502ede39045faffa102a8d95108b66192b66469/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/90cf459c1c1518f337436004a3f0c58e938a75debc1c5a3ca88355cf43d60dce/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/90cf459c1c1518f337436004a3f0c58e938a75debc1c5a3ca88355cf43d60dce/userdata/shm major:0 minor:234 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/957ce6cd0b35b23d312801ad6e7bb9c80c7681a99cf93c0dcf3f11f18978f9e5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/957ce6cd0b35b23d312801ad6e7bb9c80c7681a99cf93c0dcf3f11f18978f9e5/userdata/shm major:0 minor:342 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/991829626d8cb2c44828df6a0be61b9f870c53505c6e9f498713a9635bb625f2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/991829626d8cb2c44828df6a0be61b9f870c53505c6e9f498713a9635bb625f2/userdata/shm major:0 minor:75 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a5daeb44ff1a28cff9bd2e239be0feab2789cd292da35e64eebbd80e58417d29/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a5daeb44ff1a28cff9bd2e239be0feab2789cd292da35e64eebbd80e58417d29/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ac45b1452a5a2eab5e649027acd1beaa6c94881f56387773cc7ddafee57da38b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ac45b1452a5a2eab5e649027acd1beaa6c94881f56387773cc7ddafee57da38b/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b357a98f35b01ad756fbc6711ceb483c4111b17c28cd2d862cbdc24216acac69/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b357a98f35b01ad756fbc6711ceb483c4111b17c28cd2d862cbdc24216acac69/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bfcb6494f3705ded0a8ab9f8ecd0a3df0279cda651e6a658c31984f2d0811da2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bfcb6494f3705ded0a8ab9f8ecd0a3df0279cda651e6a658c31984f2d0811da2/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d46b9b62e9ba891ea3ab09a9892a0bfe4d24944e784ca0f93a59719f7d06553b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d46b9b62e9ba891ea3ab09a9892a0bfe4d24944e784ca0f93a59719f7d06553b/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d6a753be9b83bcb04228bfab37ea563efae01bef7cc7b20bea23258f613b96bf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d6a753be9b83bcb04228bfab37ea563efae01bef7cc7b20bea23258f613b96bf/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d85b28b8973ea1aa43d44c588788ea20b71e1ca18c7d5de3ab0dedc17a42eb8b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d85b28b8973ea1aa43d44c588788ea20b71e1ca18c7d5de3ab0dedc17a42eb8b/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d9cad674ab6242b49531be8dd0c5c0448d767f682c9a1da4c3ff1bc88bc18cf0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d9cad674ab6242b49531be8dd0c5c0448d767f682c9a1da4c3ff1bc88bc18cf0/userdata/shm major:0 minor:317 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e806da4c9b6cb5741fb45ac6a65e1de0631a2c1d6924212171068605aac0357e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e806da4c9b6cb5741fb45ac6a65e1de0631a2c1d6924212171068605aac0357e/userdata/shm major:0 minor:352 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ea5f80fdb69989b93327100cb6fcfb2fa8096a7a299f66db1968c8863e20e362/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ea5f80fdb69989b93327100cb6fcfb2fa8096a7a299f66db1968c8863e20e362/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f8ccb61c415dbd02c5b80ef5f49d22335e29d795a05f67c294f83f9551357155/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f8ccb61c415dbd02c5b80ef5f49d22335e29d795a05f67c294f83f9551357155/userdata/shm major:0 minor:230 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fbf11e61588c3647bbe3aaecd0de27bf27232851500858619e110e2b251e0bdb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fbf11e61588c3647bbe3aaecd0de27bf27232851500858619e110e2b251e0bdb/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fed14f7cf3ae3d7ab5f9f3da6fa553395102604ddbe374558ea449827c6b0f02/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fed14f7cf3ae3d7ab5f9f3da6fa553395102604ddbe374558ea449827c6b0f02/userdata/shm major:0 minor:294 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0995c467-d41c-43e9-ab5a-0609a3a7cf83/volumes/kubernetes.io~projected/kube-api-access-lk7lz:{mountpoint:/var/lib/kubelet/pods/0995c467-d41c-43e9-ab5a-0609a3a7cf83/volumes/kubernetes.io~projected/kube-api-access-lk7lz major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0cd51906-d6ac-438c-8716-7b60d4c9a1e4/volumes/kubernetes.io~projected/kube-api-access-hp284:{mountpoint:/var/lib/kubelet/pods/0cd51906-d6ac-438c-8716-7b60d4c9a1e4/volumes/kubernetes.io~projected/kube-api-access-hp284 major:0 minor:351 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0cd51906-d6ac-438c-8716-7b60d4c9a1e4/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/0cd51906-d6ac-438c-8716-7b60d4c9a1e4/volumes/kubernetes.io~secret/signing-key major:0 minor:350 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/289044f0-b173-489e-971f-3dff8aaf9aaa/volumes/kubernetes.io~projected/kube-api-access-tpslp:{mountpoint:/var/lib/kubelet/pods/289044f0-b173-489e-971f-3dff8aaf9aaa/volumes/kubernetes.io~projected/kube-api-access-tpslp major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8/volumes/kubernetes.io~projected/kube-api-access-tftr4:{mountpoint:/var/lib/kubelet/pods/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8/volumes/kubernetes.io~projected/kube-api-access-tftr4 major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/36598f65-5a1d-43e3-acc2-71c1e56f112c/volumes/kubernetes.io~projected/kube-api-access-7m57g:{mountpoint:/var/lib/kubelet/pods/36598f65-5a1d-43e3-acc2-71c1e56f112c/volumes/kubernetes.io~projected/kube-api-access-7m57g major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/36598f65-5a1d-43e3-acc2-71c1e56f112c/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/36598f65-5a1d-43e3-acc2-71c1e56f112c/volumes/kubernetes.io~secret/serving-cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/380a7770-3519-404b-927c-dd6754a9ccfb/volumes/kubernetes.io~projected/kube-api-access-l2vxr:{mountpoint:/var/lib/kubelet/pods/380a7770-3519-404b-927c-dd6754a9ccfb/volumes/kubernetes.io~projected/kube-api-access-l2vxr major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3a3d055a-397e-436d-99bd-e82541b4ce57/volumes/kubernetes.io~projected/kube-api-access-mq9sj:{mountpoint:/var/lib/kubelet/pods/3a3d055a-397e-436d-99bd-e82541b4ce57/volumes/kubernetes.io~projected/kube-api-access-mq9sj major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3a3d055a-397e-436d-99bd-e82541b4ce57/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/3a3d055a-397e-436d-99bd-e82541b4ce57/volumes/kubernetes.io~secret/serving-cert major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/439cdf28-89f2-47eb-9a61-b63f4db9237b/volumes/kubernetes.io~projected/kube-api-access-6gqqq:{mountpoint:/var/lib/kubelet/pods/439cdf28-89f2-47eb-9a61-b63f4db9237b/volumes/kubernetes.io~projected/kube-api-access-6gqqq major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/45862374-6557-46b1-9982-4b77670216df/volumes/kubernetes.io~projected/kube-api-access-dhxb4:{mountpoint:/var/lib/kubelet/pods/45862374-6557-46b1-9982-4b77670216df/volumes/kubernetes.io~projected/kube-api-access-dhxb4 major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/542a90b4-b01a-4cad-a5bf-e0181fe30586/volumes/kubernetes.io~projected/kube-api-access-8q89j:{mountpoint:/var/lib/kubelet/pods/542a90b4-b01a-4cad-a5bf-e0181fe30586/volumes/kubernetes.io~projected/kube-api-access-8q89j major:0 minor:337 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/588bc17e-1307-4055-96a4-cbd60ba48541/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/588bc17e-1307-4055-96a4-cbd60ba48541/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/588bc17e-1307-4055-96a4-cbd60ba48541/volumes/kubernetes.io~projected/kube-api-access-kg58s:{mountpoint:/var/lib/kubelet/pods/588bc17e-1307-4055-96a4-cbd60ba48541/volumes/kubernetes.io~projected/kube-api-access-kg58s major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/588bc17e-1307-4055-96a4-cbd60ba48541/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/588bc17e-1307-4055-96a4-cbd60ba48541/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/588bc17e-1307-4055-96a4-cbd60ba48541/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/588bc17e-1307-4055-96a4-cbd60ba48541/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5cbdd163-bfdd-4fda-8141-21b969a3aa08/volumes/kubernetes.io~projected/kube-api-access-82fzq:{mountpoint:/var/lib/kubelet/pods/5cbdd163-bfdd-4fda-8141-21b969a3aa08/volumes/kubernetes.io~projected/kube-api-access-82fzq major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5cbdd163-bfdd-4fda-8141-21b969a3aa08/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/5cbdd163-bfdd-4fda-8141-21b969a3aa08/volumes/kubernetes.io~secret/cert major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6c07fa44-702c-4e55-afe3-451696e76f82/volumes/kubernetes.io~projected/kube-api-access-qnmx6:{mountpoint:/var/lib/kubelet/pods/6c07fa44-702c-4e55-afe3-451696e76f82/volumes/kubernetes.io~projected/kube-api-access-qnmx6 major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6c07fa44-702c-4e55-afe3-451696e76f82/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/6c07fa44-702c-4e55-afe3-451696e76f82/volumes/kubernetes.io~secret/serving-cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/72792cfa-71f1-418a-a59d-40d2f5c392d9/volumes/kubernetes.io~projected/kube-api-access-xck8c:{mountpoint:/var/lib/kubelet/pods/72792cfa-71f1-418a-a59d-40d2f5c392d9/volumes/kubernetes.io~projected/kube-api-access-xck8c major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/736d15ff-56b5-40cf-b19a-38564c93d8b2/volumes/kubernetes.io~projected/kube-api-access-bw8bb:{mountpoint:/var/lib/kubelet/pods/736d15ff-56b5-40cf-b19a-38564c93d8b2/volumes/kubernetes.io~projected/kube-api-access-bw8bb major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7b22f42e-7346-4165-b4ea-99e12837742c/volumes/kubernetes.io~projected/kube-api-access-lbs2h:{mountpoint:/var/lib/kubelet/pods/7b22f42e-7346-4165-b4ea-99e12837742c/volumes/kubernetes.io~projected/kube-api-access-lbs2h major:0 minor:272 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/88ceb339-f96e-45a4-ad35-9691dc70fbd9/volumes/kubernetes.io~projected/kube-api-access-7h69t:{mountpoint:/var/lib/kubelet/pods/88ceb339-f96e-45a4-ad35-9691dc70fbd9/volumes/kubernetes.io~projected/kube-api-access-7h69t major:0 minor:332 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8915bffd-4628-4aee-994b-81de7d1ad7c6/volumes/kubernetes.io~projected/kube-api-access-zgtg6:{mountpoint:/var/lib/kubelet/pods/8915bffd-4628-4aee-994b-81de7d1ad7c6/volumes/kubernetes.io~projected/kube-api-access-zgtg6 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a1471771-c3a3-4c38-a124-455ab7e5e2d5/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/a1471771-c3a3-4c38-a124-455ab7e5e2d5/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a1471771-c3a3-4c38-a124-455ab7e5e2d5/volumes/kubernetes.io~projected/kube-api-access-9zwtz:{mountpoint:/var/lib/kubelet/pods/a1471771-c3a3-4c38-a124-455ab7e5e2d5/volumes/kubernetes.io~projected/kube-api-access-9zwtz major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a1471771-c3a3-4c38-a124-455ab7e5e2d5/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/a1471771-c3a3-4c38-a124-455ab7e5e2d5/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a4982959-0762-44eb-a382-a510881805aa/volumes/kubernetes.io~projected/kube-api-access-9tkqm:{mountpoint:/var/lib/kubelet/pods/a4982959-0762-44eb-a382-a510881805aa/volumes/kubernetes.io~projected/kube-api-access-9tkqm major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/abb8c77f-1d9a-4a7d-adde-ff0b851395ed/volumes/kubernetes.io~projected/kube-api-access-jmf4v:{mountpoint:/var/lib/kubelet/pods/abb8c77f-1d9a-4a7d-adde-ff0b851395ed/volumes/kubernetes.io~projected/kube-api-access-jmf4v major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3746624-9331-4bfa-81ed-3a6f37c8d0e6/volumes/kubernetes.io~projected/kube-api-access-lzqqr:{mountpoint:/var/lib/kubelet/pods/b3746624-9331-4bfa-81ed-3a6f37c8d0e6/volumes/kubernetes.io~projected/kube-api-access-lzqqr major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3a526c1-84f8-41a0-8dee-0ed08bddc5da/volumes/kubernetes.io~projected/kube-api-access-jk4z7:{mountpoint:/var/lib/kubelet/pods/b3a526c1-84f8-41a0-8dee-0ed08bddc5da/volumes/kubernetes.io~projected/kube-api-access-jk4z7 major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3a526c1-84f8-41a0-8dee-0ed08bddc5da/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/b3a526c1-84f8-41a0-8dee-0ed08bddc5da/volumes/kubernetes.io~secret/serving-cert major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b53d4190-50d2-4994-b730-a593c5133702/volumes/kubernetes.io~projected/kube-api-access-7g8bm:{mountpoint:/var/lib/kubelet/pods/b53d4190-50d2-4994-b730-a593c5133702/volumes/kubernetes.io~projected/kube-api-access-7g8bm major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c61b4b48-0d5d-4c17-9218-c38bf3581e98/volumes/kubernetes.io~projected/kube-api-access-qg9zw:{mountpoint:/var/lib/kubelet/pods/c61b4b48-0d5d-4c17-9218-c38bf3581e98/volumes/kubernetes.io~projected/kube-api-access-qg9zw major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03/volumes/kubernetes.io~projected/kube-api-access-85njj:{mountpoint:/var/lib/kubelet/pods/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03/volumes/kubernetes.io~projected/kube-api-access-85njj major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d6afb4de-bd45-4038-a6a9-9ff8671eb430/volumes/kubernetes.io~projected/kube-api-access-b9k4d:{mountpoint:/var/lib/kubelet/pods/d6afb4de-bd45-4038-a6a9-9ff8671eb430/volumes/kubernetes.io~projected/kube-api-access-b9k4d major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d6afb4de-bd45-4038-a6a9-9ff8671eb430/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/d6afb4de-bd45-4038-a6a9-9ff8671eb430/volumes/kubernetes.io~secret/default-certificate major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d6afb4de-bd45-4038-a6a9-9ff8671eb430/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/d6afb4de-bd45-4038-a6a9-9ff8671eb430/volumes/kubernetes.io~secret/stats-auth major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ddc108c9-ccd3-462a-8694-2421004791cd/volumes/kubernetes.io~projected/kube-api-access-zzn4j:{mountpoint:/var/lib/kubelet/pods/ddc108c9-ccd3-462a-8694-2421004791cd/volumes/kubernetes.io~projected/kube-api-access-zzn4j major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e3313fc5-6c47-4d16-8289-80b781a413cd/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/e3313fc5-6c47-4d16-8289-80b781a413cd/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e3313fc5-6c47-4d16-8289-80b781a413cd/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/e3313fc5-6c47-4d16-8289-80b781a413cd/volumes/kubernetes.io~empty-dir/tmp major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e3313fc5-6c47-4d16-8289-80b781a413cd/volumes/kubernetes.io~projected/kube-api-access-wg7z2:{mountpoint:/var/lib/kubelet/pods/e3313fc5-6c47-4d16-8289-80b781a413cd/volumes/kubernetes.io~projected/kube-api-access-wg7z2 major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e5a6f4cf-6f6f-4195-8304-aa0648e43ad9/volumes/kubernetes.io~projected/kube-api-access-x472s:{mountpoint:/var/lib/kubelet/pods/e5a6f4cf-6f6f-4195-8304-aa0648e43ad9/volumes/kubernetes.io~projected/kube-api-access-x472s major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eb453169-964e-4e16-a300-a54f2f3e74a2/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/eb453169-964e-4e16-a300-a54f2f3e74a2/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fe9f47b3-180f-4485-b611-a66abe1974db/volumes/kubernetes.io~projected/kube-api-access-2r8kc:{mountpoint:/var/lib/kubelet/pods/fe9f47b3-180f-4485-b611-a66abe1974db/volumes/kubernetes.io~projected/kube-api-access-2r8kc major:0 minor:213 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/c82524f83cd41705702b6adf4c13c8b04ac09e05d395758dab7bb2d669bb6cb8/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/8a6e79534bde4fc2d4472c02089350229412390fa51cb8739571e8a4439627e9/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/ec19f4cbb3a39d1d82502f769c1b779db58b04844185be80a7740950f70ddfe5/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/b53acf52ec64b7d8f4cfe76d4ce0f15eeead7524c473d1b263c69a74b32fd410/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/f454b4d0df0cceb97c6839c51ffab53cf27a8e789f82ac43172186194897fc7c/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/8f73fbd42b89f4f7aa91b9aa510ba7fab103324d0311014cddbc48e33b37455e/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/1d757b375975233dfad656ac76d6eb69f7f52d47c312bcb9dc0577d0b32bfb0c/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/5a5a9bcf3a59c3d03cf4c12343b9dd99334c3aed21a275bb2730995565cd5e21/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/333aed9d59d8050acd31178316c9981d783ad0952fb1254e0709f2c7e0be8ac3/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/846b0f8e8b7f8399c704cfafdd409cf23a8210d9ca34226d4e81d222635a200b/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-142:{mountpoint:/var/lib/containers/storage/overlay/b467c5735b21090e130e7e8f825be0cf733cd5dfc7503c17010df63fcbcf6e05/merged major:0 minor:142 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/f9edf9c3fb6e7e266fb2760f34cf820b78a52d466769e87d74897c1c975b6057/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/946b77c987da3fc6fcf5c283c8338a81dc5e8ec6c54a4f296766942adb7c69db/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/44c17b30abb0ad23c266666c15774e50635aa61bf336f4350692347f64b1444b/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/081ecb1a144392e0032cd8d3373c49309c5cb0cc6ca9d9a80c41fc3e34c98a7b/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/140b5315330fcdee36f762655b088da38be540ca4ac7aa70b96704384ab34496/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-173:{mountpoint:/var/lib/containers/storage/overlay/64adc43b7fd7ed33e17c2a58dd6a5c5b1b3598a303e0fb1dfcced585b2889941/merged major:0 minor:173 fsType:overlay blockSize:0} overlay_0-175:{mountpoint:/var/lib/containers/storage/overlay/065d8de8753bbf3d247d6453786e741695d9106ec5d73ffcbdabe7a95484be9b/merged major:0 minor:175 fsType:overlay blockSize:0} overlay_0-178:{mountpoint:/var/lib/containers/storage/overlay/c6bccaa9b8fd6db3dae708d7e4d5b6d05b0d232b5a2ac44b2ba6bc174136670e/merged major:0 minor:178 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/d5de16b68d8ed6cb8341de1b06dd8aa2230c387da0f38c9a544af9fe9c7ed5d3/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/1c5714cd2dc2ce714582e76edb38127e95a9734614a4ecae357970c0e865144a/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/64d44e7117f281421aa8a962917f87f0ea2c25a26fbf85cf84dca39d67f8d513/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/ab0c9961ff28b5bba4044941a4fda98210518b3b998be4a2ee2f2b0c0b000880/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/0d04108d7b7cb3b81b88ee02124a4ef651d1305a6bb3ab9f6659011c6b44eeba/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/635f1eb33fe6c5b322b419ea98f0a6ffc5b6f7c49f252dfa7773c0672d44b8af/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/ec3fa231068ba193ec940bd0d67f4be8c4dbec3633f164748bc1de8afd0adbb4/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/44ec55a9552528d0b8727e0a3e1b499952a45149597ad7815a22ce0325c02db8/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/4f0ffeebe6b6ed1768de80154335d70ddb5a45f95a2b34c427791a2d95c3d5ab/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/6e6aadf6551c6ccc70e770f7911efc71206a78db0a347ee0d0bca78318ff20e4/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/4e1bfd7eca756818b44137b651f3fdf47ddf6467897aa38bf50495b0f1a2cff4/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/456ebf8250f7a7eaf7af59fe7771516e5eac8026987252d8fc26d7adad3cf9f9/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/4952d92785e055af4c90cc247ceaa2959b99222a12ea663a1657179118be686a/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-270:{mountpoint:/var/lib/containers/storage/overlay/23fe596999fd7af02ed8093581ab39aa48c162e625883af06cebcded74588454/merged major:0 minor:270 fsType:overlay blockSize:0} overlay_0-285:{mountpoint:/var/lib/containers/storage/overlay/c719acc619e253d276ccc2df90daba89e0c26f0d507fa1e1b5a5ca4be441b142/merged major:0 minor:285 fsType:overlay blockSize:0} overlay_0-287:{mountpoint:/var/lib/containers/storage/overlay/34e49b2224fd35625c9dcb162c476ab896c1883c821d260d54365e486e432adf/merged major:0 minor:287 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/37cd30f809a72508086f0e5a58c3351aa6623be9b8ea169a72a0ef7ba35317c3/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/abe1d8dedd8bd720f8d986a6af78a9f059ac6753f861eda723cb01a465ee9440/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/d286aa34ab8fe0657c98ef42d0b11f7dd712f3207c16af1ae70251e12f780a3f/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/3a9fb56c1b5244b75ac82e444bc452b580ea567af9d878c71dbf712a867750be/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-306:{mountpoint:/var/lib/containers/storage/overlay/79e4fabadbdfbe887ad152929dde1be4006d7523d376c42091eda9fd48251942/merged major:0 minor:306 fsType:overlay blockSize:0} overlay_0-308:{mountpoint:/var/lib/containers/storage/overlay/625bcf40d8d9e6a6ba877611454b5d9ad24adb1e9565492766ae0dc54731808e/merged major:0 minor:308 fsType:overlay blockSize:0} overlay_0-330:{mountpoint:/var/lib/containers/storage/overlay/e3b66e133bfa73c5618e5bb3f8698ca423da707329efaadb0348886ec0ecde13/merged major:0 minor:330 fsType:overlay blockSize:0} overlay_0-338:{mountpoint:/var/lib/containers/storage/overlay/887b3f9b0fd8842133223517e4b7f2aea64a8b4ea51847aa7d0f5ba386bdf749/merged major:0 minor:338 fsType:overlay blockSize:0} overlay_0-340:{mountpoint:/var/lib/containers/storage/overlay/90f1305cbaadf1d41d829736e9363fcccce7b57925b3ee5220f55749b287a5f5/merged major:0 minor:340 fsType:overlay blockSize:0} overlay_0-354:{mountpoint:/var/lib/containers/storage/overlay/19f80f19c4283579622139f4508cdfae4f32634d0f2bc2489a9ecbb2fcb934fb/merged major:0 minor:354 fsType:overlay blockSize:0} overlay_0-356:{mountpoint:/var/lib/containers/storage/overlay/7c9ad78364af322cad77221ba211e839c269ad3f7352057dbc24d6054a112026/merged major:0 minor:356 fsType:overlay blockSize:0} overlay_0-358:{mountpoint:/var/lib/containers/storage/overlay/033d0f9a2ba15f39c165342c8fc6d44c40b4643dc496565896bf87702cc15373/merged major:0 minor:358 fsType:overlay blockSize:0} overlay_0-360:{mountpoint:/var/lib/containers/storage/overlay/c0d947a204703b4264df135a76ec92b3619e15a67fef0484ab294e5cee66bed2/merged major:0 minor:360 fsType:overlay blockSize:0} overlay_0-362:{mountpoint:/var/lib/containers/storage/overlay/4fef72ae95c9bd3dc58ec4d95af91ac7520111b49c5b6cfc3c17b0f0bc35c7dc/merged major:0 minor:362 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/70d30a9bd0585c062a01bc33cd2bc4131876fa4f34e5ef96473f77e72e5279a1/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/3ba0521c8980c2c0d4b127a26d6743d73dd978d54172037ac6264f5a7348ad4c/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/59f45e658ff2907c4cc499c8664ebd755405e7efc1832e2af4ae66fea0a44b99/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/e581ce855e72a6a128e90c82ff8aab3c0407075c513531734fe34d493d3ba9ed/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/abf301f5f274dfe5f1be959032b9b20cd141a461edb7a5e3f381a995a7bb1f6d/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/8dd49109c6cfa31793572c85e1c8941275806d762c4d4cbe805dc291a866dc00/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/2177f44af6c4ec3afd3fd86ea9c010d8a02b369bc7ae74544876828d19aea010/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/9073360b41ce24b3442f099a32797663ead8eda31eec0db28f86cdaf446b064e/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/846ffc5d545a4d1873d579a9a96cbb14bf436dc142deb4f5261a4d4ab0b085ff/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/f55c9360180904db71740aba58399a6e9ca5e8e1615fbcfb4d1871482b2a9b27/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/831cb4169c08bd65e262abc575ca743899266846e9c02791cc209e820b42e6b9/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/9199f3e1b5d1a98ca95be6d190ae37669eaa2b382eff622a2b6a28f875a91a1b/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/53a08ba9d9417a04722f2953e081238a8c0a19f2e628a93b2e29efa237e403d6/merged major:0 minor:96 fsType:overlay blockSize:0}]
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.674668    5077 manager.go:217] Machine: {Timestamp:2026-11-03 21:45:06.673700376 +0000 UTC m=+0.077361799 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102058 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dc5b3268a5fa4e91671a859fcd63a SystemUUID:ec2dc5b3-268a-5fa4-e916-71a859fcd63a BootID:6ef32b6e-1abf-480c-84d0-0ba8d47df8a8 Filesystems:[{Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ac45b1452a5a2eab5e649027acd1beaa6c94881f56387773cc7ddafee57da38b/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6c07fa44-702c-4e55-afe3-451696e76f82/volumes/kubernetes.io~projected/kube-api-access-qnmx6 DeviceMajor:0 DeviceMinor:225 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/90cf459c1c1518f337436004a3f0c58e938a75debc1c5a3ca88355cf43d60dce/userdata/shm DeviceMajor:0 DeviceMinor:234 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d46b9b62e9ba891ea3ab09a9892a0bfe4d24944e784ca0f93a59719f7d06553b/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b357a98f35b01ad756fbc6711ceb483c4111b17c28cd2d862cbdc24216acac69/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b3a526c1-84f8-41a0-8dee-0ed08bddc5da/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:202 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b53d4190-50d2-4994-b730-a593c5133702/volumes/kubernetes.io~projected/kube-api-access-7g8bm DeviceMajor:0 DeviceMinor:219 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-354 DeviceMajor:0 DeviceMinor:354 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:201 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/588bc17e-1307-4055-96a4-cbd60ba48541/volumes/kubernetes.io~projected/kube-api-access-kg58s DeviceMajor:0 DeviceMinor:215 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5cbdd163-bfdd-4fda-8141-21b969a3aa08/volumes/kubernetes.io~projected/kube-api-access-82fzq DeviceMajor:0 DeviceMinor:220 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/010d9285d681fb1c0f9f5025662927cef701ef59de0a4dcc8e437a10aa7d8eb4/userdata/shm DeviceMajor:0 DeviceMinor:348 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b3a526c1-84f8-41a0-8dee-0ed08bddc5da/volumes/kubernetes.io~projected/kube-api-access-jk4z7 DeviceMajor:0 DeviceMinor:217 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/542a90b4-b01a-4cad-a5bf-e0181fe30586/volumes/kubernetes.io~projected/kube-api-access-8q89j DeviceMajor:0 DeviceMinor:337 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b3746624-9331-4bfa-81ed-3a6f37c8d0e6/volumes/kubernetes.io~projected/kube-api-access-lzqqr DeviceMajor:0 DeviceMinor:210 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fbf11e61588c3647bbe3aaecd0de27bf27232851500858619e110e2b251e0bdb/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/c61b4b48-0d5d-4c17-9218-c38bf3581e98/volumes/kubernetes.io~projected/kube-api-access-qg9zw DeviceMajor:0 DeviceMinor:310 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8/volumes/kubernetes.io~projected/kube-api-access-tftr4 DeviceMajor:0 DeviceMinor:61 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d6a753be9b83bcb04228bfab37ea563efae01bef7cc7b20bea23258f613b96bf/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a1471771-c3a3-4c38-a124-455ab7e5e2d5/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:56 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a1471771-c3a3-4c38-a124-455ab7e5e2d5/volumes/kubernetes.io~projected/kube-api-access-9zwtz DeviceMajor:0 DeviceMinor:60 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/173fe4f979fb91439e66255672f886b5aacc3cdce09b2be43b40f92c4883a9e4/userdata/shm DeviceMajor:0 DeviceMinor:92 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/588bc17e-1307-4055-96a4-cbd60ba48541/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:206 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ea5f80fdb69989b93327100cb6fcfb2fa8096a7a299f66db1968c8863e20e362/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6dfd29e14aaaf59752e08786e0371aaa8b47fb230cc545c494f15a097f6122ef/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e5a6f4cf-6f6f-4195-8304-aa0648e43ad9/volumes/kubernetes.io~projected/kube-api-access-x472s DeviceMajor:0 DeviceMinor:224 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-270 DeviceMajor:0 DeviceMinor:270 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:293 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3a3d055a-397e-436d-99bd-e82541b4ce57/volumes/kubernetes.io~projected/kube-api-access-mq9sj DeviceMajor:0 DeviceMinor:212 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/736d15ff-56b5-40cf-b19a-38564c93d8b2/volumes/kubernetes.io~projected/kube-api-access-bw8bb DeviceMajor:0 DeviceMinor:66 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d85b28b8973ea1aa43d44c588788ea20b71e1ca18c7d5de3ab0dedc17a42eb8b/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7b22f42e-7346-4165-b4ea-99e12837742c/volumes/kubernetes.io~projected/kube-api-access-lbs2h DeviceMajor:0 DeviceMinor:272 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/24cc09b481a6341e12171d151216947511774a36c7e685d42e6b13a61b41b757/userdata/shm DeviceMajor:0 DeviceMinor:296 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-360 DeviceMajor:0 DeviceMinor:360 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/72792cfa-71f1-418a-a59d-40d2f5c392d9/volumes/kubernetes.io~projected/kube-api-access-xck8c DeviceMajor:0 DeviceMinor:65 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-362 DeviceMajor:0 DeviceMinor:362 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a4982959-0762-44eb-a382-a510881805aa/volumes/kubernetes.io~projected/kube-api-access-9tkqm DeviceMajor:0 DeviceMinor:67 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/44d234fd81d474c08f6af409d87ab4f9aac197d382658f93682aef15ef4a8600/userdata/shm DeviceMajor:0 DeviceMinor:81 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-142 DeviceMajor:0 DeviceMinor:142 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d6afb4de-bd45-4038-a6a9-9ff8671eb430/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:197 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6c07fa44-702c-4e55-afe3-451696e76f82/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:203 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d6afb4de-bd45-4038-a6a9-9ff8671eb430/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:204 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/3a3d055a-397e-436d-99bd-e82541b4ce57/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:205 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/fe9f47b3-180f-4485-b611-a66abe1974db/volumes/kubernetes.io~projected/kube-api-access-2r8kc DeviceMajor:0 DeviceMinor:213 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/588bc17e-1307-4055-96a4-cbd60ba48541/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:214 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d6afb4de-bd45-4038-a6a9-9ff8671eb430/volumes/kubernetes.io~projected/kube-api-access-b9k4d DeviceMajor:0 DeviceMinor:218 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/205e1a69bc4a13d16b2a19da1e85a0aec68a6cdd415818a444e1abd9d24f94dc/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-175 DeviceMajor:0 DeviceMinor:175 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/45862374-6557-46b1-9982-4b77670216df/volumes/kubernetes.io~projected/kube-api-access-dhxb4 DeviceMajor:0 DeviceMinor:222 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/58b23b1048cea694797201eb85ffb9ff4ce65f997215a15726919c7b58980708/userdata/shm DeviceMajor:0 DeviceMinor:241 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/abb8c77f-1d9a-4a7d-adde-ff0b851395ed/volumes/kubernetes.io~projected/kube-api-access-jmf4v DeviceMajor:0 DeviceMinor:315 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-338 DeviceMajor:0 DeviceMinor:338 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/991829626d8cb2c44828df6a0be61b9f870c53505c6e9f498713a9635bb625f2/userdata/shm DeviceMajor:0 DeviceMinor:75 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/588bc17e-1307-4055-96a4-cbd60ba48541/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:207 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5cbdd163-bfdd-4fda-8141-21b969a3aa08/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:209 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/957ce6cd0b35b23d312801ad6e7bb9c80c7681a99cf93c0dcf3f11f18978f9e5/userdata/shm DeviceMajor:0 DeviceMinor:342 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a1471771-c3a3-4c38-a124-455ab7e5e2d5/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:208 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fed14f7cf3ae3d7ab5f9f3da6fa553395102604ddbe374558ea449827c6b0f02/userdata/shm DeviceMajor:0 DeviceMinor:294 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0cd51906-d6ac-438c-8716-7b60d4c9a1e4/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:350 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0cd51906-d6ac-438c-8716-7b60d4c9a1e4/volumes/kubernetes.io~projected/kube-api-access-hp284 DeviceMajor:0 DeviceMinor:351 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/36598f65-5a1d-43e3-acc2-71c1e56f112c/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:45 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/36598f65-5a1d-43e3-acc2-71c1e56f112c/volumes/kubernetes.io~projected/kube-api-access-7m57g DeviceMajor:0 DeviceMinor:216 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-285 DeviceMajor:0 DeviceMinor:285 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-306 DeviceMajor:0 DeviceMinor:306 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/eb453169-964e-4e16-a300-a54f2f3e74a2/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7ec0d5932964902f8592b5884502ede39045faffa102a8d95108b66192b66469/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/289044f0-b173-489e-971f-3dff8aaf9aaa/volumes/kubernetes.io~projected/kube-api-access-tpslp DeviceMajor:0 DeviceMinor:226 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-340 DeviceMajor:0 DeviceMinor:340 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:221 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f8ccb61c415dbd02c5b80ef5f49d22335e29d795a05f67c294f83f9551357155/userdata/shm DeviceMajor:0 DeviceMinor:230 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03/volumes/kubernetes.io~projected/kube-api-access-85njj DeviceMajor:0 DeviceMinor:223 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/439cdf28-89f2-47eb-9a61-b63f4db9237b/volumes/kubernetes.io~projected/kube-api-access-6gqqq DeviceMajor:0 DeviceMinor:227 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d9cad674ab6242b49531be8dd0c5c0448d767f682c9a1da4c3ff1bc88bc18cf0/userdata/shm DeviceMajor:0 DeviceMinor:317 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-356 DeviceMajor:0 DeviceMinor:356 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e3313fc5-6c47-4d16-8289-80b781a413cd/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:63 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e3313fc5-6c47-4d16-8289-80b781a413cd/volumes/kubernetes.io~projected/kube-api-access-wg7z2 DeviceMajor:0 DeviceMinor:64 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/224136773b85483d6d6428c897c0dfe9416b7bcc5185e47a50bf3141f89cf51b/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8915bffd-4628-4aee-994b-81de7d1ad7c6/volumes/kubernetes.io~projected/kube-api-access-zgtg6 DeviceMajor:0 DeviceMinor:59 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ddc108c9-ccd3-462a-8694-2421004791cd/volumes/kubernetes.io~projected/kube-api-access-zzn4j DeviceMajor:0 DeviceMinor:211 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-308 DeviceMajor:0 DeviceMinor:308 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/88ceb339-f96e-45a4-ad35-9691dc70fbd9/volumes/kubernetes.io~projected/kube-api-access-7h69t DeviceMajor:0 DeviceMinor:332 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e806da4c9b6cb5741fb45ac6a65e1de0631a2c1d6924212171068605aac0357e/userdata/shm DeviceMajor:0 DeviceMinor:352 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-358 DeviceMajor:0 DeviceMinor:358 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/494f57d0d92855b0f36e61b1276c99c609e2d6f683e1b57b2cfc8bbb46bfbf44/userdata/shm DeviceMajor:0 DeviceMinor:235 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0995c467-d41c-43e9-ab5a-0609a3a7cf83/volumes/kubernetes.io~projected/kube-api-access-lk7lz DeviceMajor:0 DeviceMinor:57 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bfcb6494f3705ded0a8ab9f8ecd0a3df0279cda651e6a658c31984f2d0811da2/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-330 DeviceMajor:0 DeviceMinor:330 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e3313fc5-6c47-4d16-8289-80b781a413cd/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:62 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-173 DeviceMajor:0 DeviceMinor:173 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-287 DeviceMajor:0 DeviceMinor:287 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-178 DeviceMajor:0 DeviceMinor:178 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/380a7770-3519-404b-927c-dd6754a9ccfb/volumes/kubernetes.io~projected/kube-api-access-l2vxr DeviceMajor:0 DeviceMinor:58 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a5daeb44ff1a28cff9bd2e239be0feab2789cd292da35e64eebbd80e58417d29/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:010d9285d681fb1 MacAddress:e2:38:35:19:e0:ce Speed:10000 Mtu:8901} {Name:224136773b85483 MacAddress:ae:d1:85:59:53:b6 Speed:10000 Mtu:8901} {Name:24cc09b481a6341 MacAddress:e6:b2:e3:fe:9f:20 Speed:10000 Mtu:8901} {Name:494f57d0d92855b MacAddress:ae:d2:d2:b5:93:41 Speed:10000 Mtu:8901} {Name:58b23b1048cea69 MacAddress:a2:d7:30:61:04:c8 Speed:10000 Mtu:8901} {Name:90cf459c1c1518f MacAddress:42:27:27:77:c3:4e Speed:10000 Mtu:8901} {Name:957ce6cd0b35b23 MacAddress:ae:ea:b9:52:00:05 Speed:10000 Mtu:8901} {Name:a5daeb44ff1a28c MacAddress:3e:5f:7a:84:9e:45 Speed:10000 Mtu:8901} {Name:bfcb6494f3705de MacAddress:16:36:18:7f:5d:02 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:d2:0a:5e:03 Speed:0 Mtu:9001} {Name:br-int MacAddress:76:87:f2:c0:3a:a0 Speed:0 Mtu:8901} {Name:d85b28b8973ea1a MacAddress:fa:be:f9:ab:3f:52 Speed:10000 Mtu:8901} {Name:d9cad674ab6242b MacAddress:fe:fb:7d:14:9a:dc Speed:10000 Mtu:8901} {Name:e806da4c9b6cb57 MacAddress:46:d8:59:9d:76:b7 Speed:10000 Mtu:8901} {Name:ea5f80fdb69989b MacAddress:9e:59:46:26:68:4a Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:d2:0a:5e:03 Speed:0 Mtu:9001} {Name:f8ccb61c415dbd0 MacAddress:0e:71:69:46:3d:f7 Speed:10000 Mtu:8901} {Name:fbf11e61588c364 MacAddress:de:09:c0:0f:12:22 Speed:10000 Mtu:8901} {Name:fed14f7cf3ae3d7 MacAddress:c2:20:46:d9:a3:71 Speed:10000 Mtu:8901} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:c6:29:8e:70:98:64 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.675312    5077 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.675369    5077 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.675724    5077 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.675746    5077 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-183.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.675864    5077 topology_manager.go:143] "Creating topology manager with none policy"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.675871    5077 container_manager_linux.go:311] "Creating device plugin manager"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.675886    5077 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.675898    5077 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.675916    5077 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.676083    5077 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.676180    5077 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.676213    5077 kubelet.go:493] "Attempting to sync node with API server"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.676270    5077 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.676285    5077 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.676307    5077 kubelet.go:405] "Adding apiserver pod source"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.676317    5077 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.677329    5077 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.677339    5077 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.677796    5077 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.679927    5077 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.679936    5077 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.680020    5077 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.680366    5077 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.680413    5077 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.680603    5077 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.680625    5077 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.680636    5077 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.680650    5077 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.680660    5077 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.680671    5077 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.680683    5077 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.680693    5077 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.680707    5077 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.680719    5077 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.680755    5077 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.680776    5077 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.680841    5077 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 03 21:45:06.680849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.680856    5077 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 03 21:45:06.684530 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.684515    5077 server.go:1263] "Started kubelet"
Nov 03 21:45:06.684669 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.684602    5077 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 03 21:45:06.685920 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.684654    5077 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 03 21:45:06.685920 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.685109    5077 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 03 21:45:06.685920 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.685509    5077 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 03 21:45:06.685118 ip-10-0-128-183 systemd[1]: Started Kubernetes Kubelet.
Nov 03 21:45:06.686146 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.685926    5077 server.go:317] "Adding debug handlers to kubelet server"
Nov 03 21:45:06.691044 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.691029    5077 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 03 21:45:06.691352 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.691326    5077 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 03 21:45:06.692075 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.692017    5077 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 21:39:26 +0000 UTC" deadline="2028-07-08 23:34:33.368839564 +0000 UTC"
Nov 03 21:45:06.692075 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.692063    5077 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14713h49m26.676781174s"
Nov 03 21:45:06.692322 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.692187    5077 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 03 21:45:06.692322 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.692199    5077 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 03 21:45:06.692322 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.692320    5077 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 03 21:45:06.692632 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:06.692612    5077 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-183.us-east-2.compute.internal\" not found"
Nov 03 21:45:06.692687 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.692665    5077 factory.go:55] Registering systemd factory
Nov 03 21:45:06.692687 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.692683    5077 factory.go:223] Registration of the systemd container factory successfully
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.694384    5077 factory.go:153] Registering CRI-O factory
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.694403    5077 factory.go:223] Registration of the crio container factory successfully
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.694467    5077 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.694484    5077 factory.go:103] Registering Raw factory
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.694502    5077 manager.go:1199] Started watching for new ooms in manager
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.694859    5077 manager.go:319] Starting recovery of all containers
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695185    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" volumeName="kubernetes.io/configmap/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-trusted-ca" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695237    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" volumeName="kubernetes.io/secret/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-installation-pull-secrets" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695268    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e5a6f4cf-6f6f-4195-8304-aa0648e43ad9" volumeName="kubernetes.io/projected/e5a6f4cf-6f6f-4195-8304-aa0648e43ad9-kube-api-access-x472s" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695282    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0995c467-d41c-43e9-ab5a-0609a3a7cf83" volumeName="kubernetes.io/projected/0995c467-d41c-43e9-ab5a-0609a3a7cf83-kube-api-access-lk7lz" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695323    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="289044f0-b173-489e-971f-3dff8aaf9aaa" volumeName="kubernetes.io/configmap/289044f0-b173-489e-971f-3dff8aaf9aaa-config-volume" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695336    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="380a7770-3519-404b-927c-dd6754a9ccfb" volumeName="kubernetes.io/projected/380a7770-3519-404b-927c-dd6754a9ccfb-kube-api-access-l2vxr" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695347    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a3d055a-397e-436d-99bd-e82541b4ce57" volumeName="kubernetes.io/configmap/3a3d055a-397e-436d-99bd-e82541b4ce57-service-ca-bundle" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695388    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="45862374-6557-46b1-9982-4b77670216df" volumeName="kubernetes.io/projected/45862374-6557-46b1-9982-4b77670216df-kube-api-access-dhxb4" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695418    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="588bc17e-1307-4055-96a4-cbd60ba48541" volumeName="kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-bound-sa-token" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695427    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1471771-c3a3-4c38-a124-455ab7e5e2d5" volumeName="kubernetes.io/secret/a1471771-c3a3-4c38-a124-455ab7e5e2d5-ovn-node-metrics-cert" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695443    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0cd51906-d6ac-438c-8716-7b60d4c9a1e4" volumeName="kubernetes.io/configmap/0cd51906-d6ac-438c-8716-7b60d4c9a1e4-signing-cabundle" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695465    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b1bc67e-f876-4fec-b9bf-a3a8906d8d94" volumeName="kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695474    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a3d055a-397e-436d-99bd-e82541b4ce57" volumeName="kubernetes.io/empty-dir/3a3d055a-397e-436d-99bd-e82541b4ce57-snapshots" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695489    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="588bc17e-1307-4055-96a4-cbd60ba48541" volumeName="kubernetes.io/secret/588bc17e-1307-4055-96a4-cbd60ba48541-installation-pull-secrets" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695508    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" volumeName="kubernetes.io/configmap/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-certificates" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695514    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" volumeName="kubernetes.io/secret/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-image-registry-private-configuration" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695531    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="abb8c77f-1d9a-4a7d-adde-ff0b851395ed" volumeName="kubernetes.io/configmap/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-service-ca-bundle" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695544    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="289044f0-b173-489e-971f-3dff8aaf9aaa" volumeName="kubernetes.io/projected/289044f0-b173-489e-971f-3dff8aaf9aaa-kube-api-access-tpslp" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695551    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a3d055a-397e-436d-99bd-e82541b4ce57" volumeName="kubernetes.io/configmap/3a3d055a-397e-436d-99bd-e82541b4ce57-trusted-ca-bundle" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695568    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="588bc17e-1307-4055-96a4-cbd60ba48541" volumeName="kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-kube-api-access-kg58s" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695575    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="736d15ff-56b5-40cf-b19a-38564c93d8b2" volumeName="kubernetes.io/projected/736d15ff-56b5-40cf-b19a-38564c93d8b2-kube-api-access-bw8bb" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695596    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="88ceb339-f96e-45a4-ad35-9691dc70fbd9" volumeName="kubernetes.io/projected/88ceb339-f96e-45a4-ad35-9691dc70fbd9-kube-api-access-7h69t" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695633    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0cd51906-d6ac-438c-8716-7b60d4c9a1e4" volumeName="kubernetes.io/projected/0cd51906-d6ac-438c-8716-7b60d4c9a1e4-kube-api-access-hp284" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695651    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0cd51906-d6ac-438c-8716-7b60d4c9a1e4" volumeName="kubernetes.io/secret/0cd51906-d6ac-438c-8716-7b60d4c9a1e4-signing-key" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695659    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="72792cfa-71f1-418a-a59d-40d2f5c392d9" volumeName="kubernetes.io/projected/72792cfa-71f1-418a-a59d-40d2f5c392d9-kube-api-access-xck8c" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695674    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1471771-c3a3-4c38-a124-455ab7e5e2d5" volumeName="kubernetes.io/configmap/a1471771-c3a3-4c38-a124-455ab7e5e2d5-env-overrides" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695692    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="abb8c77f-1d9a-4a7d-adde-ff0b851395ed" volumeName="kubernetes.io/projected/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-kube-api-access-jmf4v" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695699    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" volumeName="kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-bound-sa-token" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695719    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e3313fc5-6c47-4d16-8289-80b781a413cd" volumeName="kubernetes.io/projected/e3313fc5-6c47-4d16-8289-80b781a413cd-kube-api-access-wg7z2" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695727    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="439cdf28-89f2-47eb-9a61-b63f4db9237b" volumeName="kubernetes.io/projected/439cdf28-89f2-47eb-9a61-b63f4db9237b-kube-api-access-6gqqq" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695742    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="588bc17e-1307-4055-96a4-cbd60ba48541" volumeName="kubernetes.io/secret/588bc17e-1307-4055-96a4-cbd60ba48541-image-registry-private-configuration" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695767    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5cbdd163-bfdd-4fda-8141-21b969a3aa08" volumeName="kubernetes.io/projected/5cbdd163-bfdd-4fda-8141-21b969a3aa08-kube-api-access-82fzq" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695775    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6c07fa44-702c-4e55-afe3-451696e76f82" volumeName="kubernetes.io/secret/6c07fa44-702c-4e55-afe3-451696e76f82-serving-cert" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695782    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="72792cfa-71f1-418a-a59d-40d2f5c392d9" volumeName="kubernetes.io/configmap/72792cfa-71f1-418a-a59d-40d2f5c392d9-cni-sysctl-allowlist" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695798    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="736d15ff-56b5-40cf-b19a-38564c93d8b2" volumeName="kubernetes.io/configmap/736d15ff-56b5-40cf-b19a-38564c93d8b2-serviceca" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695805    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3746624-9331-4bfa-81ed-3a6f37c8d0e6" volumeName="kubernetes.io/configmap/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-config" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695812    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fe9f47b3-180f-4485-b611-a66abe1974db" volumeName="kubernetes.io/projected/fe9f47b3-180f-4485-b611-a66abe1974db-kube-api-access-2r8kc" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695827    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2abaabbc-57ab-4afa-99f5-17eaeb9c23b8" volumeName="kubernetes.io/projected/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-kube-api-access-tftr4" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695842    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="380a7770-3519-404b-927c-dd6754a9ccfb" volumeName="kubernetes.io/configmap/380a7770-3519-404b-927c-dd6754a9ccfb-multus-daemon-config" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695848    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" volumeName="kubernetes.io/empty-dir/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-ca-trust-extracted" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695856    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d6afb4de-bd45-4038-a6a9-9ff8671eb430" volumeName="kubernetes.io/projected/d6afb4de-bd45-4038-a6a9-9ff8671eb430-kube-api-access-b9k4d" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695864    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36598f65-5a1d-43e3-acc2-71c1e56f112c" volumeName="kubernetes.io/configmap/36598f65-5a1d-43e3-acc2-71c1e56f112c-config" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695871    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36598f65-5a1d-43e3-acc2-71c1e56f112c" volumeName="kubernetes.io/secret/36598f65-5a1d-43e3-acc2-71c1e56f112c-serving-cert" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695893    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="380a7770-3519-404b-927c-dd6754a9ccfb" volumeName="kubernetes.io/configmap/380a7770-3519-404b-927c-dd6754a9ccfb-cni-binary-copy" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695910    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="abb8c77f-1d9a-4a7d-adde-ff0b851395ed" volumeName="kubernetes.io/configmap/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-trusted-ca-bundle" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695917    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3a526c1-84f8-41a0-8dee-0ed08bddc5da" volumeName="kubernetes.io/secret/b3a526c1-84f8-41a0-8dee-0ed08bddc5da-serving-cert" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695928    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d6afb4de-bd45-4038-a6a9-9ff8671eb430" volumeName="kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-stats-auth" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695937    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ddc108c9-ccd3-462a-8694-2421004791cd" volumeName="kubernetes.io/configmap/ddc108c9-ccd3-462a-8694-2421004791cd-telemetry-config" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695944    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="588bc17e-1307-4055-96a4-cbd60ba48541" volumeName="kubernetes.io/configmap/588bc17e-1307-4055-96a4-cbd60ba48541-registry-certificates" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695967    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5cbdd163-bfdd-4fda-8141-21b969a3aa08" volumeName="kubernetes.io/secret/5cbdd163-bfdd-4fda-8141-21b969a3aa08-cert" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695975    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b53d4190-50d2-4994-b730-a593c5133702" volumeName="kubernetes.io/projected/b53d4190-50d2-4994-b730-a593c5133702-kube-api-access-7g8bm" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695982    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c61b4b48-0d5d-4c17-9218-c38bf3581e98" volumeName="kubernetes.io/projected/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-api-access-qg9zw" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695991    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="289044f0-b173-489e-971f-3dff8aaf9aaa" volumeName="kubernetes.io/empty-dir/289044f0-b173-489e-971f-3dff8aaf9aaa-tmp-dir" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.695998    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36598f65-5a1d-43e3-acc2-71c1e56f112c" volumeName="kubernetes.io/configmap/36598f65-5a1d-43e3-acc2-71c1e56f112c-trusted-ca" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696014    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a3d055a-397e-436d-99bd-e82541b4ce57" volumeName="kubernetes.io/secret/3a3d055a-397e-436d-99bd-e82541b4ce57-serving-cert" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696022    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="542a90b4-b01a-4cad-a5bf-e0181fe30586" volumeName="kubernetes.io/projected/542a90b4-b01a-4cad-a5bf-e0181fe30586-kube-api-access-8q89j" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696049    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6c07fa44-702c-4e55-afe3-451696e76f82" volumeName="kubernetes.io/configmap/6c07fa44-702c-4e55-afe3-451696e76f82-config" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696058    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="72792cfa-71f1-418a-a59d-40d2f5c392d9" volumeName="kubernetes.io/configmap/72792cfa-71f1-418a-a59d-40d2f5c392d9-whereabouts-flatfile-configmap" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696076    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3a526c1-84f8-41a0-8dee-0ed08bddc5da" volumeName="kubernetes.io/configmap/b3a526c1-84f8-41a0-8dee-0ed08bddc5da-config" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696100    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e3313fc5-6c47-4d16-8289-80b781a413cd" volumeName="kubernetes.io/empty-dir/e3313fc5-6c47-4d16-8289-80b781a413cd-tmp" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696107    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0995c467-d41c-43e9-ab5a-0609a3a7cf83" volumeName="kubernetes.io/configmap/0995c467-d41c-43e9-ab5a-0609a3a7cf83-iptables-alerter-script" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696114    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a3d055a-397e-436d-99bd-e82541b4ce57" volumeName="kubernetes.io/empty-dir/3a3d055a-397e-436d-99bd-e82541b4ce57-tmp" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696125    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a3d055a-397e-436d-99bd-e82541b4ce57" volumeName="kubernetes.io/projected/3a3d055a-397e-436d-99bd-e82541b4ce57-kube-api-access-mq9sj" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696136    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3ebc2e42-6892-480b-a793-4f224d09f45d" volumeName="kubernetes.io/configmap/3ebc2e42-6892-480b-a793-4f224d09f45d-nginx-conf" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696147    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b22f42e-7346-4165-b4ea-99e12837742c" volumeName="kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696158    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8915bffd-4628-4aee-994b-81de7d1ad7c6" volumeName="kubernetes.io/projected/8915bffd-4628-4aee-994b-81de7d1ad7c6-kube-api-access-zgtg6" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696169    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3746624-9331-4bfa-81ed-3a6f37c8d0e6" volumeName="kubernetes.io/projected/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-kube-api-access-lzqqr" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696180    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb453169-964e-4e16-a300-a54f2f3e74a2" volumeName="kubernetes.io/secret/eb453169-964e-4e16-a300-a54f2f3e74a2-agent-certs" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696191    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="72792cfa-71f1-418a-a59d-40d2f5c392d9" volumeName="kubernetes.io/configmap/72792cfa-71f1-418a-a59d-40d2f5c392d9-cni-binary-copy" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696201    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4982959-0762-44eb-a382-a510881805aa" volumeName="kubernetes.io/empty-dir/a4982959-0762-44eb-a382-a510881805aa-tmp-dir" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696210    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36598f65-5a1d-43e3-acc2-71c1e56f112c" volumeName="kubernetes.io/projected/36598f65-5a1d-43e3-acc2-71c1e56f112c-kube-api-access-7m57g" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696226    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="588bc17e-1307-4055-96a4-cbd60ba48541" volumeName="kubernetes.io/empty-dir/588bc17e-1307-4055-96a4-cbd60ba48541-ca-trust-extracted" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696234    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4982959-0762-44eb-a382-a510881805aa" volumeName="kubernetes.io/projected/a4982959-0762-44eb-a382-a510881805aa-kube-api-access-9tkqm" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696274    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="abb8c77f-1d9a-4a7d-adde-ff0b851395ed" volumeName="kubernetes.io/empty-dir/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-archives-path" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696284    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e3313fc5-6c47-4d16-8289-80b781a413cd" volumeName="kubernetes.io/empty-dir/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-tuned" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696302    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb453169-964e-4e16-a300-a54f2f3e74a2" volumeName="kubernetes.io/configmap/eb453169-964e-4e16-a300-a54f2f3e74a2-konnectivity-ca" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696313    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c61b4b48-0d5d-4c17-9218-c38bf3581e98" volumeName="kubernetes.io/empty-dir/c61b4b48-0d5d-4c17-9218-c38bf3581e98-data-volume" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696327    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d6afb4de-bd45-4038-a6a9-9ff8671eb430" volumeName="kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-default-certificate" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696340    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ddc108c9-ccd3-462a-8694-2421004791cd" volumeName="kubernetes.io/projected/ddc108c9-ccd3-462a-8694-2421004791cd-kube-api-access-zzn4j" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696352    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="588bc17e-1307-4055-96a4-cbd60ba48541" volumeName="kubernetes.io/configmap/588bc17e-1307-4055-96a4-cbd60ba48541-trusted-ca" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696395    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6c07fa44-702c-4e55-afe3-451696e76f82" volumeName="kubernetes.io/projected/6c07fa44-702c-4e55-afe3-451696e76f82-kube-api-access-qnmx6" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696408    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1471771-c3a3-4c38-a124-455ab7e5e2d5" volumeName="kubernetes.io/configmap/a1471771-c3a3-4c38-a124-455ab7e5e2d5-ovnkube-config" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696421    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1471771-c3a3-4c38-a124-455ab7e5e2d5" volumeName="kubernetes.io/configmap/a1471771-c3a3-4c38-a124-455ab7e5e2d5-ovnkube-script-lib" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696436    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1471771-c3a3-4c38-a124-455ab7e5e2d5" volumeName="kubernetes.io/projected/a1471771-c3a3-4c38-a124-455ab7e5e2d5-kube-api-access-9zwtz" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696448    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" volumeName="kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-kube-api-access-85njj" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696461    5077 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3a526c1-84f8-41a0-8dee-0ed08bddc5da" volumeName="kubernetes.io/projected/b3a526c1-84f8-41a0-8dee-0ed08bddc5da-kube-api-access-jk4z7" seLinuxMountContext=""
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696472    5077 reconstruct.go:97] "Volume reconstruction finished"
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696481    5077 reconciler.go:29] "Reconciler: start to sync state"
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696573    5077 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 21:45:06.697039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.696763    5077 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 21:45:06.704043 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.703548    5077 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 21:45:06.704043 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.703865    5077 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Nov 03 21:45:06.715336 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.715317    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pspgs_36598f65-5a1d-43e3-acc2-71c1e56f112c/console-operator/1.log"
Nov 03 21:45:06.715435 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.715388    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pspgs_36598f65-5a1d-43e3-acc2-71c1e56f112c/console-operator/1.log"
Nov 03 21:45:06.726072 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.726021    5077 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 03 21:45:06.727819 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.727587    5077 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 03 21:45:06.727819 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.727610    5077 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 03 21:45:06.727819 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.727637    5077 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 03 21:45:06.727819 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:06.727682    5077 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 03 21:45:06.731701 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.731677    5077 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 21:45:06.743864 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.743845    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pspgs_36598f65-5a1d-43e3-acc2-71c1e56f112c/console-operator/1.log"
Nov 03 21:45:06.743966 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.743873    5077 generic.go:356] "Generic (PLEG): container finished" podID="36598f65-5a1d-43e3-acc2-71c1e56f112c" containerID="205e56b9b376059dd655d9e4c4c3295d73f1dd1ee6091d03a9936d7434913f5c" exitCode=255
Nov 03 21:45:06.749201 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.749178    5077 generic.go:356] "Generic (PLEG): container finished" podID="72792cfa-71f1-418a-a59d-40d2f5c392d9" containerID="7d24b3d045225f381b92cbcdca064fcc484d15486acc203e2dd0392221923518" exitCode=0
Nov 03 21:45:06.749201 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.749202    5077 generic.go:356] "Generic (PLEG): container finished" podID="72792cfa-71f1-418a-a59d-40d2f5c392d9" containerID="802ba13bce7c87616ccaa01536319df20bf2f3734cde0288aa14f6bcb92a8780" exitCode=0
Nov 03 21:45:06.749201 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.749214    5077 generic.go:356] "Generic (PLEG): container finished" podID="72792cfa-71f1-418a-a59d-40d2f5c392d9" containerID="321b993df7344145bf05d37dd4c63329e20dae4abc918f4537962b1f8d429c98" exitCode=0
Nov 03 21:45:06.749423 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.749222    5077 generic.go:356] "Generic (PLEG): container finished" podID="72792cfa-71f1-418a-a59d-40d2f5c392d9" containerID="1c373587a4d8c7e2829315cc8a2aec531c5dc6be4802fd862ec257008ab52a14" exitCode=0
Nov 03 21:45:06.749423 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.749229    5077 generic.go:356] "Generic (PLEG): container finished" podID="72792cfa-71f1-418a-a59d-40d2f5c392d9" containerID="11903edfba14c5d2af2015adf7b48fde9c3442dcf6a91bdb69c1e4f01f77e78c" exitCode=0
Nov 03 21:45:06.749423 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.749236    5077 generic.go:356] "Generic (PLEG): container finished" podID="72792cfa-71f1-418a-a59d-40d2f5c392d9" containerID="1f03e6704625f5b176f74d5a407974a6232a2406cb65f02d9cdf47d5f29939f8" exitCode=0
Nov 03 21:45:06.767130 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.767100    5077 generic.go:356] "Generic (PLEG): container finished" podID="e92af9dfcd386af37bd479e7884242eb" containerID="7f84e556692c0ccc33ce4901d9b007481bc7537533cb10359d70e320d905964f" exitCode=0
Nov 03 21:45:06.795951 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.795894    5077 manager.go:324] Recovery completed
Nov 03 21:45:06.815862 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.815837    5077 cpu_manager.go:226] "Starting" policy="none"
Nov 03 21:45:06.815862 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.815855    5077 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 03 21:45:06.816027 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.815876    5077 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 03 21:45:06.816027 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.815997    5077 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Nov 03 21:45:06.816027 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.816009    5077 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Nov 03 21:45:06.816027 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.816026    5077 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Nov 03 21:45:06.816139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.816031    5077 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Nov 03 21:45:06.816139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.816037    5077 policy_none.go:50] "Start"
Nov 03 21:45:06.816139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.816045    5077 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 03 21:45:06.816139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.816054    5077 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 03 21:45:06.816273 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.816180    5077 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Nov 03 21:45:06.816273 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.816187    5077 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Nov 03 21:45:06.816273 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.816193    5077 policy_none.go:44] "Start"
Nov 03 21:45:06.820556 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.820530    5077 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 03 21:45:06.823916 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.823905    5077 manager.go:341] "Starting Device Plugin manager"
Nov 03 21:45:06.824494 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:06.823926    5077 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 03 21:45:06.824546 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.824500    5077 server.go:87] "Starting device plugin registration server"
Nov 03 21:45:06.824745 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.824734    5077 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 03 21:45:06.824776 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.824748    5077 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 03 21:45:06.825308 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.824831    5077 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 03 21:45:06.825483 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.825449    5077 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 03 21:45:06.825551 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.825514    5077 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 03 21:45:06.825551 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.825523    5077 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 03 21:45:06.826792 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.825644    5077 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-03T21:45:06.825482837Z","UUID":"55ccf7d2-b800-404f-ac5b-fdfe7076b490","Handler":null,"Name":"","Endpoint":""}
Nov 03 21:45:06.827292 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:06.827271    5077 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 03 21:45:06.827815 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.827778    5077 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal"]
Nov 03 21:45:06.828322 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.828304    5077 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 03 21:45:06.828418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.828367    5077 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 03 21:45:06.829406 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.829091    5077 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:45:06.829406 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.829083    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal" event={"ID":"512504a651dea6eb0e990f68b3a9a61c","Type":"ContainerStarted","Data":"205e1a69bc4a13d16b2a19da1e85a0aec68a6cdd415818a444e1abd9d24f94dc"}
Nov 03 21:45:06.829558 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.829444    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal" event={"ID":"e92af9dfcd386af37bd479e7884242eb","Type":"ContainerStarted","Data":"03fdb0069b9b8d3c9d8ff6aa6196354aaed3dc680a9cd807707b4aff6aadaeff"}
Nov 03 21:45:06.829558 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.829487    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal" event={"ID":"e92af9dfcd386af37bd479e7884242eb","Type":"ContainerDied","Data":"7f84e556692c0ccc33ce4901d9b007481bc7537533cb10359d70e320d905964f"}
Nov 03 21:45:06.829558 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.829512    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal" event={"ID":"e92af9dfcd386af37bd479e7884242eb","Type":"ContainerStarted","Data":"d6a753be9b83bcb04228bfab37ea563efae01bef7cc7b20bea23258f613b96bf"}
Nov 03 21:45:06.830196 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.829722    5077 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:45:06.844778 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.844753    5077 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 03 21:45:06.844875 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:06.844805    5077 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:45:06.845235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.845220    5077 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 03 21:45:06.845323 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:06.845274    5077 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:45:06.905149 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.905113    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e92af9dfcd386af37bd479e7884242eb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal\" (UID: \"e92af9dfcd386af37bd479e7884242eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:45:06.905320 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.905157    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e92af9dfcd386af37bd479e7884242eb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal\" (UID: \"e92af9dfcd386af37bd479e7884242eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:45:06.905320 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.905236    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/512504a651dea6eb0e990f68b3a9a61c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal\" (UID: \"512504a651dea6eb0e990f68b3a9a61c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:45:06.925216 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.925189    5077 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 21:45:06.926587 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.926571    5077 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 03 21:45:06.926671 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.926605    5077 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 03 21:45:06.926671 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.926620    5077 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-183.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 03 21:45:06.926743 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.926680    5077 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:45:06.940582 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.940562    5077 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:45:06.940687 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:06.940629    5077 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:45:07.006047 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.006016    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e92af9dfcd386af37bd479e7884242eb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal\" (UID: \"e92af9dfcd386af37bd479e7884242eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:45:07.006229 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.006060    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e92af9dfcd386af37bd479e7884242eb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal\" (UID: \"e92af9dfcd386af37bd479e7884242eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:45:07.006229 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.006080    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/512504a651dea6eb0e990f68b3a9a61c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal\" (UID: \"512504a651dea6eb0e990f68b3a9a61c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:45:07.006229 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.006122    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/512504a651dea6eb0e990f68b3a9a61c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal\" (UID: \"512504a651dea6eb0e990f68b3a9a61c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:45:07.006229 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.006132    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e92af9dfcd386af37bd479e7884242eb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal\" (UID: \"e92af9dfcd386af37bd479e7884242eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:45:07.006229 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.006141    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e92af9dfcd386af37bd479e7884242eb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal\" (UID: \"e92af9dfcd386af37bd479e7884242eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:45:07.676987 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.676948    5077 apiserver.go:52] "Watching apiserver"
Nov 03 21:45:07.687690 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.687666    5077 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 03 21:45:07.690159 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.690087    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tqldf","openshift-multus/multus-pg6ql","openshift-multus/multus-additional-cni-plugins-r964d","kube-system/kas-connection-checker-685895c7c9-f5kct","openshift-cluster-node-tuning-operator/tuned-85lqj","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg","openshift-dns/node-resolver-4jznx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd","openshift-ovn-kubernetes/ovnkube-node-hgk2l","openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j","openshift-insights/periodic-gathering-xghgl-bwm6n","openshift-kube-storage-version-migrator/migrator-66df5d496b-g7kms","kube-system/kas-connection-checker-685895c7c9-wd97l","openshift-network-diagnostics/network-check-target-ztd6j","openshift-image-registry/image-registry-9b86b7998-kbxzw","openshift-service-ca/service-ca-5fffc97bdf-czxjn","openshift-network-diagnostics/network-check-source-6f78d59f99-vhbjg","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c","openshift-console-operator/console-operator-7cd56b8dbc-pspgs","openshift-ingress/router-default-5b77b9dbdf-rbjh5","openshift-network-console/networking-console-plugin-86c478bb88-fv6vx","kube-system/konnectivity-agent-mrf9j","kube-system/kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal","kube-system/kas-connection-checker-685895c7c9-p7l88","openshift-insights/insights-runtime-extractor-x7fmc","openshift-image-registry/node-ca-txllc","openshift-kube-storage-version-migrator/migrator-66df5d496b-zdz8c","openshift-image-registry/image-registry-5d56fbb4cf-57p87","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-5w6h4","openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng","openshift-dns/dns-default-bmvnd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal","kube-system/global-pull-secret-syncer-dndpk","openshift-multus/network-metrics-daemon-kjp2c","openshift-network-operator/iptables-alerter-lmjlz","openshift-insights/insights-operator-7c4986d449-kmt8d"]
Nov 03 21:45:07.692708 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.692687    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:45:07.693036 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.693017    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:45:07.694662 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.694645    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:07.695174 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.695153    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Nov 03 21:45:07.695290 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.695163    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Nov 03 21:45:07.695344 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.695285    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Nov 03 21:45:07.695391 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.695372    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:07.695937 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.695917    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"
Nov 03 21:45:07.698848 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.698831    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Nov 03 21:45:07.698970 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.698843    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Nov 03 21:45:07.698970 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.698949    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Nov 03 21:45:07.698970 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.698844    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Nov 03 21:45:07.699171 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.699027    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Nov 03 21:45:07.699337 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.699322    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 03 21:45:07.699448 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.699434    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 03 21:45:07.699547 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.699533    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Nov 03 21:45:07.699547 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.699541    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Nov 03 21:45:07.699656 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.699614    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Nov 03 21:45:07.699656 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.699619    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Nov 03 21:45:07.699656 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.699625    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Nov 03 21:45:07.699796 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.699665    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Nov 03 21:45:07.699796 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.699667    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Nov 03 21:45:07.699894 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.699855    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 03 21:45:07.699894 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.699865    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Nov 03 21:45:07.699980 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.699917    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Nov 03 21:45:07.700049 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.700036    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 03 21:45:07.700114 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.700100    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Nov 03 21:45:07.701676 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.701659    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:45:07.701815 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.701754    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Nov 03 21:45:07.701929 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.701910    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Nov 03 21:45:07.702536 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.702510    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Nov 03 21:45:07.703707 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.703684    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Nov 03 21:45:07.703802 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.703779    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Nov 03 21:45:07.704236 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.704220    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Nov 03 21:45:07.704821 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.704803    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Nov 03 21:45:07.707169 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.707144    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 03 21:45:07.707277 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.707225    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Nov 03 21:45:07.708283 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.708263    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-52n7c\""
Nov 03 21:45:07.708482 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.708454    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 03 21:45:07.708548 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.708523    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Nov 03 21:45:07.708724 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.708703    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Nov 03 21:45:07.709031 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.708927    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-rdd92\""
Nov 03 21:45:07.709134 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.708948    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 03 21:45:07.709215 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.708997    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Nov 03 21:45:07.709318 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.709297    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 03 21:45:07.709380 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.709336    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-wvc4j\" (UID: \"ddc108c9-ccd3-462a-8694-2421004791cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:45:07.709427 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.709413    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x472s\" (UniqueName: \"kubernetes.io/projected/e5a6f4cf-6f6f-4195-8304-aa0648e43ad9-kube-api-access-x472s\") pod \"kas-connection-checker-685895c7c9-f5kct\" (UID: \"e5a6f4cf-6f6f-4195-8304-aa0648e43ad9\") " pod="kube-system/kas-connection-checker-685895c7c9-f5kct"
Nov 03 21:45:07.709527 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.709464    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36598f65-5a1d-43e3-acc2-71c1e56f112c-config\") pod \"console-operator-7cd56b8dbc-pspgs\" (UID: \"36598f65-5a1d-43e3-acc2-71c1e56f112c\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:45:07.709573 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.709532    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jbpmc\""
Nov 03 21:45:07.709701 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.709686    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-hgwjm\""
Nov 03 21:45:07.709993 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.709278    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lqk2r\""
Nov 03 21:45:07.710049 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.709122    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 03 21:45:07.710049 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.709948    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36598f65-5a1d-43e3-acc2-71c1e56f112c-trusted-ca\") pod \"console-operator-7cd56b8dbc-pspgs\" (UID: \"36598f65-5a1d-43e3-acc2-71c1e56f112c\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:45:07.710135 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.710087    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m57g\" (UniqueName: \"kubernetes.io/projected/36598f65-5a1d-43e3-acc2-71c1e56f112c-kube-api-access-7m57g\") pod \"console-operator-7cd56b8dbc-pspgs\" (UID: \"36598f65-5a1d-43e3-acc2-71c1e56f112c\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:45:07.710183 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.710140    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ddc108c9-ccd3-462a-8694-2421004791cd-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-wvc4j\" (UID: \"ddc108c9-ccd3-462a-8694-2421004791cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:45:07.710316 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.710288    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzn4j\" (UniqueName: \"kubernetes.io/projected/ddc108c9-ccd3-462a-8694-2421004791cd-kube-api-access-zzn4j\") pod \"cluster-monitoring-operator-884576c57-wvc4j\" (UID: \"ddc108c9-ccd3-462a-8694-2421004791cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:45:07.710491 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.710439    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g8bm\" (UniqueName: \"kubernetes.io/projected/b53d4190-50d2-4994-b730-a593c5133702-kube-api-access-7g8bm\") pod \"kas-connection-checker-685895c7c9-p7l88\" (UID: \"b53d4190-50d2-4994-b730-a593c5133702\") " pod="kube-system/kas-connection-checker-685895c7c9-p7l88"
Nov 03 21:45:07.710574 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.710520    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:07.710950 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.710687    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gqqq\" (UniqueName: \"kubernetes.io/projected/439cdf28-89f2-47eb-9a61-b63f4db9237b-kube-api-access-6gqqq\") pod \"kas-connection-checker-685895c7c9-wd97l\" (UID: \"439cdf28-89f2-47eb-9a61-b63f4db9237b\") " pod="kube-system/kas-connection-checker-685895c7c9-wd97l"
Nov 03 21:45:07.710950 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.710730    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36598f65-5a1d-43e3-acc2-71c1e56f112c-serving-cert\") pod \"console-operator-7cd56b8dbc-pspgs\" (UID: \"36598f65-5a1d-43e3-acc2-71c1e56f112c\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:45:07.711144 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.711036    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bc4mv\""
Nov 03 21:45:07.711144 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.711072    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 03 21:45:07.711144 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.711089    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lbb62\""
Nov 03 21:45:07.711144 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.711038    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Nov 03 21:45:07.711144 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.711134    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 03 21:45:07.711144 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.711143    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Nov 03 21:45:07.711452 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.711180    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Nov 03 21:45:07.711452 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.711236    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36598f65-5a1d-43e3-acc2-71c1e56f112c-serving-cert\") pod \"console-operator-7cd56b8dbc-pspgs\" (UID: \"36598f65-5a1d-43e3-acc2-71c1e56f112c\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:45:07.711532 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.711492    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Nov 03 21:45:07.711571 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.711531    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fc4bx\""
Nov 03 21:45:07.712847 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.711916    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 03 21:45:07.712847 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.712084    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 03 21:45:07.712847 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.712390    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ddc108c9-ccd3-462a-8694-2421004791cd-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-wvc4j\" (UID: \"ddc108c9-ccd3-462a-8694-2421004791cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:45:07.712847 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.712396    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Nov 03 21:45:07.712847 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.712514    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36598f65-5a1d-43e3-acc2-71c1e56f112c-config\") pod \"console-operator-7cd56b8dbc-pspgs\" (UID: \"36598f65-5a1d-43e3-acc2-71c1e56f112c\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:45:07.712847 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.712524    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 03 21:45:07.712847 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.712531    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 03 21:45:07.712847 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.712576    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 03 21:45:07.712847 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.712605    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Nov 03 21:45:07.712847 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.712672    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 03 21:45:07.712847 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.712704    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Nov 03 21:45:07.712847 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.712759    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 03 21:45:07.712847 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.712819    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 03 21:45:07.712847 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.712843    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 03 21:45:07.713649 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.712908    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 03 21:45:07.713649 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.712972    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t98zr\""
Nov 03 21:45:07.713649 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.712975    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 03 21:45:07.713649 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.713018    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 03 21:45:07.713649 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.713030    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 03 21:45:07.713649 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.713066    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 03 21:45:07.713649 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.712845    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-p72km\""
Nov 03 21:45:07.713649 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.713095    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 03 21:45:07.713649 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.713116    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 03 21:45:07.713649 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.713141    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 03 21:45:07.713649 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.713164    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 03 21:45:07.713649 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.713206    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 03 21:45:07.713649 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.713207    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 03 21:45:07.713649 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.713208    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 03 21:45:07.713649 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.713232    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 03 21:45:07.713649 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.713220    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 03 21:45:07.713649 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.713403    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:45:07.713649 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.713411    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 03 21:45:07.713649 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.713488    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-5xcnq\""
Nov 03 21:45:07.714630 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.713694    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-txfgg\""
Nov 03 21:45:07.714630 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.714163    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 03 21:45:07.714630 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.714492    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rn6dh\""
Nov 03 21:45:07.715113 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.715089    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:07.716383 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.716360    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 03 21:45:07.716976 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.716958    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 03 21:45:07.717058 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.716975    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 03 21:45:07.717105 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.717091    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 03 21:45:07.717185 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.717150    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 03 21:45:07.717231 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.717184    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 03 21:45:07.717231 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.717189    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-wc5kn\""
Nov 03 21:45:07.717937 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.717921    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5f6rr\""
Nov 03 21:45:07.717983 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.717970    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-92tpk\""
Nov 03 21:45:07.718115 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.718101    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7bvj7\""
Nov 03 21:45:07.720212 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.720197    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 03 21:45:07.721163 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.721142    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Nov 03 21:45:07.721280 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.721192    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 03 21:45:07.721518 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.721502    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Nov 03 21:45:07.721622 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.721606    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36598f65-5a1d-43e3-acc2-71c1e56f112c-trusted-ca\") pod \"console-operator-7cd56b8dbc-pspgs\" (UID: \"36598f65-5a1d-43e3-acc2-71c1e56f112c\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:45:07.721715 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.721703    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Nov 03 21:45:07.721815 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.721804    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Nov 03 21:45:07.721884 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.721860    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Nov 03 21:45:07.721974 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.721962    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zl56c\""
Nov 03 21:45:07.722027 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.722022    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Nov 03 21:45:07.722079 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.722043    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-cvbdp\""
Nov 03 21:45:07.723453 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.723433    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g8bm\" (UniqueName: \"kubernetes.io/projected/b53d4190-50d2-4994-b730-a593c5133702-kube-api-access-7g8bm\") pod \"kas-connection-checker-685895c7c9-p7l88\" (UID: \"b53d4190-50d2-4994-b730-a593c5133702\") " pod="kube-system/kas-connection-checker-685895c7c9-p7l88"
Nov 03 21:45:07.723590 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.723569    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x472s\" (UniqueName: \"kubernetes.io/projected/e5a6f4cf-6f6f-4195-8304-aa0648e43ad9-kube-api-access-x472s\") pod \"kas-connection-checker-685895c7c9-f5kct\" (UID: \"e5a6f4cf-6f6f-4195-8304-aa0648e43ad9\") " pod="kube-system/kas-connection-checker-685895c7c9-f5kct"
Nov 03 21:45:07.723650 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.723579    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m57g\" (UniqueName: \"kubernetes.io/projected/36598f65-5a1d-43e3-acc2-71c1e56f112c-kube-api-access-7m57g\") pod \"console-operator-7cd56b8dbc-pspgs\" (UID: \"36598f65-5a1d-43e3-acc2-71c1e56f112c\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:45:07.723650 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.723622    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzn4j\" (UniqueName: \"kubernetes.io/projected/ddc108c9-ccd3-462a-8694-2421004791cd-kube-api-access-zzn4j\") pod \"cluster-monitoring-operator-884576c57-wvc4j\" (UID: \"ddc108c9-ccd3-462a-8694-2421004791cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:45:07.724270 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.724208    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gqqq\" (UniqueName: \"kubernetes.io/projected/439cdf28-89f2-47eb-9a61-b63f4db9237b-kube-api-access-6gqqq\") pod \"kas-connection-checker-685895c7c9-wd97l\" (UID: \"439cdf28-89f2-47eb-9a61-b63f4db9237b\") " pod="kube-system/kas-connection-checker-685895c7c9-wd97l"
Nov 03 21:45:07.789709 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.789682    5077 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:45:07.794552 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.794533    5077 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 03 21:45:07.803542 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.803518    5077 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 03 21:45:07.803647 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:07.803577    5077 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-183.us-east-2.compute.internal"
Nov 03 21:45:07.810981 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.810960    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.811107 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.810990    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a526c1-84f8-41a0-8dee-0ed08bddc5da-serving-cert\") pod \"service-ca-operator-544d749c8c-xzhng\" (UID: \"b3a526c1-84f8-41a0-8dee-0ed08bddc5da\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng"
Nov 03 21:45:07.811107 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811007    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk4z7\" (UniqueName: \"kubernetes.io/projected/b3a526c1-84f8-41a0-8dee-0ed08bddc5da-kube-api-access-jk4z7\") pod \"service-ca-operator-544d749c8c-xzhng\" (UID: \"b3a526c1-84f8-41a0-8dee-0ed08bddc5da\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng"
Nov 03 21:45:07.811107 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811022    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-image-registry-private-configuration\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:07.811287 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811168    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-multus-socket-dir-parent\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.811287 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811209    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/380a7770-3519-404b-927c-dd6754a9ccfb-multus-daemon-config\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.811287 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811232    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a526c1-84f8-41a0-8dee-0ed08bddc5da-serving-cert\") pod \"service-ca-operator-544d749c8c-xzhng\" (UID: \"b3a526c1-84f8-41a0-8dee-0ed08bddc5da\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng"
Nov 03 21:45:07.811287 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811268    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-image-registry-private-configuration\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:07.811470 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811272    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhxb4\" (UniqueName: \"kubernetes.io/projected/45862374-6557-46b1-9982-4b77670216df-kube-api-access-dhxb4\") pod \"volume-data-source-validator-58c9f5f46d-5w6h4\" (UID: \"45862374-6557-46b1-9982-4b77670216df\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-5w6h4"
Nov 03 21:45:07.811470 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811317    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-run-systemd\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.811470 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811345    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:45:07.811470 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811411    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h69t\" (UniqueName: \"kubernetes.io/projected/88ceb339-f96e-45a4-ad35-9691dc70fbd9-kube-api-access-7h69t\") pod \"migrator-66df5d496b-g7kms\" (UID: \"88ceb339-f96e-45a4-ad35-9691dc70fbd9\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-g7kms"
Nov 03 21:45:07.811470 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811444    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-installation-pull-secrets\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:07.811710 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811489    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-multus-cni-dir\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.811710 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811516    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tkqm\" (UniqueName: \"kubernetes.io/projected/a4982959-0762-44eb-a382-a510881805aa-kube-api-access-9tkqm\") pod \"node-resolver-4jznx\" (UID: \"a4982959-0762-44eb-a382-a510881805aa\") " pod="openshift-dns/node-resolver-4jznx"
Nov 03 21:45:07.811710 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811519    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/380a7770-3519-404b-927c-dd6754a9ccfb-multus-daemon-config\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.811710 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811574    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0995c467-d41c-43e9-ab5a-0609a3a7cf83-host-slash\") pod \"iptables-alerter-lmjlz\" (UID: \"0995c467-d41c-43e9-ab5a-0609a3a7cf83\") " pod="openshift-network-operator/iptables-alerter-lmjlz"
Nov 03 21:45:07.811710 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811606    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-var-lib-cni-multus\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.811710 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811632    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:45:07.811710 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811656    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-original-pull-secret\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:45:07.811710 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811665    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpslp\" (UniqueName: \"kubernetes.io/projected/289044f0-b173-489e-971f-3dff8aaf9aaa-kube-api-access-tpslp\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:45:07.811972 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811725    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-installation-pull-secrets\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:07.811972 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811738    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0cd51906-d6ac-438c-8716-7b60d4c9a1e4-signing-cabundle\") pod \"service-ca-5fffc97bdf-czxjn\" (UID: \"0cd51906-d6ac-438c-8716-7b60d4c9a1e4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-czxjn"
Nov 03 21:45:07.811972 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811784    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/736d15ff-56b5-40cf-b19a-38564c93d8b2-host\") pod \"node-ca-txllc\" (UID: \"736d15ff-56b5-40cf-b19a-38564c93d8b2\") " pod="openshift-image-registry/node-ca-txllc"
Nov 03 21:45:07.811972 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811815    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-metrics-certs\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:07.811972 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811860    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q89j\" (UniqueName: \"kubernetes.io/projected/542a90b4-b01a-4cad-a5bf-e0181fe30586-kube-api-access-8q89j\") pod \"migrator-66df5d496b-zdz8c\" (UID: \"542a90b4-b01a-4cad-a5bf-e0181fe30586\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-zdz8c"
Nov 03 21:45:07.811972 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811881    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmf4v\" (UniqueName: \"kubernetes.io/projected/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-kube-api-access-jmf4v\") pod \"periodic-gathering-xghgl-bwm6n\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") " pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:07.811972 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811899    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-5dl8c\" (UID: \"b3746624-9331-4bfa-81ed-3a6f37c8d0e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:45:07.811972 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811915    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a3d055a-397e-436d-99bd-e82541b4ce57-service-ca-bundle\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:45:07.811972 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811933    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0cd51906-d6ac-438c-8716-7b60d4c9a1e4-signing-cabundle\") pod \"service-ca-5fffc97bdf-czxjn\" (UID: \"0cd51906-d6ac-438c-8716-7b60d4c9a1e4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-czxjn"
Nov 03 21:45:07.811972 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811935    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/289044f0-b173-489e-971f-3dff8aaf9aaa-tmp-dir\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:45:07.811972 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811972    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/588bc17e-1307-4055-96a4-cbd60ba48541-installation-pull-secrets\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:07.812435 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811989    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/289044f0-b173-489e-971f-3dff8aaf9aaa-tmp-dir\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:45:07.812435 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.811999    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-var-lib-openvswitch\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.812435 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812025    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-hostroot\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.812435 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812059    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a3d055a-397e-436d-99bd-e82541b4ce57-service-ca-bundle\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:45:07.812435 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812076    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72792cfa-71f1-418a-a59d-40d2f5c392d9-cnibin\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:45:07.812435 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812126    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/588bc17e-1307-4055-96a4-cbd60ba48541-image-registry-private-configuration\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:07.812435 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812159    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-5dl8c\" (UID: \"b3746624-9331-4bfa-81ed-3a6f37c8d0e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:45:07.812435 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812167    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-etc-openvswitch\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.812435 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812168    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/588bc17e-1307-4055-96a4-cbd60ba48541-installation-pull-secrets\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:07.812435 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812210    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-service-ca-bundle\") pod \"periodic-gathering-xghgl-bwm6n\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") " pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:07.812435 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812239    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-run-k8s-cni-cncf-io\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.812435 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812312    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c61b4b48-0d5d-4c17-9218-c38bf3581e98-crio-socket\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:07.812435 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812355    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-service-ca-bundle\") pod \"periodic-gathering-xghgl-bwm6n\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") " pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:07.812435 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812362    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:07.812435 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812367    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/588bc17e-1307-4055-96a4-cbd60ba48541-image-registry-private-configuration\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:07.812435 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812399    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb453169-964e-4e16-a300-a54f2f3e74a2-konnectivity-ca\") pod \"konnectivity-agent-mrf9j\" (UID: \"eb453169-964e-4e16-a300-a54f2f3e74a2\") " pod="kube-system/konnectivity-agent-mrf9j"
Nov 03 21:45:07.812435 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812432    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1471771-c3a3-4c38-a124-455ab7e5e2d5-ovn-node-metrics-cert\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812479    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-run-netns\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812499    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-tuned\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812518    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0cd51906-d6ac-438c-8716-7b60d4c9a1e4-signing-key\") pod \"service-ca-5fffc97bdf-czxjn\" (UID: \"0cd51906-d6ac-438c-8716-7b60d4c9a1e4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-czxjn"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812533    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-var-lib-kubelet\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812553    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-archives-path\") pod \"periodic-gathering-xghgl-bwm6n\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") " pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812607    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-tuned\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812615    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-archives-path\") pod \"periodic-gathering-xghgl-bwm6n\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") " pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812614    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a3d055a-397e-436d-99bd-e82541b4ce57-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812670    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb453169-964e-4e16-a300-a54f2f3e74a2-konnectivity-ca\") pod \"konnectivity-agent-mrf9j\" (UID: \"eb453169-964e-4e16-a300-a54f2f3e74a2\") " pod="kube-system/konnectivity-agent-mrf9j"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812672    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1471771-c3a3-4c38-a124-455ab7e5e2d5-ovn-node-metrics-cert\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812732    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-stats-auth\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812804    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-modprobe-d\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812823    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0cd51906-d6ac-438c-8716-7b60d4c9a1e4-signing-key\") pod \"service-ca-5fffc97bdf-czxjn\" (UID: \"0cd51906-d6ac-438c-8716-7b60d4c9a1e4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-czxjn"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812850    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw8bb\" (UniqueName: \"kubernetes.io/projected/736d15ff-56b5-40cf-b19a-38564c93d8b2-kube-api-access-bw8bb\") pod \"node-ca-txllc\" (UID: \"736d15ff-56b5-40cf-b19a-38564c93d8b2\") " pod="openshift-image-registry/node-ca-txllc"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812883    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85njj\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-kube-api-access-85njj\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812926    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a3d055a-397e-436d-99bd-e82541b4ce57-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812926    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/380a7770-3519-404b-927c-dd6754a9ccfb-cni-binary-copy\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812948    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-stats-auth\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812964    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c07fa44-702c-4e55-afe3-451696e76f82-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg\" (UID: \"6c07fa44-702c-4e55-afe3-451696e76f82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.812991    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82fzq\" (UniqueName: \"kubernetes.io/projected/5cbdd163-bfdd-4fda-8141-21b969a3aa08-kube-api-access-82fzq\") pod \"ingress-canary-tqldf\" (UID: \"5cbdd163-bfdd-4fda-8141-21b969a3aa08\") " pod="openshift-ingress-canary/ingress-canary-tqldf"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813016    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72792cfa-71f1-418a-a59d-40d2f5c392d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813042    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg7z2\" (UniqueName: \"kubernetes.io/projected/e3313fc5-6c47-4d16-8289-80b781a413cd-kube-api-access-wg7z2\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813118    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c07fa44-702c-4e55-afe3-451696e76f82-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg\" (UID: \"6c07fa44-702c-4e55-afe3-451696e76f82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813149    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-certificates\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813148    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/380a7770-3519-404b-927c-dd6754a9ccfb-cni-binary-copy\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813167    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-var-lib-cni-bin\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813183    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-sys-fs\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:45:07.813218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813210    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9k4d\" (UniqueName: \"kubernetes.io/projected/d6afb4de-bd45-4038-a6a9-9ff8671eb430-kube-api-access-b9k4d\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813342    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp284\" (UniqueName: \"kubernetes.io/projected/0cd51906-d6ac-438c-8716-7b60d4c9a1e4-kube-api-access-hp284\") pod \"service-ca-5fffc97bdf-czxjn\" (UID: \"0cd51906-d6ac-438c-8716-7b60d4c9a1e4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-czxjn"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813377    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-sysctl-conf\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813407    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c61b4b48-0d5d-4c17-9218-c38bf3581e98-data-volume\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813490    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c61b4b48-0d5d-4c17-9218-c38bf3581e98-data-volume\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813511    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg9zw\" (UniqueName: \"kubernetes.io/projected/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-api-access-qg9zw\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813548    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813591    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-ca-trust-extracted\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813621    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/289044f0-b173-489e-971f-3dff8aaf9aaa-config-volume\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813641    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-default-certificate\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813669    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-ca-trust-extracted\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813663    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813711    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/588bc17e-1307-4055-96a4-cbd60ba48541-trusted-ca\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813733    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-kubernetes\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813770    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgtg6\" (UniqueName: \"kubernetes.io/projected/8915bffd-4628-4aee-994b-81de7d1ad7c6-kube-api-access-zgtg6\") pod \"network-metrics-daemon-kjp2c\" (UID: \"8915bffd-4628-4aee-994b-81de7d1ad7c6\") " pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813806    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-device-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813819    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/289044f0-b173-489e-971f-3dff8aaf9aaa-config-volume\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813830    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/289044f0-b173-489e-971f-3dff8aaf9aaa-metrics-tls\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813880    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-default-certificate\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813898    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/72792cfa-71f1-418a-a59d-40d2f5c392d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813920    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg58s\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-kube-api-access-kg58s\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813952    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-certificates\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.813953    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-kubelet\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814090    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3a526c1-84f8-41a0-8dee-0ed08bddc5da-config\") pod \"service-ca-operator-544d749c8c-xzhng\" (UID: \"b3a526c1-84f8-41a0-8dee-0ed08bddc5da\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814137    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/72792cfa-71f1-418a-a59d-40d2f5c392d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814126    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzqqr\" (UniqueName: \"kubernetes.io/projected/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-kube-api-access-lzqqr\") pod \"cluster-samples-operator-6ddb6c8b94-5dl8c\" (UID: \"b3746624-9331-4bfa-81ed-3a6f37c8d0e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814161    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/588bc17e-1307-4055-96a4-cbd60ba48541-trusted-ca\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814173    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814232    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-systemd-units\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814289    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3a526c1-84f8-41a0-8dee-0ed08bddc5da-config\") pod \"service-ca-operator-544d749c8c-xzhng\" (UID: \"b3a526c1-84f8-41a0-8dee-0ed08bddc5da\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814299    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-sysctl-d\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814324    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-registration-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:45:07.814403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814362    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-sysconfig\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814426    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs\") pod \"network-metrics-daemon-kjp2c\" (UID: \"8915bffd-4628-4aee-994b-81de7d1ad7c6\") " pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814443    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4982959-0762-44eb-a382-a510881805aa-hosts-file\") pod \"node-resolver-4jznx\" (UID: \"a4982959-0762-44eb-a382-a510881805aa\") " pod="openshift-dns/node-resolver-4jznx"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814480    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-run-ovn\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814516    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/736d15ff-56b5-40cf-b19a-38564c93d8b2-serviceca\") pod \"node-ca-txllc\" (UID: \"736d15ff-56b5-40cf-b19a-38564c93d8b2\") " pod="openshift-image-registry/node-ca-txllc"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814548    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-kubelet-config\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814568    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cbdd163-bfdd-4fda-8141-21b969a3aa08-cert\") pod \"ingress-canary-tqldf\" (UID: \"5cbdd163-bfdd-4fda-8141-21b969a3aa08\") " pod="openshift-ingress-canary/ingress-canary-tqldf"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814682    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/72792cfa-71f1-418a-a59d-40d2f5c392d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814791    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-run-netns\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814833    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-cni-netd\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814853    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-run\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814883    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cbdd163-bfdd-4fda-8141-21b969a3aa08-cert\") pod \"ingress-canary-tqldf\" (UID: \"5cbdd163-bfdd-4fda-8141-21b969a3aa08\") " pod="openshift-ingress-canary/ingress-canary-tqldf"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814906    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a3d055a-397e-436d-99bd-e82541b4ce57-serving-cert\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814951    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.814947    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/72792cfa-71f1-418a-a59d-40d2f5c392d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815069    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq9sj\" (UniqueName: \"kubernetes.io/projected/3a3d055a-397e-436d-99bd-e82541b4ce57-kube-api-access-mq9sj\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815109    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3ebc2e42-6892-480b-a793-4f224d09f45d-nginx-conf\") pod \"networking-console-plugin-86c478bb88-fv6vx\" (UID: \"3ebc2e42-6892-480b-a793-4f224d09f45d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815138    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/736d15ff-56b5-40cf-b19a-38564c93d8b2-serviceca\") pod \"node-ca-txllc\" (UID: \"736d15ff-56b5-40cf-b19a-38564c93d8b2\") " pod="openshift-image-registry/node-ca-txllc"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815137    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a3d055a-397e-436d-99bd-e82541b4ce57-tmp\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815182    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-run-openvswitch\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815201    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a3d055a-397e-436d-99bd-e82541b4ce57-tmp\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815207    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-lib-modules\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815236    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-trusted-ca-bundle\") pod \"periodic-gathering-xghgl-bwm6n\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") " pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815296    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-5dl8c\" (UID: \"b3746624-9331-4bfa-81ed-3a6f37c8d0e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815313    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3ebc2e42-6892-480b-a793-4f224d09f45d-nginx-conf\") pod \"networking-console-plugin-86c478bb88-fv6vx\" (UID: \"3ebc2e42-6892-480b-a793-4f224d09f45d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815329    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-bound-sa-token\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:07.815420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815403    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a3d055a-397e-436d-99bd-e82541b4ce57-serving-cert\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815499    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c07fa44-702c-4e55-afe3-451696e76f82-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg\" (UID: \"6c07fa44-702c-4e55-afe3-451696e76f82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815559    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-trusted-ca-bundle\") pod \"periodic-gathering-xghgl-bwm6n\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") " pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815593    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-slash\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815691    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fv6vx\" (UID: \"3ebc2e42-6892-480b-a793-4f224d09f45d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815695    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c07fa44-702c-4e55-afe3-451696e76f82-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg\" (UID: \"6c07fa44-702c-4e55-afe3-451696e76f82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815729    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-trusted-ca\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815753    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-socket-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815771    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tftr4\" (UniqueName: \"kubernetes.io/projected/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-kube-api-access-tftr4\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815786    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815807    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-systemd\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815853    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbs2h\" (UniqueName: \"kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h\") pod \"network-check-target-ztd6j\" (UID: \"7b22f42e-7346-4165-b4ea-99e12837742c\") " pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815884    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/588bc17e-1307-4055-96a4-cbd60ba48541-ca-trust-extracted\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815928    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a1471771-c3a3-4c38-a124-455ab7e5e2d5-ovnkube-config\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815953    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3313fc5-6c47-4d16-8289-80b781a413cd-tmp\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.815978    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0995c467-d41c-43e9-ab5a-0609a3a7cf83-iptables-alerter-script\") pod \"iptables-alerter-lmjlz\" (UID: \"0995c467-d41c-43e9-ab5a-0609a3a7cf83\") " pod="openshift-network-operator/iptables-alerter-lmjlz"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816008    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-system-cni-dir\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816015    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/588bc17e-1307-4055-96a4-cbd60ba48541-ca-trust-extracted\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816037    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-bound-sa-token\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816043    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3313fc5-6c47-4d16-8289-80b781a413cd-tmp\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816067    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-log-socket\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816149    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-trusted-ca\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816157    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-host\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816160    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a1471771-c3a3-4c38-a124-455ab7e5e2d5-ovnkube-config\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816201    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-wvc4j\" (UID: \"ddc108c9-ccd3-462a-8694-2421004791cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816221    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0995c467-d41c-43e9-ab5a-0609a3a7cf83-iptables-alerter-script\") pod \"iptables-alerter-lmjlz\" (UID: \"0995c467-d41c-43e9-ab5a-0609a3a7cf83\") " pod="openshift-network-operator/iptables-alerter-lmjlz"
Nov 03 21:45:07.816235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816234    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-run-multus-certs\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816305    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk7lz\" (UniqueName: \"kubernetes.io/projected/0995c467-d41c-43e9-ab5a-0609a3a7cf83-kube-api-access-lk7lz\") pod \"iptables-alerter-lmjlz\" (UID: \"0995c467-d41c-43e9-ab5a-0609a3a7cf83\") " pod="openshift-network-operator/iptables-alerter-lmjlz"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:07.816338    5077 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816368    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3a3d055a-397e-436d-99bd-e82541b4ce57-snapshots\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816388    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnmx6\" (UniqueName: \"kubernetes.io/projected/6c07fa44-702c-4e55-afe3-451696e76f82-kube-api-access-qnmx6\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg\" (UID: \"6c07fa44-702c-4e55-afe3-451696e76f82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:07.816424    5077 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls podName:ddc108c9-ccd3-462a-8694-2421004791cd nodeName:}" failed. No retries permitted until 2026-11-03 21:45:08.316398229 +0000 UTC m=+1.720059650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-wvc4j" (UID: "ddc108c9-ccd3-462a-8694-2421004791cd") : secret "cluster-monitoring-operator-tls" not found
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816443    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72792cfa-71f1-418a-a59d-40d2f5c392d9-system-cni-dir\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816482    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/588bc17e-1307-4055-96a4-cbd60ba48541-registry-certificates\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816507    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3a3d055a-397e-436d-99bd-e82541b4ce57-snapshots\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816507    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zwtz\" (UniqueName: \"kubernetes.io/projected/a1471771-c3a3-4c38-a124-455ab7e5e2d5-kube-api-access-9zwtz\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816550    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-sys\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816574    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-dbus\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816598    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-multus-conf-dir\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816637    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xck8c\" (UniqueName: \"kubernetes.io/projected/72792cfa-71f1-418a-a59d-40d2f5c392d9-kube-api-access-xck8c\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816664    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb453169-964e-4e16-a300-a54f2f3e74a2-agent-certs\") pod \"konnectivity-agent-mrf9j\" (UID: \"eb453169-964e-4e16-a300-a54f2f3e74a2\") " pod="kube-system/konnectivity-agent-mrf9j"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816785    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-cni-bin\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816828    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a1471771-c3a3-4c38-a124-455ab7e5e2d5-env-overrides\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816897    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb453169-964e-4e16-a300-a54f2f3e74a2-agent-certs\") pod \"konnectivity-agent-mrf9j\" (UID: \"eb453169-964e-4e16-a300-a54f2f3e74a2\") " pod="kube-system/konnectivity-agent-mrf9j"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816910    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a1471771-c3a3-4c38-a124-455ab7e5e2d5-ovnkube-script-lib\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816940    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r8kc\" (UniqueName: \"kubernetes.io/projected/fe9f47b3-180f-4485-b611-a66abe1974db-kube-api-access-2r8kc\") pod \"network-check-source-6f78d59f99-vhbjg\" (UID: \"fe9f47b3-180f-4485-b611-a66abe1974db\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-vhbjg"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.816982    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a1471771-c3a3-4c38-a124-455ab7e5e2d5-env-overrides\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.817020    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-cnibin\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.817049    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72792cfa-71f1-418a-a59d-40d2f5c392d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.817075    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4982959-0762-44eb-a382-a510881805aa-tmp-dir\") pod \"node-resolver-4jznx\" (UID: \"a4982959-0762-44eb-a382-a510881805aa\") " pod="openshift-dns/node-resolver-4jznx"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.817100    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-var-lib-kubelet\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.817139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.817120    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a1471771-c3a3-4c38-a124-455ab7e5e2d5-ovnkube-script-lib\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.817914 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.817157    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/588bc17e-1307-4055-96a4-cbd60ba48541-registry-certificates\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:07.817914 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.817204    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-etc-kubernetes\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.817914 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.817225    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4982959-0762-44eb-a382-a510881805aa-tmp-dir\") pod \"node-resolver-4jznx\" (UID: \"a4982959-0762-44eb-a382-a510881805aa\") " pod="openshift-dns/node-resolver-4jznx"
Nov 03 21:45:07.817914 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.817240    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2vxr\" (UniqueName: \"kubernetes.io/projected/380a7770-3519-404b-927c-dd6754a9ccfb-kube-api-access-l2vxr\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.817914 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.817237    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72792cfa-71f1-418a-a59d-40d2f5c392d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:45:07.817914 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.817308    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-etc-selinux\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:45:07.817914 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.817350    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-node-log\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.825556 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.824997    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h69t\" (UniqueName: \"kubernetes.io/projected/88ceb339-f96e-45a4-ad35-9691dc70fbd9-kube-api-access-7h69t\") pod \"migrator-66df5d496b-g7kms\" (UID: \"88ceb339-f96e-45a4-ad35-9691dc70fbd9\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-g7kms"
Nov 03 21:45:07.825556 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.825218    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk4z7\" (UniqueName: \"kubernetes.io/projected/b3a526c1-84f8-41a0-8dee-0ed08bddc5da-kube-api-access-jk4z7\") pod \"service-ca-operator-544d749c8c-xzhng\" (UID: \"b3a526c1-84f8-41a0-8dee-0ed08bddc5da\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng"
Nov 03 21:45:07.825556 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.825240    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhxb4\" (UniqueName: \"kubernetes.io/projected/45862374-6557-46b1-9982-4b77670216df-kube-api-access-dhxb4\") pod \"volume-data-source-validator-58c9f5f46d-5w6h4\" (UID: \"45862374-6557-46b1-9982-4b77670216df\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-5w6h4"
Nov 03 21:45:07.825556 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.825217    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tkqm\" (UniqueName: \"kubernetes.io/projected/a4982959-0762-44eb-a382-a510881805aa-kube-api-access-9tkqm\") pod \"node-resolver-4jznx\" (UID: \"a4982959-0762-44eb-a382-a510881805aa\") " pod="openshift-dns/node-resolver-4jznx"
Nov 03 21:45:07.825556 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.825351    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q89j\" (UniqueName: \"kubernetes.io/projected/542a90b4-b01a-4cad-a5bf-e0181fe30586-kube-api-access-8q89j\") pod \"migrator-66df5d496b-zdz8c\" (UID: \"542a90b4-b01a-4cad-a5bf-e0181fe30586\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-zdz8c"
Nov 03 21:45:07.825556 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.825509    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmf4v\" (UniqueName: \"kubernetes.io/projected/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-kube-api-access-jmf4v\") pod \"periodic-gathering-xghgl-bwm6n\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") " pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:07.825556 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.825526    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzqqr\" (UniqueName: \"kubernetes.io/projected/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-kube-api-access-lzqqr\") pod \"cluster-samples-operator-6ddb6c8b94-5dl8c\" (UID: \"b3746624-9331-4bfa-81ed-3a6f37c8d0e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:45:07.825835 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.825615    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg9zw\" (UniqueName: \"kubernetes.io/projected/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-api-access-qg9zw\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:07.825835 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.825644    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpslp\" (UniqueName: \"kubernetes.io/projected/289044f0-b173-489e-971f-3dff8aaf9aaa-kube-api-access-tpslp\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:45:07.825835 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.825690    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw8bb\" (UniqueName: \"kubernetes.io/projected/736d15ff-56b5-40cf-b19a-38564c93d8b2-kube-api-access-bw8bb\") pod \"node-ca-txllc\" (UID: \"736d15ff-56b5-40cf-b19a-38564c93d8b2\") " pod="openshift-image-registry/node-ca-txllc"
Nov 03 21:45:07.826142 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.826119    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82fzq\" (UniqueName: \"kubernetes.io/projected/5cbdd163-bfdd-4fda-8141-21b969a3aa08-kube-api-access-82fzq\") pod \"ingress-canary-tqldf\" (UID: \"5cbdd163-bfdd-4fda-8141-21b969a3aa08\") " pod="openshift-ingress-canary/ingress-canary-tqldf"
Nov 03 21:45:07.826321 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.826305    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgtg6\" (UniqueName: \"kubernetes.io/projected/8915bffd-4628-4aee-994b-81de7d1ad7c6-kube-api-access-zgtg6\") pod \"network-metrics-daemon-kjp2c\" (UID: \"8915bffd-4628-4aee-994b-81de7d1ad7c6\") " pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:45:07.826404 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.826364    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9k4d\" (UniqueName: \"kubernetes.io/projected/d6afb4de-bd45-4038-a6a9-9ff8671eb430-kube-api-access-b9k4d\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:07.826492 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.826475    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85njj\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-kube-api-access-85njj\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:07.826619 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.826602    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg7z2\" (UniqueName: \"kubernetes.io/projected/e3313fc5-6c47-4d16-8289-80b781a413cd-kube-api-access-wg7z2\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.827195 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.827180    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp284\" (UniqueName: \"kubernetes.io/projected/0cd51906-d6ac-438c-8716-7b60d4c9a1e4-kube-api-access-hp284\") pod \"service-ca-5fffc97bdf-czxjn\" (UID: \"0cd51906-d6ac-438c-8716-7b60d4c9a1e4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-czxjn"
Nov 03 21:45:07.827287 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.827272    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq9sj\" (UniqueName: \"kubernetes.io/projected/3a3d055a-397e-436d-99bd-e82541b4ce57-kube-api-access-mq9sj\") pod \"insights-operator-7c4986d449-kmt8d\" (UID: \"3a3d055a-397e-436d-99bd-e82541b4ce57\") " pod="openshift-insights/insights-operator-7c4986d449-kmt8d"
Nov 03 21:45:07.828102 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.828088    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-bound-sa-token\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:07.833091 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.833070    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tftr4\" (UniqueName: \"kubernetes.io/projected/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-kube-api-access-tftr4\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:45:07.833257 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.833118    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk7lz\" (UniqueName: \"kubernetes.io/projected/0995c467-d41c-43e9-ab5a-0609a3a7cf83-kube-api-access-lk7lz\") pod \"iptables-alerter-lmjlz\" (UID: \"0995c467-d41c-43e9-ab5a-0609a3a7cf83\") " pod="openshift-network-operator/iptables-alerter-lmjlz"
Nov 03 21:45:07.833257 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.833072    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbs2h\" (UniqueName: \"kubernetes.io/projected/7b22f42e-7346-4165-b4ea-99e12837742c-kube-api-access-lbs2h\") pod \"network-check-target-ztd6j\" (UID: \"7b22f42e-7346-4165-b4ea-99e12837742c\") " pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:45:07.833342 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.833306    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnmx6\" (UniqueName: \"kubernetes.io/projected/6c07fa44-702c-4e55-afe3-451696e76f82-kube-api-access-qnmx6\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg\" (UID: \"6c07fa44-702c-4e55-afe3-451696e76f82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg"
Nov 03 21:45:07.833378 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.833358    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-bound-sa-token\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:07.835783 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.835764    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zwtz\" (UniqueName: \"kubernetes.io/projected/a1471771-c3a3-4c38-a124-455ab7e5e2d5-kube-api-access-9zwtz\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.835847 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.835829    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r8kc\" (UniqueName: \"kubernetes.io/projected/fe9f47b3-180f-4485-b611-a66abe1974db-kube-api-access-2r8kc\") pod \"network-check-source-6f78d59f99-vhbjg\" (UID: \"fe9f47b3-180f-4485-b611-a66abe1974db\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-vhbjg"
Nov 03 21:45:07.836073 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.836046    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xck8c\" (UniqueName: \"kubernetes.io/projected/72792cfa-71f1-418a-a59d-40d2f5c392d9-kube-api-access-xck8c\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:45:07.836537 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.836522    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2vxr\" (UniqueName: \"kubernetes.io/projected/380a7770-3519-404b-927c-dd6754a9ccfb-kube-api-access-l2vxr\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.838566 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.838547    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg58s\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-kube-api-access-kg58s\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:07.918676 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.918651    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-var-lib-openvswitch\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.918676 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.918680    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-hostroot\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.918918 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.918694    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72792cfa-71f1-418a-a59d-40d2f5c392d9-cnibin\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:45:07.918918 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.918726    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-etc-openvswitch\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.918918 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.918751    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-run-k8s-cni-cncf-io\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.918918 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.918766    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-var-lib-openvswitch\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.918918 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.918775    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c61b4b48-0d5d-4c17-9218-c38bf3581e98-crio-socket\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:07.918918 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.918786    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72792cfa-71f1-418a-a59d-40d2f5c392d9-cnibin\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:45:07.918918 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.918777    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-hostroot\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.918918 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.918821    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c61b4b48-0d5d-4c17-9218-c38bf3581e98-crio-socket\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:07.918918 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.918820    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-etc-openvswitch\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.918918 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.918832    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-run-k8s-cni-cncf-io\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.918918 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.918857    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:07.918918 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.918895    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-run-netns\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.918945    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-var-lib-kubelet\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.918955    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-run-netns\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.918974    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-modprobe-d\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919003    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-var-lib-kubelet\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919010    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72792cfa-71f1-418a-a59d-40d2f5c392d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919038    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-var-lib-cni-bin\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919055    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-modprobe-d\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919058    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72792cfa-71f1-418a-a59d-40d2f5c392d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919068    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-sys-fs\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919094    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-sysctl-conf\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919127    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919140    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-sys-fs\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919096    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-var-lib-cni-bin\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919158    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919184    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-kubernetes\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919210    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-device-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919213    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-sysctl-conf\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919183    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919233    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/289044f0-b173-489e-971f-3dff8aaf9aaa-metrics-tls\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919282    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-kubernetes\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919289    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-device-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919284    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-kubelet\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:07.919319    5077 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle podName:d6afb4de-bd45-4038-a6a9-9ff8671eb430 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:08.419299071 +0000 UTC m=+1.822960496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle") pod "router-default-5b77b9dbdf-rbjh5" (UID: "d6afb4de-bd45-4038-a6a9-9ff8671eb430") : configmap references non-existent config key: service-ca.crt
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919324    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-kubelet\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919358    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919397    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-systemd-units\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919416    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-sysctl-d\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919438    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-registration-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919447    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-systemd-units\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919439    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c61b4b48-0d5d-4c17-9218-c38bf3581e98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919485    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-registration-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919463    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-sysconfig\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919511    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs\") pod \"network-metrics-daemon-kjp2c\" (UID: \"8915bffd-4628-4aee-994b-81de7d1ad7c6\") " pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:45:07.919501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919522    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-sysconfig\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919530    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4982959-0762-44eb-a382-a510881805aa-hosts-file\") pod \"node-resolver-4jznx\" (UID: \"a4982959-0762-44eb-a382-a510881805aa\") " pod="openshift-dns/node-resolver-4jznx"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919561    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-run-ovn\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919568    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-sysctl-d\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919587    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-kubelet-config\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:07.919607    5077 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919614    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-run-netns\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919618    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-run-ovn\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919628    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4982959-0762-44eb-a382-a510881805aa-hosts-file\") pod \"node-resolver-4jznx\" (UID: \"a4982959-0762-44eb-a382-a510881805aa\") " pod="openshift-dns/node-resolver-4jznx"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919651    5077 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919640    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-cni-netd\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919671    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-cni-netd\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919694    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-run\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919703    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-run-netns\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919716    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-kubelet-config\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919738    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-run\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:07.919741    5077 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls podName:c61b4b48-0d5d-4c17-9218-c38bf3581e98 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:08.419693727 +0000 UTC m=+1.823355150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x7fmc" (UID: "c61b4b48-0d5d-4c17-9218-c38bf3581e98") : secret "insights-runtime-extractor-tls" not found
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919792    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919819    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-run-openvswitch\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919847    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-lib-modules\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919868    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-5dl8c\" (UID: \"b3746624-9331-4bfa-81ed-3a6f37c8d0e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919881    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-run-openvswitch\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919891    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-slash\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919915    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fv6vx\" (UID: \"3ebc2e42-6892-480b-a793-4f224d09f45d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919938    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-socket-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:07.919958    5077 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919976    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-lib-modules\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919990    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-socket-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.919990    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-slash\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:07.920003    5077 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls podName:b3746624-9331-4bfa-81ed-3a6f37c8d0e6 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:08.419988446 +0000 UTC m=+1.823649857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-5dl8c" (UID: "b3746624-9331-4bfa-81ed-3a6f37c8d0e6") : secret "samples-operator-tls" not found
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920026    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:07.920057    5077 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920099    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-systemd\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920057    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-etc-systemd\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:07.920134    5077 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert podName:3ebc2e42-6892-480b-a793-4f224d09f45d nodeName:}" failed. No retries permitted until 2026-11-03 21:45:08.420116747 +0000 UTC m=+1.823778158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fv6vx" (UID: "3ebc2e42-6892-480b-a793-4f224d09f45d") : secret "networking-console-plugin-cert" not found
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920165    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-system-cni-dir\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920194    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-log-socket\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920218    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-host\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920231    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-log-socket\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920275    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-run-multus-certs\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920303    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-host\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920305    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72792cfa-71f1-418a-a59d-40d2f5c392d9-system-cni-dir\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920311    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-run-multus-certs\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920278    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-system-cni-dir\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920335    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72792cfa-71f1-418a-a59d-40d2f5c392d9-system-cni-dir\") pod \"multus-additional-cni-plugins-r964d\" (UID: \"72792cfa-71f1-418a-a59d-40d2f5c392d9\") " pod="openshift-multus/multus-additional-cni-plugins-r964d"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920336    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-sys\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920378    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-dbus\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920394    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-multus-conf-dir\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920410    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-cni-bin\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920435    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-cnibin\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920464    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-var-lib-kubelet\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920473    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b1bc67e-f876-4fec-b9bf-a3a8906d8d94-dbus\") pod \"global-pull-secret-syncer-dndpk\" (UID: \"7b1bc67e-f876-4fec-b9bf-a3a8906d8d94\") " pod="kube-system/global-pull-secret-syncer-dndpk"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920533    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3313fc5-6c47-4d16-8289-80b781a413cd-sys\") pod \"tuned-85lqj\" (UID: \"e3313fc5-6c47-4d16-8289-80b781a413cd\") " pod="openshift-cluster-node-tuning-operator/tuned-85lqj"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920554    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-etc-kubernetes\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920590    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-var-lib-kubelet\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920598    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-etc-selinux\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920623    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-node-log\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920638    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-etc-kubernetes\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920644    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-cni-bin\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920647    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920684    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-cnibin\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920686    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-multus-socket-dir-parent\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920695    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920725    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-run-systemd\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920738    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-node-log\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920760    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-multus-socket-dir-parent\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920776    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-multus-cni-dir\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920781    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-etc-selinux\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920803    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0995c467-d41c-43e9-ab5a-0609a3a7cf83-host-slash\") pod \"iptables-alerter-lmjlz\" (UID: \"0995c467-d41c-43e9-ab5a-0609a3a7cf83\") " pod="openshift-network-operator/iptables-alerter-lmjlz"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920820    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-multus-conf-dir\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920839    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0995c467-d41c-43e9-ab5a-0609a3a7cf83-host-slash\") pod \"iptables-alerter-lmjlz\" (UID: \"0995c467-d41c-43e9-ab5a-0609a3a7cf83\") " pod="openshift-network-operator/iptables-alerter-lmjlz"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920805    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1471771-c3a3-4c38-a124-455ab7e5e2d5-run-systemd\") pod \"ovnkube-node-hgk2l\" (UID: \"a1471771-c3a3-4c38-a124-455ab7e5e2d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920865    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-var-lib-cni-multus\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920872    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-multus-cni-dir\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920889    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920919    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/380a7770-3519-404b-927c-dd6754a9ccfb-host-var-lib-cni-multus\") pod \"multus-pg6ql\" (UID: \"380a7770-3519-404b-927c-dd6754a9ccfb\") " pod="openshift-multus/multus-pg6ql"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920937    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/736d15ff-56b5-40cf-b19a-38564c93d8b2-host\") pod \"node-ca-txllc\" (UID: \"736d15ff-56b5-40cf-b19a-38564c93d8b2\") " pod="openshift-image-registry/node-ca-txllc"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920963    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-metrics-certs\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.920965    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2abaabbc-57ab-4afa-99f5-17eaeb9c23b8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jggmd\" (UID: \"2abaabbc-57ab-4afa-99f5-17eaeb9c23b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jggmd"
Nov 03 21:45:07.921418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.921038    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/736d15ff-56b5-40cf-b19a-38564c93d8b2-host\") pod \"node-ca-txllc\" (UID: \"736d15ff-56b5-40cf-b19a-38564c93d8b2\") " pod="openshift-image-registry/node-ca-txllc"
Nov 03 21:45:07.924223 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.922694    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls\") pod \"image-registry-9b86b7998-kbxzw\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") " pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:07.924223 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.922726    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8915bffd-4628-4aee-994b-81de7d1ad7c6-metrics-certs\") pod \"network-metrics-daemon-kjp2c\" (UID: \"8915bffd-4628-4aee-994b-81de7d1ad7c6\") " pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:45:07.924223 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.922998    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls\") pod \"image-registry-5d56fbb4cf-57p87\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") " pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:07.924223 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.923057    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/289044f0-b173-489e-971f-3dff8aaf9aaa-metrics-tls\") pod \"dns-default-bmvnd\" (UID: \"289044f0-b173-489e-971f-3dff8aaf9aaa\") " pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:45:07.924223 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.923451    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6afb4de-bd45-4038-a6a9-9ff8671eb430-metrics-certs\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:07.993065 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.992987    5077 scope.go:122] "RemoveContainer" containerID="205e56b9b376059dd655d9e4c4c3295d73f1dd1ee6091d03a9936d7434913f5c"
Nov 03 21:45:07.995089 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:07.995070    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:08.002645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.002626    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kjp2c"
Nov 03 21:45:08.011043 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.011021    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:08.014298 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.014278    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:45:08.302507 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.302417    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d56fbb4cf-57p87"]
Nov 03 21:45:08.307116 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:08.307070    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod588bc17e_1307_4055_96a4_cbd60ba48541.slice/crio-4356ed4c38d6a7a1ebd0be6fc0c3cb1cf4514e753684e54483042d3051550219 WatchSource:0}: Error finding container 4356ed4c38d6a7a1ebd0be6fc0c3cb1cf4514e753684e54483042d3051550219: Status 404 returned error can't find the container with id 4356ed4c38d6a7a1ebd0be6fc0c3cb1cf4514e753684e54483042d3051550219
Nov 03 21:45:08.307361 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.307329    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kjp2c"]
Nov 03 21:45:08.311790 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:08.311764    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8915bffd_4628_4aee_994b_81de7d1ad7c6.slice/crio-d9f39360552bfb4bfdceeecca324da41aaa47573fd2feb2f03992838249a3d93 WatchSource:0}: Error finding container d9f39360552bfb4bfdceeecca324da41aaa47573fd2feb2f03992838249a3d93: Status 404 returned error can't find the container with id d9f39360552bfb4bfdceeecca324da41aaa47573fd2feb2f03992838249a3d93
Nov 03 21:45:08.315937 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.315915    5077 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 21:45:08.324512 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.324487    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-wvc4j\" (UID: \"ddc108c9-ccd3-462a-8694-2421004791cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:45:08.327207 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.327184    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddc108c9-ccd3-462a-8694-2421004791cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-wvc4j\" (UID: \"ddc108c9-ccd3-462a-8694-2421004791cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:45:08.346282 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.345822    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bmvnd"]
Nov 03 21:45:08.361217 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:08.361193    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod289044f0_b173_489e_971f_3dff8aaf9aaa.slice/crio-7a7feb3932d4fc564c32b2ecbd68b999c488ca65a0917274ea63d99359a7508d WatchSource:0}: Error finding container 7a7feb3932d4fc564c32b2ecbd68b999c488ca65a0917274ea63d99359a7508d: Status 404 returned error can't find the container with id 7a7feb3932d4fc564c32b2ecbd68b999c488ca65a0917274ea63d99359a7508d
Nov 03 21:45:08.394138 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.394111    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9b86b7998-kbxzw"]
Nov 03 21:45:08.398493 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:08.398466    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21190d3_0ed6_4c4e_a71f_ca14d48ffd03.slice/crio-01a3a25b343e99dbf3192305c99dbcaf256b99ddf933829c2d368ed78a392655 WatchSource:0}: Error finding container 01a3a25b343e99dbf3192305c99dbcaf256b99ddf933829c2d368ed78a392655: Status 404 returned error can't find the container with id 01a3a25b343e99dbf3192305c99dbcaf256b99ddf933829c2d368ed78a392655
Nov 03 21:45:08.425476 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.425449    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fv6vx\" (UID: \"3ebc2e42-6892-480b-a793-4f224d09f45d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"
Nov 03 21:45:08.425581 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.425550    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:08.425635 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.425593    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:08.425635 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:08.425622    5077 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 03 21:45:08.425706 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.425632    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-5dl8c\" (UID: \"b3746624-9331-4bfa-81ed-3a6f37c8d0e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:45:08.425706 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:08.425686    5077 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert podName:3ebc2e42-6892-480b-a793-4f224d09f45d nodeName:}" failed. No retries permitted until 2026-11-03 21:45:09.425668543 +0000 UTC m=+2.829329954 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fv6vx" (UID: "3ebc2e42-6892-480b-a793-4f224d09f45d") : secret "networking-console-plugin-cert" not found
Nov 03 21:45:08.425787 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:08.425706    5077 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle podName:d6afb4de-bd45-4038-a6a9-9ff8671eb430 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:09.425696528 +0000 UTC m=+2.829357943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle") pod "router-default-5b77b9dbdf-rbjh5" (UID: "d6afb4de-bd45-4038-a6a9-9ff8671eb430") : configmap references non-existent config key: service-ca.crt
Nov 03 21:45:08.425787 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:08.425735    5077 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 21:45:08.425860 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:08.425795    5077 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls podName:c61b4b48-0d5d-4c17-9218-c38bf3581e98 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:09.425778409 +0000 UTC m=+2.829439818 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x7fmc" (UID: "c61b4b48-0d5d-4c17-9218-c38bf3581e98") : secret "insights-runtime-extractor-tls" not found
Nov 03 21:45:08.428199 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.428178    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3746624-9331-4bfa-81ed-3a6f37c8d0e6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-5dl8c\" (UID: \"b3746624-9331-4bfa-81ed-3a6f37c8d0e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:45:08.506020 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.506000    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4jznx_a4982959-0762-44eb-a382-a510881805aa/dns-node-resolver/0.log"
Nov 03 21:45:08.593629 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.593590    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"
Nov 03 21:45:08.593813 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.593697    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"
Nov 03 21:45:08.798205 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.798178    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pspgs_36598f65-5a1d-43e3-acc2-71c1e56f112c/console-operator/1.log"
Nov 03 21:45:08.798802 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.798295    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs" event={"ID":"36598f65-5a1d-43e3-acc2-71c1e56f112c","Type":"ContainerStarted","Data":"13910d70f2c507d5aeacdd93217f83e974395754e732426fd0945956f1db679d"}
Nov 03 21:45:08.800456 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.800430    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kjp2c" event={"ID":"8915bffd-4628-4aee-994b-81de7d1ad7c6","Type":"ContainerStarted","Data":"d9f39360552bfb4bfdceeecca324da41aaa47573fd2feb2f03992838249a3d93"}
Nov 03 21:45:08.803011 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.802990    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9b86b7998-kbxzw" event={"ID":"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03","Type":"ContainerStarted","Data":"1d3d4836379b0f6a2cd913545936188412838a79338a9a6602801ab0c10a059f"}
Nov 03 21:45:08.803120 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.803030    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9b86b7998-kbxzw" event={"ID":"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03","Type":"ContainerStarted","Data":"01a3a25b343e99dbf3192305c99dbcaf256b99ddf933829c2d368ed78a392655"}
Nov 03 21:45:08.804852 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.804572    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bmvnd" event={"ID":"289044f0-b173-489e-971f-3dff8aaf9aaa","Type":"ContainerStarted","Data":"7a7feb3932d4fc564c32b2ecbd68b999c488ca65a0917274ea63d99359a7508d"}
Nov 03 21:45:08.806781 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.806756    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87" event={"ID":"588bc17e-1307-4055-96a4-cbd60ba48541","Type":"ContainerStarted","Data":"3f523d52b06b080049c56bfa8df786d5fdae9414bfe5cc7af3dc0900fbb071d2"}
Nov 03 21:45:08.806977 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.806802    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87" event={"ID":"588bc17e-1307-4055-96a4-cbd60ba48541","Type":"ContainerStarted","Data":"4356ed4c38d6a7a1ebd0be6fc0c3cb1cf4514e753684e54483042d3051550219"}
Nov 03 21:45:08.905594 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.905548    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c"]
Nov 03 21:45:08.923349 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.923279    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j"]
Nov 03 21:45:08.929172 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:08.929138    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc108c9_ccd3_462a_8694_2421004791cd.slice/crio-a43d6a33975d71daec2d0e96cd117bd1d5ab7d39e78f31e3d5dac01c2fe6258d WatchSource:0}: Error finding container a43d6a33975d71daec2d0e96cd117bd1d5ab7d39e78f31e3d5dac01c2fe6258d: Status 404 returned error can't find the container with id a43d6a33975d71daec2d0e96cd117bd1d5ab7d39e78f31e3d5dac01c2fe6258d
Nov 03 21:45:08.951481 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:08.950128    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:09.091211 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:09.090508    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:45:09.105911 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:09.105873    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d56fbb4cf-57p87_588bc17e-1307-4055-96a4-cbd60ba48541/registry/0.log"
Nov 03 21:45:09.307146 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:09.307070    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-9b86b7998-kbxzw_d21190d3-0ed6-4c4e-a71f-ca14d48ffd03/registry/0.log"
Nov 03 21:45:09.435703 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:09.435658    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:09.435889 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:09.435709    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:09.435889 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:09.435762    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fv6vx\" (UID: \"3ebc2e42-6892-480b-a793-4f224d09f45d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"
Nov 03 21:45:09.435889 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:09.435854    5077 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle podName:d6afb4de-bd45-4038-a6a9-9ff8671eb430 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:11.435826355 +0000 UTC m=+4.839487769 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle") pod "router-default-5b77b9dbdf-rbjh5" (UID: "d6afb4de-bd45-4038-a6a9-9ff8671eb430") : configmap references non-existent config key: service-ca.crt
Nov 03 21:45:09.436069 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:09.435894    5077 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 03 21:45:09.436069 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:09.435951    5077 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert podName:3ebc2e42-6892-480b-a793-4f224d09f45d nodeName:}" failed. No retries permitted until 2026-11-03 21:45:11.435934604 +0000 UTC m=+4.839596015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fv6vx" (UID: "3ebc2e42-6892-480b-a793-4f224d09f45d") : secret "networking-console-plugin-cert" not found
Nov 03 21:45:09.436069 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:09.436014    5077 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 21:45:09.436069 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:09.436048    5077 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls podName:c61b4b48-0d5d-4c17-9218-c38bf3581e98 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:11.436036873 +0000 UTC m=+4.839698284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x7fmc" (UID: "c61b4b48-0d5d-4c17-9218-c38bf3581e98") : secret "insights-runtime-extractor-tls" not found
Nov 03 21:45:09.756085 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:09.756055    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:09.812447 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:09.812413    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j" event={"ID":"ddc108c9-ccd3-462a-8694-2421004791cd","Type":"ContainerStarted","Data":"a43d6a33975d71daec2d0e96cd117bd1d5ab7d39e78f31e3d5dac01c2fe6258d"}
Nov 03 21:45:09.813561 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:09.813537    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c" event={"ID":"b3746624-9331-4bfa-81ed-3a6f37c8d0e6","Type":"ContainerStarted","Data":"33d058fa1046cb0bee920b0e26618b194ff90d9dae80e15e29a7b1b0ff79106f"}
Nov 03 21:45:09.813671 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:09.813590    5077 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 03 21:45:09.906179 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:09.906159    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-txllc_736d15ff-56b5-40cf-b19a-38564c93d8b2/node-ca/0.log"
Nov 03 21:45:10.306083 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:10.306037    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tqldf_5cbdd163-bfdd-4fda-8141-21b969a3aa08/serve-healthcheck-canary/0.log"
Nov 03 21:45:10.507041 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:10.506956    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-g7kms_88ceb339-f96e-45a4-ad35-9691dc70fbd9/migrator/0.log"
Nov 03 21:45:10.707088 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:10.707062    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-zdz8c_542a90b4-b01a-4cad-a5bf-e0181fe30586/migrator/0.log"
Nov 03 21:45:10.821047 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:10.820478    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kjp2c" event={"ID":"8915bffd-4628-4aee-994b-81de7d1ad7c6","Type":"ContainerStarted","Data":"22f04686bea22e657169aad583903b0f80aec7b3fec8bf86da14bfd3b3bd9e31"}
Nov 03 21:45:10.821047 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:10.820542    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kjp2c" event={"ID":"8915bffd-4628-4aee-994b-81de7d1ad7c6","Type":"ContainerStarted","Data":"bc1687c016faa8e5239221827ddaceddea098322d7fbb4f7451f76c964b0551e"}
Nov 03 21:45:10.822178 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:10.822151    5077 generic.go:356] "Generic (PLEG): container finished" podID="3a3d055a-397e-436d-99bd-e82541b4ce57" containerID="10ecca4335ff24d76e5ecc904d3a9c026d96f33a80e319444e02944e61e13bcd" exitCode=0
Nov 03 21:45:10.822310 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:10.822212    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-kmt8d" event={"ID":"3a3d055a-397e-436d-99bd-e82541b4ce57","Type":"ContainerDied","Data":"10ecca4335ff24d76e5ecc904d3a9c026d96f33a80e319444e02944e61e13bcd"}
Nov 03 21:45:10.822749 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:10.822721    5077 scope.go:122] "RemoveContainer" containerID="10ecca4335ff24d76e5ecc904d3a9c026d96f33a80e319444e02944e61e13bcd"
Nov 03 21:45:10.908110 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:10.908084    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg_6c07fa44-702c-4e55-afe3-451696e76f82/kube-storage-version-migrator-operator/0.log"
Nov 03 21:45:11.462708 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:11.462622    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fv6vx\" (UID: \"3ebc2e42-6892-480b-a793-4f224d09f45d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"
Nov 03 21:45:11.463103 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:11.462733    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:11.463103 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:11.462768    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:11.463103 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:11.462914    5077 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 21:45:11.463103 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:11.462963    5077 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls podName:c61b4b48-0d5d-4c17-9218-c38bf3581e98 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:15.462950457 +0000 UTC m=+8.866611879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x7fmc" (UID: "c61b4b48-0d5d-4c17-9218-c38bf3581e98") : secret "insights-runtime-extractor-tls" not found
Nov 03 21:45:11.463846 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:11.463824    5077 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle podName:d6afb4de-bd45-4038-a6a9-9ff8671eb430 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:15.463807704 +0000 UTC m=+8.867469116 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle") pod "router-default-5b77b9dbdf-rbjh5" (UID: "d6afb4de-bd45-4038-a6a9-9ff8671eb430") : configmap references non-existent config key: service-ca.crt
Nov 03 21:45:11.468805 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:11.468781    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ebc2e42-6892-480b-a793-4f224d09f45d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fv6vx\" (UID: \"3ebc2e42-6892-480b-a793-4f224d09f45d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"
Nov 03 21:45:11.596600 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:11.596562    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"
Nov 03 21:45:11.646307 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:11.646269    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:11.827613 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:11.827583    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wvc4j" event={"ID":"ddc108c9-ccd3-462a-8694-2421004791cd","Type":"ContainerStarted","Data":"76510d57b0a751ab8d73085cfc62082e993ca0daea69539efe63ab0d4e6d7dfc"}
Nov 03 21:45:11.829704 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:11.829679    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bmvnd" event={"ID":"289044f0-b173-489e-971f-3dff8aaf9aaa","Type":"ContainerStarted","Data":"7fbdee92593c4b657705ea181959996f526f222cabc6fe96229610fa1040e783"}
Nov 03 21:45:11.829806 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:11.829727    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bmvnd" event={"ID":"289044f0-b173-489e-971f-3dff8aaf9aaa","Type":"ContainerStarted","Data":"8d02fb78c446f73303b2321ee6b3104e79e8886cb30c07c3f882e5ef7a0a56ee"}
Nov 03 21:45:11.829806 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:11.829759    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:45:11.831781 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:11.831757    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c" event={"ID":"b3746624-9331-4bfa-81ed-3a6f37c8d0e6","Type":"ContainerStarted","Data":"6c84609cc271cb62e0169f038c28d484b58c0f95b5830f3bf1ac3bc8090cef63"}
Nov 03 21:45:11.834442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:11.834421    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-kmt8d" event={"ID":"3a3d055a-397e-436d-99bd-e82541b4ce57","Type":"ContainerStarted","Data":"df98ff904c0356cd80467011b427f830706415d9a6bc46b44911393076515690"}
Nov 03 21:45:11.886265 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:11.886224    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-fv6vx"]
Nov 03 21:45:11.888374 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:11.888352    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:11.888556 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:11.888544    5077 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 03 21:45:11.890282 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:11.890241    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ebc2e42_6892_480b_a793_4f224d09f45d.slice/crio-20a4eae97c5d7e650fb649ba77eb7d72543a240ad8c1f8c9b45347e8d464c511 WatchSource:0}: Error finding container 20a4eae97c5d7e650fb649ba77eb7d72543a240ad8c1f8c9b45347e8d464c511: Status 404 returned error can't find the container with id 20a4eae97c5d7e650fb649ba77eb7d72543a240ad8c1f8c9b45347e8d464c511
Nov 03 21:45:12.525133 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:12.525105    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgk2l"
Nov 03 21:45:12.841010 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:12.840955    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-5dl8c" event={"ID":"b3746624-9331-4bfa-81ed-3a6f37c8d0e6","Type":"ContainerStarted","Data":"73bdae1a531342bf4365f713e9a91bdba8f85d1977a045e1efef0ef9d6980e76"}
Nov 03 21:45:12.842761 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:12.842728    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx" event={"ID":"3ebc2e42-6892-480b-a793-4f224d09f45d","Type":"ContainerStarted","Data":"20a4eae97c5d7e650fb649ba77eb7d72543a240ad8c1f8c9b45347e8d464c511"}
Nov 03 21:45:13.848416 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:13.848381    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-fv6vx" event={"ID":"3ebc2e42-6892-480b-a793-4f224d09f45d","Type":"ContainerStarted","Data":"5a23531a917ae4fd1af450632013e00b7038c4bfdf808a2434c6bd92d0807c16"}
Nov 03 21:45:15.499364 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:15.499325    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:15.499364 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:15.499369    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:15.499994 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:15.499971    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6afb4de-bd45-4038-a6a9-9ff8671eb430-service-ca-bundle\") pod \"router-default-5b77b9dbdf-rbjh5\" (UID: \"d6afb4de-bd45-4038-a6a9-9ff8671eb430\") " pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:15.501762 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:15.501746    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c61b4b48-0d5d-4c17-9218-c38bf3581e98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x7fmc\" (UID: \"c61b4b48-0d5d-4c17-9218-c38bf3581e98\") " pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:15.515764 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:15.515740    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x7fmc"
Nov 03 21:45:15.601719 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:15.601690    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:45:15.601857 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:15.601834    5077 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 03 21:45:15.605377 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:15.605358    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-pspgs"
Nov 03 21:45:15.792697 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:15.792622    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x7fmc"]
Nov 03 21:45:15.795745 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:15.795723    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:15.796433 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:15.796412    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc61b4b48_0d5d_4c17_9218_c38bf3581e98.slice/crio-ee4210ff33adef7d7c345359f75d691a1f8f93cf5e8ecde463ac44b037721020 WatchSource:0}: Error finding container ee4210ff33adef7d7c345359f75d691a1f8f93cf5e8ecde463ac44b037721020: Status 404 returned error can't find the container with id ee4210ff33adef7d7c345359f75d691a1f8f93cf5e8ecde463ac44b037721020
Nov 03 21:45:15.869901 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:15.869866    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x7fmc" event={"ID":"c61b4b48-0d5d-4c17-9218-c38bf3581e98","Type":"ContainerStarted","Data":"ee4210ff33adef7d7c345359f75d691a1f8f93cf5e8ecde463ac44b037721020"}
Nov 03 21:45:16.082149 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:16.082120    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b77b9dbdf-rbjh5"]
Nov 03 21:45:16.085651 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:16.085617    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6afb4de_bd45_4038_a6a9_9ff8671eb430.slice/crio-627f3214f7e3aeeebc43659afbc8faa481cff3cd278d8e86aec5be4f19d5fd26 WatchSource:0}: Error finding container 627f3214f7e3aeeebc43659afbc8faa481cff3cd278d8e86aec5be4f19d5fd26: Status 404 returned error can't find the container with id 627f3214f7e3aeeebc43659afbc8faa481cff3cd278d8e86aec5be4f19d5fd26
Nov 03 21:45:16.874798 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:16.874762    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x7fmc" event={"ID":"c61b4b48-0d5d-4c17-9218-c38bf3581e98","Type":"ContainerStarted","Data":"ac3fd883cb901deaea9a558aef247c2216bb68348f9496ab7719b0e1712cf2ea"}
Nov 03 21:45:16.875193 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:16.874837    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x7fmc" event={"ID":"c61b4b48-0d5d-4c17-9218-c38bf3581e98","Type":"ContainerStarted","Data":"561bfa5b07db9fe65031cb48a86ecbd382b9ab534f8bd0964e29334549d366f7"}
Nov 03 21:45:16.876340 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:16.876315    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5" event={"ID":"d6afb4de-bd45-4038-a6a9-9ff8671eb430","Type":"ContainerStarted","Data":"6acf8359becbb241060cc63c6043993044bf0a5fdb9b29198e5f1460db0f0840"}
Nov 03 21:45:16.876443 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:16.876359    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5" event={"ID":"d6afb4de-bd45-4038-a6a9-9ff8671eb430","Type":"ContainerStarted","Data":"627f3214f7e3aeeebc43659afbc8faa481cff3cd278d8e86aec5be4f19d5fd26"}
Nov 03 21:45:17.796826 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:17.796799    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:17.799290 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:17.799264    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:18.887978 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:18.887946    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x7fmc" event={"ID":"c61b4b48-0d5d-4c17-9218-c38bf3581e98","Type":"ContainerStarted","Data":"51771488511a6aed96cbfefdd95a30b015cd51f9d66dfce7d4a63b8bdb1f9f26"}
Nov 03 21:45:18.888368 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:18.887959    5077 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 03 21:45:20.239666 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:20.239627    5077 patch_prober.go:29] interesting pod/image-registry-5d56fbb4cf-57p87 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Nov 03 21:45:20.240061 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:20.239724    5077 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87" podUID="588bc17e-1307-4055-96a4-cbd60ba48541" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 21:45:21.844920 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:21.844894    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bmvnd"
Nov 03 21:45:21.969991 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:21.969965    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-tzp9l-5l52b"]
Nov 03 21:45:21.973670 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:21.973649    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-tzp9l-5l52b"
Nov 03 21:45:22.005571 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.005542    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-tzp9l-5l52b"]
Nov 03 21:45:22.022890 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.022857    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b4kn2"]
Nov 03 21:45:22.026808 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.026786    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-7v4vz"]
Nov 03 21:45:22.026953 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.026933    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b4kn2"
Nov 03 21:45:22.030072 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.030051    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-7v4vz"
Nov 03 21:45:22.056282 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.056237    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Nov 03 21:45:22.056976 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.056321    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Nov 03 21:45:22.057068 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.056617    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-fct8t\""
Nov 03 21:45:22.057068 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.056801    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Nov 03 21:45:22.057068 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.056916    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xvfj8\""
Nov 03 21:45:22.058465 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.058442    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b4kn2"]
Nov 03 21:45:22.059626 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.059606    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-7v4vz"]
Nov 03 21:45:22.061460 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.061435    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpxkj\" (UniqueName: \"kubernetes.io/projected/02f3529a-929e-490f-91ec-2c2d232b8e48-kube-api-access-hpxkj\") pod \"periodic-gathering-tzp9l-5l52b\" (UID: \"02f3529a-929e-490f-91ec-2c2d232b8e48\") " pod="openshift-insights/periodic-gathering-tzp9l-5l52b"
Nov 03 21:45:22.061580 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.061476    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02f3529a-929e-490f-91ec-2c2d232b8e48-service-ca-bundle\") pod \"periodic-gathering-tzp9l-5l52b\" (UID: \"02f3529a-929e-490f-91ec-2c2d232b8e48\") " pod="openshift-insights/periodic-gathering-tzp9l-5l52b"
Nov 03 21:45:22.061660 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.061607    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/02f3529a-929e-490f-91ec-2c2d232b8e48-archives-path\") pod \"periodic-gathering-tzp9l-5l52b\" (UID: \"02f3529a-929e-490f-91ec-2c2d232b8e48\") " pod="openshift-insights/periodic-gathering-tzp9l-5l52b"
Nov 03 21:45:22.061716 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.061656    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02f3529a-929e-490f-91ec-2c2d232b8e48-trusted-ca-bundle\") pod \"periodic-gathering-tzp9l-5l52b\" (UID: \"02f3529a-929e-490f-91ec-2c2d232b8e48\") " pod="openshift-insights/periodic-gathering-tzp9l-5l52b"
Nov 03 21:45:22.064614 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.064593    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d56fbb4cf-57p87"]
Nov 03 21:45:22.118041 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.117966    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"]
Nov 03 21:45:22.121484 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.121438    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.137301 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.137276    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"]
Nov 03 21:45:22.162756 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.162725    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb4nn\" (UniqueName: \"kubernetes.io/projected/1488e0c3-5c2e-46a2-874b-c00dcabc4d33-kube-api-access-sb4nn\") pod \"downloads-6dd789c8b7-7v4vz\" (UID: \"1488e0c3-5c2e-46a2-874b-c00dcabc4d33\") " pod="openshift-console/downloads-6dd789c8b7-7v4vz"
Nov 03 21:45:22.162886 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.162777    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpxkj\" (UniqueName: \"kubernetes.io/projected/02f3529a-929e-490f-91ec-2c2d232b8e48-kube-api-access-hpxkj\") pod \"periodic-gathering-tzp9l-5l52b\" (UID: \"02f3529a-929e-490f-91ec-2c2d232b8e48\") " pod="openshift-insights/periodic-gathering-tzp9l-5l52b"
Nov 03 21:45:22.162886 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.162822    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02f3529a-929e-490f-91ec-2c2d232b8e48-service-ca-bundle\") pod \"periodic-gathering-tzp9l-5l52b\" (UID: \"02f3529a-929e-490f-91ec-2c2d232b8e48\") " pod="openshift-insights/periodic-gathering-tzp9l-5l52b"
Nov 03 21:45:22.162886 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.162861    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/02f3529a-929e-490f-91ec-2c2d232b8e48-archives-path\") pod \"periodic-gathering-tzp9l-5l52b\" (UID: \"02f3529a-929e-490f-91ec-2c2d232b8e48\") " pod="openshift-insights/periodic-gathering-tzp9l-5l52b"
Nov 03 21:45:22.163022 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.162886    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1488e0c3-5c2e-46a2-874b-c00dcabc4d33-tmp\") pod \"downloads-6dd789c8b7-7v4vz\" (UID: \"1488e0c3-5c2e-46a2-874b-c00dcabc4d33\") " pod="openshift-console/downloads-6dd789c8b7-7v4vz"
Nov 03 21:45:22.163022 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.162909    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02f3529a-929e-490f-91ec-2c2d232b8e48-trusted-ca-bundle\") pod \"periodic-gathering-tzp9l-5l52b\" (UID: \"02f3529a-929e-490f-91ec-2c2d232b8e48\") " pod="openshift-insights/periodic-gathering-tzp9l-5l52b"
Nov 03 21:45:22.163022 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.162943    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/897eaea3-a154-4b83-ad26-35bf4b5fa782-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-b4kn2\" (UID: \"897eaea3-a154-4b83-ad26-35bf4b5fa782\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b4kn2"
Nov 03 21:45:22.163303 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.163238    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/02f3529a-929e-490f-91ec-2c2d232b8e48-archives-path\") pod \"periodic-gathering-tzp9l-5l52b\" (UID: \"02f3529a-929e-490f-91ec-2c2d232b8e48\") " pod="openshift-insights/periodic-gathering-tzp9l-5l52b"
Nov 03 21:45:22.163585 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.163567    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02f3529a-929e-490f-91ec-2c2d232b8e48-service-ca-bundle\") pod \"periodic-gathering-tzp9l-5l52b\" (UID: \"02f3529a-929e-490f-91ec-2c2d232b8e48\") " pod="openshift-insights/periodic-gathering-tzp9l-5l52b"
Nov 03 21:45:22.163801 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.163785    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02f3529a-929e-490f-91ec-2c2d232b8e48-trusted-ca-bundle\") pod \"periodic-gathering-tzp9l-5l52b\" (UID: \"02f3529a-929e-490f-91ec-2c2d232b8e48\") " pod="openshift-insights/periodic-gathering-tzp9l-5l52b"
Nov 03 21:45:22.175177 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.175147    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpxkj\" (UniqueName: \"kubernetes.io/projected/02f3529a-929e-490f-91ec-2c2d232b8e48-kube-api-access-hpxkj\") pod \"periodic-gathering-tzp9l-5l52b\" (UID: \"02f3529a-929e-490f-91ec-2c2d232b8e48\") " pod="openshift-insights/periodic-gathering-tzp9l-5l52b"
Nov 03 21:45:22.264127 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.264094    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jrhg\" (UniqueName: \"kubernetes.io/projected/12db04ea-e25c-4de4-ba08-2cbc02d9550d-kube-api-access-9jrhg\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.264127 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.264132    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12db04ea-e25c-4de4-ba08-2cbc02d9550d-registry-certificates\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.264425 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.264161    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12db04ea-e25c-4de4-ba08-2cbc02d9550d-bound-sa-token\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.264425 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.264272    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb4nn\" (UniqueName: \"kubernetes.io/projected/1488e0c3-5c2e-46a2-874b-c00dcabc4d33-kube-api-access-sb4nn\") pod \"downloads-6dd789c8b7-7v4vz\" (UID: \"1488e0c3-5c2e-46a2-874b-c00dcabc4d33\") " pod="openshift-console/downloads-6dd789c8b7-7v4vz"
Nov 03 21:45:22.264425 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.264326    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12db04ea-e25c-4de4-ba08-2cbc02d9550d-trusted-ca\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.264425 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.264356    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12db04ea-e25c-4de4-ba08-2cbc02d9550d-image-registry-private-configuration\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.264425 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.264387    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12db04ea-e25c-4de4-ba08-2cbc02d9550d-installation-pull-secrets\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.264615 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.264454    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12db04ea-e25c-4de4-ba08-2cbc02d9550d-registry-tls\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.264615 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.264549    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1488e0c3-5c2e-46a2-874b-c00dcabc4d33-tmp\") pod \"downloads-6dd789c8b7-7v4vz\" (UID: \"1488e0c3-5c2e-46a2-874b-c00dcabc4d33\") " pod="openshift-console/downloads-6dd789c8b7-7v4vz"
Nov 03 21:45:22.264615 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.264585    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/897eaea3-a154-4b83-ad26-35bf4b5fa782-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-b4kn2\" (UID: \"897eaea3-a154-4b83-ad26-35bf4b5fa782\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b4kn2"
Nov 03 21:45:22.264615 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.264609    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12db04ea-e25c-4de4-ba08-2cbc02d9550d-ca-trust-extracted\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.265018 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.264996    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1488e0c3-5c2e-46a2-874b-c00dcabc4d33-tmp\") pod \"downloads-6dd789c8b7-7v4vz\" (UID: \"1488e0c3-5c2e-46a2-874b-c00dcabc4d33\") " pod="openshift-console/downloads-6dd789c8b7-7v4vz"
Nov 03 21:45:22.267430 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.267406    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/897eaea3-a154-4b83-ad26-35bf4b5fa782-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-b4kn2\" (UID: \"897eaea3-a154-4b83-ad26-35bf4b5fa782\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b4kn2"
Nov 03 21:45:22.269691 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.269668    5077 patch_prober.go:29] interesting pod/image-registry-9b86b7998-kbxzw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Nov 03 21:45:22.269800 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.269708    5077 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-9b86b7998-kbxzw" podUID="d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 21:45:22.277425 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.277405    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb4nn\" (UniqueName: \"kubernetes.io/projected/1488e0c3-5c2e-46a2-874b-c00dcabc4d33-kube-api-access-sb4nn\") pod \"downloads-6dd789c8b7-7v4vz\" (UID: \"1488e0c3-5c2e-46a2-874b-c00dcabc4d33\") " pod="openshift-console/downloads-6dd789c8b7-7v4vz"
Nov 03 21:45:22.289084 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.289067    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-tzp9l-5l52b"
Nov 03 21:45:22.340813 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.340781    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b4kn2"
Nov 03 21:45:22.358912 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.358735    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-7v4vz"
Nov 03 21:45:22.367301 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.365863    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12db04ea-e25c-4de4-ba08-2cbc02d9550d-bound-sa-token\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.367301 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.365917    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12db04ea-e25c-4de4-ba08-2cbc02d9550d-trusted-ca\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.367301 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.365956    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12db04ea-e25c-4de4-ba08-2cbc02d9550d-image-registry-private-configuration\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.367301 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.366003    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12db04ea-e25c-4de4-ba08-2cbc02d9550d-installation-pull-secrets\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.367301 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.366029    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12db04ea-e25c-4de4-ba08-2cbc02d9550d-registry-tls\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.367301 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.366093    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12db04ea-e25c-4de4-ba08-2cbc02d9550d-ca-trust-extracted\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.367301 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.366124    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jrhg\" (UniqueName: \"kubernetes.io/projected/12db04ea-e25c-4de4-ba08-2cbc02d9550d-kube-api-access-9jrhg\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.367301 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.366157    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12db04ea-e25c-4de4-ba08-2cbc02d9550d-registry-certificates\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.367301 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.366969    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12db04ea-e25c-4de4-ba08-2cbc02d9550d-registry-certificates\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.368104 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.368053    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12db04ea-e25c-4de4-ba08-2cbc02d9550d-ca-trust-extracted\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.368990 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.368924    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12db04ea-e25c-4de4-ba08-2cbc02d9550d-trusted-ca\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.371543 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.371499    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12db04ea-e25c-4de4-ba08-2cbc02d9550d-installation-pull-secrets\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.371878 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.371855    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12db04ea-e25c-4de4-ba08-2cbc02d9550d-registry-tls\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.373919 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.373875    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12db04ea-e25c-4de4-ba08-2cbc02d9550d-image-registry-private-configuration\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.380190 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.380166    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jrhg\" (UniqueName: \"kubernetes.io/projected/12db04ea-e25c-4de4-ba08-2cbc02d9550d-kube-api-access-9jrhg\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.381121 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.381103    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12db04ea-e25c-4de4-ba08-2cbc02d9550d-bound-sa-token\") pod \"image-registry-5b8dfd77d5-z4wdd\" (UID: \"12db04ea-e25c-4de4-ba08-2cbc02d9550d\") " pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.433508 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.433482    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.481706 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.481678    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:22.481838 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.481824    5077 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 03 21:45:22.490356 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.490285    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5b77b9dbdf-rbjh5"
Nov 03 21:45:22.564872 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.564849    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-tzp9l-5l52b"]
Nov 03 21:45:22.567317 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:22.567293    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02f3529a_929e_490f_91ec_2c2d232b8e48.slice/crio-b3e30dff3276005119ab85c81ac804a4275fe974218a860db66fda0d18fac4c8 WatchSource:0}: Error finding container b3e30dff3276005119ab85c81ac804a4275fe974218a860db66fda0d18fac4c8: Status 404 returned error can't find the container with id b3e30dff3276005119ab85c81ac804a4275fe974218a860db66fda0d18fac4c8
Nov 03 21:45:22.627846 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.627823    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b4kn2"]
Nov 03 21:45:22.631161 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:22.631135    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod897eaea3_a154_4b83_ad26_35bf4b5fa782.slice/crio-55c12f339c283d9c3e719c2f2b172557333464eaca514dfe1ae05bd564d0a1ce WatchSource:0}: Error finding container 55c12f339c283d9c3e719c2f2b172557333464eaca514dfe1ae05bd564d0a1ce: Status 404 returned error can't find the container with id 55c12f339c283d9c3e719c2f2b172557333464eaca514dfe1ae05bd564d0a1ce
Nov 03 21:45:22.646142 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.645986    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-7v4vz"]
Nov 03 21:45:22.650095 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:22.650070    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1488e0c3_5c2e_46a2_874b_c00dcabc4d33.slice/crio-681ce66617c00c4054f68c1bffa5b08245b71af64fce6c7b3091b73ceb6f0a5f WatchSource:0}: Error finding container 681ce66617c00c4054f68c1bffa5b08245b71af64fce6c7b3091b73ceb6f0a5f: Status 404 returned error can't find the container with id 681ce66617c00c4054f68c1bffa5b08245b71af64fce6c7b3091b73ceb6f0a5f
Nov 03 21:45:22.716060 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.716038    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"]
Nov 03 21:45:22.718561 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:22.718525    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12db04ea_e25c_4de4_ba08_2cbc02d9550d.slice/crio-0a4efbf273a2d06324565a4bd5e56f58bdde73aff2c219a0ab02ff64bc2ff704 WatchSource:0}: Error finding container 0a4efbf273a2d06324565a4bd5e56f58bdde73aff2c219a0ab02ff64bc2ff704: Status 404 returned error can't find the container with id 0a4efbf273a2d06324565a4bd5e56f58bdde73aff2c219a0ab02ff64bc2ff704
Nov 03 21:45:22.906462 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.906381    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd" event={"ID":"12db04ea-e25c-4de4-ba08-2cbc02d9550d","Type":"ContainerStarted","Data":"9e28c51c8333b311b483640b5e4063d563df45066bf9db1503cd85bf9002f233"}
Nov 03 21:45:22.906462 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.906435    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd" event={"ID":"12db04ea-e25c-4de4-ba08-2cbc02d9550d","Type":"ContainerStarted","Data":"0a4efbf273a2d06324565a4bd5e56f58bdde73aff2c219a0ab02ff64bc2ff704"}
Nov 03 21:45:22.906977 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.906572    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:22.907728 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.907704    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-7v4vz" event={"ID":"1488e0c3-5c2e-46a2-874b-c00dcabc4d33","Type":"ContainerStarted","Data":"681ce66617c00c4054f68c1bffa5b08245b71af64fce6c7b3091b73ceb6f0a5f"}
Nov 03 21:45:22.909015 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.908994    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b4kn2" event={"ID":"897eaea3-a154-4b83-ad26-35bf4b5fa782","Type":"ContainerStarted","Data":"55c12f339c283d9c3e719c2f2b172557333464eaca514dfe1ae05bd564d0a1ce"}
Nov 03 21:45:22.910572 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.910540    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-tzp9l-5l52b" event={"ID":"02f3529a-929e-490f-91ec-2c2d232b8e48","Type":"ContainerStarted","Data":"49690cefcd326a5321b23624d1218afaa72a327b7935616016f0cd2dacc79cb8"}
Nov 03 21:45:22.910689 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.910578    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-tzp9l-5l52b" event={"ID":"02f3529a-929e-490f-91ec-2c2d232b8e48","Type":"ContainerStarted","Data":"b3e30dff3276005119ab85c81ac804a4275fe974218a860db66fda0d18fac4c8"}
Nov 03 21:45:22.932216 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.932165    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd" podStartSLOduration=0.93214922 podStartE2EDuration="932.14922ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:22.931048368 +0000 UTC m=+16.334709799" watchObservedRunningTime="2026-11-03 21:45:22.93214922 +0000 UTC m=+16.335810660"
Nov 03 21:45:22.949086 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:22.949036    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-tzp9l-5l52b" podStartSLOduration=1.9490164760000002 podStartE2EDuration="1.949016476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:22.948504854 +0000 UTC m=+16.352166274" watchObservedRunningTime="2026-11-03 21:45:22.949016476 +0000 UTC m=+16.352677919"
Nov 03 21:45:23.916850 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:23.916810    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b4kn2" event={"ID":"897eaea3-a154-4b83-ad26-35bf4b5fa782","Type":"ContainerStarted","Data":"dd84212ab67b800a504feabf7f0259668e5ff99265ecde8d66553580f66b1826"}
Nov 03 21:45:23.917294 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:23.917084    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b4kn2"
Nov 03 21:45:23.922746 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:23.922721    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b4kn2"
Nov 03 21:45:23.935403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:23.935357    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b4kn2" podStartSLOduration=1.78273714 podStartE2EDuration="2.935343537s" totalImagesPullingTime="1.152606397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:23.933996943 +0000 UTC m=+17.337658373" watchObservedRunningTime="2026-11-03 21:45:23.935343537 +0000 UTC m=+17.339004967"
Nov 03 21:45:24.957898 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:24.956151    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw"]
Nov 03 21:45:24.962308 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:24.962280    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw"
Nov 03 21:45:24.980441 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:24.980410    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 03 21:45:24.980582 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:24.980492    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw"]
Nov 03 21:45:24.980923 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:24.980664    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Nov 03 21:45:24.980923 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:24.980804    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qzqf8\""
Nov 03 21:45:24.980923 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:24.980879    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Nov 03 21:45:25.092509 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.092475    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e897dcc8-aa9a-42b2-8d2b-d56d43316f49-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-qzpgw\" (UID: \"e897dcc8-aa9a-42b2-8d2b-d56d43316f49\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw"
Nov 03 21:45:25.092743 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.092598    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q67l9\" (UniqueName: \"kubernetes.io/projected/e897dcc8-aa9a-42b2-8d2b-d56d43316f49-kube-api-access-q67l9\") pod \"prometheus-operator-9cd89b74c-qzpgw\" (UID: \"e897dcc8-aa9a-42b2-8d2b-d56d43316f49\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw"
Nov 03 21:45:25.092818 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.092738    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e897dcc8-aa9a-42b2-8d2b-d56d43316f49-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-qzpgw\" (UID: \"e897dcc8-aa9a-42b2-8d2b-d56d43316f49\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw"
Nov 03 21:45:25.092818 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.092773    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e897dcc8-aa9a-42b2-8d2b-d56d43316f49-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-qzpgw\" (UID: \"e897dcc8-aa9a-42b2-8d2b-d56d43316f49\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw"
Nov 03 21:45:25.193660 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.193626    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e897dcc8-aa9a-42b2-8d2b-d56d43316f49-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-qzpgw\" (UID: \"e897dcc8-aa9a-42b2-8d2b-d56d43316f49\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw"
Nov 03 21:45:25.193660 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.193666    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e897dcc8-aa9a-42b2-8d2b-d56d43316f49-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-qzpgw\" (UID: \"e897dcc8-aa9a-42b2-8d2b-d56d43316f49\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw"
Nov 03 21:45:25.193896 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.193728    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e897dcc8-aa9a-42b2-8d2b-d56d43316f49-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-qzpgw\" (UID: \"e897dcc8-aa9a-42b2-8d2b-d56d43316f49\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw"
Nov 03 21:45:25.193896 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.193784    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q67l9\" (UniqueName: \"kubernetes.io/projected/e897dcc8-aa9a-42b2-8d2b-d56d43316f49-kube-api-access-q67l9\") pod \"prometheus-operator-9cd89b74c-qzpgw\" (UID: \"e897dcc8-aa9a-42b2-8d2b-d56d43316f49\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw"
Nov 03 21:45:25.194570 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.194543    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e897dcc8-aa9a-42b2-8d2b-d56d43316f49-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-qzpgw\" (UID: \"e897dcc8-aa9a-42b2-8d2b-d56d43316f49\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw"
Nov 03 21:45:25.196645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.196623    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e897dcc8-aa9a-42b2-8d2b-d56d43316f49-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-qzpgw\" (UID: \"e897dcc8-aa9a-42b2-8d2b-d56d43316f49\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw"
Nov 03 21:45:25.196770 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.196724    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e897dcc8-aa9a-42b2-8d2b-d56d43316f49-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-qzpgw\" (UID: \"e897dcc8-aa9a-42b2-8d2b-d56d43316f49\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw"
Nov 03 21:45:25.206226 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.206201    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q67l9\" (UniqueName: \"kubernetes.io/projected/e897dcc8-aa9a-42b2-8d2b-d56d43316f49-kube-api-access-q67l9\") pod \"prometheus-operator-9cd89b74c-qzpgw\" (UID: \"e897dcc8-aa9a-42b2-8d2b-d56d43316f49\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw"
Nov 03 21:45:25.264956 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.264872    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-c7fb84867-8qnmq"]
Nov 03 21:45:25.268699 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.268681    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.272765 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.272723    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Nov 03 21:45:25.272765 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.272756    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Nov 03 21:45:25.272936 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.272797    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Nov 03 21:45:25.273086 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.273068    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Nov 03 21:45:25.273229 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.273215    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nmvdk\""
Nov 03 21:45:25.273370 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.273356    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Nov 03 21:45:25.278728 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.278705    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c7fb84867-8qnmq"]
Nov 03 21:45:25.292535 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.292513    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw"
Nov 03 21:45:25.395839 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.395805    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p654\" (UniqueName: \"kubernetes.io/projected/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-kube-api-access-9p654\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.395989 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.395863    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-oauth-serving-cert\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.395989 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.395894    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-tmp\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.395989 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.395914    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-service-ca\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.395989 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.395935    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-serving-cert\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.395989 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.395964    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-oauth-config\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.395989 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.395986    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-config\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.496770 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.496733    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p654\" (UniqueName: \"kubernetes.io/projected/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-kube-api-access-9p654\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.496940 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.496786    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-oauth-serving-cert\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.496940 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.496819    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-tmp\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.496940 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.496838    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-service-ca\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.496940 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.496859    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-serving-cert\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.496940 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.496901    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-oauth-config\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.496940 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.496932    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-config\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.497425 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.497373    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-tmp\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.497920 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.497897    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-service-ca\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.498017 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.497978    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-oauth-serving-cert\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.498124 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.498097    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-config\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.500167 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.500146    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-serving-cert\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.500422 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.500400    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-oauth-config\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.509887 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.509865    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p654\" (UniqueName: \"kubernetes.io/projected/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-kube-api-access-9p654\") pod \"console-c7fb84867-8qnmq\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") " pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.581969 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.581934    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw"]
Nov 03 21:45:25.584931 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.584905    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:25.585325 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:25.585301    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode897dcc8_aa9a_42b2_8d2b_d56d43316f49.slice/crio-61431f864e06477a5a0fae269abfa66bd86dd041231fa7b194425dce0597f251 WatchSource:0}: Error finding container 61431f864e06477a5a0fae269abfa66bd86dd041231fa7b194425dce0597f251: Status 404 returned error can't find the container with id 61431f864e06477a5a0fae269abfa66bd86dd041231fa7b194425dce0597f251
Nov 03 21:45:25.867873 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.867799    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c7fb84867-8qnmq"]
Nov 03 21:45:25.872122 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:25.872086    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5ba6f27_8258_4ff2_817f_2ef32e8673c3.slice/crio-a6f0b6d3fd9b876b053ac81d8bda5e5a246b5a027b03a9d4e56e50999be64eb9 WatchSource:0}: Error finding container a6f0b6d3fd9b876b053ac81d8bda5e5a246b5a027b03a9d4e56e50999be64eb9: Status 404 returned error can't find the container with id a6f0b6d3fd9b876b053ac81d8bda5e5a246b5a027b03a9d4e56e50999be64eb9
Nov 03 21:45:25.928938 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.928864    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c7fb84867-8qnmq" event={"ID":"d5ba6f27-8258-4ff2-817f-2ef32e8673c3","Type":"ContainerStarted","Data":"a6f0b6d3fd9b876b053ac81d8bda5e5a246b5a027b03a9d4e56e50999be64eb9"}
Nov 03 21:45:25.930396 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:25.930361    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw" event={"ID":"e897dcc8-aa9a-42b2-8d2b-d56d43316f49","Type":"ContainerStarted","Data":"61431f864e06477a5a0fae269abfa66bd86dd041231fa7b194425dce0597f251"}
Nov 03 21:45:27.922654 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:27.922621    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bmvnd_289044f0-b173-489e-971f-3dff8aaf9aaa/dns/0.log"
Nov 03 21:45:27.944952 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:27.944916    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw" event={"ID":"e897dcc8-aa9a-42b2-8d2b-d56d43316f49","Type":"ContainerStarted","Data":"e5f1b23897672b394867f14b2f5b593cadd4c7c0aa9a283da5a9c4ba7b7518a0"}
Nov 03 21:45:27.945092 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:27.945011    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw" event={"ID":"e897dcc8-aa9a-42b2-8d2b-d56d43316f49","Type":"ContainerStarted","Data":"46a458782443f31774cfcd3048b5596f394c4afb1776ec5abc936ab632ec1330"}
Nov 03 21:45:27.965529 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:27.965464    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-qzpgw" podStartSLOduration=2.5987229640000002 podStartE2EDuration="3.965446098s" totalImagesPullingTime="1.366723134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:27.964455602 +0000 UTC m=+21.368117033" watchObservedRunningTime="2026-11-03 21:45:27.965446098 +0000 UTC m=+21.369107528"
Nov 03 21:45:28.122092 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:28.122066    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bmvnd_289044f0-b173-489e-971f-3dff8aaf9aaa/kube-rbac-proxy/0.log"
Nov 03 21:45:28.322599 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:28.322572    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4jznx_a4982959-0762-44eb-a382-a510881805aa/dns-node-resolver/0.log"
Nov 03 21:45:28.922435 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:28.922410    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b8dfd77d5-z4wdd_12db04ea-e25c-4de4-ba08-2cbc02d9550d/registry/0.log"
Nov 03 21:45:29.124603 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:29.124576    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d56fbb4cf-57p87_588bc17e-1307-4055-96a4-cbd60ba48541/registry/0.log"
Nov 03 21:45:29.322620 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:29.322592    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-9b86b7998-kbxzw_d21190d3-0ed6-4c4e-a71f-ca14d48ffd03/registry/0.log"
Nov 03 21:45:29.922281 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:29.922136    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-txllc_736d15ff-56b5-40cf-b19a-38564c93d8b2/node-ca/0.log"
Nov 03 21:45:29.930732 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:29.930698    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:45:29.956477 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:29.956439    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c7fb84867-8qnmq" event={"ID":"d5ba6f27-8258-4ff2-817f-2ef32e8673c3","Type":"ContainerStarted","Data":"e2ee8b8b7f99c67eb799261be72d68ba27b650a3a9d63757f2b86821ae618e0c"}
Nov 03 21:45:29.978286 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:29.978208    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-c7fb84867-8qnmq" podStartSLOduration=1.774110491 podStartE2EDuration="4.978188902s" totalImagesPullingTime="3.204078411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:29.976282001 +0000 UTC m=+23.379943432" watchObservedRunningTime="2026-11-03 21:45:29.978188902 +0000 UTC m=+23.381850333"
Nov 03 21:45:30.122593 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.122559    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b77b9dbdf-rbjh5_d6afb4de-bd45-4038-a6a9-9ff8671eb430/router/0.log"
Nov 03 21:45:30.328644 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.328617    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tqldf_5cbdd163-bfdd-4fda-8141-21b969a3aa08/serve-healthcheck-canary/0.log"
Nov 03 21:45:30.355668 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.355640    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7zfdb"]
Nov 03 21:45:30.360548 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.360521    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.370016 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.369993    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s5f4x\""
Nov 03 21:45:30.430650 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.430054    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mrf9j"
Nov 03 21:45:30.439415 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.439367    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 03 21:45:30.439415 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.439374    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 03 21:45:30.447779 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.447752    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-root\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.447909 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.447792    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-node-exporter-tls\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.447909 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.447827    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-node-exporter-wtmp\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.448033 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.447929    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g7px\" (UniqueName: \"kubernetes.io/projected/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-kube-api-access-5g7px\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.448033 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.447968    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-sys\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.448033 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.448024    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-node-exporter-textfile\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.448182 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.448077    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.448182 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.448126    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.448182 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.448168    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-metrics-client-ca\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.456400 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.456347    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 03 21:45:30.551395 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.549231    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g7px\" (UniqueName: \"kubernetes.io/projected/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-kube-api-access-5g7px\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.551395 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.549289    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-sys\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.551395 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.549348    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-node-exporter-textfile\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.551395 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.549380    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.551395 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.549429    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.551395 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.549466    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-metrics-client-ca\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.551395 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.549502    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-root\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.551395 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.549518    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-node-exporter-tls\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.551395 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.549553    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-node-exporter-wtmp\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.551395 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.549701    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-node-exporter-wtmp\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.551395 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.550059    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-sys\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.551395 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.550760    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-root\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.551395 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:30.550855    5077 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Nov 03 21:45:30.551395 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.550882    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-metrics-client-ca\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.551395 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:30.550909    5077 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-node-exporter-tls podName:e6d83909-5c30-4707-8e6d-d1d6dc9188d6 nodeName:}" failed. No retries permitted until 2026-11-03 21:45:31.050893776 +0000 UTC m=+24.454555187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-node-exporter-tls") pod "node-exporter-7zfdb" (UID: "e6d83909-5c30-4707-8e6d-d1d6dc9188d6") : secret "node-exporter-tls" not found
Nov 03 21:45:30.551395 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.551352    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.552378 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.551481    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-node-exporter-textfile\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.554608 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.554583    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.563989 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.563965    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g7px\" (UniqueName: \"kubernetes.io/projected/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-kube-api-access-5g7px\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:30.829009 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:30.828979    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:45:31.054459 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:31.054415    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-node-exporter-tls\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:31.057282 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:31.057236    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e6d83909-5c30-4707-8e6d-d1d6dc9188d6-node-exporter-tls\") pod \"node-exporter-7zfdb\" (UID: \"e6d83909-5c30-4707-8e6d-d1d6dc9188d6\") " pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:31.281705 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:31.281624    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7zfdb"
Nov 03 21:45:31.303078 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:31.303040    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6d83909_5c30_4707_8e6d_d1d6dc9188d6.slice/crio-a6940a7798590b698476dbad7514cf4b9f1c4fd6f8090899b33ac4952dfb18cc WatchSource:0}: Error finding container a6940a7798590b698476dbad7514cf4b9f1c4fd6f8090899b33ac4952dfb18cc: Status 404 returned error can't find the container with id a6940a7798590b698476dbad7514cf4b9f1c4fd6f8090899b33ac4952dfb18cc
Nov 03 21:45:31.969699 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:31.969656    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7zfdb" event={"ID":"e6d83909-5c30-4707-8e6d-d1d6dc9188d6","Type":"ContainerStarted","Data":"a6940a7798590b698476dbad7514cf4b9f1c4fd6f8090899b33ac4952dfb18cc"}
Nov 03 21:45:32.071965 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:32.071934    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:32.983798 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:32.983723    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7zfdb" event={"ID":"e6d83909-5c30-4707-8e6d-d1d6dc9188d6","Type":"ContainerStarted","Data":"c1854895ee3e6793cc323b20b6e87896993e4a6e60b45c78bea4cbb2e9249a25"}
Nov 03 21:45:33.990770 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:33.990729    5077 generic.go:356] "Generic (PLEG): container finished" podID="e6d83909-5c30-4707-8e6d-d1d6dc9188d6" containerID="c1854895ee3e6793cc323b20b6e87896993e4a6e60b45c78bea4cbb2e9249a25" exitCode=0
Nov 03 21:45:33.991267 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:33.990852    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7zfdb" event={"ID":"e6d83909-5c30-4707-8e6d-d1d6dc9188d6","Type":"ContainerDied","Data":"c1854895ee3e6793cc323b20b6e87896993e4a6e60b45c78bea4cbb2e9249a25"}
Nov 03 21:45:34.998092 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:34.998060    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7zfdb" event={"ID":"e6d83909-5c30-4707-8e6d-d1d6dc9188d6","Type":"ContainerStarted","Data":"59bc19724560176c74403940bef9c30252e2ec4f21346ba4a6f10f494225f218"}
Nov 03 21:45:34.998531 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:34.998114    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7zfdb" event={"ID":"e6d83909-5c30-4707-8e6d-d1d6dc9188d6","Type":"ContainerStarted","Data":"f11363b29000a4fd4a107c8096527fc6efcaa2c09ec4c91648233a4c5987976b"}
Nov 03 21:45:35.023317 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:35.023215    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7zfdb" podStartSLOduration=3.422923522 podStartE2EDuration="5.023196158s" totalImagesPullingTime="1.485269936s" totalInitContainerRuntime="115.0027ms" isStatefulPod=true podCreationTimestamp="2026-11-03 21:45:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:35.021155841 +0000 UTC m=+28.424817270" watchObservedRunningTime="2026-11-03 21:45:35.023196158 +0000 UTC m=+28.426857588"
Nov 03 21:45:35.418560 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:35.418525    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c7fb84867-8qnmq"]
Nov 03 21:45:35.585374 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:35.585344    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:45:39.094442 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:39.094410    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ztd6j"
Nov 03 21:45:40.291848 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.291816    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-85b86444db-n45x2"]
Nov 03 21:45:40.307999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.307967    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85b86444db-n45x2"]
Nov 03 21:45:40.308214 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.308075    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.344134 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.344084    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Nov 03 21:45:40.358146 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.358116    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-service-ca\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.358337 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.358166    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-oauth-serving-cert\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.358337 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.358190    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11f56b3b-d1a2-41c6-94e3-559217afa2bc-tmp\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.358417 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.358363    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-trusted-ca-bundle\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.358452 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.358415    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-config\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.358491 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.358448    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-serving-cert\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.358491 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.358471    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-oauth-config\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.358625 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.358605    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5tl4\" (UniqueName: \"kubernetes.io/projected/11f56b3b-d1a2-41c6-94e3-559217afa2bc-kube-api-access-z5tl4\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.459211 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.459177    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-service-ca\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.459597 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.459225    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-oauth-serving-cert\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.459597 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.459326    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11f56b3b-d1a2-41c6-94e3-559217afa2bc-tmp\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.459597 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.459363    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-trusted-ca-bundle\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.459597 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.459407    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-config\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.459597 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.459465    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-serving-cert\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.459597 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.459494    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-oauth-config\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.459597 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.459551    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5tl4\" (UniqueName: \"kubernetes.io/projected/11f56b3b-d1a2-41c6-94e3-559217afa2bc-kube-api-access-z5tl4\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.460005 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.459761    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11f56b3b-d1a2-41c6-94e3-559217afa2bc-tmp\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.460064 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.460010    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-oauth-serving-cert\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.460296 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.460262    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-config\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.460500 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.460480    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-service-ca\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.460581 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.460564    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-trusted-ca-bundle\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.462156 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.462134    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-serving-cert\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.462267 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.462159    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-oauth-config\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.473132 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.473112    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5tl4\" (UniqueName: \"kubernetes.io/projected/11f56b3b-d1a2-41c6-94e3-559217afa2bc-kube-api-access-z5tl4\") pod \"console-85b86444db-n45x2\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") " pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.636166 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.636128    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:40.967776 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:40.967686    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85b86444db-n45x2"]
Nov 03 21:45:40.970790 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:45:40.970762    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f56b3b_d1a2_41c6_94e3_559217afa2bc.slice/crio-f90354d0c785b35111f652f734a664b52234a144002cbd253f30a8ca66276b80 WatchSource:0}: Error finding container f90354d0c785b35111f652f734a664b52234a144002cbd253f30a8ca66276b80: Status 404 returned error can't find the container with id f90354d0c785b35111f652f734a664b52234a144002cbd253f30a8ca66276b80
Nov 03 21:45:41.032910 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:41.032881    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-7v4vz" event={"ID":"1488e0c3-5c2e-46a2-874b-c00dcabc4d33","Type":"ContainerStarted","Data":"5e548b6fd9c362e9df7a7e0b380dd5c0c2f53538b15a377d4eda10998ac42db0"}
Nov 03 21:45:41.033072 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:41.033042    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-7v4vz"
Nov 03 21:45:41.034617 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:41.034596    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b86444db-n45x2" event={"ID":"11f56b3b-d1a2-41c6-94e3-559217afa2bc","Type":"ContainerStarted","Data":"f90354d0c785b35111f652f734a664b52234a144002cbd253f30a8ca66276b80"}
Nov 03 21:45:41.034731 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:41.034690    5077 patch_prober.go:29] interesting pod/downloads-6dd789c8b7-7v4vz container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.30:8080/\": dial tcp 10.132.0.30:8080: connect: connection refused" start-of-body=
Nov 03 21:45:41.034731 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:41.034724    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6dd789c8b7-7v4vz" podUID="1488e0c3-5c2e-46a2-874b-c00dcabc4d33" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.30:8080/\": dial tcp 10.132.0.30:8080: connect: connection refused"
Nov 03 21:45:41.056407 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:41.056365    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-7v4vz" podStartSLOduration=1.966490048 podStartE2EDuration="20.056351699s" totalImagesPullingTime="18.089861651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:41.055530944 +0000 UTC m=+34.459192372" watchObservedRunningTime="2026-11-03 21:45:41.056351699 +0000 UTC m=+34.460013129"
Nov 03 21:45:42.045588 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:42.045551    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b86444db-n45x2" event={"ID":"11f56b3b-d1a2-41c6-94e3-559217afa2bc","Type":"ContainerStarted","Data":"e96cd5699185d8f1ffa9cc4c4f39c71abf84b14bd6b2b955cad744361ca0a786"}
Nov 03 21:45:42.052404 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:42.052322    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-7v4vz"
Nov 03 21:45:42.069613 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:42.069548    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-85b86444db-n45x2" podStartSLOduration=2.06953261 podStartE2EDuration="2.06953261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:42.066415456 +0000 UTC m=+35.470076890" watchObservedRunningTime="2026-11-03 21:45:42.06953261 +0000 UTC m=+35.473194042"
Nov 03 21:45:43.926041 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:43.926010    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b8dfd77d5-z4wdd"
Nov 03 21:45:43.986721 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:43.986685    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9b86b7998-kbxzw"]
Nov 03 21:45:47.089278 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.089124    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87" podUID="588bc17e-1307-4055-96a4-cbd60ba48541" containerName="registry" containerID="cri-o://3f523d52b06b080049c56bfa8df786d5fdae9414bfe5cc7af3dc0900fbb071d2" gracePeriod=30
Nov 03 21:45:47.419017 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.418984    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:47.551507 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.551469    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-bound-sa-token\") pod \"588bc17e-1307-4055-96a4-cbd60ba48541\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") "
Nov 03 21:45:47.551700 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.551520    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/588bc17e-1307-4055-96a4-cbd60ba48541-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/588bc17e-1307-4055-96a4-cbd60ba48541-registry-certificates\") pod \"588bc17e-1307-4055-96a4-cbd60ba48541\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") "
Nov 03 21:45:47.551700 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.551564    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-kube-api-access-kg58s\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-kube-api-access-kg58s\") pod \"588bc17e-1307-4055-96a4-cbd60ba48541\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") "
Nov 03 21:45:47.551700 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.551589    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/588bc17e-1307-4055-96a4-cbd60ba48541-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/588bc17e-1307-4055-96a4-cbd60ba48541-image-registry-private-configuration\") pod \"588bc17e-1307-4055-96a4-cbd60ba48541\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") "
Nov 03 21:45:47.551700 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.551630    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls\") pod \"588bc17e-1307-4055-96a4-cbd60ba48541\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") "
Nov 03 21:45:47.551929 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.551760    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/588bc17e-1307-4055-96a4-cbd60ba48541-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/588bc17e-1307-4055-96a4-cbd60ba48541-ca-trust-extracted\") pod \"588bc17e-1307-4055-96a4-cbd60ba48541\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") "
Nov 03 21:45:47.551929 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.551804    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/588bc17e-1307-4055-96a4-cbd60ba48541-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/588bc17e-1307-4055-96a4-cbd60ba48541-trusted-ca\") pod \"588bc17e-1307-4055-96a4-cbd60ba48541\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") "
Nov 03 21:45:47.551929 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.551848    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/588bc17e-1307-4055-96a4-cbd60ba48541-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/588bc17e-1307-4055-96a4-cbd60ba48541-installation-pull-secrets\") pod \"588bc17e-1307-4055-96a4-cbd60ba48541\" (UID: \"588bc17e-1307-4055-96a4-cbd60ba48541\") "
Nov 03 21:45:47.552299 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.552268    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/588bc17e-1307-4055-96a4-cbd60ba48541-registry-certificates" pod "588bc17e-1307-4055-96a4-cbd60ba48541" (UID: "588bc17e-1307-4055-96a4-cbd60ba48541"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:45:47.552787 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.552757    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/588bc17e-1307-4055-96a4-cbd60ba48541-trusted-ca" pod "588bc17e-1307-4055-96a4-cbd60ba48541" (UID: "588bc17e-1307-4055-96a4-cbd60ba48541"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:45:47.555039 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.554904    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls" pod "588bc17e-1307-4055-96a4-cbd60ba48541" (UID: "588bc17e-1307-4055-96a4-cbd60ba48541"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:45:47.555419 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.555325    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/588bc17e-1307-4055-96a4-cbd60ba48541-installation-pull-secrets" pod "588bc17e-1307-4055-96a4-cbd60ba48541" (UID: "588bc17e-1307-4055-96a4-cbd60ba48541"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:45:47.555419 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.555325    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-bound-sa-token" pod "588bc17e-1307-4055-96a4-cbd60ba48541" (UID: "588bc17e-1307-4055-96a4-cbd60ba48541"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:45:47.555907 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.555881    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-kube-api-access-kg58s" pod "588bc17e-1307-4055-96a4-cbd60ba48541" (UID: "588bc17e-1307-4055-96a4-cbd60ba48541"). InnerVolumeSpecName "kube-api-access-kg58s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:45:47.557011 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.556982    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/588bc17e-1307-4055-96a4-cbd60ba48541-image-registry-private-configuration" pod "588bc17e-1307-4055-96a4-cbd60ba48541" (UID: "588bc17e-1307-4055-96a4-cbd60ba48541"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:45:47.561157 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.561127    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/588bc17e-1307-4055-96a4-cbd60ba48541-ca-trust-extracted" pod "588bc17e-1307-4055-96a4-cbd60ba48541" (UID: "588bc17e-1307-4055-96a4-cbd60ba48541"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:45:47.653337 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.653230    5077 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/588bc17e-1307-4055-96a4-cbd60ba48541-installation-pull-secrets\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:45:47.653337 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.653293    5077 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-bound-sa-token\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:45:47.653337 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.653306    5077 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/588bc17e-1307-4055-96a4-cbd60ba48541-registry-certificates\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:45:47.653337 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.653321    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg58s\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-kube-api-access-kg58s\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:45:47.653337 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.653335    5077 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/588bc17e-1307-4055-96a4-cbd60ba48541-image-registry-private-configuration\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:45:47.653337 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.653345    5077 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/588bc17e-1307-4055-96a4-cbd60ba48541-registry-tls\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:45:47.653672 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.653354    5077 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/588bc17e-1307-4055-96a4-cbd60ba48541-ca-trust-extracted\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:45:47.653672 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:47.653362    5077 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/588bc17e-1307-4055-96a4-cbd60ba48541-trusted-ca\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:45:48.086407 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:48.086362    5077 generic.go:356] "Generic (PLEG): container finished" podID="588bc17e-1307-4055-96a4-cbd60ba48541" containerID="3f523d52b06b080049c56bfa8df786d5fdae9414bfe5cc7af3dc0900fbb071d2" exitCode=0
Nov 03 21:45:48.086634 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:48.086423    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87"
Nov 03 21:45:48.086634 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:48.086449    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87" event={"ID":"588bc17e-1307-4055-96a4-cbd60ba48541","Type":"ContainerDied","Data":"3f523d52b06b080049c56bfa8df786d5fdae9414bfe5cc7af3dc0900fbb071d2"}
Nov 03 21:45:48.086634 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:48.086521    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d56fbb4cf-57p87" event={"ID":"588bc17e-1307-4055-96a4-cbd60ba48541","Type":"ContainerDied","Data":"4356ed4c38d6a7a1ebd0be6fc0c3cb1cf4514e753684e54483042d3051550219"}
Nov 03 21:45:48.086634 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:48.086556    5077 scope.go:122] "RemoveContainer" containerID="3f523d52b06b080049c56bfa8df786d5fdae9414bfe5cc7af3dc0900fbb071d2"
Nov 03 21:45:48.097928 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:48.097812    5077 scope.go:122] "RemoveContainer" containerID="3f523d52b06b080049c56bfa8df786d5fdae9414bfe5cc7af3dc0900fbb071d2"
Nov 03 21:45:48.098231 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:48.098188    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f523d52b06b080049c56bfa8df786d5fdae9414bfe5cc7af3dc0900fbb071d2\": container with ID starting with 3f523d52b06b080049c56bfa8df786d5fdae9414bfe5cc7af3dc0900fbb071d2 not found: ID does not exist" containerID="3f523d52b06b080049c56bfa8df786d5fdae9414bfe5cc7af3dc0900fbb071d2"
Nov 03 21:45:48.098304 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:48.098228    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f523d52b06b080049c56bfa8df786d5fdae9414bfe5cc7af3dc0900fbb071d2"} err="failed to get container status \"3f523d52b06b080049c56bfa8df786d5fdae9414bfe5cc7af3dc0900fbb071d2\": rpc error: code = NotFound desc = could not find container \"3f523d52b06b080049c56bfa8df786d5fdae9414bfe5cc7af3dc0900fbb071d2\": container with ID starting with 3f523d52b06b080049c56bfa8df786d5fdae9414bfe5cc7af3dc0900fbb071d2 not found: ID does not exist"
Nov 03 21:45:48.110995 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:48.110969    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d56fbb4cf-57p87"]
Nov 03 21:45:48.115373 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:48.115346    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d56fbb4cf-57p87"]
Nov 03 21:45:48.735203 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:48.735162    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="588bc17e-1307-4055-96a4-cbd60ba48541" path="/var/lib/kubelet/pods/588bc17e-1307-4055-96a4-cbd60ba48541/volumes"
Nov 03 21:45:50.636490 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:50.636454    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:50.636878 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:50.636558    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:50.641373 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:50.641346    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:51.105618 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:51.105592    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:45:54.413312 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:54.413280    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-xghgl-bwm6n"]
Nov 03 21:45:54.413865 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:54.413472    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-xghgl-bwm6n" podUID="abb8c77f-1d9a-4a7d-adde-ff0b851395ed" containerName="insights-gathering" containerID="cri-o://4ee5644d6242e02aa993244c4ed94bb746708073989adf6244c8a06e7cce8813" gracePeriod=30
Nov 03 21:45:54.753757 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:54.753710    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:54.820556 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:54.820495    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-trusted-ca-bundle\") pod \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") "
Nov 03 21:45:54.820773 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:54.820565    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-kube-api-access-jmf4v\" (UniqueName: \"kubernetes.io/projected/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-kube-api-access-jmf4v\") pod \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") "
Nov 03 21:45:54.820773 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:54.820594    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-service-ca-bundle\") pod \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") "
Nov 03 21:45:54.820773 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:54.820629    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-archives-path\") pod \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\" (UID: \"abb8c77f-1d9a-4a7d-adde-ff0b851395ed\") "
Nov 03 21:45:54.820969 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:54.820914    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-service-ca-bundle" pod "abb8c77f-1d9a-4a7d-adde-ff0b851395ed" (UID: "abb8c77f-1d9a-4a7d-adde-ff0b851395ed"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:45:54.820969 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:54.820931    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-trusted-ca-bundle" pod "abb8c77f-1d9a-4a7d-adde-ff0b851395ed" (UID: "abb8c77f-1d9a-4a7d-adde-ff0b851395ed"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:45:54.821055 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:54.820985    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-archives-path" pod "abb8c77f-1d9a-4a7d-adde-ff0b851395ed" (UID: "abb8c77f-1d9a-4a7d-adde-ff0b851395ed"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:45:54.823076 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:54.823056    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-kube-api-access-jmf4v" pod "abb8c77f-1d9a-4a7d-adde-ff0b851395ed" (UID: "abb8c77f-1d9a-4a7d-adde-ff0b851395ed"). InnerVolumeSpecName "kube-api-access-jmf4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:45:54.921440 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:54.921402    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmf4v\" (UniqueName: \"kubernetes.io/projected/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-kube-api-access-jmf4v\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:45:54.921440 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:54.921429    5077 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-service-ca-bundle\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:45:54.921440 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:54.921440    5077 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-archives-path\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:45:54.921440 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:54.921449    5077 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abb8c77f-1d9a-4a7d-adde-ff0b851395ed-trusted-ca-bundle\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:45:55.120393 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:55.120355    5077 generic.go:356] "Generic (PLEG): container finished" podID="abb8c77f-1d9a-4a7d-adde-ff0b851395ed" containerID="4ee5644d6242e02aa993244c4ed94bb746708073989adf6244c8a06e7cce8813" exitCode=2
Nov 03 21:45:55.120608 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:55.120403    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-xghgl-bwm6n"
Nov 03 21:45:55.120608 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:55.120422    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-xghgl-bwm6n" event={"ID":"abb8c77f-1d9a-4a7d-adde-ff0b851395ed","Type":"ContainerDied","Data":"4ee5644d6242e02aa993244c4ed94bb746708073989adf6244c8a06e7cce8813"}
Nov 03 21:45:55.120608 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:55.120464    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-xghgl-bwm6n" event={"ID":"abb8c77f-1d9a-4a7d-adde-ff0b851395ed","Type":"ContainerDied","Data":"d9cad674ab6242b49531be8dd0c5c0448d767f682c9a1da4c3ff1bc88bc18cf0"}
Nov 03 21:45:55.120608 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:55.120486    5077 scope.go:122] "RemoveContainer" containerID="4ee5644d6242e02aa993244c4ed94bb746708073989adf6244c8a06e7cce8813"
Nov 03 21:45:55.135673 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:55.135647    5077 scope.go:122] "RemoveContainer" containerID="4ee5644d6242e02aa993244c4ed94bb746708073989adf6244c8a06e7cce8813"
Nov 03 21:45:55.135986 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:55.135967    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ee5644d6242e02aa993244c4ed94bb746708073989adf6244c8a06e7cce8813\": container with ID starting with 4ee5644d6242e02aa993244c4ed94bb746708073989adf6244c8a06e7cce8813 not found: ID does not exist" containerID="4ee5644d6242e02aa993244c4ed94bb746708073989adf6244c8a06e7cce8813"
Nov 03 21:45:55.136054 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:55.136002    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ee5644d6242e02aa993244c4ed94bb746708073989adf6244c8a06e7cce8813"} err="failed to get container status \"4ee5644d6242e02aa993244c4ed94bb746708073989adf6244c8a06e7cce8813\": rpc error: code = NotFound desc = could not find container \"4ee5644d6242e02aa993244c4ed94bb746708073989adf6244c8a06e7cce8813\": container with ID starting with 4ee5644d6242e02aa993244c4ed94bb746708073989adf6244c8a06e7cce8813 not found: ID does not exist"
Nov 03 21:45:55.141814 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:55.141785    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-xghgl-bwm6n"]
Nov 03 21:45:55.145920 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:55.145896    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-xghgl-bwm6n"]
Nov 03 21:45:56.734302 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:45:56.734270    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="abb8c77f-1d9a-4a7d-adde-ff0b851395ed" path="/var/lib/kubelet/pods/abb8c77f-1d9a-4a7d-adde-ff0b851395ed/volumes"
Nov 03 21:45:59.927840 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:45:59.927795    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:46:00.441513 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.441447    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-c7fb84867-8qnmq" podUID="d5ba6f27-8258-4ff2-817f-2ef32e8673c3" containerName="console" containerID="cri-o://e2ee8b8b7f99c67eb799261be72d68ba27b650a3a9d63757f2b86821ae618e0c" gracePeriod=15
Nov 03 21:46:00.736322 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.736289    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:46:00.875299 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.875265    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-oauth-serving-cert\") pod \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") "
Nov 03 21:46:00.875490 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.875327    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-config\" (UniqueName: \"kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-config\") pod \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") "
Nov 03 21:46:00.875490 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.875420    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-serving-cert\") pod \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") "
Nov 03 21:46:00.875490 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.875457    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-tmp\") pod \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") "
Nov 03 21:46:00.875658 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.875492    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-kube-api-access-9p654\" (UniqueName: \"kubernetes.io/projected/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-kube-api-access-9p654\") pod \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") "
Nov 03 21:46:00.875658 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.875634    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-oauth-serving-cert" pod "d5ba6f27-8258-4ff2-817f-2ef32e8673c3" (UID: "d5ba6f27-8258-4ff2-817f-2ef32e8673c3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:46:00.875763 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.875674    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-service-ca\") pod \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") "
Nov 03 21:46:00.875763 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.875716    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-oauth-config\") pod \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\" (UID: \"d5ba6f27-8258-4ff2-817f-2ef32e8673c3\") "
Nov 03 21:46:00.875865 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.875770    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-tmp" pod "d5ba6f27-8258-4ff2-817f-2ef32e8673c3" (UID: "d5ba6f27-8258-4ff2-817f-2ef32e8673c3"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:46:00.875865 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.875679    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-config" pod "d5ba6f27-8258-4ff2-817f-2ef32e8673c3" (UID: "d5ba6f27-8258-4ff2-817f-2ef32e8673c3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:46:00.875980 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.875964    5077 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-config\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:00.876031 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.875983    5077 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-tmp\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:00.876031 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.875979    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-service-ca" pod "d5ba6f27-8258-4ff2-817f-2ef32e8673c3" (UID: "d5ba6f27-8258-4ff2-817f-2ef32e8673c3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:46:00.876031 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.875994    5077 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-oauth-serving-cert\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:00.877964 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.877939    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-serving-cert" pod "d5ba6f27-8258-4ff2-817f-2ef32e8673c3" (UID: "d5ba6f27-8258-4ff2-817f-2ef32e8673c3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:46:00.878072 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.877962    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-kube-api-access-9p654" pod "d5ba6f27-8258-4ff2-817f-2ef32e8673c3" (UID: "d5ba6f27-8258-4ff2-817f-2ef32e8673c3"). InnerVolumeSpecName "kube-api-access-9p654". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:46:00.878072 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.877963    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-oauth-config" pod "d5ba6f27-8258-4ff2-817f-2ef32e8673c3" (UID: "d5ba6f27-8258-4ff2-817f-2ef32e8673c3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:46:00.976709 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.976621    5077 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-serving-cert\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:00.976709 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.976653    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9p654\" (UniqueName: \"kubernetes.io/projected/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-kube-api-access-9p654\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:00.976709 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.976664    5077 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-service-ca\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:00.976709 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:00.976674    5077 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5ba6f27-8258-4ff2-817f-2ef32e8673c3-console-oauth-config\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:01.151041 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:01.151008    5077 generic.go:356] "Generic (PLEG): container finished" podID="d5ba6f27-8258-4ff2-817f-2ef32e8673c3" containerID="e2ee8b8b7f99c67eb799261be72d68ba27b650a3a9d63757f2b86821ae618e0c" exitCode=0
Nov 03 21:46:01.151207 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:01.151057    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c7fb84867-8qnmq"
Nov 03 21:46:01.151207 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:01.151062    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c7fb84867-8qnmq" event={"ID":"d5ba6f27-8258-4ff2-817f-2ef32e8673c3","Type":"ContainerDied","Data":"e2ee8b8b7f99c67eb799261be72d68ba27b650a3a9d63757f2b86821ae618e0c"}
Nov 03 21:46:01.151207 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:01.151104    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c7fb84867-8qnmq" event={"ID":"d5ba6f27-8258-4ff2-817f-2ef32e8673c3","Type":"ContainerDied","Data":"a6f0b6d3fd9b876b053ac81d8bda5e5a246b5a027b03a9d4e56e50999be64eb9"}
Nov 03 21:46:01.151207 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:01.151126    5077 scope.go:122] "RemoveContainer" containerID="e2ee8b8b7f99c67eb799261be72d68ba27b650a3a9d63757f2b86821ae618e0c"
Nov 03 21:46:01.160444 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:01.160427    5077 scope.go:122] "RemoveContainer" containerID="e2ee8b8b7f99c67eb799261be72d68ba27b650a3a9d63757f2b86821ae618e0c"
Nov 03 21:46:01.160727 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:46:01.160705    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2ee8b8b7f99c67eb799261be72d68ba27b650a3a9d63757f2b86821ae618e0c\": container with ID starting with e2ee8b8b7f99c67eb799261be72d68ba27b650a3a9d63757f2b86821ae618e0c not found: ID does not exist" containerID="e2ee8b8b7f99c67eb799261be72d68ba27b650a3a9d63757f2b86821ae618e0c"
Nov 03 21:46:01.160840 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:01.160741    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2ee8b8b7f99c67eb799261be72d68ba27b650a3a9d63757f2b86821ae618e0c"} err="failed to get container status \"e2ee8b8b7f99c67eb799261be72d68ba27b650a3a9d63757f2b86821ae618e0c\": rpc error: code = NotFound desc = could not find container \"e2ee8b8b7f99c67eb799261be72d68ba27b650a3a9d63757f2b86821ae618e0c\": container with ID starting with e2ee8b8b7f99c67eb799261be72d68ba27b650a3a9d63757f2b86821ae618e0c not found: ID does not exist"
Nov 03 21:46:01.176795 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:01.176767    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c7fb84867-8qnmq"]
Nov 03 21:46:01.183903 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:01.183881    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c7fb84867-8qnmq"]
Nov 03 21:46:02.739466 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:02.739431    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d5ba6f27-8258-4ff2-817f-2ef32e8673c3" path="/var/lib/kubelet/pods/d5ba6f27-8258-4ff2-817f-2ef32e8673c3/volumes"
Nov 03 21:46:09.013345 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.013276    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-9b86b7998-kbxzw" podUID="d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" containerName="registry" containerID="cri-o://1d3d4836379b0f6a2cd913545936188412838a79338a9a6602801ab0c10a059f" gracePeriod=30
Nov 03 21:46:09.189340 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.189311    5077 generic.go:356] "Generic (PLEG): container finished" podID="d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" containerID="1d3d4836379b0f6a2cd913545936188412838a79338a9a6602801ab0c10a059f" exitCode=0
Nov 03 21:46:09.189492 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.189375    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9b86b7998-kbxzw" event={"ID":"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03","Type":"ContainerDied","Data":"1d3d4836379b0f6a2cd913545936188412838a79338a9a6602801ab0c10a059f"}
Nov 03 21:46:09.261178 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.261146    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:46:09.352635 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.352594    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-ca-trust-extracted\") pod \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") "
Nov 03 21:46:09.352838 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.352653    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls\") pod \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") "
Nov 03 21:46:09.352838 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.352689    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-certificates\") pod \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") "
Nov 03 21:46:09.352838 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.352739    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-installation-pull-secrets\") pod \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") "
Nov 03 21:46:09.352838 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.352782    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-kube-api-access-85njj\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-kube-api-access-85njj\") pod \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") "
Nov 03 21:46:09.352838 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.352825    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-bound-sa-token\") pod \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") "
Nov 03 21:46:09.353090 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.352856    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-trusted-ca\") pod \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") "
Nov 03 21:46:09.353090 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.352913    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-image-registry-private-configuration\") pod \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\" (UID: \"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03\") "
Nov 03 21:46:09.353603 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.353307    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-certificates" pod "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" (UID: "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:46:09.353603 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.353390    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-trusted-ca" pod "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" (UID: "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:46:09.353603 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.353408    5077 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-certificates\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:09.355504 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.355469    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-installation-pull-secrets" pod "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" (UID: "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:46:09.355812 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.355780    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-bound-sa-token" pod "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" (UID: "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:46:09.355924 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.355909    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls" pod "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" (UID: "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:46:09.355990 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.355921    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-kube-api-access-85njj" pod "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" (UID: "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03"). InnerVolumeSpecName "kube-api-access-85njj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:46:09.355990 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.355931    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-image-registry-private-configuration" pod "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" (UID: "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:46:09.359853 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.359828    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-ca-trust-extracted" pod "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" (UID: "d21190d3-0ed6-4c4e-a71f-ca14d48ffd03"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:46:09.454054 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.454003    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85njj\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-kube-api-access-85njj\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:09.454054 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.454047    5077 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-bound-sa-token\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:09.454054 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.454057    5077 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-trusted-ca\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:09.454054 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.454067    5077 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-image-registry-private-configuration\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:09.454054 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.454075    5077 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-ca-trust-extracted\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:09.454399 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.454084    5077 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-registry-tls\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:09.454399 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:09.454092    5077 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03-installation-pull-secrets\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:10.194390 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:10.194357    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b86b7998-kbxzw"
Nov 03 21:46:10.194390 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:10.194381    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9b86b7998-kbxzw" event={"ID":"d21190d3-0ed6-4c4e-a71f-ca14d48ffd03","Type":"ContainerDied","Data":"01a3a25b343e99dbf3192305c99dbcaf256b99ddf933829c2d368ed78a392655"}
Nov 03 21:46:10.194889 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:10.194439    5077 scope.go:122] "RemoveContainer" containerID="1d3d4836379b0f6a2cd913545936188412838a79338a9a6602801ab0c10a059f"
Nov 03 21:46:10.216182 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:10.216118    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9b86b7998-kbxzw"]
Nov 03 21:46:10.222871 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:10.222839    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9b86b7998-kbxzw"]
Nov 03 21:46:10.733374 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:10.733339    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" path="/var/lib/kubelet/pods/d21190d3-0ed6-4c4e-a71f-ca14d48ffd03/volumes"
Nov 03 21:46:11.201168 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:11.201138    5077 generic.go:356] "Generic (PLEG): container finished" podID="b3a526c1-84f8-41a0-8dee-0ed08bddc5da" containerID="49a999ac0543cf8fc6b63957de908b7708916e43b205c20e91c756c3d61e3f0e" exitCode=0
Nov 03 21:46:11.201598 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:11.201207    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng" event={"ID":"b3a526c1-84f8-41a0-8dee-0ed08bddc5da","Type":"ContainerDied","Data":"49a999ac0543cf8fc6b63957de908b7708916e43b205c20e91c756c3d61e3f0e"}
Nov 03 21:46:11.201598 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:11.201542    5077 scope.go:122] "RemoveContainer" containerID="49a999ac0543cf8fc6b63957de908b7708916e43b205c20e91c756c3d61e3f0e"
Nov 03 21:46:12.206969 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:12.206933    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-xzhng" event={"ID":"b3a526c1-84f8-41a0-8dee-0ed08bddc5da","Type":"ContainerStarted","Data":"81a3822a2d67c349f018979caf16fbbd0fd6c51f8e0a36ba07f68c3cf4f86f52"}
Nov 03 21:46:28.564433 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:28.564398    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85b86444db-n45x2"]
Nov 03 21:46:29.932308 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:46:29.932232    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:46:31.292298 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:31.292194    5077 generic.go:356] "Generic (PLEG): container finished" podID="3a3d055a-397e-436d-99bd-e82541b4ce57" containerID="df98ff904c0356cd80467011b427f830706415d9a6bc46b44911393076515690" exitCode=0
Nov 03 21:46:31.292298 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:31.292279    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-kmt8d" event={"ID":"3a3d055a-397e-436d-99bd-e82541b4ce57","Type":"ContainerDied","Data":"df98ff904c0356cd80467011b427f830706415d9a6bc46b44911393076515690"}
Nov 03 21:46:31.292759 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:31.292336    5077 scope.go:122] "RemoveContainer" containerID="10ecca4335ff24d76e5ecc904d3a9c026d96f33a80e319444e02944e61e13bcd"
Nov 03 21:46:31.292759 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:31.292642    5077 scope.go:122] "RemoveContainer" containerID="df98ff904c0356cd80467011b427f830706415d9a6bc46b44911393076515690"
Nov 03 21:46:31.292905 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:46:31.292885    5077 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"insights-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=insights-operator pod=insights-operator-7c4986d449-kmt8d_openshift-insights(3a3d055a-397e-436d-99bd-e82541b4ce57)\"" pod="openshift-insights/insights-operator-7c4986d449-kmt8d" podUID="3a3d055a-397e-436d-99bd-e82541b4ce57"
Nov 03 21:46:36.314564 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:36.314528    5077 generic.go:356] "Generic (PLEG): container finished" podID="6c07fa44-702c-4e55-afe3-451696e76f82" containerID="d8ae56b5044a5a1006dadf9c3d1828cdf514fc58b80de4f4351a58325d079e25" exitCode=0
Nov 03 21:46:36.314988 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:36.314591    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg" event={"ID":"6c07fa44-702c-4e55-afe3-451696e76f82","Type":"ContainerDied","Data":"d8ae56b5044a5a1006dadf9c3d1828cdf514fc58b80de4f4351a58325d079e25"}
Nov 03 21:46:36.314988 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:36.314894    5077 scope.go:122] "RemoveContainer" containerID="d8ae56b5044a5a1006dadf9c3d1828cdf514fc58b80de4f4351a58325d079e25"
Nov 03 21:46:37.320542 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:37.320508    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-nrwcg" event={"ID":"6c07fa44-702c-4e55-afe3-451696e76f82","Type":"ContainerStarted","Data":"ba71c8101a95efa4728ff95e3739b7a48d2f7ff45bf7f01affdb729f8e94230a"}
Nov 03 21:46:43.728909 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:43.728879    5077 scope.go:122] "RemoveContainer" containerID="df98ff904c0356cd80467011b427f830706415d9a6bc46b44911393076515690"
Nov 03 21:46:44.041484 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.041399    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-tzp9l-5l52b"]
Nov 03 21:46:44.041647 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.041565    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-tzp9l-5l52b" podUID="02f3529a-929e-490f-91ec-2c2d232b8e48" containerName="insights-gathering" containerID="cri-o://49690cefcd326a5321b23624d1218afaa72a327b7935616016f0cd2dacc79cb8" gracePeriod=30
Nov 03 21:46:44.293714 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.293652    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-tzp9l-5l52b"
Nov 03 21:46:44.352584 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.352543    5077 generic.go:356] "Generic (PLEG): container finished" podID="02f3529a-929e-490f-91ec-2c2d232b8e48" containerID="49690cefcd326a5321b23624d1218afaa72a327b7935616016f0cd2dacc79cb8" exitCode=2
Nov 03 21:46:44.352777 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.352591    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-tzp9l-5l52b"
Nov 03 21:46:44.352777 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.352591    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-tzp9l-5l52b" event={"ID":"02f3529a-929e-490f-91ec-2c2d232b8e48","Type":"ContainerDied","Data":"49690cefcd326a5321b23624d1218afaa72a327b7935616016f0cd2dacc79cb8"}
Nov 03 21:46:44.352777 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.352672    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-tzp9l-5l52b" event={"ID":"02f3529a-929e-490f-91ec-2c2d232b8e48","Type":"ContainerDied","Data":"b3e30dff3276005119ab85c81ac804a4275fe974218a860db66fda0d18fac4c8"}
Nov 03 21:46:44.352777 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.352699    5077 scope.go:122] "RemoveContainer" containerID="49690cefcd326a5321b23624d1218afaa72a327b7935616016f0cd2dacc79cb8"
Nov 03 21:46:44.354645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.354623    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-kmt8d" event={"ID":"3a3d055a-397e-436d-99bd-e82541b4ce57","Type":"ContainerStarted","Data":"ddda315ba2b7da33f040df023b88d4ba4dd66d0361d8007bf45dab144029d6c1"}
Nov 03 21:46:44.361377 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.361336    5077 scope.go:122] "RemoveContainer" containerID="49690cefcd326a5321b23624d1218afaa72a327b7935616016f0cd2dacc79cb8"
Nov 03 21:46:44.361621 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:46:44.361604    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49690cefcd326a5321b23624d1218afaa72a327b7935616016f0cd2dacc79cb8\": container with ID starting with 49690cefcd326a5321b23624d1218afaa72a327b7935616016f0cd2dacc79cb8 not found: ID does not exist" containerID="49690cefcd326a5321b23624d1218afaa72a327b7935616016f0cd2dacc79cb8"
Nov 03 21:46:44.361666 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.361632    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49690cefcd326a5321b23624d1218afaa72a327b7935616016f0cd2dacc79cb8"} err="failed to get container status \"49690cefcd326a5321b23624d1218afaa72a327b7935616016f0cd2dacc79cb8\": rpc error: code = NotFound desc = could not find container \"49690cefcd326a5321b23624d1218afaa72a327b7935616016f0cd2dacc79cb8\": container with ID starting with 49690cefcd326a5321b23624d1218afaa72a327b7935616016f0cd2dacc79cb8 not found: ID does not exist"
Nov 03 21:46:44.473259 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.473215    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/02f3529a-929e-490f-91ec-2c2d232b8e48-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02f3529a-929e-490f-91ec-2c2d232b8e48-service-ca-bundle\") pod \"02f3529a-929e-490f-91ec-2c2d232b8e48\" (UID: \"02f3529a-929e-490f-91ec-2c2d232b8e48\") "
Nov 03 21:46:44.473448 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.473342    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/02f3529a-929e-490f-91ec-2c2d232b8e48-kube-api-access-hpxkj\" (UniqueName: \"kubernetes.io/projected/02f3529a-929e-490f-91ec-2c2d232b8e48-kube-api-access-hpxkj\") pod \"02f3529a-929e-490f-91ec-2c2d232b8e48\" (UID: \"02f3529a-929e-490f-91ec-2c2d232b8e48\") "
Nov 03 21:46:44.473448 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.473381    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/02f3529a-929e-490f-91ec-2c2d232b8e48-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02f3529a-929e-490f-91ec-2c2d232b8e48-trusted-ca-bundle\") pod \"02f3529a-929e-490f-91ec-2c2d232b8e48\" (UID: \"02f3529a-929e-490f-91ec-2c2d232b8e48\") "
Nov 03 21:46:44.473448 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.473413    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/02f3529a-929e-490f-91ec-2c2d232b8e48-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/02f3529a-929e-490f-91ec-2c2d232b8e48-archives-path\") pod \"02f3529a-929e-490f-91ec-2c2d232b8e48\" (UID: \"02f3529a-929e-490f-91ec-2c2d232b8e48\") "
Nov 03 21:46:44.473845 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.473758    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02f3529a-929e-490f-91ec-2c2d232b8e48-service-ca-bundle" pod "02f3529a-929e-490f-91ec-2c2d232b8e48" (UID: "02f3529a-929e-490f-91ec-2c2d232b8e48"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:46:44.473845 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.473769    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02f3529a-929e-490f-91ec-2c2d232b8e48-trusted-ca-bundle" pod "02f3529a-929e-490f-91ec-2c2d232b8e48" (UID: "02f3529a-929e-490f-91ec-2c2d232b8e48"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:46:44.473845 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.473768    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02f3529a-929e-490f-91ec-2c2d232b8e48-archives-path" pod "02f3529a-929e-490f-91ec-2c2d232b8e48" (UID: "02f3529a-929e-490f-91ec-2c2d232b8e48"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:46:44.475717 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.475699    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02f3529a-929e-490f-91ec-2c2d232b8e48-kube-api-access-hpxkj" pod "02f3529a-929e-490f-91ec-2c2d232b8e48" (UID: "02f3529a-929e-490f-91ec-2c2d232b8e48"). InnerVolumeSpecName "kube-api-access-hpxkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:46:44.574989 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.574961    5077 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02f3529a-929e-490f-91ec-2c2d232b8e48-trusted-ca-bundle\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:44.574989 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.574988    5077 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/02f3529a-929e-490f-91ec-2c2d232b8e48-archives-path\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:44.575184 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.574998    5077 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02f3529a-929e-490f-91ec-2c2d232b8e48-service-ca-bundle\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:44.575184 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.575007    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpxkj\" (UniqueName: \"kubernetes.io/projected/02f3529a-929e-490f-91ec-2c2d232b8e48-kube-api-access-hpxkj\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:44.674579 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.674545    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-tzp9l-5l52b"]
Nov 03 21:46:44.678503 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.678475    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-tzp9l-5l52b"]
Nov 03 21:46:44.734278 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:44.734222    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="02f3529a-929e-490f-91ec-2c2d232b8e48" path="/var/lib/kubelet/pods/02f3529a-929e-490f-91ec-2c2d232b8e48/volumes"
Nov 03 21:46:53.590806 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:53.590730    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-85b86444db-n45x2" podUID="11f56b3b-d1a2-41c6-94e3-559217afa2bc" containerName="console" containerID="cri-o://e96cd5699185d8f1ffa9cc4c4f39c71abf84b14bd6b2b955cad744361ca0a786" gracePeriod=15
Nov 03 21:46:53.839134 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:53.839113    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:46:53.848508 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:53.848445    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11f56b3b-d1a2-41c6-94e3-559217afa2bc-kube-api-access-z5tl4\" (UniqueName: \"kubernetes.io/projected/11f56b3b-d1a2-41c6-94e3-559217afa2bc-kube-api-access-z5tl4\") pod \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") "
Nov 03 21:46:53.848508 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:53.848484    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-oauth-serving-cert\") pod \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") "
Nov 03 21:46:53.848878 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:53.848854    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-oauth-serving-cert" pod "11f56b3b-d1a2-41c6-94e3-559217afa2bc" (UID: "11f56b3b-d1a2-41c6-94e3-559217afa2bc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:46:53.850651 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:53.850629    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11f56b3b-d1a2-41c6-94e3-559217afa2bc-kube-api-access-z5tl4" pod "11f56b3b-d1a2-41c6-94e3-559217afa2bc" (UID: "11f56b3b-d1a2-41c6-94e3-559217afa2bc"). InnerVolumeSpecName "kube-api-access-z5tl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:46:53.948998 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:53.948971    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-oauth-config\") pod \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") "
Nov 03 21:46:53.949240 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:53.949008    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11f56b3b-d1a2-41c6-94e3-559217afa2bc-tmp\" (UniqueName: \"kubernetes.io/empty-dir/11f56b3b-d1a2-41c6-94e3-559217afa2bc-tmp\") pod \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") "
Nov 03 21:46:53.949240 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:53.949027    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-serving-cert\") pod \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") "
Nov 03 21:46:53.949240 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:53.949085    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-service-ca\" (UniqueName: \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-service-ca\") pod \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") "
Nov 03 21:46:53.949240 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:53.949114    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-trusted-ca-bundle\") pod \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") "
Nov 03 21:46:53.949240 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:53.949131    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-config\" (UniqueName: \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-config\") pod \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\" (UID: \"11f56b3b-d1a2-41c6-94e3-559217afa2bc\") "
Nov 03 21:46:53.949525 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:53.949311    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5tl4\" (UniqueName: \"kubernetes.io/projected/11f56b3b-d1a2-41c6-94e3-559217afa2bc-kube-api-access-z5tl4\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:53.949525 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:53.949330    5077 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-oauth-serving-cert\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:53.949525 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:53.949324    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11f56b3b-d1a2-41c6-94e3-559217afa2bc-tmp" pod "11f56b3b-d1a2-41c6-94e3-559217afa2bc" (UID: "11f56b3b-d1a2-41c6-94e3-559217afa2bc"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:46:53.949525 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:53.949507    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-service-ca" pod "11f56b3b-d1a2-41c6-94e3-559217afa2bc" (UID: "11f56b3b-d1a2-41c6-94e3-559217afa2bc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:46:53.949661 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:53.949559    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-trusted-ca-bundle" pod "11f56b3b-d1a2-41c6-94e3-559217afa2bc" (UID: "11f56b3b-d1a2-41c6-94e3-559217afa2bc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:46:53.949661 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:53.949623    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-config" pod "11f56b3b-d1a2-41c6-94e3-559217afa2bc" (UID: "11f56b3b-d1a2-41c6-94e3-559217afa2bc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:46:53.951390 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:53.951365    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-oauth-config" pod "11f56b3b-d1a2-41c6-94e3-559217afa2bc" (UID: "11f56b3b-d1a2-41c6-94e3-559217afa2bc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:46:53.951504 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:53.951448    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-serving-cert" pod "11f56b3b-d1a2-41c6-94e3-559217afa2bc" (UID: "11f56b3b-d1a2-41c6-94e3-559217afa2bc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:46:54.050501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:54.050466    5077 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-trusted-ca-bundle\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:54.050501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:54.050494    5077 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-config\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:54.050501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:54.050505    5077 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-oauth-config\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:54.050501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:54.050514    5077 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11f56b3b-d1a2-41c6-94e3-559217afa2bc-tmp\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:54.050773 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:54.050525    5077 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11f56b3b-d1a2-41c6-94e3-559217afa2bc-console-serving-cert\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:54.050773 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:54.050536    5077 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11f56b3b-d1a2-41c6-94e3-559217afa2bc-service-ca\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:46:54.397565 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:54.397529    5077 generic.go:356] "Generic (PLEG): container finished" podID="11f56b3b-d1a2-41c6-94e3-559217afa2bc" containerID="e96cd5699185d8f1ffa9cc4c4f39c71abf84b14bd6b2b955cad744361ca0a786" exitCode=0
Nov 03 21:46:54.397742 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:54.397580    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b86444db-n45x2"
Nov 03 21:46:54.397742 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:54.397618    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b86444db-n45x2" event={"ID":"11f56b3b-d1a2-41c6-94e3-559217afa2bc","Type":"ContainerDied","Data":"e96cd5699185d8f1ffa9cc4c4f39c71abf84b14bd6b2b955cad744361ca0a786"}
Nov 03 21:46:54.397742 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:54.397671    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b86444db-n45x2" event={"ID":"11f56b3b-d1a2-41c6-94e3-559217afa2bc","Type":"ContainerDied","Data":"f90354d0c785b35111f652f734a664b52234a144002cbd253f30a8ca66276b80"}
Nov 03 21:46:54.397742 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:54.397699    5077 scope.go:122] "RemoveContainer" containerID="e96cd5699185d8f1ffa9cc4c4f39c71abf84b14bd6b2b955cad744361ca0a786"
Nov 03 21:46:54.406708 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:54.406691    5077 scope.go:122] "RemoveContainer" containerID="e96cd5699185d8f1ffa9cc4c4f39c71abf84b14bd6b2b955cad744361ca0a786"
Nov 03 21:46:54.406987 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:46:54.406969    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e96cd5699185d8f1ffa9cc4c4f39c71abf84b14bd6b2b955cad744361ca0a786\": container with ID starting with e96cd5699185d8f1ffa9cc4c4f39c71abf84b14bd6b2b955cad744361ca0a786 not found: ID does not exist" containerID="e96cd5699185d8f1ffa9cc4c4f39c71abf84b14bd6b2b955cad744361ca0a786"
Nov 03 21:46:54.407038 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:54.406996    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e96cd5699185d8f1ffa9cc4c4f39c71abf84b14bd6b2b955cad744361ca0a786"} err="failed to get container status \"e96cd5699185d8f1ffa9cc4c4f39c71abf84b14bd6b2b955cad744361ca0a786\": rpc error: code = NotFound desc = could not find container \"e96cd5699185d8f1ffa9cc4c4f39c71abf84b14bd6b2b955cad744361ca0a786\": container with ID starting with e96cd5699185d8f1ffa9cc4c4f39c71abf84b14bd6b2b955cad744361ca0a786 not found: ID does not exist"
Nov 03 21:46:54.419522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:54.419501    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85b86444db-n45x2"]
Nov 03 21:46:54.423453 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:54.423435    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85b86444db-n45x2"]
Nov 03 21:46:54.733937 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:46:54.733861    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="11f56b3b-d1a2-41c6-94e3-559217afa2bc" path="/var/lib/kubelet/pods/11f56b3b-d1a2-41c6-94e3-559217afa2bc/volumes"
Nov 03 21:46:59.925909 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:46:59.925872    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:47:29.929638 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:47:29.929547    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:47:59.923608 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:47:59.923569    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:48:29.927569 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:48:29.927527    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:48:59.924510 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:48:59.924424    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:49:29.924630 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:49:29.924589    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:49:54.855740 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.855708    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"]
Nov 03 21:49:54.856143 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.856034    5077 cpu_manager.go:414] "containerMap: removing container" podUID="abb8c77f-1d9a-4a7d-adde-ff0b851395ed" containerName="insights-gathering"
Nov 03 21:49:54.856143 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.856044    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="abb8c77f-1d9a-4a7d-adde-ff0b851395ed" containerName="insights-gathering"
Nov 03 21:49:54.856143 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.856061    5077 cpu_manager.go:414] "containerMap: removing container" podUID="02f3529a-929e-490f-91ec-2c2d232b8e48" containerName="insights-gathering"
Nov 03 21:49:54.856143 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.856068    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="02f3529a-929e-490f-91ec-2c2d232b8e48" containerName="insights-gathering"
Nov 03 21:49:54.856143 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.856079    5077 cpu_manager.go:414] "containerMap: removing container" podUID="11f56b3b-d1a2-41c6-94e3-559217afa2bc" containerName="console"
Nov 03 21:49:54.856143 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.856084    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11f56b3b-d1a2-41c6-94e3-559217afa2bc" containerName="console"
Nov 03 21:49:54.856143 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.856098    5077 cpu_manager.go:414] "containerMap: removing container" podUID="588bc17e-1307-4055-96a4-cbd60ba48541" containerName="registry"
Nov 03 21:49:54.856143 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.856103    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="588bc17e-1307-4055-96a4-cbd60ba48541" containerName="registry"
Nov 03 21:49:54.856143 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.856112    5077 cpu_manager.go:414] "containerMap: removing container" podUID="d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" containerName="registry"
Nov 03 21:49:54.856143 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.856116    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" containerName="registry"
Nov 03 21:49:54.856143 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.856129    5077 cpu_manager.go:414] "containerMap: removing container" podUID="d5ba6f27-8258-4ff2-817f-2ef32e8673c3" containerName="console"
Nov 03 21:49:54.856143 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.856133    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d5ba6f27-8258-4ff2-817f-2ef32e8673c3" containerName="console"
Nov 03 21:49:54.856579 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.856199    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="d5ba6f27-8258-4ff2-817f-2ef32e8673c3" containerName="console"
Nov 03 21:49:54.856579 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.856207    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="abb8c77f-1d9a-4a7d-adde-ff0b851395ed" containerName="insights-gathering"
Nov 03 21:49:54.856579 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.856214    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="02f3529a-929e-490f-91ec-2c2d232b8e48" containerName="insights-gathering"
Nov 03 21:49:54.856579 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.856219    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="11f56b3b-d1a2-41c6-94e3-559217afa2bc" containerName="console"
Nov 03 21:49:54.856579 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.856225    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="588bc17e-1307-4055-96a4-cbd60ba48541" containerName="registry"
Nov 03 21:49:54.856579 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.856231    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="d21190d3-0ed6-4c4e-a71f-ca14d48ffd03" containerName="registry"
Nov 03 21:49:54.859255 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.859233    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:49:54.887502 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.887470    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"]
Nov 03 21:49:54.921387 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.921361    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Nov 03 21:49:54.921571 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.921412    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Nov 03 21:49:54.928713 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.928679    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Nov 03 21:49:54.928901 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.928882    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Nov 03 21:49:54.928977 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.928918    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-c5jhj\""
Nov 03 21:49:54.928977 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.928951    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-metrics-tls\""
Nov 03 21:49:54.943708 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.943675    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca796c19-6509-4ead-93b3-c5b55f2702cb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77f6458f94-sj6tx\" (UID: \"ca796c19-6509-4ead-93b3-c5b55f2702cb\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:49:54.943708 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.943706    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca796c19-6509-4ead-93b3-c5b55f2702cb-webhook-cert\") pod \"opendatahub-operator-controller-manager-77f6458f94-sj6tx\" (UID: \"ca796c19-6509-4ead-93b3-c5b55f2702cb\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:49:54.943905 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.943731    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9vkt\" (UniqueName: \"kubernetes.io/projected/ca796c19-6509-4ead-93b3-c5b55f2702cb-kube-api-access-s9vkt\") pod \"opendatahub-operator-controller-manager-77f6458f94-sj6tx\" (UID: \"ca796c19-6509-4ead-93b3-c5b55f2702cb\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:49:54.943905 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.943876    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca796c19-6509-4ead-93b3-c5b55f2702cb-tmp\") pod \"opendatahub-operator-controller-manager-77f6458f94-sj6tx\" (UID: \"ca796c19-6509-4ead-93b3-c5b55f2702cb\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:49:54.943987 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.943904    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca796c19-6509-4ead-93b3-c5b55f2702cb-metrics-cert\") pod \"opendatahub-operator-controller-manager-77f6458f94-sj6tx\" (UID: \"ca796c19-6509-4ead-93b3-c5b55f2702cb\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:49:54.943987 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:54.943930    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca796c19-6509-4ead-93b3-c5b55f2702cb-manifests\") pod \"opendatahub-operator-controller-manager-77f6458f94-sj6tx\" (UID: \"ca796c19-6509-4ead-93b3-c5b55f2702cb\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:49:55.044381 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:55.044343    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca796c19-6509-4ead-93b3-c5b55f2702cb-tmp\") pod \"opendatahub-operator-controller-manager-77f6458f94-sj6tx\" (UID: \"ca796c19-6509-4ead-93b3-c5b55f2702cb\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:49:55.044381 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:55.044382    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca796c19-6509-4ead-93b3-c5b55f2702cb-metrics-cert\") pod \"opendatahub-operator-controller-manager-77f6458f94-sj6tx\" (UID: \"ca796c19-6509-4ead-93b3-c5b55f2702cb\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:49:55.044619 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:55.044404    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca796c19-6509-4ead-93b3-c5b55f2702cb-manifests\") pod \"opendatahub-operator-controller-manager-77f6458f94-sj6tx\" (UID: \"ca796c19-6509-4ead-93b3-c5b55f2702cb\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:49:55.044619 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:55.044437    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca796c19-6509-4ead-93b3-c5b55f2702cb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77f6458f94-sj6tx\" (UID: \"ca796c19-6509-4ead-93b3-c5b55f2702cb\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:49:55.044619 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:55.044461    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca796c19-6509-4ead-93b3-c5b55f2702cb-webhook-cert\") pod \"opendatahub-operator-controller-manager-77f6458f94-sj6tx\" (UID: \"ca796c19-6509-4ead-93b3-c5b55f2702cb\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:49:55.044619 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:55.044496    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9vkt\" (UniqueName: \"kubernetes.io/projected/ca796c19-6509-4ead-93b3-c5b55f2702cb-kube-api-access-s9vkt\") pod \"opendatahub-operator-controller-manager-77f6458f94-sj6tx\" (UID: \"ca796c19-6509-4ead-93b3-c5b55f2702cb\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:49:55.044901 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:55.044874    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca796c19-6509-4ead-93b3-c5b55f2702cb-manifests\") pod \"opendatahub-operator-controller-manager-77f6458f94-sj6tx\" (UID: \"ca796c19-6509-4ead-93b3-c5b55f2702cb\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:49:55.046901 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:55.046869    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca796c19-6509-4ead-93b3-c5b55f2702cb-tmp\") pod \"opendatahub-operator-controller-manager-77f6458f94-sj6tx\" (UID: \"ca796c19-6509-4ead-93b3-c5b55f2702cb\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:49:55.047131 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:55.047110    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca796c19-6509-4ead-93b3-c5b55f2702cb-metrics-cert\") pod \"opendatahub-operator-controller-manager-77f6458f94-sj6tx\" (UID: \"ca796c19-6509-4ead-93b3-c5b55f2702cb\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:49:55.047239 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:55.047218    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca796c19-6509-4ead-93b3-c5b55f2702cb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77f6458f94-sj6tx\" (UID: \"ca796c19-6509-4ead-93b3-c5b55f2702cb\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:49:55.047314 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:55.047218    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca796c19-6509-4ead-93b3-c5b55f2702cb-webhook-cert\") pod \"opendatahub-operator-controller-manager-77f6458f94-sj6tx\" (UID: \"ca796c19-6509-4ead-93b3-c5b55f2702cb\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:49:55.059576 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:55.059554    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9vkt\" (UniqueName: \"kubernetes.io/projected/ca796c19-6509-4ead-93b3-c5b55f2702cb-kube-api-access-s9vkt\") pod \"opendatahub-operator-controller-manager-77f6458f94-sj6tx\" (UID: \"ca796c19-6509-4ead-93b3-c5b55f2702cb\") " pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:49:55.174067 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:55.173976    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:49:55.475942 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:55.475867    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"]
Nov 03 21:49:55.479188 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:49:55.479161    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca796c19_6509_4ead_93b3_c5b55f2702cb.slice/crio-94288a0a9f3c206c96fee693d87a2e29f57fa5cb8e0e4a1da2ba5deb5ea303b3 WatchSource:0}: Error finding container 94288a0a9f3c206c96fee693d87a2e29f57fa5cb8e0e4a1da2ba5deb5ea303b3: Status 404 returned error can't find the container with id 94288a0a9f3c206c96fee693d87a2e29f57fa5cb8e0e4a1da2ba5deb5ea303b3
Nov 03 21:49:56.130744 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:56.130698    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx" event={"ID":"ca796c19-6509-4ead-93b3-c5b55f2702cb","Type":"ContainerStarted","Data":"94288a0a9f3c206c96fee693d87a2e29f57fa5cb8e0e4a1da2ba5deb5ea303b3"}
Nov 03 21:49:59.146347 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:59.146307    5077 generic.go:356] "Generic (PLEG): container finished" podID="ca796c19-6509-4ead-93b3-c5b55f2702cb" containerID="ecd225de4ab364b54936123c0f79464911f8986e2a46cc1444fa871d18161159" exitCode=0
Nov 03 21:49:59.146807 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:49:59.146394    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx" event={"ID":"ca796c19-6509-4ead-93b3-c5b55f2702cb","Type":"ContainerDied","Data":"ecd225de4ab364b54936123c0f79464911f8986e2a46cc1444fa871d18161159"}
Nov 03 21:49:59.927082 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:49:59.926985    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:50:00.152199 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:00.152163    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx" event={"ID":"ca796c19-6509-4ead-93b3-c5b55f2702cb","Type":"ContainerStarted","Data":"e13e2c1001b23dc77c899d0e3f7bfe4107ce7416bd7bd1a3fc3f5784f954e087"}
Nov 03 21:50:00.152606 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:00.152424    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:50:00.201912 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:00.201792    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx" podStartSLOduration=2.2676758 podStartE2EDuration="6.201776198s" totalImagesPullingTime="3.432468188s" totalInitContainerRuntime="501.63221ms" isStatefulPod=false podCreationTimestamp="2026-11-03 21:49:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:50:00.199720433 +0000 UTC m=+293.603381863" watchObservedRunningTime="2026-11-03 21:50:00.201776198 +0000 UTC m=+293.605437626"
Nov 03 21:50:06.754455 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:06.754425    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pspgs_36598f65-5a1d-43e3-acc2-71c1e56f112c/console-operator/1.log"
Nov 03 21:50:06.756296 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:06.756274    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pspgs_36598f65-5a1d-43e3-acc2-71c1e56f112c/console-operator/1.log"
Nov 03 21:50:11.160565 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:11.160532    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77f6458f94-sj6tx"
Nov 03 21:50:15.672080 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:15.672047    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65998dd86f-s5ch5"]
Nov 03 21:50:15.683101 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:15.683077    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65998dd86f-s5ch5"
Nov 03 21:50:15.698273 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:15.698225    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65998dd86f-s5ch5"]
Nov 03 21:50:15.718171 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:15.718145    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Nov 03 21:50:15.718372 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:15.718238    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Nov 03 21:50:15.718441 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:15.718313    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8z4qx\""
Nov 03 21:50:15.825315 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:15.825284    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df967c38-9228-48fb-8aed-90749175ab1c-tmp\") pod \"kube-auth-proxy-65998dd86f-s5ch5\" (UID: \"df967c38-9228-48fb-8aed-90749175ab1c\") " pod="openshift-ingress/kube-auth-proxy-65998dd86f-s5ch5"
Nov 03 21:50:15.825505 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:15.825327    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df967c38-9228-48fb-8aed-90749175ab1c-tls-certs\") pod \"kube-auth-proxy-65998dd86f-s5ch5\" (UID: \"df967c38-9228-48fb-8aed-90749175ab1c\") " pod="openshift-ingress/kube-auth-proxy-65998dd86f-s5ch5"
Nov 03 21:50:15.825505 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:15.825351    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww78s\" (UniqueName: \"kubernetes.io/projected/df967c38-9228-48fb-8aed-90749175ab1c-kube-api-access-ww78s\") pod \"kube-auth-proxy-65998dd86f-s5ch5\" (UID: \"df967c38-9228-48fb-8aed-90749175ab1c\") " pod="openshift-ingress/kube-auth-proxy-65998dd86f-s5ch5"
Nov 03 21:50:15.926285 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:15.926188    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df967c38-9228-48fb-8aed-90749175ab1c-tmp\") pod \"kube-auth-proxy-65998dd86f-s5ch5\" (UID: \"df967c38-9228-48fb-8aed-90749175ab1c\") " pod="openshift-ingress/kube-auth-proxy-65998dd86f-s5ch5"
Nov 03 21:50:15.926285 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:15.926233    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df967c38-9228-48fb-8aed-90749175ab1c-tls-certs\") pod \"kube-auth-proxy-65998dd86f-s5ch5\" (UID: \"df967c38-9228-48fb-8aed-90749175ab1c\") " pod="openshift-ingress/kube-auth-proxy-65998dd86f-s5ch5"
Nov 03 21:50:15.926285 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:15.926281    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww78s\" (UniqueName: \"kubernetes.io/projected/df967c38-9228-48fb-8aed-90749175ab1c-kube-api-access-ww78s\") pod \"kube-auth-proxy-65998dd86f-s5ch5\" (UID: \"df967c38-9228-48fb-8aed-90749175ab1c\") " pod="openshift-ingress/kube-auth-proxy-65998dd86f-s5ch5"
Nov 03 21:50:15.928918 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:15.928885    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df967c38-9228-48fb-8aed-90749175ab1c-tmp\") pod \"kube-auth-proxy-65998dd86f-s5ch5\" (UID: \"df967c38-9228-48fb-8aed-90749175ab1c\") " pod="openshift-ingress/kube-auth-proxy-65998dd86f-s5ch5"
Nov 03 21:50:15.929041 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:15.929005    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df967c38-9228-48fb-8aed-90749175ab1c-tls-certs\") pod \"kube-auth-proxy-65998dd86f-s5ch5\" (UID: \"df967c38-9228-48fb-8aed-90749175ab1c\") " pod="openshift-ingress/kube-auth-proxy-65998dd86f-s5ch5"
Nov 03 21:50:15.941318 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:15.941281    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww78s\" (UniqueName: \"kubernetes.io/projected/df967c38-9228-48fb-8aed-90749175ab1c-kube-api-access-ww78s\") pod \"kube-auth-proxy-65998dd86f-s5ch5\" (UID: \"df967c38-9228-48fb-8aed-90749175ab1c\") " pod="openshift-ingress/kube-auth-proxy-65998dd86f-s5ch5"
Nov 03 21:50:16.000262 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:16.000209    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65998dd86f-s5ch5"
Nov 03 21:50:16.276333 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:16.276307    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65998dd86f-s5ch5"]
Nov 03 21:50:16.279133 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:50:16.279103    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf967c38_9228_48fb_8aed_90749175ab1c.slice/crio-bf8dbb0a072bad6e202d0af5ae59a9a172d4f58076e3caf780646d6c22b442f4 WatchSource:0}: Error finding container bf8dbb0a072bad6e202d0af5ae59a9a172d4f58076e3caf780646d6c22b442f4: Status 404 returned error can't find the container with id bf8dbb0a072bad6e202d0af5ae59a9a172d4f58076e3caf780646d6c22b442f4
Nov 03 21:50:16.281494 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:16.281478    5077 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 21:50:17.230688 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:17.230653    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65998dd86f-s5ch5" event={"ID":"df967c38-9228-48fb-8aed-90749175ab1c","Type":"ContainerStarted","Data":"bf8dbb0a072bad6e202d0af5ae59a9a172d4f58076e3caf780646d6c22b442f4"}
Nov 03 21:50:19.240931 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:19.240884    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65998dd86f-s5ch5" event={"ID":"df967c38-9228-48fb-8aed-90749175ab1c","Type":"ContainerStarted","Data":"92ce5bdecace5a8a874d13ade03d953f29ca1a97b1ebed29fd36af666018928f"}
Nov 03 21:50:19.260169 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:19.260066    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65998dd86f-s5ch5" podStartSLOduration=1.824726658 podStartE2EDuration="4.260049497s" totalImagesPullingTime="2.435322839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:50:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:50:19.259677637 +0000 UTC m=+312.663339069" watchObservedRunningTime="2026-11-03 21:50:19.260049497 +0000 UTC m=+312.663710928"
Nov 03 21:50:22.696940 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.696907    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"]
Nov 03 21:50:22.709665 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.709632    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.713293 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.713270    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"]
Nov 03 21:50:22.714914 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.714895    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 03 21:50:22.776398 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.776362    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-ztmvl\""
Nov 03 21:50:22.883460 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.883419    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4193750a-8017-49b3-b520-3b1fa02a68e3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.883637 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.883483    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4193750a-8017-49b3-b520-3b1fa02a68e3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.883637 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.883570    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4193750a-8017-49b3-b520-3b1fa02a68e3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.883637 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.883603    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4193750a-8017-49b3-b520-3b1fa02a68e3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.883637 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.883626    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4193750a-8017-49b3-b520-3b1fa02a68e3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.883774 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.883710    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4193750a-8017-49b3-b520-3b1fa02a68e3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.883774 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.883748    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4193750a-8017-49b3-b520-3b1fa02a68e3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.883853 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.883827    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4193750a-8017-49b3-b520-3b1fa02a68e3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.883887 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.883858    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdcc7\" (UniqueName: \"kubernetes.io/projected/4193750a-8017-49b3-b520-3b1fa02a68e3-kube-api-access-rdcc7\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.985284 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.985194    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4193750a-8017-49b3-b520-3b1fa02a68e3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.985284 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.985238    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4193750a-8017-49b3-b520-3b1fa02a68e3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.985511 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.985288    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4193750a-8017-49b3-b520-3b1fa02a68e3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.985511 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.985399    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4193750a-8017-49b3-b520-3b1fa02a68e3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.985511 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.985460    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4193750a-8017-49b3-b520-3b1fa02a68e3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.985511 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.985504    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdcc7\" (UniqueName: \"kubernetes.io/projected/4193750a-8017-49b3-b520-3b1fa02a68e3-kube-api-access-rdcc7\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.985717 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.985544    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4193750a-8017-49b3-b520-3b1fa02a68e3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.985717 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.985604    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4193750a-8017-49b3-b520-3b1fa02a68e3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.985717 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.985645    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4193750a-8017-49b3-b520-3b1fa02a68e3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.985717 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.985676    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4193750a-8017-49b3-b520-3b1fa02a68e3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.986015 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.985991    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4193750a-8017-49b3-b520-3b1fa02a68e3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.986169 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.986116    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4193750a-8017-49b3-b520-3b1fa02a68e3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.986344 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.986320    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4193750a-8017-49b3-b520-3b1fa02a68e3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.986586 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.986329    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4193750a-8017-49b3-b520-3b1fa02a68e3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.988193 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.988173    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4193750a-8017-49b3-b520-3b1fa02a68e3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.988340 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.988317    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4193750a-8017-49b3-b520-3b1fa02a68e3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.997935 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.997910    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4193750a-8017-49b3-b520-3b1fa02a68e3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:22.998033 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:22.998010    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdcc7\" (UniqueName: \"kubernetes.io/projected/4193750a-8017-49b3-b520-3b1fa02a68e3-kube-api-access-rdcc7\") pod \"data-science-gateway-data-science-gateway-class-8f76c657-jb84k\" (UID: \"4193750a-8017-49b3-b520-3b1fa02a68e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:23.035985 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:23.035950    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:23.320448 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:23.320417    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"]
Nov 03 21:50:23.324460 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:50:23.324435    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4193750a_8017_49b3_b520_3b1fa02a68e3.slice/crio-c726e8d1d02d897c56c2ede3ca59d30ec6070de84ac71141d6eecf09bfbb8bba WatchSource:0}: Error finding container c726e8d1d02d897c56c2ede3ca59d30ec6070de84ac71141d6eecf09bfbb8bba: Status 404 returned error can't find the container with id c726e8d1d02d897c56c2ede3ca59d30ec6070de84ac71141d6eecf09bfbb8bba
Nov 03 21:50:24.263544 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:24.263505    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k" event={"ID":"4193750a-8017-49b3-b520-3b1fa02a68e3","Type":"ContainerStarted","Data":"c726e8d1d02d897c56c2ede3ca59d30ec6070de84ac71141d6eecf09bfbb8bba"}
Nov 03 21:50:26.538658 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:26.538626    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:50:26.538960 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:26.538693    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:50:26.538960 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:26.538723    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:50:27.279066 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:27.279030    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k" event={"ID":"4193750a-8017-49b3-b520-3b1fa02a68e3","Type":"ContainerStarted","Data":"456cad124136a8f28c133cbdff4545a07276c54ad2f037d8c12823dc0542113b"}
Nov 03 21:50:27.302456 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:27.302393    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k" podStartSLOduration=2.091787244 podStartE2EDuration="5.302375018s" totalImagesPullingTime="3.210587774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:50:27.302036607 +0000 UTC m=+320.705698038" watchObservedRunningTime="2026-11-03 21:50:27.302375018 +0000 UTC m=+320.706036448"
Nov 03 21:50:28.036373 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:28.036330    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:28.041355 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:28.041330    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:28.288398 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:28.285602    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:28.289297 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:50:28.289273    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-8f76c657-jb84k"
Nov 03 21:50:29.937837 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:50:29.937788    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:50:59.925497 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:50:59.925457    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:51:13.525059 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.525028    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-2cp8m"]
Nov 03 21:51:13.544907 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.544872    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-2cp8m"]
Nov 03 21:51:13.545060 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.544977    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-2cp8m"
Nov 03 21:51:13.557049 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.557024    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Nov 03 21:51:13.557049 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.557024    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2p2xt\""
Nov 03 21:51:13.563645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.563621    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-58jdx"]
Nov 03 21:51:13.567141 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.567103    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-58jdx"
Nov 03 21:51:13.578372 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.578350    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-58jdx"]
Nov 03 21:51:13.591885 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.591856    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-f87fcf56c-rmbn6"]
Nov 03 21:51:13.595921 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.595900    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-f87fcf56c-rmbn6"
Nov 03 21:51:13.605608 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.604523    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-f87fcf56c-rmbn6"]
Nov 03 21:51:13.635937 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.635912    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/924ab530-dbeb-446a-8069-ad634ab44e49-cert\") pod \"kserve-controller-manager-776cc66d47-2cp8m\" (UID: \"924ab530-dbeb-446a-8069-ad634ab44e49\") " pod="opendatahub/kserve-controller-manager-776cc66d47-2cp8m"
Nov 03 21:51:13.636085 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.635965    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm5tq\" (UniqueName: \"kubernetes.io/projected/924ab530-dbeb-446a-8069-ad634ab44e49-kube-api-access-tm5tq\") pod \"kserve-controller-manager-776cc66d47-2cp8m\" (UID: \"924ab530-dbeb-446a-8069-ad634ab44e49\") " pod="opendatahub/kserve-controller-manager-776cc66d47-2cp8m"
Nov 03 21:51:13.656848 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.656821    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-mc9rq\""
Nov 03 21:51:13.662274 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.657646    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Nov 03 21:51:13.662274 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.657913    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xznsr\""
Nov 03 21:51:13.664546 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.664522    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Nov 03 21:51:13.664672 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.664522    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Nov 03 21:51:13.737028 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.736984    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm5tq\" (UniqueName: \"kubernetes.io/projected/924ab530-dbeb-446a-8069-ad634ab44e49-kube-api-access-tm5tq\") pod \"kserve-controller-manager-776cc66d47-2cp8m\" (UID: \"924ab530-dbeb-446a-8069-ad634ab44e49\") " pod="opendatahub/kserve-controller-manager-776cc66d47-2cp8m"
Nov 03 21:51:13.737215 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.737066    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/924ab530-dbeb-446a-8069-ad634ab44e49-cert\") pod \"kserve-controller-manager-776cc66d47-2cp8m\" (UID: \"924ab530-dbeb-446a-8069-ad634ab44e49\") " pod="opendatahub/kserve-controller-manager-776cc66d47-2cp8m"
Nov 03 21:51:13.737215 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.737103    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvkqw\" (UniqueName: \"kubernetes.io/projected/78e28086-24fc-42d6-ac43-3a5967c67012-kube-api-access-nvkqw\") pod \"odh-model-controller-f87fcf56c-rmbn6\" (UID: \"78e28086-24fc-42d6-ac43-3a5967c67012\") " pod="opendatahub/odh-model-controller-f87fcf56c-rmbn6"
Nov 03 21:51:13.737215 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.737147    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fhxc\" (UniqueName: \"kubernetes.io/projected/51ec143b-216f-4314-8997-8170d60a0804-kube-api-access-8fhxc\") pod \"model-serving-api-75bd89fdfc-58jdx\" (UID: \"51ec143b-216f-4314-8997-8170d60a0804\") " pod="opendatahub/model-serving-api-75bd89fdfc-58jdx"
Nov 03 21:51:13.737215 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.737170    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78e28086-24fc-42d6-ac43-3a5967c67012-cert\") pod \"odh-model-controller-f87fcf56c-rmbn6\" (UID: \"78e28086-24fc-42d6-ac43-3a5967c67012\") " pod="opendatahub/odh-model-controller-f87fcf56c-rmbn6"
Nov 03 21:51:13.737400 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.737326    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51ec143b-216f-4314-8997-8170d60a0804-tls-certs\") pod \"model-serving-api-75bd89fdfc-58jdx\" (UID: \"51ec143b-216f-4314-8997-8170d60a0804\") " pod="opendatahub/model-serving-api-75bd89fdfc-58jdx"
Nov 03 21:51:13.737400 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.737368    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78e28086-24fc-42d6-ac43-3a5967c67012-metrics-certs\") pod \"odh-model-controller-f87fcf56c-rmbn6\" (UID: \"78e28086-24fc-42d6-ac43-3a5967c67012\") " pod="opendatahub/odh-model-controller-f87fcf56c-rmbn6"
Nov 03 21:51:13.739655 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.739630    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/924ab530-dbeb-446a-8069-ad634ab44e49-cert\") pod \"kserve-controller-manager-776cc66d47-2cp8m\" (UID: \"924ab530-dbeb-446a-8069-ad634ab44e49\") " pod="opendatahub/kserve-controller-manager-776cc66d47-2cp8m"
Nov 03 21:51:13.749687 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.749665    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm5tq\" (UniqueName: \"kubernetes.io/projected/924ab530-dbeb-446a-8069-ad634ab44e49-kube-api-access-tm5tq\") pod \"kserve-controller-manager-776cc66d47-2cp8m\" (UID: \"924ab530-dbeb-446a-8069-ad634ab44e49\") " pod="opendatahub/kserve-controller-manager-776cc66d47-2cp8m"
Nov 03 21:51:13.837966 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.837935    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvkqw\" (UniqueName: \"kubernetes.io/projected/78e28086-24fc-42d6-ac43-3a5967c67012-kube-api-access-nvkqw\") pod \"odh-model-controller-f87fcf56c-rmbn6\" (UID: \"78e28086-24fc-42d6-ac43-3a5967c67012\") " pod="opendatahub/odh-model-controller-f87fcf56c-rmbn6"
Nov 03 21:51:13.838171 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.837982    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fhxc\" (UniqueName: \"kubernetes.io/projected/51ec143b-216f-4314-8997-8170d60a0804-kube-api-access-8fhxc\") pod \"model-serving-api-75bd89fdfc-58jdx\" (UID: \"51ec143b-216f-4314-8997-8170d60a0804\") " pod="opendatahub/model-serving-api-75bd89fdfc-58jdx"
Nov 03 21:51:13.838171 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.837999    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78e28086-24fc-42d6-ac43-3a5967c67012-cert\") pod \"odh-model-controller-f87fcf56c-rmbn6\" (UID: \"78e28086-24fc-42d6-ac43-3a5967c67012\") " pod="opendatahub/odh-model-controller-f87fcf56c-rmbn6"
Nov 03 21:51:13.838171 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.838028    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51ec143b-216f-4314-8997-8170d60a0804-tls-certs\") pod \"model-serving-api-75bd89fdfc-58jdx\" (UID: \"51ec143b-216f-4314-8997-8170d60a0804\") " pod="opendatahub/model-serving-api-75bd89fdfc-58jdx"
Nov 03 21:51:13.838171 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.838047    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78e28086-24fc-42d6-ac43-3a5967c67012-metrics-certs\") pod \"odh-model-controller-f87fcf56c-rmbn6\" (UID: \"78e28086-24fc-42d6-ac43-3a5967c67012\") " pod="opendatahub/odh-model-controller-f87fcf56c-rmbn6"
Nov 03 21:51:13.840851 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.840819    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78e28086-24fc-42d6-ac43-3a5967c67012-metrics-certs\") pod \"odh-model-controller-f87fcf56c-rmbn6\" (UID: \"78e28086-24fc-42d6-ac43-3a5967c67012\") " pod="opendatahub/odh-model-controller-f87fcf56c-rmbn6"
Nov 03 21:51:13.840957 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.840819    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78e28086-24fc-42d6-ac43-3a5967c67012-cert\") pod \"odh-model-controller-f87fcf56c-rmbn6\" (UID: \"78e28086-24fc-42d6-ac43-3a5967c67012\") " pod="opendatahub/odh-model-controller-f87fcf56c-rmbn6"
Nov 03 21:51:13.840957 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.840927    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51ec143b-216f-4314-8997-8170d60a0804-tls-certs\") pod \"model-serving-api-75bd89fdfc-58jdx\" (UID: \"51ec143b-216f-4314-8997-8170d60a0804\") " pod="opendatahub/model-serving-api-75bd89fdfc-58jdx"
Nov 03 21:51:13.850204 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.850180    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fhxc\" (UniqueName: \"kubernetes.io/projected/51ec143b-216f-4314-8997-8170d60a0804-kube-api-access-8fhxc\") pod \"model-serving-api-75bd89fdfc-58jdx\" (UID: \"51ec143b-216f-4314-8997-8170d60a0804\") " pod="opendatahub/model-serving-api-75bd89fdfc-58jdx"
Nov 03 21:51:13.850350 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.850329    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvkqw\" (UniqueName: \"kubernetes.io/projected/78e28086-24fc-42d6-ac43-3a5967c67012-kube-api-access-nvkqw\") pod \"odh-model-controller-f87fcf56c-rmbn6\" (UID: \"78e28086-24fc-42d6-ac43-3a5967c67012\") " pod="opendatahub/odh-model-controller-f87fcf56c-rmbn6"
Nov 03 21:51:13.859162 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.859144    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-2cp8m"
Nov 03 21:51:13.882301 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.882276    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-58jdx"
Nov 03 21:51:13.913812 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:13.912586    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-f87fcf56c-rmbn6"
Nov 03 21:51:14.137473 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:14.137311    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-2cp8m"]
Nov 03 21:51:14.140297 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:51:14.140267    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod924ab530_dbeb_446a_8069_ad634ab44e49.slice/crio-1253e7419cdf896a2aca7571d982aa41191377c6086dd3e71ec7b15fdefce1f8 WatchSource:0}: Error finding container 1253e7419cdf896a2aca7571d982aa41191377c6086dd3e71ec7b15fdefce1f8: Status 404 returned error can't find the container with id 1253e7419cdf896a2aca7571d982aa41191377c6086dd3e71ec7b15fdefce1f8
Nov 03 21:51:14.212732 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:14.212703    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-58jdx"]
Nov 03 21:51:14.215604 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:51:14.215576    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ec143b_216f_4314_8997_8170d60a0804.slice/crio-f6667e7239fd5f2d8cc05b40694de692c12de04d833fba09887601a8a7a13020 WatchSource:0}: Error finding container f6667e7239fd5f2d8cc05b40694de692c12de04d833fba09887601a8a7a13020: Status 404 returned error can't find the container with id f6667e7239fd5f2d8cc05b40694de692c12de04d833fba09887601a8a7a13020
Nov 03 21:51:14.235808 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:14.235786    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-f87fcf56c-rmbn6"]
Nov 03 21:51:14.240350 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:51:14.240315    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78e28086_24fc_42d6_ac43_3a5967c67012.slice/crio-d5ade41e675bcd647a2c0c0d7d2a85b88a82827e61abd6f88a8a7b637897cdec WatchSource:0}: Error finding container d5ade41e675bcd647a2c0c0d7d2a85b88a82827e61abd6f88a8a7b637897cdec: Status 404 returned error can't find the container with id d5ade41e675bcd647a2c0c0d7d2a85b88a82827e61abd6f88a8a7b637897cdec
Nov 03 21:51:14.481823 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:14.481732    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-f87fcf56c-rmbn6" event={"ID":"78e28086-24fc-42d6-ac43-3a5967c67012","Type":"ContainerStarted","Data":"d5ade41e675bcd647a2c0c0d7d2a85b88a82827e61abd6f88a8a7b637897cdec"}
Nov 03 21:51:14.482978 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:14.482952    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-2cp8m" event={"ID":"924ab530-dbeb-446a-8069-ad634ab44e49","Type":"ContainerStarted","Data":"1253e7419cdf896a2aca7571d982aa41191377c6086dd3e71ec7b15fdefce1f8"}
Nov 03 21:51:14.484121 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:14.484099    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-58jdx" event={"ID":"51ec143b-216f-4314-8997-8170d60a0804","Type":"ContainerStarted","Data":"f6667e7239fd5f2d8cc05b40694de692c12de04d833fba09887601a8a7a13020"}
Nov 03 21:51:17.505688 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:17.505589    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-58jdx" event={"ID":"51ec143b-216f-4314-8997-8170d60a0804","Type":"ContainerStarted","Data":"7a8ff0a914d9ff09a25bde0d31c2b7b937877c525f08a32d9926095b33bd393a"}
Nov 03 21:51:17.505688 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:17.505673    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-58jdx"
Nov 03 21:51:17.507601 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:17.507577    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-2cp8m" event={"ID":"924ab530-dbeb-446a-8069-ad634ab44e49","Type":"ContainerStarted","Data":"7809e06bb9232038c3050a5971384b63830121fd16abb5f39aed5a80cf290d09"}
Nov 03 21:51:17.507743 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:17.507716    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-2cp8m"
Nov 03 21:51:17.526961 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:17.526910    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-58jdx" podStartSLOduration=1.95797481 podStartE2EDuration="4.526893461s" totalImagesPullingTime="2.568918651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:51:17.524785363 +0000 UTC m=+370.928446794" watchObservedRunningTime="2026-11-03 21:51:17.526893461 +0000 UTC m=+370.930554891"
Nov 03 21:51:17.545526 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:17.545470    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-2cp8m" podStartSLOduration=1.62502299 podStartE2EDuration="4.545453527s" totalImagesPullingTime="2.920430537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:51:17.543624097 +0000 UTC m=+370.947285529" watchObservedRunningTime="2026-11-03 21:51:17.545453527 +0000 UTC m=+370.949114958"
Nov 03 21:51:18.515347 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:18.515311    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-f87fcf56c-rmbn6" event={"ID":"78e28086-24fc-42d6-ac43-3a5967c67012","Type":"ContainerStarted","Data":"d04be1cf1605a4cdd3841ce6fb5f63274c3d8ca513247f7a0bd05b898a7d448c"}
Nov 03 21:51:18.535848 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:18.535807    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-f87fcf56c-rmbn6" podStartSLOduration=2.090428204 podStartE2EDuration="5.535794204s" totalImagesPullingTime="3.445366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:51:18.535161404 +0000 UTC m=+371.938822834" watchObservedRunningTime="2026-11-03 21:51:18.535794204 +0000 UTC m=+371.939455644"
Nov 03 21:51:19.519655 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:19.519621    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-f87fcf56c-rmbn6"
Nov 03 21:51:28.519638 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:28.519609    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-58jdx"
Nov 03 21:51:29.927626 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:51:29.927589    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:51:30.526481 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:30.526445    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-f87fcf56c-rmbn6"
Nov 03 21:51:48.521427 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:51:48.521355    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-2cp8m"
Nov 03 21:51:59.926569 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:51:59.926529    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:52:23.151701 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:23.151663    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d6dd76dc-qx8vw"]
Nov 03 21:52:23.155695 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:23.155671    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d6dd76dc-qx8vw"
Nov 03 21:52:23.164031 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:23.163745    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Nov 03 21:52:23.164031 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:23.163836    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Nov 03 21:52:23.164031 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:23.163869    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-q9pn7\""
Nov 03 21:52:23.166980 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:23.166957    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d6dd76dc-qx8vw"]
Nov 03 21:52:23.246604 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:23.246567    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk8gx\" (UniqueName: \"kubernetes.io/projected/21f88430-9b16-4a1c-88dc-5f26f5983884-kube-api-access-qk8gx\") pod \"authorino-operator-68d6dd76dc-qx8vw\" (UID: \"21f88430-9b16-4a1c-88dc-5f26f5983884\") " pod="kuadrant-system/authorino-operator-68d6dd76dc-qx8vw"
Nov 03 21:52:23.348090 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:23.348010    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk8gx\" (UniqueName: \"kubernetes.io/projected/21f88430-9b16-4a1c-88dc-5f26f5983884-kube-api-access-qk8gx\") pod \"authorino-operator-68d6dd76dc-qx8vw\" (UID: \"21f88430-9b16-4a1c-88dc-5f26f5983884\") " pod="kuadrant-system/authorino-operator-68d6dd76dc-qx8vw"
Nov 03 21:52:23.360392 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:23.360357    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk8gx\" (UniqueName: \"kubernetes.io/projected/21f88430-9b16-4a1c-88dc-5f26f5983884-kube-api-access-qk8gx\") pod \"authorino-operator-68d6dd76dc-qx8vw\" (UID: \"21f88430-9b16-4a1c-88dc-5f26f5983884\") " pod="kuadrant-system/authorino-operator-68d6dd76dc-qx8vw"
Nov 03 21:52:23.471340 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:23.471230    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d6dd76dc-qx8vw"
Nov 03 21:52:23.769641 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:23.769617    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d6dd76dc-qx8vw"]
Nov 03 21:52:23.772427 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:52:23.772399    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f88430_9b16_4a1c_88dc_5f26f5983884.slice/crio-a264781172b39b87e29f84f26c9766d46a5fb808da0613503f21d4a45e746f71 WatchSource:0}: Error finding container a264781172b39b87e29f84f26c9766d46a5fb808da0613503f21d4a45e746f71: Status 404 returned error can't find the container with id a264781172b39b87e29f84f26c9766d46a5fb808da0613503f21d4a45e746f71
Nov 03 21:52:23.802540 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:23.802510    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d6dd76dc-qx8vw" event={"ID":"21f88430-9b16-4a1c-88dc-5f26f5983884","Type":"ContainerStarted","Data":"a264781172b39b87e29f84f26c9766d46a5fb808da0613503f21d4a45e746f71"}
Nov 03 21:52:26.818218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:26.818178    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d6dd76dc-qx8vw" event={"ID":"21f88430-9b16-4a1c-88dc-5f26f5983884","Type":"ContainerStarted","Data":"37181206535eb741c2f1f835246d44cb6ed9a8770762556ceb5b4b553cbfc212"}
Nov 03 21:52:26.818685 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:26.818421    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d6dd76dc-qx8vw"
Nov 03 21:52:26.839489 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:26.839440    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d6dd76dc-qx8vw" podStartSLOduration=1.151384351 podStartE2EDuration="3.839428396s" totalImagesPullingTime="2.688044045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:52:26.837301275 +0000 UTC m=+440.240962705" watchObservedRunningTime="2026-11-03 21:52:26.839428396 +0000 UTC m=+440.243089826"
Nov 03 21:52:27.530847 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:27.530811    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"]
Nov 03 21:52:27.534537 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:27.534516    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"
Nov 03 21:52:27.541907 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:27.541887    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x87xv\""
Nov 03 21:52:27.546930 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:27.546905    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"]
Nov 03 21:52:27.588777 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:27.588750    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d74a1a61-47a5-4d85-858b-2e3572fad7c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-nkwqx\" (UID: \"d74a1a61-47a5-4d85-858b-2e3572fad7c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"
Nov 03 21:52:27.588931 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:27.588892    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdmks\" (UniqueName: \"kubernetes.io/projected/d74a1a61-47a5-4d85-858b-2e3572fad7c8-kube-api-access-hdmks\") pod \"kuadrant-operator-controller-manager-6b6fb56846-nkwqx\" (UID: \"d74a1a61-47a5-4d85-858b-2e3572fad7c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"
Nov 03 21:52:27.689339 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:27.689304    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdmks\" (UniqueName: \"kubernetes.io/projected/d74a1a61-47a5-4d85-858b-2e3572fad7c8-kube-api-access-hdmks\") pod \"kuadrant-operator-controller-manager-6b6fb56846-nkwqx\" (UID: \"d74a1a61-47a5-4d85-858b-2e3572fad7c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"
Nov 03 21:52:27.689519 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:27.689363    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d74a1a61-47a5-4d85-858b-2e3572fad7c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-nkwqx\" (UID: \"d74a1a61-47a5-4d85-858b-2e3572fad7c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"
Nov 03 21:52:27.689802 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:27.689783    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d74a1a61-47a5-4d85-858b-2e3572fad7c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-nkwqx\" (UID: \"d74a1a61-47a5-4d85-858b-2e3572fad7c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"
Nov 03 21:52:27.710622 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:27.710591    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdmks\" (UniqueName: \"kubernetes.io/projected/d74a1a61-47a5-4d85-858b-2e3572fad7c8-kube-api-access-hdmks\") pod \"kuadrant-operator-controller-manager-6b6fb56846-nkwqx\" (UID: \"d74a1a61-47a5-4d85-858b-2e3572fad7c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"
Nov 03 21:52:27.847584 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:27.847559    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"
Nov 03 21:52:28.140939 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:28.140858    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"]
Nov 03 21:52:28.144197 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:52:28.144167    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74a1a61_47a5_4d85_858b_2e3572fad7c8.slice/crio-c248a0dcb57e5c33707fe79dac861a1dc4733afc7e7b6ad9252e061645077af3 WatchSource:0}: Error finding container c248a0dcb57e5c33707fe79dac861a1dc4733afc7e7b6ad9252e061645077af3: Status 404 returned error can't find the container with id c248a0dcb57e5c33707fe79dac861a1dc4733afc7e7b6ad9252e061645077af3
Nov 03 21:52:28.828297 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:28.828234    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx" event={"ID":"d74a1a61-47a5-4d85-858b-2e3572fad7c8","Type":"ContainerStarted","Data":"c248a0dcb57e5c33707fe79dac861a1dc4733afc7e7b6ad9252e061645077af3"}
Nov 03 21:52:29.666449 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:29.666410    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65bfd79598-m92st"]
Nov 03 21:52:29.670153 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:29.670131    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-65bfd79598-m92st"
Nov 03 21:52:29.680438 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:29.680406    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Nov 03 21:52:29.680784 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:29.680753    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xbtps\""
Nov 03 21:52:29.690009 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:29.689987    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65bfd79598-m92st"]
Nov 03 21:52:29.706812 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:29.706789    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djrmj\" (UniqueName: \"kubernetes.io/projected/87c1c751-dd4a-412b-bfb8-716e76f8ccbf-kube-api-access-djrmj\") pod \"dns-operator-controller-manager-65bfd79598-m92st\" (UID: \"87c1c751-dd4a-412b-bfb8-716e76f8ccbf\") " pod="kuadrant-system/dns-operator-controller-manager-65bfd79598-m92st"
Nov 03 21:52:29.807620 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:29.807584    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djrmj\" (UniqueName: \"kubernetes.io/projected/87c1c751-dd4a-412b-bfb8-716e76f8ccbf-kube-api-access-djrmj\") pod \"dns-operator-controller-manager-65bfd79598-m92st\" (UID: \"87c1c751-dd4a-412b-bfb8-716e76f8ccbf\") " pod="kuadrant-system/dns-operator-controller-manager-65bfd79598-m92st"
Nov 03 21:52:29.820750 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:29.820711    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djrmj\" (UniqueName: \"kubernetes.io/projected/87c1c751-dd4a-412b-bfb8-716e76f8ccbf-kube-api-access-djrmj\") pod \"dns-operator-controller-manager-65bfd79598-m92st\" (UID: \"87c1c751-dd4a-412b-bfb8-716e76f8ccbf\") " pod="kuadrant-system/dns-operator-controller-manager-65bfd79598-m92st"
Nov 03 21:52:29.937989 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:52:29.937871    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:52:29.985598 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:29.985541    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-65bfd79598-m92st"
Nov 03 21:52:30.303601 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:30.303563    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65bfd79598-m92st"]
Nov 03 21:52:30.307034 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:52:30.307001    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c1c751_dd4a_412b_bfb8_716e76f8ccbf.slice/crio-c1f90ac7bc6d42002f2977a30b3b53c04ffc42b4c3db8735338a2b4d77bbfb68 WatchSource:0}: Error finding container c1f90ac7bc6d42002f2977a30b3b53c04ffc42b4c3db8735338a2b4d77bbfb68: Status 404 returned error can't find the container with id c1f90ac7bc6d42002f2977a30b3b53c04ffc42b4c3db8735338a2b4d77bbfb68
Nov 03 21:52:30.841720 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:30.841675    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-65bfd79598-m92st" event={"ID":"87c1c751-dd4a-412b-bfb8-716e76f8ccbf","Type":"ContainerStarted","Data":"c1f90ac7bc6d42002f2977a30b3b53c04ffc42b4c3db8735338a2b4d77bbfb68"}
Nov 03 21:52:31.686441 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:31.686408    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k"]
Nov 03 21:52:31.691949 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:31.691918    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k"
Nov 03 21:52:31.701880 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:31.701846    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wvg2x\""
Nov 03 21:52:31.703550 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:31.703519    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k"]
Nov 03 21:52:31.728867 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:31.728834    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9jcp\" (UniqueName: \"kubernetes.io/projected/c73f0709-a978-490d-9254-942fa378d4a0-kube-api-access-n9jcp\") pod \"limitador-operator-controller-manager-856dd584c5-vz62k\" (UID: \"c73f0709-a978-490d-9254-942fa378d4a0\") " pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k"
Nov 03 21:52:31.830378 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:31.830333    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9jcp\" (UniqueName: \"kubernetes.io/projected/c73f0709-a978-490d-9254-942fa378d4a0-kube-api-access-n9jcp\") pod \"limitador-operator-controller-manager-856dd584c5-vz62k\" (UID: \"c73f0709-a978-490d-9254-942fa378d4a0\") " pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k"
Nov 03 21:52:31.846066 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:31.846036    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9jcp\" (UniqueName: \"kubernetes.io/projected/c73f0709-a978-490d-9254-942fa378d4a0-kube-api-access-n9jcp\") pod \"limitador-operator-controller-manager-856dd584c5-vz62k\" (UID: \"c73f0709-a978-490d-9254-942fa378d4a0\") " pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k"
Nov 03 21:52:32.010470 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:32.010394    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k"
Nov 03 21:52:32.298502 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:32.298473    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k"]
Nov 03 21:52:32.300424 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:52:32.300383    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc73f0709_a978_490d_9254_942fa378d4a0.slice/crio-9f6e956e5998d3a96d1abb373f39cbffaf6c5f9a12025b9beb21d32260f71240 WatchSource:0}: Error finding container 9f6e956e5998d3a96d1abb373f39cbffaf6c5f9a12025b9beb21d32260f71240: Status 404 returned error can't find the container with id 9f6e956e5998d3a96d1abb373f39cbffaf6c5f9a12025b9beb21d32260f71240
Nov 03 21:52:32.856185 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:32.856149    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k" event={"ID":"c73f0709-a978-490d-9254-942fa378d4a0","Type":"ContainerStarted","Data":"9f6e956e5998d3a96d1abb373f39cbffaf6c5f9a12025b9beb21d32260f71240"}
Nov 03 21:52:33.863425 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:33.863335    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-65bfd79598-m92st" event={"ID":"87c1c751-dd4a-412b-bfb8-716e76f8ccbf","Type":"ContainerStarted","Data":"23d9de4939a153516bb914067f10af43dda163d77718cc2aeae55a5a2e988fba"}
Nov 03 21:52:33.863836 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:33.863483    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-65bfd79598-m92st"
Nov 03 21:52:33.865519 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:33.865484    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx" event={"ID":"d74a1a61-47a5-4d85-858b-2e3572fad7c8","Type":"ContainerStarted","Data":"55c99c67208c2c1280a0933d2b138b1352861b05bc3f0bb5ebd6507bba957f7c"}
Nov 03 21:52:33.865669 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:33.865625    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"
Nov 03 21:52:33.886047 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:33.886004    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-65bfd79598-m92st" podStartSLOduration=2.037319569 podStartE2EDuration="4.885992105s" totalImagesPullingTime="2.848672536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:52:33.885131243 +0000 UTC m=+447.288792686" watchObservedRunningTime="2026-11-03 21:52:33.885992105 +0000 UTC m=+447.289653536"
Nov 03 21:52:33.907153 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:33.907072    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx" podStartSLOduration=1.48862283 podStartE2EDuration="6.907055733s" totalImagesPullingTime="5.418432903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:52:33.905941458 +0000 UTC m=+447.309602889" watchObservedRunningTime="2026-11-03 21:52:33.907055733 +0000 UTC m=+447.310717165"
Nov 03 21:52:37.825797 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:37.825766    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d6dd76dc-qx8vw"
Nov 03 21:52:41.906583 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:41.906547    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k" event={"ID":"c73f0709-a978-490d-9254-942fa378d4a0","Type":"ContainerStarted","Data":"2aa626db7a25133fc73e73e7abd489ba40dd663a46b1ff761beffe00bd300d9c"}
Nov 03 21:52:41.907012 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:41.906621    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k"
Nov 03 21:52:41.926226 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:41.926181    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k" podStartSLOduration=2.064349294 podStartE2EDuration="10.926169365s" totalImagesPullingTime="8.861820071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:52:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:52:41.924568841 +0000 UTC m=+455.328230288" watchObservedRunningTime="2026-11-03 21:52:41.926169365 +0000 UTC m=+455.329830791"
Nov 03 21:52:44.872490 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:44.872457    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"
Nov 03 21:52:44.872890 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:44.872633    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-65bfd79598-m92st"
Nov 03 21:52:46.582956 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:46.582924    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x"]
Nov 03 21:52:46.586745 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:46.586729    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x"
Nov 03 21:52:46.599750 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:46.599723    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x"]
Nov 03 21:52:46.664651 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:46.664608    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6341fcc-32dc-42be-b7a9-83e65a6b1615-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-rcm9x\" (UID: \"d6341fcc-32dc-42be-b7a9-83e65a6b1615\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x"
Nov 03 21:52:46.664801 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:46.664666    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjzhv\" (UniqueName: \"kubernetes.io/projected/d6341fcc-32dc-42be-b7a9-83e65a6b1615-kube-api-access-kjzhv\") pod \"kuadrant-operator-controller-manager-6b76784d48-rcm9x\" (UID: \"d6341fcc-32dc-42be-b7a9-83e65a6b1615\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x"
Nov 03 21:52:46.765966 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:46.765931    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjzhv\" (UniqueName: \"kubernetes.io/projected/d6341fcc-32dc-42be-b7a9-83e65a6b1615-kube-api-access-kjzhv\") pod \"kuadrant-operator-controller-manager-6b76784d48-rcm9x\" (UID: \"d6341fcc-32dc-42be-b7a9-83e65a6b1615\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x"
Nov 03 21:52:46.766139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:46.766018    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6341fcc-32dc-42be-b7a9-83e65a6b1615-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-rcm9x\" (UID: \"d6341fcc-32dc-42be-b7a9-83e65a6b1615\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x"
Nov 03 21:52:46.766378 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:46.766361    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6341fcc-32dc-42be-b7a9-83e65a6b1615-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-rcm9x\" (UID: \"d6341fcc-32dc-42be-b7a9-83e65a6b1615\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x"
Nov 03 21:52:46.778520 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:46.778489    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjzhv\" (UniqueName: \"kubernetes.io/projected/d6341fcc-32dc-42be-b7a9-83e65a6b1615-kube-api-access-kjzhv\") pod \"kuadrant-operator-controller-manager-6b76784d48-rcm9x\" (UID: \"d6341fcc-32dc-42be-b7a9-83e65a6b1615\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x"
Nov 03 21:52:46.900370 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:46.900295    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x"
Nov 03 21:52:47.187642 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:47.187542    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x"]
Nov 03 21:52:47.191594 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:52:47.191563    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6341fcc_32dc_42be_b7a9_83e65a6b1615.slice/crio-5ea6b9e40f1228d713676398f89ee4c0381fefe8c2724fe501f36e8d308dd90c WatchSource:0}: Error finding container 5ea6b9e40f1228d713676398f89ee4c0381fefe8c2724fe501f36e8d308dd90c: Status 404 returned error can't find the container with id 5ea6b9e40f1228d713676398f89ee4c0381fefe8c2724fe501f36e8d308dd90c
Nov 03 21:52:47.938351 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:47.938312    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x" event={"ID":"d6341fcc-32dc-42be-b7a9-83e65a6b1615","Type":"ContainerStarted","Data":"8a068e00913682feb667dcaf67df90d1e8ddcd87eb62f7eeab6f19461190b16b"}
Nov 03 21:52:47.938748 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:47.938373    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x" event={"ID":"d6341fcc-32dc-42be-b7a9-83e65a6b1615","Type":"ContainerStarted","Data":"5ea6b9e40f1228d713676398f89ee4c0381fefe8c2724fe501f36e8d308dd90c"}
Nov 03 21:52:47.938748 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:47.938464    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x"
Nov 03 21:52:47.963327 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:47.963284    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x" podStartSLOduration=1.963269717 podStartE2EDuration="1.963269717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:52:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:52:47.961472601 +0000 UTC m=+461.365134031" watchObservedRunningTime="2026-11-03 21:52:47.963269717 +0000 UTC m=+461.366931138"
Nov 03 21:52:48.641424 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.641387    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"]
Nov 03 21:52:48.641604 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.641569    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx" podUID="d74a1a61-47a5-4d85-858b-2e3572fad7c8" containerName="manager" containerID="cri-o://55c99c67208c2c1280a0933d2b138b1352861b05bc3f0bb5ebd6507bba957f7c" gracePeriod=2
Nov 03 21:52:48.651448 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.651418    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"]
Nov 03 21:52:48.667225 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.667201    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm"]
Nov 03 21:52:48.667641 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:52:48.667606    5077 status_manager.go:1068] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d74a1a61-47a5-4d85-858b-2e3572fad7c8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-6b6fb56846-nkwqx\": pods \"kuadrant-operator-controller-manager-6b6fb56846-nkwqx\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"
Nov 03 21:52:48.667779 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.667764    5077 cpu_manager.go:414] "containerMap: removing container" podUID="d74a1a61-47a5-4d85-858b-2e3572fad7c8" containerName="manager"
Nov 03 21:52:48.667838 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.667783    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d74a1a61-47a5-4d85-858b-2e3572fad7c8" containerName="manager"
Nov 03 21:52:48.667923 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.667911    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="d74a1a61-47a5-4d85-858b-2e3572fad7c8" containerName="manager"
Nov 03 21:52:48.671175 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.671154    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm"
Nov 03 21:52:48.673892 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:52:48.673856    5077 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-nkwqx\" is forbidden: User \"system:node:ip-10-0-128-183.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-183.us-east-2.compute.internal' and this object" podUID="d74a1a61-47a5-4d85-858b-2e3572fad7c8" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"
Nov 03 21:52:48.674844 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.674823    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x"]
Nov 03 21:52:48.688133 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.688087    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm"]
Nov 03 21:52:48.690093 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.690071    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x"]
Nov 03 21:52:48.703811 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.703786    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j"]
Nov 03 21:52:48.704478 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.704459    5077 cpu_manager.go:414] "containerMap: removing container" podUID="d6341fcc-32dc-42be-b7a9-83e65a6b1615" containerName="manager"
Nov 03 21:52:48.704478 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.704478    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d6341fcc-32dc-42be-b7a9-83e65a6b1615" containerName="manager"
Nov 03 21:52:48.704620 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.704567    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="d6341fcc-32dc-42be-b7a9-83e65a6b1615" containerName="manager"
Nov 03 21:52:48.708221 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.708198    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j"
Nov 03 21:52:48.710950 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:52:48.710918    5077 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-nkwqx\" is forbidden: User \"system:node:ip-10-0-128-183.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-183.us-east-2.compute.internal' and this object" podUID="d74a1a61-47a5-4d85-858b-2e3572fad7c8" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"
Nov 03 21:52:48.711913 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.711887    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k"]
Nov 03 21:52:48.712086 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.712062    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k" podUID="c73f0709-a978-490d-9254-942fa378d4a0" containerName="manager" containerID="cri-o://2aa626db7a25133fc73e73e7abd489ba40dd663a46b1ff761beffe00bd300d9c" gracePeriod=2
Nov 03 21:52:48.714049 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.714026    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k"
Nov 03 21:52:48.718358 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.718336    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j"]
Nov 03 21:52:48.722350 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.722276    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k"]
Nov 03 21:52:48.737257 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.737219    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-856dd584c5-zpzht"]
Nov 03 21:52:48.737665 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.737650    5077 cpu_manager.go:414] "containerMap: removing container" podUID="c73f0709-a978-490d-9254-942fa378d4a0" containerName="manager"
Nov 03 21:52:48.737718 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.737668    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c73f0709-a978-490d-9254-942fa378d4a0" containerName="manager"
Nov 03 21:52:48.737780 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.737770    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="c73f0709-a978-490d-9254-942fa378d4a0" containerName="manager"
Nov 03 21:52:48.739123 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:52:48.739093    5077 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-nkwqx\" is forbidden: User \"system:node:ip-10-0-128-183.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-183.us-east-2.compute.internal' and this object" podUID="d74a1a61-47a5-4d85-858b-2e3572fad7c8" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"
Nov 03 21:52:48.740946 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.740928    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-zpzht"
Nov 03 21:52:48.741584 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:52:48.741558    5077 status_manager.go:1045] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-856dd584c5-vz62k\" is forbidden: User \"system:node:ip-10-0-128-183.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-183.us-east-2.compute.internal' and this object" podUID="c73f0709-a978-490d-9254-942fa378d4a0" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k"
Nov 03 21:52:48.751587 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.751235    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-856dd584c5-zpzht"]
Nov 03 21:52:48.785886 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.785858    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b9ac745-871e-4e1d-8ec0-73ba04d03bbd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-fq5cm\" (UID: \"9b9ac745-871e-4e1d-8ec0-73ba04d03bbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm"
Nov 03 21:52:48.786050 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.785895    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2nhz\" (UniqueName: \"kubernetes.io/projected/9b9ac745-871e-4e1d-8ec0-73ba04d03bbd-kube-api-access-k2nhz\") pod \"kuadrant-operator-controller-manager-6b6fb56846-fq5cm\" (UID: \"9b9ac745-871e-4e1d-8ec0-73ba04d03bbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm"
Nov 03 21:52:48.786127 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.786055    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ea22438-9edd-44a5-899b-1ffab308f081-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-xqh8j\" (UID: \"9ea22438-9edd-44a5-899b-1ffab308f081\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j"
Nov 03 21:52:48.786127 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.786096    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgp4g\" (UniqueName: \"kubernetes.io/projected/9ea22438-9edd-44a5-899b-1ffab308f081-kube-api-access-cgp4g\") pod \"kuadrant-operator-controller-manager-6b76784d48-xqh8j\" (UID: \"9ea22438-9edd-44a5-899b-1ffab308f081\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j"
Nov 03 21:52:48.886942 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.886911    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ea22438-9edd-44a5-899b-1ffab308f081-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-xqh8j\" (UID: \"9ea22438-9edd-44a5-899b-1ffab308f081\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j"
Nov 03 21:52:48.887113 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.886948    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgp4g\" (UniqueName: \"kubernetes.io/projected/9ea22438-9edd-44a5-899b-1ffab308f081-kube-api-access-cgp4g\") pod \"kuadrant-operator-controller-manager-6b76784d48-xqh8j\" (UID: \"9ea22438-9edd-44a5-899b-1ffab308f081\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j"
Nov 03 21:52:48.887113 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.887028    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b9ac745-871e-4e1d-8ec0-73ba04d03bbd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-fq5cm\" (UID: \"9b9ac745-871e-4e1d-8ec0-73ba04d03bbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm"
Nov 03 21:52:48.887113 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.887058    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2nhz\" (UniqueName: \"kubernetes.io/projected/9b9ac745-871e-4e1d-8ec0-73ba04d03bbd-kube-api-access-k2nhz\") pod \"kuadrant-operator-controller-manager-6b6fb56846-fq5cm\" (UID: \"9b9ac745-871e-4e1d-8ec0-73ba04d03bbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm"
Nov 03 21:52:48.887319 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.887116    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jldfm\" (UniqueName: \"kubernetes.io/projected/b6435da6-942d-4238-9e4a-41db53bf3a39-kube-api-access-jldfm\") pod \"limitador-operator-controller-manager-856dd584c5-zpzht\" (UID: \"b6435da6-942d-4238-9e4a-41db53bf3a39\") " pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-zpzht"
Nov 03 21:52:48.888310 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.888276    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b9ac745-871e-4e1d-8ec0-73ba04d03bbd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-fq5cm\" (UID: \"9b9ac745-871e-4e1d-8ec0-73ba04d03bbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm"
Nov 03 21:52:48.888538 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.888521    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ea22438-9edd-44a5-899b-1ffab308f081-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-xqh8j\" (UID: \"9ea22438-9edd-44a5-899b-1ffab308f081\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j"
Nov 03 21:52:48.900668 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.900593    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgp4g\" (UniqueName: \"kubernetes.io/projected/9ea22438-9edd-44a5-899b-1ffab308f081-kube-api-access-cgp4g\") pod \"kuadrant-operator-controller-manager-6b76784d48-xqh8j\" (UID: \"9ea22438-9edd-44a5-899b-1ffab308f081\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j"
Nov 03 21:52:48.902024 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.901998    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2nhz\" (UniqueName: \"kubernetes.io/projected/9b9ac745-871e-4e1d-8ec0-73ba04d03bbd-kube-api-access-k2nhz\") pod \"kuadrant-operator-controller-manager-6b6fb56846-fq5cm\" (UID: \"9b9ac745-871e-4e1d-8ec0-73ba04d03bbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm"
Nov 03 21:52:48.947239 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.947203    5077 generic.go:356] "Generic (PLEG): container finished" podID="c73f0709-a978-490d-9254-942fa378d4a0" containerID="2aa626db7a25133fc73e73e7abd489ba40dd663a46b1ff761beffe00bd300d9c" exitCode=0
Nov 03 21:52:48.948688 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.948663    5077 generic.go:356] "Generic (PLEG): container finished" podID="d74a1a61-47a5-4d85-858b-2e3572fad7c8" containerID="55c99c67208c2c1280a0933d2b138b1352861b05bc3f0bb5ebd6507bba957f7c" exitCode=0
Nov 03 21:52:48.952393 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.952371    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"
Nov 03 21:52:48.961373 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.961356    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k"
Nov 03 21:52:48.988406 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:48.988379    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jldfm\" (UniqueName: \"kubernetes.io/projected/b6435da6-942d-4238-9e4a-41db53bf3a39-kube-api-access-jldfm\") pod \"limitador-operator-controller-manager-856dd584c5-zpzht\" (UID: \"b6435da6-942d-4238-9e4a-41db53bf3a39\") " pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-zpzht"
Nov 03 21:52:49.004798 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.004774    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jldfm\" (UniqueName: \"kubernetes.io/projected/b6435da6-942d-4238-9e4a-41db53bf3a39-kube-api-access-jldfm\") pod \"limitador-operator-controller-manager-856dd584c5-zpzht\" (UID: \"b6435da6-942d-4238-9e4a-41db53bf3a39\") " pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-zpzht"
Nov 03 21:52:49.089702 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.089665    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c73f0709-a978-490d-9254-942fa378d4a0-kube-api-access-n9jcp\" (UniqueName: \"kubernetes.io/projected/c73f0709-a978-490d-9254-942fa378d4a0-kube-api-access-n9jcp\") pod \"c73f0709-a978-490d-9254-942fa378d4a0\" (UID: \"c73f0709-a978-490d-9254-942fa378d4a0\") "
Nov 03 21:52:49.089848 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.089723    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d74a1a61-47a5-4d85-858b-2e3572fad7c8-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d74a1a61-47a5-4d85-858b-2e3572fad7c8-extensions-socket-volume\") pod \"d74a1a61-47a5-4d85-858b-2e3572fad7c8\" (UID: \"d74a1a61-47a5-4d85-858b-2e3572fad7c8\") "
Nov 03 21:52:49.089848 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.089809    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d74a1a61-47a5-4d85-858b-2e3572fad7c8-kube-api-access-hdmks\" (UniqueName: \"kubernetes.io/projected/d74a1a61-47a5-4d85-858b-2e3572fad7c8-kube-api-access-hdmks\") pod \"d74a1a61-47a5-4d85-858b-2e3572fad7c8\" (UID: \"d74a1a61-47a5-4d85-858b-2e3572fad7c8\") "
Nov 03 21:52:49.090324 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.090287    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d74a1a61-47a5-4d85-858b-2e3572fad7c8-extensions-socket-volume" pod "d74a1a61-47a5-4d85-858b-2e3572fad7c8" (UID: "d74a1a61-47a5-4d85-858b-2e3572fad7c8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:52:49.092107 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.092082    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d74a1a61-47a5-4d85-858b-2e3572fad7c8-kube-api-access-hdmks" pod "d74a1a61-47a5-4d85-858b-2e3572fad7c8" (UID: "d74a1a61-47a5-4d85-858b-2e3572fad7c8"). InnerVolumeSpecName "kube-api-access-hdmks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:52:49.092215 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.092139    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c73f0709-a978-490d-9254-942fa378d4a0-kube-api-access-n9jcp" pod "c73f0709-a978-490d-9254-942fa378d4a0" (UID: "c73f0709-a978-490d-9254-942fa378d4a0"). InnerVolumeSpecName "kube-api-access-n9jcp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:52:49.118353 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.118320    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm"
Nov 03 21:52:49.126316 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.126297    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j"
Nov 03 21:52:49.135115 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.135092    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-zpzht"
Nov 03 21:52:49.192553 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.192517    5077 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d74a1a61-47a5-4d85-858b-2e3572fad7c8-extensions-socket-volume\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:52:49.192863 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.192560    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdmks\" (UniqueName: \"kubernetes.io/projected/d74a1a61-47a5-4d85-858b-2e3572fad7c8-kube-api-access-hdmks\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:52:49.192863 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.192575    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9jcp\" (UniqueName: \"kubernetes.io/projected/c73f0709-a978-490d-9254-942fa378d4a0-kube-api-access-n9jcp\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:52:49.400539 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.400521    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm"]
Nov 03 21:52:49.403123 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:52:49.403094    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b9ac745_871e_4e1d_8ec0_73ba04d03bbd.slice/crio-744c656c8ad07827e2b4c7db06552bbf8df52880a620e0d8b4e552f49f87fdad WatchSource:0}: Error finding container 744c656c8ad07827e2b4c7db06552bbf8df52880a620e0d8b4e552f49f87fdad: Status 404 returned error can't find the container with id 744c656c8ad07827e2b4c7db06552bbf8df52880a620e0d8b4e552f49f87fdad
Nov 03 21:52:49.424181 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.423536    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-856dd584c5-zpzht"]
Nov 03 21:52:49.424181 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.424043    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j"]
Nov 03 21:52:49.433534 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:52:49.433505    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6435da6_942d_4238_9e4a_41db53bf3a39.slice/crio-a61c65679579fff897d0241a4f9677e568d00647115909e44932af20ed72a405 WatchSource:0}: Error finding container a61c65679579fff897d0241a4f9677e568d00647115909e44932af20ed72a405: Status 404 returned error can't find the container with id a61c65679579fff897d0241a4f9677e568d00647115909e44932af20ed72a405
Nov 03 21:52:49.433825 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:52:49.433798    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ea22438_9edd_44a5_899b_1ffab308f081.slice/crio-df90295dfd4f7d335fc7184b3b9d7e47a74792e651a97983dbb1c9b977696d49 WatchSource:0}: Error finding container df90295dfd4f7d335fc7184b3b9d7e47a74792e651a97983dbb1c9b977696d49: Status 404 returned error can't find the container with id df90295dfd4f7d335fc7184b3b9d7e47a74792e651a97983dbb1c9b977696d49
Nov 03 21:52:49.960341 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.957745    5077 scope.go:122] "RemoveContainer" containerID="2aa626db7a25133fc73e73e7abd489ba40dd663a46b1ff761beffe00bd300d9c"
Nov 03 21:52:49.960341 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.957923    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k"
Nov 03 21:52:49.962238 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.962208    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-nkwqx"
Nov 03 21:52:49.964332 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.964228    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j" event={"ID":"9ea22438-9edd-44a5-899b-1ffab308f081","Type":"ContainerStarted","Data":"f90eaed0c382e753ccf942f9ad85bf8e99b763f84abb638094a7d52a736f5376"}
Nov 03 21:52:49.964332 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.964293    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j" event={"ID":"9ea22438-9edd-44a5-899b-1ffab308f081","Type":"ContainerStarted","Data":"df90295dfd4f7d335fc7184b3b9d7e47a74792e651a97983dbb1c9b977696d49"}
Nov 03 21:52:49.964763 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.964708    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j"
Nov 03 21:52:49.966493 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.966466    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-zpzht" event={"ID":"b6435da6-942d-4238-9e4a-41db53bf3a39","Type":"ContainerStarted","Data":"3aece5acc30bc174af03b66c6e2e66ab29430ce0c6a3007d38a8586b0659b218"}
Nov 03 21:52:49.966581 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.966511    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-zpzht" event={"ID":"b6435da6-942d-4238-9e4a-41db53bf3a39","Type":"ContainerStarted","Data":"a61c65679579fff897d0241a4f9677e568d00647115909e44932af20ed72a405"}
Nov 03 21:52:49.966581 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.966542    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-zpzht"
Nov 03 21:52:49.968451 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.968428    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm" event={"ID":"9b9ac745-871e-4e1d-8ec0-73ba04d03bbd","Type":"ContainerStarted","Data":"438ff6f4f57688b604c9ac8152d36eaa4a9eb70d191ebaf87531109847f3564b"}
Nov 03 21:52:49.968534 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.968470    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm" event={"ID":"9b9ac745-871e-4e1d-8ec0-73ba04d03bbd","Type":"ContainerStarted","Data":"744c656c8ad07827e2b4c7db06552bbf8df52880a620e0d8b4e552f49f87fdad"}
Nov 03 21:52:49.968605 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.968530    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x" podUID="d6341fcc-32dc-42be-b7a9-83e65a6b1615" containerName="manager" containerID="cri-o://8a068e00913682feb667dcaf67df90d1e8ddcd87eb62f7eeab6f19461190b16b" gracePeriod=2
Nov 03 21:52:49.968605 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.968550    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm"
Nov 03 21:52:49.970420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.970397    5077 scope.go:122] "RemoveContainer" containerID="55c99c67208c2c1280a0933d2b138b1352861b05bc3f0bb5ebd6507bba957f7c"
Nov 03 21:52:49.990022 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:49.989978    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j" podStartSLOduration=1.9899646500000001 podStartE2EDuration="1.98996465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:52:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:52:49.987827259 +0000 UTC m=+463.391488690" watchObservedRunningTime="2026-11-03 21:52:49.98996465 +0000 UTC m=+463.393626160"
Nov 03 21:52:49.990332 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:52:49.990304    5077 status_manager.go:1045] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-856dd584c5-vz62k\" is forbidden: User \"system:node:ip-10-0-128-183.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-183.us-east-2.compute.internal' and this object" podUID="c73f0709-a978-490d-9254-942fa378d4a0" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k"
Nov 03 21:52:50.011494 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:50.011441    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-zpzht" podStartSLOduration=2.011424739 podStartE2EDuration="2.011424739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:52:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:52:50.011025554 +0000 UTC m=+463.414686984" watchObservedRunningTime="2026-11-03 21:52:50.011424739 +0000 UTC m=+463.415086170"
Nov 03 21:52:50.033170 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:50.033120    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm" podStartSLOduration=2.033104717 podStartE2EDuration="2.033104717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:52:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:52:50.03213401 +0000 UTC m=+463.435795463" watchObservedRunningTime="2026-11-03 21:52:50.033104717 +0000 UTC m=+463.436766147"
Nov 03 21:52:50.213202 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:50.213144    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x"
Nov 03 21:52:50.215788 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:52:50.215762    5077 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b76784d48-rcm9x\" is forbidden: User \"system:node:ip-10-0-128-183.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-183.us-east-2.compute.internal' and this object" podUID="d6341fcc-32dc-42be-b7a9-83e65a6b1615" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x"
Nov 03 21:52:50.217975 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:52:50.217951    5077 status_manager.go:1045] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-856dd584c5-vz62k\" is forbidden: User \"system:node:ip-10-0-128-183.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-183.us-east-2.compute.internal' and this object" podUID="c73f0709-a978-490d-9254-942fa378d4a0" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-vz62k"
Nov 03 21:52:50.303746 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:50.303715    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d6341fcc-32dc-42be-b7a9-83e65a6b1615-kube-api-access-kjzhv\" (UniqueName: \"kubernetes.io/projected/d6341fcc-32dc-42be-b7a9-83e65a6b1615-kube-api-access-kjzhv\") pod \"d6341fcc-32dc-42be-b7a9-83e65a6b1615\" (UID: \"d6341fcc-32dc-42be-b7a9-83e65a6b1615\") "
Nov 03 21:52:50.303910 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:50.303804    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6341fcc-32dc-42be-b7a9-83e65a6b1615-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6341fcc-32dc-42be-b7a9-83e65a6b1615-extensions-socket-volume\") pod \"d6341fcc-32dc-42be-b7a9-83e65a6b1615\" (UID: \"d6341fcc-32dc-42be-b7a9-83e65a6b1615\") "
Nov 03 21:52:50.304195 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:50.304170    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6341fcc-32dc-42be-b7a9-83e65a6b1615-extensions-socket-volume" pod "d6341fcc-32dc-42be-b7a9-83e65a6b1615" (UID: "d6341fcc-32dc-42be-b7a9-83e65a6b1615"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:52:50.305873 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:50.305850    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6341fcc-32dc-42be-b7a9-83e65a6b1615-kube-api-access-kjzhv" pod "d6341fcc-32dc-42be-b7a9-83e65a6b1615" (UID: "d6341fcc-32dc-42be-b7a9-83e65a6b1615"). InnerVolumeSpecName "kube-api-access-kjzhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:52:50.405109 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:50.405071    5077 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6341fcc-32dc-42be-b7a9-83e65a6b1615-extensions-socket-volume\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:52:50.405109 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:50.405103    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjzhv\" (UniqueName: \"kubernetes.io/projected/d6341fcc-32dc-42be-b7a9-83e65a6b1615-kube-api-access-kjzhv\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:52:50.735260 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:50.735224    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c73f0709-a978-490d-9254-942fa378d4a0" path="/var/lib/kubelet/pods/c73f0709-a978-490d-9254-942fa378d4a0/volumes"
Nov 03 21:52:50.735617 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:50.735603    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d6341fcc-32dc-42be-b7a9-83e65a6b1615" path="/var/lib/kubelet/pods/d6341fcc-32dc-42be-b7a9-83e65a6b1615/volumes"
Nov 03 21:52:50.735909 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:50.735898    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d74a1a61-47a5-4d85-858b-2e3572fad7c8" path="/var/lib/kubelet/pods/d74a1a61-47a5-4d85-858b-2e3572fad7c8/volumes"
Nov 03 21:52:50.975828 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:50.975797    5077 generic.go:356] "Generic (PLEG): container finished" podID="d6341fcc-32dc-42be-b7a9-83e65a6b1615" containerID="8a068e00913682feb667dcaf67df90d1e8ddcd87eb62f7eeab6f19461190b16b" exitCode=0
Nov 03 21:52:50.976318 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:50.975852    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-rcm9x"
Nov 03 21:52:50.976318 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:50.975908    5077 scope.go:122] "RemoveContainer" containerID="8a068e00913682feb667dcaf67df90d1e8ddcd87eb62f7eeab6f19461190b16b"
Nov 03 21:52:50.984721 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:50.984697    5077 scope.go:122] "RemoveContainer" containerID="8a068e00913682feb667dcaf67df90d1e8ddcd87eb62f7eeab6f19461190b16b"
Nov 03 21:52:50.984998 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:52:50.984964    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a068e00913682feb667dcaf67df90d1e8ddcd87eb62f7eeab6f19461190b16b\": container with ID starting with 8a068e00913682feb667dcaf67df90d1e8ddcd87eb62f7eeab6f19461190b16b not found: ID does not exist" containerID="8a068e00913682feb667dcaf67df90d1e8ddcd87eb62f7eeab6f19461190b16b"
Nov 03 21:52:50.985050 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:52:50.985010    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a068e00913682feb667dcaf67df90d1e8ddcd87eb62f7eeab6f19461190b16b"} err="failed to get container status \"8a068e00913682feb667dcaf67df90d1e8ddcd87eb62f7eeab6f19461190b16b\": rpc error: code = NotFound desc = could not find container \"8a068e00913682feb667dcaf67df90d1e8ddcd87eb62f7eeab6f19461190b16b\": container with ID starting with 8a068e00913682feb667dcaf67df90d1e8ddcd87eb62f7eeab6f19461190b16b not found: ID does not exist"
Nov 03 21:52:59.925415 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:52:59.925380    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:53:00.979369 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:00.979334    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j"
Nov 03 21:53:00.979758 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:00.979505    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm"
Nov 03 21:53:00.979758 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:00.979548    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-zpzht"
Nov 03 21:53:01.043157 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:01.043124    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm"]
Nov 03 21:53:01.043441 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:01.043411    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm" podUID="9b9ac745-871e-4e1d-8ec0-73ba04d03bbd" containerName="manager" containerID="cri-o://438ff6f4f57688b604c9ac8152d36eaa4a9eb70d191ebaf87531109847f3564b" gracePeriod=10
Nov 03 21:53:01.305010 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:01.304987    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm"
Nov 03 21:53:01.407881 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:01.407849    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9b9ac745-871e-4e1d-8ec0-73ba04d03bbd-kube-api-access-k2nhz\" (UniqueName: \"kubernetes.io/projected/9b9ac745-871e-4e1d-8ec0-73ba04d03bbd-kube-api-access-k2nhz\") pod \"9b9ac745-871e-4e1d-8ec0-73ba04d03bbd\" (UID: \"9b9ac745-871e-4e1d-8ec0-73ba04d03bbd\") "
Nov 03 21:53:01.408086 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:01.407928    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b9ac745-871e-4e1d-8ec0-73ba04d03bbd-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b9ac745-871e-4e1d-8ec0-73ba04d03bbd-extensions-socket-volume\") pod \"9b9ac745-871e-4e1d-8ec0-73ba04d03bbd\" (UID: \"9b9ac745-871e-4e1d-8ec0-73ba04d03bbd\") "
Nov 03 21:53:01.408335 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:01.408311    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b9ac745-871e-4e1d-8ec0-73ba04d03bbd-extensions-socket-volume" pod "9b9ac745-871e-4e1d-8ec0-73ba04d03bbd" (UID: "9b9ac745-871e-4e1d-8ec0-73ba04d03bbd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:53:01.410105 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:01.410079    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b9ac745-871e-4e1d-8ec0-73ba04d03bbd-kube-api-access-k2nhz" pod "9b9ac745-871e-4e1d-8ec0-73ba04d03bbd" (UID: "9b9ac745-871e-4e1d-8ec0-73ba04d03bbd"). InnerVolumeSpecName "kube-api-access-k2nhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:53:01.508958 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:01.508925    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2nhz\" (UniqueName: \"kubernetes.io/projected/9b9ac745-871e-4e1d-8ec0-73ba04d03bbd-kube-api-access-k2nhz\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:53:01.508958 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:01.508953    5077 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b9ac745-871e-4e1d-8ec0-73ba04d03bbd-extensions-socket-volume\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:53:01.883525 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:01.883492    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc"]
Nov 03 21:53:01.883926 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:01.883911    5077 cpu_manager.go:414] "containerMap: removing container" podUID="9b9ac745-871e-4e1d-8ec0-73ba04d03bbd" containerName="manager"
Nov 03 21:53:01.883993 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:01.883929    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9b9ac745-871e-4e1d-8ec0-73ba04d03bbd" containerName="manager"
Nov 03 21:53:01.884030 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:01.884016    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="9b9ac745-871e-4e1d-8ec0-73ba04d03bbd" containerName="manager"
Nov 03 21:53:01.887491 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:01.887476    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc"
Nov 03 21:53:01.903572 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:01.903546    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc"]
Nov 03 21:53:02.013119 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:02.013074    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcf8z\" (UniqueName: \"kubernetes.io/projected/4eb24628-9a15-475b-922b-e0aa4280697d-kube-api-access-mcf8z\") pod \"kuadrant-operator-controller-manager-57bb9bfff-n6rqc\" (UID: \"4eb24628-9a15-475b-922b-e0aa4280697d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc"
Nov 03 21:53:02.013583 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:02.013137    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4eb24628-9a15-475b-922b-e0aa4280697d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-n6rqc\" (UID: \"4eb24628-9a15-475b-922b-e0aa4280697d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc"
Nov 03 21:53:02.034745 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:02.034710    5077 generic.go:356] "Generic (PLEG): container finished" podID="9b9ac745-871e-4e1d-8ec0-73ba04d03bbd" containerID="438ff6f4f57688b604c9ac8152d36eaa4a9eb70d191ebaf87531109847f3564b" exitCode=0
Nov 03 21:53:02.034935 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:02.034762    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm"
Nov 03 21:53:02.034935 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:02.034794    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm" event={"ID":"9b9ac745-871e-4e1d-8ec0-73ba04d03bbd","Type":"ContainerDied","Data":"438ff6f4f57688b604c9ac8152d36eaa4a9eb70d191ebaf87531109847f3564b"}
Nov 03 21:53:02.034935 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:02.034850    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm" event={"ID":"9b9ac745-871e-4e1d-8ec0-73ba04d03bbd","Type":"ContainerDied","Data":"744c656c8ad07827e2b4c7db06552bbf8df52880a620e0d8b4e552f49f87fdad"}
Nov 03 21:53:02.034935 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:02.034873    5077 scope.go:122] "RemoveContainer" containerID="438ff6f4f57688b604c9ac8152d36eaa4a9eb70d191ebaf87531109847f3564b"
Nov 03 21:53:02.047661 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:02.047497    5077 scope.go:122] "RemoveContainer" containerID="438ff6f4f57688b604c9ac8152d36eaa4a9eb70d191ebaf87531109847f3564b"
Nov 03 21:53:02.047877 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:53:02.047857    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"438ff6f4f57688b604c9ac8152d36eaa4a9eb70d191ebaf87531109847f3564b\": container with ID starting with 438ff6f4f57688b604c9ac8152d36eaa4a9eb70d191ebaf87531109847f3564b not found: ID does not exist" containerID="438ff6f4f57688b604c9ac8152d36eaa4a9eb70d191ebaf87531109847f3564b"
Nov 03 21:53:02.047939 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:02.047892    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"438ff6f4f57688b604c9ac8152d36eaa4a9eb70d191ebaf87531109847f3564b"} err="failed to get container status \"438ff6f4f57688b604c9ac8152d36eaa4a9eb70d191ebaf87531109847f3564b\": rpc error: code = NotFound desc = could not find container \"438ff6f4f57688b604c9ac8152d36eaa4a9eb70d191ebaf87531109847f3564b\": container with ID starting with 438ff6f4f57688b604c9ac8152d36eaa4a9eb70d191ebaf87531109847f3564b not found: ID does not exist"
Nov 03 21:53:02.072967 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:02.072939    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm"]
Nov 03 21:53:02.075712 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:02.075687    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-fq5cm"]
Nov 03 21:53:02.114446 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:02.114411    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4eb24628-9a15-475b-922b-e0aa4280697d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-n6rqc\" (UID: \"4eb24628-9a15-475b-922b-e0aa4280697d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc"
Nov 03 21:53:02.114616 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:02.114523    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcf8z\" (UniqueName: \"kubernetes.io/projected/4eb24628-9a15-475b-922b-e0aa4280697d-kube-api-access-mcf8z\") pod \"kuadrant-operator-controller-manager-57bb9bfff-n6rqc\" (UID: \"4eb24628-9a15-475b-922b-e0aa4280697d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc"
Nov 03 21:53:02.114796 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:02.114773    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4eb24628-9a15-475b-922b-e0aa4280697d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-n6rqc\" (UID: \"4eb24628-9a15-475b-922b-e0aa4280697d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc"
Nov 03 21:53:02.127995 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:02.127963    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcf8z\" (UniqueName: \"kubernetes.io/projected/4eb24628-9a15-475b-922b-e0aa4280697d-kube-api-access-mcf8z\") pod \"kuadrant-operator-controller-manager-57bb9bfff-n6rqc\" (UID: \"4eb24628-9a15-475b-922b-e0aa4280697d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc"
Nov 03 21:53:02.201927 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:02.201835    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc"
Nov 03 21:53:02.487903 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:02.487878    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc"]
Nov 03 21:53:02.490720 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:53:02.490688    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eb24628_9a15_475b_922b_e0aa4280697d.slice/crio-b8dd223974c7f17cbef383be5de117930fc84be11d752655a66b4d7ddfd20363 WatchSource:0}: Error finding container b8dd223974c7f17cbef383be5de117930fc84be11d752655a66b4d7ddfd20363: Status 404 returned error can't find the container with id b8dd223974c7f17cbef383be5de117930fc84be11d752655a66b4d7ddfd20363
Nov 03 21:53:02.735031 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:02.734997    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9b9ac745-871e-4e1d-8ec0-73ba04d03bbd" path="/var/lib/kubelet/pods/9b9ac745-871e-4e1d-8ec0-73ba04d03bbd/volumes"
Nov 03 21:53:03.041017 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:03.040980    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc" event={"ID":"4eb24628-9a15-475b-922b-e0aa4280697d","Type":"ContainerStarted","Data":"8503634c706b524149d937f5d0ef232a7ef3258f1b34e19946b051c080e68d54"}
Nov 03 21:53:03.041525 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:03.041038    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc" event={"ID":"4eb24628-9a15-475b-922b-e0aa4280697d","Type":"ContainerStarted","Data":"b8dd223974c7f17cbef383be5de117930fc84be11d752655a66b4d7ddfd20363"}
Nov 03 21:53:03.041525 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:03.041083    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc"
Nov 03 21:53:03.067017 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:03.066963    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc" podStartSLOduration=2.066949908 podStartE2EDuration="2.066949908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:53:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:53:03.064691703 +0000 UTC m=+476.468353134" watchObservedRunningTime="2026-11-03 21:53:03.066949908 +0000 UTC m=+476.470611337"
Nov 03 21:53:14.049204 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:14.049173    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc"
Nov 03 21:53:14.113006 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:14.112973    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j"]
Nov 03 21:53:14.113410 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:14.113322    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j" podUID="9ea22438-9edd-44a5-899b-1ffab308f081" containerName="manager" containerID="cri-o://f90eaed0c382e753ccf942f9ad85bf8e99b763f84abb638094a7d52a736f5376" gracePeriod=10
Nov 03 21:53:14.364228 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:14.364202    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j"
Nov 03 21:53:14.399647 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:14.399619    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ea22438-9edd-44a5-899b-1ffab308f081-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ea22438-9edd-44a5-899b-1ffab308f081-extensions-socket-volume\") pod \"9ea22438-9edd-44a5-899b-1ffab308f081\" (UID: \"9ea22438-9edd-44a5-899b-1ffab308f081\") "
Nov 03 21:53:14.399847 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:14.399699    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ea22438-9edd-44a5-899b-1ffab308f081-kube-api-access-cgp4g\" (UniqueName: \"kubernetes.io/projected/9ea22438-9edd-44a5-899b-1ffab308f081-kube-api-access-cgp4g\") pod \"9ea22438-9edd-44a5-899b-1ffab308f081\" (UID: \"9ea22438-9edd-44a5-899b-1ffab308f081\") "
Nov 03 21:53:14.400056 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:14.400029    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea22438-9edd-44a5-899b-1ffab308f081-extensions-socket-volume" pod "9ea22438-9edd-44a5-899b-1ffab308f081" (UID: "9ea22438-9edd-44a5-899b-1ffab308f081"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:53:14.402121 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:14.402094    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ea22438-9edd-44a5-899b-1ffab308f081-kube-api-access-cgp4g" pod "9ea22438-9edd-44a5-899b-1ffab308f081" (UID: "9ea22438-9edd-44a5-899b-1ffab308f081"). InnerVolumeSpecName "kube-api-access-cgp4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:53:14.500423 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:14.500385    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgp4g\" (UniqueName: \"kubernetes.io/projected/9ea22438-9edd-44a5-899b-1ffab308f081-kube-api-access-cgp4g\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:53:14.500423 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:14.500423    5077 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ea22438-9edd-44a5-899b-1ffab308f081-extensions-socket-volume\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:53:15.108547 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:15.108512    5077 generic.go:356] "Generic (PLEG): container finished" podID="9ea22438-9edd-44a5-899b-1ffab308f081" containerID="f90eaed0c382e753ccf942f9ad85bf8e99b763f84abb638094a7d52a736f5376" exitCode=0
Nov 03 21:53:15.109038 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:15.108556    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j"
Nov 03 21:53:15.109038 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:15.108600    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j" event={"ID":"9ea22438-9edd-44a5-899b-1ffab308f081","Type":"ContainerDied","Data":"f90eaed0c382e753ccf942f9ad85bf8e99b763f84abb638094a7d52a736f5376"}
Nov 03 21:53:15.109038 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:15.108665    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j" event={"ID":"9ea22438-9edd-44a5-899b-1ffab308f081","Type":"ContainerDied","Data":"df90295dfd4f7d335fc7184b3b9d7e47a74792e651a97983dbb1c9b977696d49"}
Nov 03 21:53:15.109038 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:15.108697    5077 scope.go:122] "RemoveContainer" containerID="f90eaed0c382e753ccf942f9ad85bf8e99b763f84abb638094a7d52a736f5376"
Nov 03 21:53:15.118920 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:15.118728    5077 scope.go:122] "RemoveContainer" containerID="f90eaed0c382e753ccf942f9ad85bf8e99b763f84abb638094a7d52a736f5376"
Nov 03 21:53:15.119075 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:53:15.119050    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f90eaed0c382e753ccf942f9ad85bf8e99b763f84abb638094a7d52a736f5376\": container with ID starting with f90eaed0c382e753ccf942f9ad85bf8e99b763f84abb638094a7d52a736f5376 not found: ID does not exist" containerID="f90eaed0c382e753ccf942f9ad85bf8e99b763f84abb638094a7d52a736f5376"
Nov 03 21:53:15.119156 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:15.119089    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f90eaed0c382e753ccf942f9ad85bf8e99b763f84abb638094a7d52a736f5376"} err="failed to get container status \"f90eaed0c382e753ccf942f9ad85bf8e99b763f84abb638094a7d52a736f5376\": rpc error: code = NotFound desc = could not find container \"f90eaed0c382e753ccf942f9ad85bf8e99b763f84abb638094a7d52a736f5376\": container with ID starting with f90eaed0c382e753ccf942f9ad85bf8e99b763f84abb638094a7d52a736f5376 not found: ID does not exist"
Nov 03 21:53:15.130645 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:15.130616    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j"]
Nov 03 21:53:15.134142 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:15.134120    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-xqh8j"]
Nov 03 21:53:16.734312 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:16.734207    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ea22438-9edd-44a5-899b-1ffab308f081" path="/var/lib/kubelet/pods/9ea22438-9edd-44a5-899b-1ffab308f081/volumes"
Nov 03 21:53:18.182630 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.182594    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"]
Nov 03 21:53:18.183628 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.183601    5077 cpu_manager.go:414] "containerMap: removing container" podUID="9ea22438-9edd-44a5-899b-1ffab308f081" containerName="manager"
Nov 03 21:53:18.183703 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.183631    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ea22438-9edd-44a5-899b-1ffab308f081" containerName="manager"
Nov 03 21:53:18.183798 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.183787    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ea22438-9edd-44a5-899b-1ffab308f081" containerName="manager"
Nov 03 21:53:18.187623 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.187596    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.191224 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.191197    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"]
Nov 03 21:53:18.218865 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.218831    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-tn75j\""
Nov 03 21:53:18.225453 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.225430    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-workload-certs\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.225539 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.225464    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-workload-socket\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.225539 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.225483    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-istio-envoy\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.225647 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.225576    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-istio-data\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.225706 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.225654    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-credential-socket\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.225706 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.225674    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.225803 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.225709    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scg8q\" (UniqueName: \"kubernetes.io/projected/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-kube-api-access-scg8q\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.225803 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.225728    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.225903 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.225830    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-istio-token\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.327128 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.327092    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-workload-certs\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.327128 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.327132    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-workload-socket\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.327393 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.327149    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-istio-envoy\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.327393 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.327177    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-istio-data\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.327393 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.327275    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-credential-socket\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.327393 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.327299    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.327393 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.327334    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scg8q\" (UniqueName: \"kubernetes.io/projected/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-kube-api-access-scg8q\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.327393 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.327357    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.327393 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.327379    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-istio-token\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.327765 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.327544    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-workload-socket\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.327765 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.327631    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-workload-certs\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.327765 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.327738    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-istio-data\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.327885 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.327789    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-credential-socket\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.328197 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.328179    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.329568 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.329546    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-istio-envoy\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.329889 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.329873    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.339300 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.339270    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-istio-token\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.339751 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.339733    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scg8q\" (UniqueName: \"kubernetes.io/projected/1c3d0988-497b-45b2-961e-5ce3fb3e6eeb-kube-api-access-scg8q\") pod \"maas-default-gateway-openshift-default-66db998887-4vtdz\" (UID: \"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.509592 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.509514    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:18.790970 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.790893    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"]
Nov 03 21:53:18.794739 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:53:18.794714    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c3d0988_497b_45b2_961e_5ce3fb3e6eeb.slice/crio-8f8c37f74a18c588285a0e0a9bfd0d9ad4fa653f13b94526bc5a42bc131e73a9 WatchSource:0}: Error finding container 8f8c37f74a18c588285a0e0a9bfd0d9ad4fa653f13b94526bc5a42bc131e73a9: Status 404 returned error can't find the container with id 8f8c37f74a18c588285a0e0a9bfd0d9ad4fa653f13b94526bc5a42bc131e73a9
Nov 03 21:53:18.796833 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.796803    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:53:18.796909 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.796868    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:53:18.796909 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:18.796898    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:53:19.130891 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:19.130851    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz" event={"ID":"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb","Type":"ContainerStarted","Data":"a0109b95926de7b33c5bfb38531142fe4f7782c84541fcfc5269f344f81a0ad1"}
Nov 03 21:53:19.131072 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:19.130911    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz" event={"ID":"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb","Type":"ContainerStarted","Data":"8f8c37f74a18c588285a0e0a9bfd0d9ad4fa653f13b94526bc5a42bc131e73a9"}
Nov 03 21:53:19.172998 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:19.172943    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz" podStartSLOduration=1.172928355 podStartE2EDuration="1.172928355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:53:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:53:19.171943811 +0000 UTC m=+492.575605245" watchObservedRunningTime="2026-11-03 21:53:19.172928355 +0000 UTC m=+492.576589843"
Nov 03 21:53:19.510299 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:19.510198    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:19.515552 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:19.515526    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:20.136155 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:20.136123    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:20.137188 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:20.137167    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:53:29.933274 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:53:29.933218    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:53:32.472761 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:32.472723    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jwwzs"]
Nov 03 21:53:32.477812 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:32.477790    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-jwwzs"
Nov 03 21:53:32.481857 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:32.481835    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l7fpp\""
Nov 03 21:53:32.482006 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:32.481868    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Nov 03 21:53:32.486983 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:32.486957    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jwwzs"]
Nov 03 21:53:32.561088 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:32.561048    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7eedf1db-7f16-4678-a93a-6ed0c5fa36a8-config-file\") pod \"limitador-limitador-74dfcfb894-jwwzs\" (UID: \"7eedf1db-7f16-4678-a93a-6ed0c5fa36a8\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-jwwzs"
Nov 03 21:53:32.561088 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:32.561100    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxkps\" (UniqueName: \"kubernetes.io/projected/7eedf1db-7f16-4678-a93a-6ed0c5fa36a8-kube-api-access-nxkps\") pod \"limitador-limitador-74dfcfb894-jwwzs\" (UID: \"7eedf1db-7f16-4678-a93a-6ed0c5fa36a8\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-jwwzs"
Nov 03 21:53:32.571747 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:32.571721    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jwwzs"]
Nov 03 21:53:32.662551 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:32.662519    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7eedf1db-7f16-4678-a93a-6ed0c5fa36a8-config-file\") pod \"limitador-limitador-74dfcfb894-jwwzs\" (UID: \"7eedf1db-7f16-4678-a93a-6ed0c5fa36a8\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-jwwzs"
Nov 03 21:53:32.662551 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:32.662560    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxkps\" (UniqueName: \"kubernetes.io/projected/7eedf1db-7f16-4678-a93a-6ed0c5fa36a8-kube-api-access-nxkps\") pod \"limitador-limitador-74dfcfb894-jwwzs\" (UID: \"7eedf1db-7f16-4678-a93a-6ed0c5fa36a8\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-jwwzs"
Nov 03 21:53:32.663372 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:32.663349    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7eedf1db-7f16-4678-a93a-6ed0c5fa36a8-config-file\") pod \"limitador-limitador-74dfcfb894-jwwzs\" (UID: \"7eedf1db-7f16-4678-a93a-6ed0c5fa36a8\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-jwwzs"
Nov 03 21:53:32.679183 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:32.679136    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxkps\" (UniqueName: \"kubernetes.io/projected/7eedf1db-7f16-4678-a93a-6ed0c5fa36a8-kube-api-access-nxkps\") pod \"limitador-limitador-74dfcfb894-jwwzs\" (UID: \"7eedf1db-7f16-4678-a93a-6ed0c5fa36a8\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-jwwzs"
Nov 03 21:53:32.793061 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:32.792983    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-jwwzs"
Nov 03 21:53:33.068515 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:33.068486    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jwwzs"]
Nov 03 21:53:33.072300 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:53:33.072271    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eedf1db_7f16_4678_a93a_6ed0c5fa36a8.slice/crio-cf11768fcd3d59c39bbd5f3ed34282dba774465798ceb63070ac5b29ada9401a WatchSource:0}: Error finding container cf11768fcd3d59c39bbd5f3ed34282dba774465798ceb63070ac5b29ada9401a: Status 404 returned error can't find the container with id cf11768fcd3d59c39bbd5f3ed34282dba774465798ceb63070ac5b29ada9401a
Nov 03 21:53:33.200077 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:33.200046    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-jwwzs" event={"ID":"7eedf1db-7f16-4678-a93a-6ed0c5fa36a8","Type":"ContainerStarted","Data":"cf11768fcd3d59c39bbd5f3ed34282dba774465798ceb63070ac5b29ada9401a"}
Nov 03 21:53:33.452385 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:33.452290    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-snxzr"]
Nov 03 21:53:33.457341 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:33.457315    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-snxzr"
Nov 03 21:53:33.461388 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:33.461362    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nqlk2\""
Nov 03 21:53:33.463495 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:33.463468    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-snxzr"]
Nov 03 21:53:33.577923 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:33.577889    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dntw\" (UniqueName: \"kubernetes.io/projected/e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd-kube-api-access-8dntw\") pod \"authorino-56c6c9ddd5-snxzr\" (UID: \"e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd\") " pod="kuadrant-system/authorino-56c6c9ddd5-snxzr"
Nov 03 21:53:33.678407 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:33.678372    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dntw\" (UniqueName: \"kubernetes.io/projected/e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd-kube-api-access-8dntw\") pod \"authorino-56c6c9ddd5-snxzr\" (UID: \"e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd\") " pod="kuadrant-system/authorino-56c6c9ddd5-snxzr"
Nov 03 21:53:33.691059 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:33.691026    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dntw\" (UniqueName: \"kubernetes.io/projected/e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd-kube-api-access-8dntw\") pod \"authorino-56c6c9ddd5-snxzr\" (UID: \"e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd\") " pod="kuadrant-system/authorino-56c6c9ddd5-snxzr"
Nov 03 21:53:33.786433 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:33.786349    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-snxzr"
Nov 03 21:53:34.058553 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:34.058531    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-snxzr"]
Nov 03 21:53:34.061022 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:53:34.060989    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9bce19f_c8ed_4f33_8cf7_c3ea8c4e47cd.slice/crio-503f1a9e96001b7aafe2641d8c23b28ae645639a574f20a79e404756d6655b41 WatchSource:0}: Error finding container 503f1a9e96001b7aafe2641d8c23b28ae645639a574f20a79e404756d6655b41: Status 404 returned error can't find the container with id 503f1a9e96001b7aafe2641d8c23b28ae645639a574f20a79e404756d6655b41
Nov 03 21:53:34.206598 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:34.206560    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-snxzr" event={"ID":"e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd","Type":"ContainerStarted","Data":"503f1a9e96001b7aafe2641d8c23b28ae645639a574f20a79e404756d6655b41"}
Nov 03 21:53:35.215049 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:35.215012    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-jwwzs" event={"ID":"7eedf1db-7f16-4678-a93a-6ed0c5fa36a8","Type":"ContainerStarted","Data":"aae828f333357be3782ebb7f94e9bf5cd46bc982eff641a150736a3b92c07fa3"}
Nov 03 21:53:35.215485 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:35.215165    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-jwwzs"
Nov 03 21:53:35.234823 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:35.234767    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-jwwzs" podStartSLOduration=1.7225542759999999 podStartE2EDuration="3.23475199s" totalImagesPullingTime="1.512197714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:53:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:53:35.234213159 +0000 UTC m=+508.637874590" watchObservedRunningTime="2026-11-03 21:53:35.23475199 +0000 UTC m=+508.638413419"
Nov 03 21:53:36.222930 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:36.222885    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-snxzr" event={"ID":"e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd","Type":"ContainerStarted","Data":"5fec045bdb90fe4a53fd4612cb088923a7208327c26081bd6657ba5f5b7d124d"}
Nov 03 21:53:36.240567 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:36.240498    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-snxzr" podStartSLOduration=1.18965473 podStartE2EDuration="3.240476442s" totalImagesPullingTime="2.050821712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:53:36.238726328 +0000 UTC m=+509.642387750" watchObservedRunningTime="2026-11-03 21:53:36.240476442 +0000 UTC m=+509.644137880"
Nov 03 21:53:46.224504 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:46.224466    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-jwwzs"
Nov 03 21:53:48.392416 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:48.392376    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jwwzs"]
Nov 03 21:53:48.393012 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:48.392614    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-jwwzs" podUID="7eedf1db-7f16-4678-a93a-6ed0c5fa36a8" containerName="limitador" containerID="cri-o://aae828f333357be3782ebb7f94e9bf5cd46bc982eff641a150736a3b92c07fa3" gracePeriod=30
Nov 03 21:53:48.943237 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:48.943205    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-jwwzs"
Nov 03 21:53:49.015724 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:49.015642    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7eedf1db-7f16-4678-a93a-6ed0c5fa36a8-kube-api-access-nxkps\" (UniqueName: \"kubernetes.io/projected/7eedf1db-7f16-4678-a93a-6ed0c5fa36a8-kube-api-access-nxkps\") pod \"7eedf1db-7f16-4678-a93a-6ed0c5fa36a8\" (UID: \"7eedf1db-7f16-4678-a93a-6ed0c5fa36a8\") "
Nov 03 21:53:49.015724 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:49.015719    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7eedf1db-7f16-4678-a93a-6ed0c5fa36a8-config-file\" (UniqueName: \"kubernetes.io/configmap/7eedf1db-7f16-4678-a93a-6ed0c5fa36a8-config-file\") pod \"7eedf1db-7f16-4678-a93a-6ed0c5fa36a8\" (UID: \"7eedf1db-7f16-4678-a93a-6ed0c5fa36a8\") "
Nov 03 21:53:49.016070 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:49.016047    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7eedf1db-7f16-4678-a93a-6ed0c5fa36a8-config-file" pod "7eedf1db-7f16-4678-a93a-6ed0c5fa36a8" (UID: "7eedf1db-7f16-4678-a93a-6ed0c5fa36a8"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:53:49.017902 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:49.017879    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7eedf1db-7f16-4678-a93a-6ed0c5fa36a8-kube-api-access-nxkps" pod "7eedf1db-7f16-4678-a93a-6ed0c5fa36a8" (UID: "7eedf1db-7f16-4678-a93a-6ed0c5fa36a8"). InnerVolumeSpecName "kube-api-access-nxkps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:53:49.117262 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:49.117212    5077 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7eedf1db-7f16-4678-a93a-6ed0c5fa36a8-config-file\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:53:49.117262 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:49.117259    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxkps\" (UniqueName: \"kubernetes.io/projected/7eedf1db-7f16-4678-a93a-6ed0c5fa36a8-kube-api-access-nxkps\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:53:49.286126 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:49.286037    5077 generic.go:356] "Generic (PLEG): container finished" podID="7eedf1db-7f16-4678-a93a-6ed0c5fa36a8" containerID="aae828f333357be3782ebb7f94e9bf5cd46bc982eff641a150736a3b92c07fa3" exitCode=0
Nov 03 21:53:49.286126 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:49.286076    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-jwwzs" event={"ID":"7eedf1db-7f16-4678-a93a-6ed0c5fa36a8","Type":"ContainerDied","Data":"aae828f333357be3782ebb7f94e9bf5cd46bc982eff641a150736a3b92c07fa3"}
Nov 03 21:53:49.286126 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:49.286085    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-jwwzs"
Nov 03 21:53:49.286126 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:49.286119    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-jwwzs" event={"ID":"7eedf1db-7f16-4678-a93a-6ed0c5fa36a8","Type":"ContainerDied","Data":"cf11768fcd3d59c39bbd5f3ed34282dba774465798ceb63070ac5b29ada9401a"}
Nov 03 21:53:49.286433 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:49.286143    5077 scope.go:122] "RemoveContainer" containerID="aae828f333357be3782ebb7f94e9bf5cd46bc982eff641a150736a3b92c07fa3"
Nov 03 21:53:49.295573 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:49.295548    5077 scope.go:122] "RemoveContainer" containerID="aae828f333357be3782ebb7f94e9bf5cd46bc982eff641a150736a3b92c07fa3"
Nov 03 21:53:49.295918 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:53:49.295899    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aae828f333357be3782ebb7f94e9bf5cd46bc982eff641a150736a3b92c07fa3\": container with ID starting with aae828f333357be3782ebb7f94e9bf5cd46bc982eff641a150736a3b92c07fa3 not found: ID does not exist" containerID="aae828f333357be3782ebb7f94e9bf5cd46bc982eff641a150736a3b92c07fa3"
Nov 03 21:53:49.295974 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:49.295928    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aae828f333357be3782ebb7f94e9bf5cd46bc982eff641a150736a3b92c07fa3"} err="failed to get container status \"aae828f333357be3782ebb7f94e9bf5cd46bc982eff641a150736a3b92c07fa3\": rpc error: code = NotFound desc = could not find container \"aae828f333357be3782ebb7f94e9bf5cd46bc982eff641a150736a3b92c07fa3\": container with ID starting with aae828f333357be3782ebb7f94e9bf5cd46bc982eff641a150736a3b92c07fa3 not found: ID does not exist"
Nov 03 21:53:49.310191 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:49.310154    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jwwzs"]
Nov 03 21:53:49.314446 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:49.314422    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jwwzs"]
Nov 03 21:53:50.734475 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:53:50.734441    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7eedf1db-7f16-4678-a93a-6ed0c5fa36a8" path="/var/lib/kubelet/pods/7eedf1db-7f16-4678-a93a-6ed0c5fa36a8/volumes"
Nov 03 21:53:59.925815 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:53:59.925770    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:54:06.469242 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:06.469209    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-v9tp4"]
Nov 03 21:54:06.469685 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:06.469672    5077 cpu_manager.go:414] "containerMap: removing container" podUID="7eedf1db-7f16-4678-a93a-6ed0c5fa36a8" containerName="limitador"
Nov 03 21:54:06.469730 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:06.469687    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7eedf1db-7f16-4678-a93a-6ed0c5fa36a8" containerName="limitador"
Nov 03 21:54:06.469764 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:06.469752    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="7eedf1db-7f16-4678-a93a-6ed0c5fa36a8" containerName="limitador"
Nov 03 21:54:06.474190 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:06.474169    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-v9tp4"
Nov 03 21:54:06.478659 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:06.478606    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Nov 03 21:54:06.480631 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:06.480612    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-v9tp4"]
Nov 03 21:54:06.568439 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:06.568409    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4-tls-cert\") pod \"authorino-6889cbd8c4-v9tp4\" (UID: \"f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4\") " pod="kuadrant-system/authorino-6889cbd8c4-v9tp4"
Nov 03 21:54:06.568603 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:06.568469    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wq9r\" (UniqueName: \"kubernetes.io/projected/f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4-kube-api-access-9wq9r\") pod \"authorino-6889cbd8c4-v9tp4\" (UID: \"f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4\") " pod="kuadrant-system/authorino-6889cbd8c4-v9tp4"
Nov 03 21:54:06.669318 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:06.669277    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4-tls-cert\") pod \"authorino-6889cbd8c4-v9tp4\" (UID: \"f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4\") " pod="kuadrant-system/authorino-6889cbd8c4-v9tp4"
Nov 03 21:54:06.669601 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:06.669377    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wq9r\" (UniqueName: \"kubernetes.io/projected/f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4-kube-api-access-9wq9r\") pod \"authorino-6889cbd8c4-v9tp4\" (UID: \"f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4\") " pod="kuadrant-system/authorino-6889cbd8c4-v9tp4"
Nov 03 21:54:06.672148 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:06.672127    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4-tls-cert\") pod \"authorino-6889cbd8c4-v9tp4\" (UID: \"f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4\") " pod="kuadrant-system/authorino-6889cbd8c4-v9tp4"
Nov 03 21:54:06.681984 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:06.681962    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wq9r\" (UniqueName: \"kubernetes.io/projected/f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4-kube-api-access-9wq9r\") pod \"authorino-6889cbd8c4-v9tp4\" (UID: \"f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4\") " pod="kuadrant-system/authorino-6889cbd8c4-v9tp4"
Nov 03 21:54:06.687207 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:06.687184    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-v9tp4"]
Nov 03 21:54:06.687414 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:06.687402    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-v9tp4"
Nov 03 21:54:06.964956 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:06.964929    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-v9tp4"]
Nov 03 21:54:06.967689 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:54:06.967656    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6c7dfd4_0bc5_4aff_8c89_3402bf3b43c4.slice/crio-1112f19959b4b48602ed444061bd34a6d3db298df44015fecb234ff6d23a34df WatchSource:0}: Error finding container 1112f19959b4b48602ed444061bd34a6d3db298df44015fecb234ff6d23a34df: Status 404 returned error can't find the container with id 1112f19959b4b48602ed444061bd34a6d3db298df44015fecb234ff6d23a34df
Nov 03 21:54:07.375313 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:07.375276    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-v9tp4" event={"ID":"f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4","Type":"ContainerStarted","Data":"1112f19959b4b48602ed444061bd34a6d3db298df44015fecb234ff6d23a34df"}
Nov 03 21:54:08.382198 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:08.382159    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-v9tp4" event={"ID":"f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4","Type":"ContainerStarted","Data":"56c8c4b0c36939c99ed1950fb4d2b344035c7c05eaf9cab357ce91e48a172c07"}
Nov 03 21:54:08.382198 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:08.382179    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6889cbd8c4-v9tp4" podUID="f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4" containerName="authorino" containerID="cri-o://56c8c4b0c36939c99ed1950fb4d2b344035c7c05eaf9cab357ce91e48a172c07" gracePeriod=30
Nov 03 21:54:08.400670 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:08.400622    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6889cbd8c4-v9tp4" podStartSLOduration=1.58438053 podStartE2EDuration="2.400607411s" totalImagesPullingTime="816.226881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:54:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:54:08.400317351 +0000 UTC m=+541.803978781" watchObservedRunningTime="2026-11-03 21:54:08.400607411 +0000 UTC m=+541.804268840"
Nov 03 21:54:08.525598 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:08.525556    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-snxzr"]
Nov 03 21:54:08.525784 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:08.525750    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-snxzr" podUID="e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd" containerName="authorino" containerID="cri-o://5fec045bdb90fe4a53fd4612cb088923a7208327c26081bd6657ba5f5b7d124d" gracePeriod=30
Nov 03 21:54:08.649184 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:08.649156    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-v9tp4"
Nov 03 21:54:08.685839 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:08.685799    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4-tls-cert\" (UniqueName: \"kubernetes.io/secret/f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4-tls-cert\") pod \"f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4\" (UID: \"f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4\") "
Nov 03 21:54:08.686015 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:08.685852    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4-kube-api-access-9wq9r\" (UniqueName: \"kubernetes.io/projected/f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4-kube-api-access-9wq9r\") pod \"f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4\" (UID: \"f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4\") "
Nov 03 21:54:08.688058 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:08.688026    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4-kube-api-access-9wq9r" pod "f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4" (UID: "f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4"). InnerVolumeSpecName "kube-api-access-9wq9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:54:08.697981 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:08.697945    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4-tls-cert" pod "f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4" (UID: "f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:54:08.785516 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:08.785490    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-snxzr"
Nov 03 21:54:08.786425 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:08.786406    5077 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4-tls-cert\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:54:08.786487 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:08.786429    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wq9r\" (UniqueName: \"kubernetes.io/projected/f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4-kube-api-access-9wq9r\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:54:08.887224 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:08.887191    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd-kube-api-access-8dntw\" (UniqueName: \"kubernetes.io/projected/e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd-kube-api-access-8dntw\") pod \"e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd\" (UID: \"e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd\") "
Nov 03 21:54:08.889420 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:08.889394    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd-kube-api-access-8dntw" pod "e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd" (UID: "e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd"). InnerVolumeSpecName "kube-api-access-8dntw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:54:08.988141 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:08.988112    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dntw\" (UniqueName: \"kubernetes.io/projected/e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd-kube-api-access-8dntw\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:54:09.389230 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:09.389199    5077 generic.go:356] "Generic (PLEG): container finished" podID="e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd" containerID="5fec045bdb90fe4a53fd4612cb088923a7208327c26081bd6657ba5f5b7d124d" exitCode=0
Nov 03 21:54:09.389701 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:09.389259    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-snxzr"
Nov 03 21:54:09.389701 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:09.389278    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-snxzr" event={"ID":"e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd","Type":"ContainerDied","Data":"5fec045bdb90fe4a53fd4612cb088923a7208327c26081bd6657ba5f5b7d124d"}
Nov 03 21:54:09.389701 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:09.389324    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-snxzr" event={"ID":"e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd","Type":"ContainerDied","Data":"503f1a9e96001b7aafe2641d8c23b28ae645639a574f20a79e404756d6655b41"}
Nov 03 21:54:09.389701 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:09.389341    5077 scope.go:122] "RemoveContainer" containerID="5fec045bdb90fe4a53fd4612cb088923a7208327c26081bd6657ba5f5b7d124d"
Nov 03 21:54:09.391079 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:09.390967    5077 generic.go:356] "Generic (PLEG): container finished" podID="f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4" containerID="56c8c4b0c36939c99ed1950fb4d2b344035c7c05eaf9cab357ce91e48a172c07" exitCode=0
Nov 03 21:54:09.391079 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:09.391049    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-v9tp4" event={"ID":"f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4","Type":"ContainerDied","Data":"56c8c4b0c36939c99ed1950fb4d2b344035c7c05eaf9cab357ce91e48a172c07"}
Nov 03 21:54:09.391365 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:09.391094    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-v9tp4" event={"ID":"f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4","Type":"ContainerDied","Data":"1112f19959b4b48602ed444061bd34a6d3db298df44015fecb234ff6d23a34df"}
Nov 03 21:54:09.391365 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:09.391155    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-v9tp4"
Nov 03 21:54:09.399193 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:09.399174    5077 scope.go:122] "RemoveContainer" containerID="5fec045bdb90fe4a53fd4612cb088923a7208327c26081bd6657ba5f5b7d124d"
Nov 03 21:54:09.399572 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:54:09.399554    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fec045bdb90fe4a53fd4612cb088923a7208327c26081bd6657ba5f5b7d124d\": container with ID starting with 5fec045bdb90fe4a53fd4612cb088923a7208327c26081bd6657ba5f5b7d124d not found: ID does not exist" containerID="5fec045bdb90fe4a53fd4612cb088923a7208327c26081bd6657ba5f5b7d124d"
Nov 03 21:54:09.399621 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:09.399581    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fec045bdb90fe4a53fd4612cb088923a7208327c26081bd6657ba5f5b7d124d"} err="failed to get container status \"5fec045bdb90fe4a53fd4612cb088923a7208327c26081bd6657ba5f5b7d124d\": rpc error: code = NotFound desc = could not find container \"5fec045bdb90fe4a53fd4612cb088923a7208327c26081bd6657ba5f5b7d124d\": container with ID starting with 5fec045bdb90fe4a53fd4612cb088923a7208327c26081bd6657ba5f5b7d124d not found: ID does not exist"
Nov 03 21:54:09.399621 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:09.399599    5077 scope.go:122] "RemoveContainer" containerID="56c8c4b0c36939c99ed1950fb4d2b344035c7c05eaf9cab357ce91e48a172c07"
Nov 03 21:54:09.407610 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:09.407594    5077 scope.go:122] "RemoveContainer" containerID="56c8c4b0c36939c99ed1950fb4d2b344035c7c05eaf9cab357ce91e48a172c07"
Nov 03 21:54:09.407950 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:54:09.407928    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56c8c4b0c36939c99ed1950fb4d2b344035c7c05eaf9cab357ce91e48a172c07\": container with ID starting with 56c8c4b0c36939c99ed1950fb4d2b344035c7c05eaf9cab357ce91e48a172c07 not found: ID does not exist" containerID="56c8c4b0c36939c99ed1950fb4d2b344035c7c05eaf9cab357ce91e48a172c07"
Nov 03 21:54:09.408056 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:09.407958    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56c8c4b0c36939c99ed1950fb4d2b344035c7c05eaf9cab357ce91e48a172c07"} err="failed to get container status \"56c8c4b0c36939c99ed1950fb4d2b344035c7c05eaf9cab357ce91e48a172c07\": rpc error: code = NotFound desc = could not find container \"56c8c4b0c36939c99ed1950fb4d2b344035c7c05eaf9cab357ce91e48a172c07\": container with ID starting with 56c8c4b0c36939c99ed1950fb4d2b344035c7c05eaf9cab357ce91e48a172c07 not found: ID does not exist"
Nov 03 21:54:09.409464 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:09.409445    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-v9tp4"]
Nov 03 21:54:09.417140 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:09.417112    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-v9tp4"]
Nov 03 21:54:09.429850 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:09.429831    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-snxzr"]
Nov 03 21:54:09.434018 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:09.433992    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-snxzr"]
Nov 03 21:54:10.734608 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:10.734549    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd" path="/var/lib/kubelet/pods/e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd/volumes"
Nov 03 21:54:10.734989 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:10.734920    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4" path="/var/lib/kubelet/pods/f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4/volumes"
Nov 03 21:54:15.659102 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.659070    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-577f596567-qzd2c"]
Nov 03 21:54:15.659535 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.659521    5077 cpu_manager.go:414] "containerMap: removing container" podUID="f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4" containerName="authorino"
Nov 03 21:54:15.659583 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.659537    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4" containerName="authorino"
Nov 03 21:54:15.659583 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.659567    5077 cpu_manager.go:414] "containerMap: removing container" podUID="e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd" containerName="authorino"
Nov 03 21:54:15.659583 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.659572    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd" containerName="authorino"
Nov 03 21:54:15.659679 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.659646    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="e9bce19f-c8ed-4f33-8cf7-c3ea8c4e47cd" containerName="authorino"
Nov 03 21:54:15.659679 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.659657    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="f6c7dfd4-0bc5-4aff-8c89-3402bf3b43c4" containerName="authorino"
Nov 03 21:54:15.665461 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.665441    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-qzd2c"
Nov 03 21:54:15.671712 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.671682    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Nov 03 21:54:15.672873 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.672853    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Nov 03 21:54:15.672987 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.672916    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tv22x\""
Nov 03 21:54:15.673055 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.673040    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Nov 03 21:54:15.674890 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.674868    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-577f596567-qzd2c"]
Nov 03 21:54:15.747040 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.746999    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/056aad18-b508-4307-9b62-fa87932184b7-webhook-cert\") pod \"maas-controller-577f596567-qzd2c\" (UID: \"056aad18-b508-4307-9b62-fa87932184b7\") " pod="opendatahub/maas-controller-577f596567-qzd2c"
Nov 03 21:54:15.747994 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.747967    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjb5q\" (UniqueName: \"kubernetes.io/projected/056aad18-b508-4307-9b62-fa87932184b7-kube-api-access-xjb5q\") pod \"maas-controller-577f596567-qzd2c\" (UID: \"056aad18-b508-4307-9b62-fa87932184b7\") " pod="opendatahub/maas-controller-577f596567-qzd2c"
Nov 03 21:54:15.748098 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.748070    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/056aad18-b508-4307-9b62-fa87932184b7-metrics-certs\") pod \"maas-controller-577f596567-qzd2c\" (UID: \"056aad18-b508-4307-9b62-fa87932184b7\") " pod="opendatahub/maas-controller-577f596567-qzd2c"
Nov 03 21:54:15.849353 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.849317    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjb5q\" (UniqueName: \"kubernetes.io/projected/056aad18-b508-4307-9b62-fa87932184b7-kube-api-access-xjb5q\") pod \"maas-controller-577f596567-qzd2c\" (UID: \"056aad18-b508-4307-9b62-fa87932184b7\") " pod="opendatahub/maas-controller-577f596567-qzd2c"
Nov 03 21:54:15.849551 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.849359    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/056aad18-b508-4307-9b62-fa87932184b7-metrics-certs\") pod \"maas-controller-577f596567-qzd2c\" (UID: \"056aad18-b508-4307-9b62-fa87932184b7\") " pod="opendatahub/maas-controller-577f596567-qzd2c"
Nov 03 21:54:15.849551 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.849402    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/056aad18-b508-4307-9b62-fa87932184b7-webhook-cert\") pod \"maas-controller-577f596567-qzd2c\" (UID: \"056aad18-b508-4307-9b62-fa87932184b7\") " pod="opendatahub/maas-controller-577f596567-qzd2c"
Nov 03 21:54:15.851995 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.851970    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/056aad18-b508-4307-9b62-fa87932184b7-webhook-cert\") pod \"maas-controller-577f596567-qzd2c\" (UID: \"056aad18-b508-4307-9b62-fa87932184b7\") " pod="opendatahub/maas-controller-577f596567-qzd2c"
Nov 03 21:54:15.852105 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.852025    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/056aad18-b508-4307-9b62-fa87932184b7-metrics-certs\") pod \"maas-controller-577f596567-qzd2c\" (UID: \"056aad18-b508-4307-9b62-fa87932184b7\") " pod="opendatahub/maas-controller-577f596567-qzd2c"
Nov 03 21:54:15.862096 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.862068    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjb5q\" (UniqueName: \"kubernetes.io/projected/056aad18-b508-4307-9b62-fa87932184b7-kube-api-access-xjb5q\") pod \"maas-controller-577f596567-qzd2c\" (UID: \"056aad18-b508-4307-9b62-fa87932184b7\") " pod="opendatahub/maas-controller-577f596567-qzd2c"
Nov 03 21:54:15.980020 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:15.979938    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-qzd2c"
Nov 03 21:54:16.007137 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:16.007105    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8f6bb67b9-7k7fc"]
Nov 03 21:54:16.014323 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:16.012819    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f6bb67b9-7k7fc"
Nov 03 21:54:16.021989 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:16.021582    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f6bb67b9-7k7fc"]
Nov 03 21:54:16.050951 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:16.050880    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b94j\" (UniqueName: \"kubernetes.io/projected/da6cd283-1c72-4bb9-9638-09c359a2730b-kube-api-access-5b94j\") pod \"maas-controller-8f6bb67b9-7k7fc\" (UID: \"da6cd283-1c72-4bb9-9638-09c359a2730b\") " pod="opendatahub/maas-controller-8f6bb67b9-7k7fc"
Nov 03 21:54:16.051095 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:16.051044    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da6cd283-1c72-4bb9-9638-09c359a2730b-metrics-certs\") pod \"maas-controller-8f6bb67b9-7k7fc\" (UID: \"da6cd283-1c72-4bb9-9638-09c359a2730b\") " pod="opendatahub/maas-controller-8f6bb67b9-7k7fc"
Nov 03 21:54:16.051170 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:16.051158    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da6cd283-1c72-4bb9-9638-09c359a2730b-webhook-cert\") pod \"maas-controller-8f6bb67b9-7k7fc\" (UID: \"da6cd283-1c72-4bb9-9638-09c359a2730b\") " pod="opendatahub/maas-controller-8f6bb67b9-7k7fc"
Nov 03 21:54:16.152412 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:16.152381    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b94j\" (UniqueName: \"kubernetes.io/projected/da6cd283-1c72-4bb9-9638-09c359a2730b-kube-api-access-5b94j\") pod \"maas-controller-8f6bb67b9-7k7fc\" (UID: \"da6cd283-1c72-4bb9-9638-09c359a2730b\") " pod="opendatahub/maas-controller-8f6bb67b9-7k7fc"
Nov 03 21:54:16.152576 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:16.152440    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da6cd283-1c72-4bb9-9638-09c359a2730b-metrics-certs\") pod \"maas-controller-8f6bb67b9-7k7fc\" (UID: \"da6cd283-1c72-4bb9-9638-09c359a2730b\") " pod="opendatahub/maas-controller-8f6bb67b9-7k7fc"
Nov 03 21:54:16.152576 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:16.152495    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da6cd283-1c72-4bb9-9638-09c359a2730b-webhook-cert\") pod \"maas-controller-8f6bb67b9-7k7fc\" (UID: \"da6cd283-1c72-4bb9-9638-09c359a2730b\") " pod="opendatahub/maas-controller-8f6bb67b9-7k7fc"
Nov 03 21:54:16.155025 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:16.154999    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da6cd283-1c72-4bb9-9638-09c359a2730b-metrics-certs\") pod \"maas-controller-8f6bb67b9-7k7fc\" (UID: \"da6cd283-1c72-4bb9-9638-09c359a2730b\") " pod="opendatahub/maas-controller-8f6bb67b9-7k7fc"
Nov 03 21:54:16.155117 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:16.155030    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da6cd283-1c72-4bb9-9638-09c359a2730b-webhook-cert\") pod \"maas-controller-8f6bb67b9-7k7fc\" (UID: \"da6cd283-1c72-4bb9-9638-09c359a2730b\") " pod="opendatahub/maas-controller-8f6bb67b9-7k7fc"
Nov 03 21:54:16.164655 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:16.164634    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b94j\" (UniqueName: \"kubernetes.io/projected/da6cd283-1c72-4bb9-9638-09c359a2730b-kube-api-access-5b94j\") pod \"maas-controller-8f6bb67b9-7k7fc\" (UID: \"da6cd283-1c72-4bb9-9638-09c359a2730b\") " pod="opendatahub/maas-controller-8f6bb67b9-7k7fc"
Nov 03 21:54:16.267941 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:16.267917    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-577f596567-qzd2c"]
Nov 03 21:54:16.270534 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:54:16.270505    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod056aad18_b508_4307_9b62_fa87932184b7.slice/crio-c649f6596528a4b66d0686ed5151270eb9b48b8dddd1fca9473368343db1b5eb WatchSource:0}: Error finding container c649f6596528a4b66d0686ed5151270eb9b48b8dddd1fca9473368343db1b5eb: Status 404 returned error can't find the container with id c649f6596528a4b66d0686ed5151270eb9b48b8dddd1fca9473368343db1b5eb
Nov 03 21:54:16.334414 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:16.334383    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f6bb67b9-7k7fc"
Nov 03 21:54:16.427902 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:16.427859    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-qzd2c" event={"ID":"056aad18-b508-4307-9b62-fa87932184b7","Type":"ContainerStarted","Data":"c649f6596528a4b66d0686ed5151270eb9b48b8dddd1fca9473368343db1b5eb"}
Nov 03 21:54:16.611144 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:16.611119    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f6bb67b9-7k7fc"]
Nov 03 21:54:16.613650 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:54:16.613623    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda6cd283_1c72_4bb9_9638_09c359a2730b.slice/crio-be5561e189581dfeecd6e3eaa874425852f1df5f5a82e927ee2592b1a46244da WatchSource:0}: Error finding container be5561e189581dfeecd6e3eaa874425852f1df5f5a82e927ee2592b1a46244da: Status 404 returned error can't find the container with id be5561e189581dfeecd6e3eaa874425852f1df5f5a82e927ee2592b1a46244da
Nov 03 21:54:17.437136 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:17.437091    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f6bb67b9-7k7fc" event={"ID":"da6cd283-1c72-4bb9-9638-09c359a2730b","Type":"ContainerStarted","Data":"be5561e189581dfeecd6e3eaa874425852f1df5f5a82e927ee2592b1a46244da"}
Nov 03 21:54:19.451165 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:19.451122    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-qzd2c" event={"ID":"056aad18-b508-4307-9b62-fa87932184b7","Type":"ContainerStarted","Data":"aa68b212b182bb19ae433d1b10edde82d4caf607d32c2e80b6da88f22547216b"}
Nov 03 21:54:19.451642 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:19.451305    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-577f596567-qzd2c"
Nov 03 21:54:19.526508 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:19.526400    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-577f596567-qzd2c" podStartSLOduration=1.533190378 podStartE2EDuration="4.526347704s" totalImagesPullingTime="2.993157326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:54:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:54:19.522454336 +0000 UTC m=+552.926115766" watchObservedRunningTime="2026-11-03 21:54:19.526347704 +0000 UTC m=+552.930009134"
Nov 03 21:54:20.457239 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:20.457196    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f6bb67b9-7k7fc" event={"ID":"da6cd283-1c72-4bb9-9638-09c359a2730b","Type":"ContainerStarted","Data":"73a828fce2e960eb8629258ce6a0bd26f2efed9739dee36dab25e9ec6f14c971"}
Nov 03 21:54:20.479034 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:20.478985    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-8f6bb67b9-7k7fc" podStartSLOduration=2.516689852 podStartE2EDuration="5.478972674s" totalImagesPullingTime="2.962282822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:54:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:54:20.478102258 +0000 UTC m=+553.881763687" watchObservedRunningTime="2026-11-03 21:54:20.478972674 +0000 UTC m=+553.882634103"
Nov 03 21:54:21.462476 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:21.462447    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8f6bb67b9-7k7fc"
Nov 03 21:54:22.892699 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:22.892661    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8"]
Nov 03 21:54:22.896983 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:22.896958    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8"
Nov 03 21:54:22.903594 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:22.903570    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\""
Nov 03 21:54:22.903743 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:22.903620    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\""
Nov 03 21:54:22.903743 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:22.903709    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-6h5gl\""
Nov 03 21:54:22.904554 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:22.904478    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\""
Nov 03 21:54:22.905123 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:22.905096    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8"]
Nov 03 21:54:23.019280 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:23.019228    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/5021d4ab-90a2-414f-aab6-947fc6e922a0-proxy-source\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-kmlh8\" (UID: \"5021d4ab-90a2-414f-aab6-947fc6e922a0\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8"
Nov 03 21:54:23.019451 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:23.019285    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fglxc\" (UniqueName: \"kubernetes.io/projected/5021d4ab-90a2-414f-aab6-947fc6e922a0-kube-api-access-fglxc\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-kmlh8\" (UID: \"5021d4ab-90a2-414f-aab6-947fc6e922a0\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8"
Nov 03 21:54:23.019500 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:23.019457    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5021d4ab-90a2-414f-aab6-947fc6e922a0-tls-cert\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-kmlh8\" (UID: \"5021d4ab-90a2-414f-aab6-947fc6e922a0\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8"
Nov 03 21:54:23.019548 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:23.019515    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5021d4ab-90a2-414f-aab6-947fc6e922a0-service-ca\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-kmlh8\" (UID: \"5021d4ab-90a2-414f-aab6-947fc6e922a0\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8"
Nov 03 21:54:23.120154 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:23.120115    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5021d4ab-90a2-414f-aab6-947fc6e922a0-service-ca\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-kmlh8\" (UID: \"5021d4ab-90a2-414f-aab6-947fc6e922a0\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8"
Nov 03 21:54:23.120375 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:23.120167    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/5021d4ab-90a2-414f-aab6-947fc6e922a0-proxy-source\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-kmlh8\" (UID: \"5021d4ab-90a2-414f-aab6-947fc6e922a0\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8"
Nov 03 21:54:23.120375 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:23.120190    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fglxc\" (UniqueName: \"kubernetes.io/projected/5021d4ab-90a2-414f-aab6-947fc6e922a0-kube-api-access-fglxc\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-kmlh8\" (UID: \"5021d4ab-90a2-414f-aab6-947fc6e922a0\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8"
Nov 03 21:54:23.120375 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:23.120321    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5021d4ab-90a2-414f-aab6-947fc6e922a0-tls-cert\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-kmlh8\" (UID: \"5021d4ab-90a2-414f-aab6-947fc6e922a0\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8"
Nov 03 21:54:23.120891 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:23.120866    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5021d4ab-90a2-414f-aab6-947fc6e922a0-service-ca\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-kmlh8\" (UID: \"5021d4ab-90a2-414f-aab6-947fc6e922a0\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8"
Nov 03 21:54:23.121205 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:23.121185    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/5021d4ab-90a2-414f-aab6-947fc6e922a0-proxy-source\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-kmlh8\" (UID: \"5021d4ab-90a2-414f-aab6-947fc6e922a0\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8"
Nov 03 21:54:23.122914 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:23.122887    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5021d4ab-90a2-414f-aab6-947fc6e922a0-tls-cert\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-kmlh8\" (UID: \"5021d4ab-90a2-414f-aab6-947fc6e922a0\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8"
Nov 03 21:54:23.133312 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:23.133291    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fglxc\" (UniqueName: \"kubernetes.io/projected/5021d4ab-90a2-414f-aab6-947fc6e922a0-kube-api-access-fglxc\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-kmlh8\" (UID: \"5021d4ab-90a2-414f-aab6-947fc6e922a0\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8"
Nov 03 21:54:23.214851 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:23.214762    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8"
Nov 03 21:54:23.498620 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:23.498548    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8"]
Nov 03 21:54:23.502029 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:54:23.502002    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5021d4ab_90a2_414f_aab6_947fc6e922a0.slice/crio-bf0a4dca84022037a212ccabb078b2979c5c644dafdc4899f7ad7e742e12ea92 WatchSource:0}: Error finding container bf0a4dca84022037a212ccabb078b2979c5c644dafdc4899f7ad7e742e12ea92: Status 404 returned error can't find the container with id bf0a4dca84022037a212ccabb078b2979c5c644dafdc4899f7ad7e742e12ea92
Nov 03 21:54:24.478915 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:24.478876    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8" event={"ID":"5021d4ab-90a2-414f-aab6-947fc6e922a0","Type":"ContainerStarted","Data":"bf0a4dca84022037a212ccabb078b2979c5c644dafdc4899f7ad7e742e12ea92"}
Nov 03 21:54:29.941538 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:54:29.941414    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:54:30.460531 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:30.460497    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-577f596567-qzd2c"
Nov 03 21:54:32.470081 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:32.470043    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8f6bb67b9-7k7fc"
Nov 03 21:54:32.524859 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:32.524823    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-577f596567-qzd2c"]
Nov 03 21:54:32.525052 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:32.525021    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-577f596567-qzd2c" podUID="056aad18-b508-4307-9b62-fa87932184b7" containerName="manager" containerID="cri-o://aa68b212b182bb19ae433d1b10edde82d4caf607d32c2e80b6da88f22547216b" gracePeriod=30
Nov 03 21:54:32.800632 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:32.800603    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-qzd2c"
Nov 03 21:54:32.923617 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:32.923574    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/056aad18-b508-4307-9b62-fa87932184b7-metrics-certs\" (UniqueName: \"kubernetes.io/secret/056aad18-b508-4307-9b62-fa87932184b7-metrics-certs\") pod \"056aad18-b508-4307-9b62-fa87932184b7\" (UID: \"056aad18-b508-4307-9b62-fa87932184b7\") "
Nov 03 21:54:32.923786 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:32.923677    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/056aad18-b508-4307-9b62-fa87932184b7-webhook-cert\" (UniqueName: \"kubernetes.io/secret/056aad18-b508-4307-9b62-fa87932184b7-webhook-cert\") pod \"056aad18-b508-4307-9b62-fa87932184b7\" (UID: \"056aad18-b508-4307-9b62-fa87932184b7\") "
Nov 03 21:54:32.923786 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:32.923744    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/056aad18-b508-4307-9b62-fa87932184b7-kube-api-access-xjb5q\" (UniqueName: \"kubernetes.io/projected/056aad18-b508-4307-9b62-fa87932184b7-kube-api-access-xjb5q\") pod \"056aad18-b508-4307-9b62-fa87932184b7\" (UID: \"056aad18-b508-4307-9b62-fa87932184b7\") "
Nov 03 21:54:32.926603 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:32.926566    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/056aad18-b508-4307-9b62-fa87932184b7-webhook-cert" pod "056aad18-b508-4307-9b62-fa87932184b7" (UID: "056aad18-b508-4307-9b62-fa87932184b7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:54:32.926603 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:32.926578    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/056aad18-b508-4307-9b62-fa87932184b7-kube-api-access-xjb5q" pod "056aad18-b508-4307-9b62-fa87932184b7" (UID: "056aad18-b508-4307-9b62-fa87932184b7"). InnerVolumeSpecName "kube-api-access-xjb5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:54:32.927444 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:32.927421    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/056aad18-b508-4307-9b62-fa87932184b7-metrics-certs" pod "056aad18-b508-4307-9b62-fa87932184b7" (UID: "056aad18-b508-4307-9b62-fa87932184b7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:54:33.024802 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:33.024717    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjb5q\" (UniqueName: \"kubernetes.io/projected/056aad18-b508-4307-9b62-fa87932184b7-kube-api-access-xjb5q\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:54:33.024802 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:33.024755    5077 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/056aad18-b508-4307-9b62-fa87932184b7-metrics-certs\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:54:33.024802 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:33.024776    5077 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/056aad18-b508-4307-9b62-fa87932184b7-webhook-cert\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:54:33.535227 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:33.535189    5077 generic.go:356] "Generic (PLEG): container finished" podID="056aad18-b508-4307-9b62-fa87932184b7" containerID="aa68b212b182bb19ae433d1b10edde82d4caf607d32c2e80b6da88f22547216b" exitCode=0
Nov 03 21:54:33.535227 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:33.535234    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-qzd2c"
Nov 03 21:54:33.535773 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:33.535278    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-qzd2c" event={"ID":"056aad18-b508-4307-9b62-fa87932184b7","Type":"ContainerDied","Data":"aa68b212b182bb19ae433d1b10edde82d4caf607d32c2e80b6da88f22547216b"}
Nov 03 21:54:33.535773 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:33.535341    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-qzd2c" event={"ID":"056aad18-b508-4307-9b62-fa87932184b7","Type":"ContainerDied","Data":"c649f6596528a4b66d0686ed5151270eb9b48b8dddd1fca9473368343db1b5eb"}
Nov 03 21:54:33.535773 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:33.535379    5077 scope.go:122] "RemoveContainer" containerID="aa68b212b182bb19ae433d1b10edde82d4caf607d32c2e80b6da88f22547216b"
Nov 03 21:54:33.546767 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:33.546184    5077 scope.go:122] "RemoveContainer" containerID="aa68b212b182bb19ae433d1b10edde82d4caf607d32c2e80b6da88f22547216b"
Nov 03 21:54:33.546767 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:54:33.546525    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa68b212b182bb19ae433d1b10edde82d4caf607d32c2e80b6da88f22547216b\": container with ID starting with aa68b212b182bb19ae433d1b10edde82d4caf607d32c2e80b6da88f22547216b not found: ID does not exist" containerID="aa68b212b182bb19ae433d1b10edde82d4caf607d32c2e80b6da88f22547216b"
Nov 03 21:54:33.546767 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:33.546552    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa68b212b182bb19ae433d1b10edde82d4caf607d32c2e80b6da88f22547216b"} err="failed to get container status \"aa68b212b182bb19ae433d1b10edde82d4caf607d32c2e80b6da88f22547216b\": rpc error: code = NotFound desc = could not find container \"aa68b212b182bb19ae433d1b10edde82d4caf607d32c2e80b6da88f22547216b\": container with ID starting with aa68b212b182bb19ae433d1b10edde82d4caf607d32c2e80b6da88f22547216b not found: ID does not exist"
Nov 03 21:54:33.561045 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:33.561021    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-577f596567-qzd2c"]
Nov 03 21:54:33.565283 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:33.565258    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-577f596567-qzd2c"]
Nov 03 21:54:34.735971 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:34.735938    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="056aad18-b508-4307-9b62-fa87932184b7" path="/var/lib/kubelet/pods/056aad18-b508-4307-9b62-fa87932184b7/volumes"
Nov 03 21:54:36.553554 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:36.553519    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8" event={"ID":"5021d4ab-90a2-414f-aab6-947fc6e922a0","Type":"ContainerStarted","Data":"78796ed00b377285729e2b6edc60aa35b01703aeac656e146926f2fdd8a3dce2"}
Nov 03 21:54:36.553983 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:36.553604    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8"
Nov 03 21:54:36.580582 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:36.580526    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8" podStartSLOduration=2.103042034 podStartE2EDuration="14.580512697s" totalImagesPullingTime="12.477470663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:54:36.578923861 +0000 UTC m=+569.982585304" watchObservedRunningTime="2026-11-03 21:54:36.580512697 +0000 UTC m=+569.984174127"
Nov 03 21:54:47.564132 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:47.564054    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-kmlh8"
Nov 03 21:54:53.097263 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.097217    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"]
Nov 03 21:54:53.097746 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.097653    5077 cpu_manager.go:414] "containerMap: removing container" podUID="056aad18-b508-4307-9b62-fa87932184b7" containerName="manager"
Nov 03 21:54:53.097746 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.097664    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="056aad18-b508-4307-9b62-fa87932184b7" containerName="manager"
Nov 03 21:54:53.097831 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.097766    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="056aad18-b508-4307-9b62-fa87932184b7" containerName="manager"
Nov 03 21:54:53.104162 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.104144    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"
Nov 03 21:54:53.110138 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.110110    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dg5g9\""
Nov 03 21:54:53.110548 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.110529    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Nov 03 21:54:53.116026 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.115998    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"]
Nov 03 21:54:53.117689 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.116789    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 03 21:54:53.117689 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.116905    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 03 21:54:53.199947 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.199910    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg4t7\" (UniqueName: \"kubernetes.io/projected/5e911317-2a54-4fad-88cc-9364d92a11d5-kube-api-access-mg4t7\") pod \"maas-api-5c48877c75-4qbxp\" (UID: \"5e911317-2a54-4fad-88cc-9364d92a11d5\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"
Nov 03 21:54:53.200148 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.199958    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e911317-2a54-4fad-88cc-9364d92a11d5-maas-api-tls\") pod \"maas-api-5c48877c75-4qbxp\" (UID: \"5e911317-2a54-4fad-88cc-9364d92a11d5\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"
Nov 03 21:54:53.200148 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.200041    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e911317-2a54-4fad-88cc-9364d92a11d5-metrics-certs\") pod \"maas-api-5c48877c75-4qbxp\" (UID: \"5e911317-2a54-4fad-88cc-9364d92a11d5\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"
Nov 03 21:54:53.200302 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.200184    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e911317-2a54-4fad-88cc-9364d92a11d5-openshift-service-ca\") pod \"maas-api-5c48877c75-4qbxp\" (UID: \"5e911317-2a54-4fad-88cc-9364d92a11d5\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"
Nov 03 21:54:53.208831 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.208809    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 03 21:54:53.301189 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.301146    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e911317-2a54-4fad-88cc-9364d92a11d5-openshift-service-ca\") pod \"maas-api-5c48877c75-4qbxp\" (UID: \"5e911317-2a54-4fad-88cc-9364d92a11d5\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"
Nov 03 21:54:53.301424 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.301221    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg4t7\" (UniqueName: \"kubernetes.io/projected/5e911317-2a54-4fad-88cc-9364d92a11d5-kube-api-access-mg4t7\") pod \"maas-api-5c48877c75-4qbxp\" (UID: \"5e911317-2a54-4fad-88cc-9364d92a11d5\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"
Nov 03 21:54:53.301424 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.301285    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e911317-2a54-4fad-88cc-9364d92a11d5-maas-api-tls\") pod \"maas-api-5c48877c75-4qbxp\" (UID: \"5e911317-2a54-4fad-88cc-9364d92a11d5\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"
Nov 03 21:54:53.301424 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.301312    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e911317-2a54-4fad-88cc-9364d92a11d5-metrics-certs\") pod \"maas-api-5c48877c75-4qbxp\" (UID: \"5e911317-2a54-4fad-88cc-9364d92a11d5\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"
Nov 03 21:54:53.301830 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.301807    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e911317-2a54-4fad-88cc-9364d92a11d5-openshift-service-ca\") pod \"maas-api-5c48877c75-4qbxp\" (UID: \"5e911317-2a54-4fad-88cc-9364d92a11d5\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"
Nov 03 21:54:53.303852 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.303830    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e911317-2a54-4fad-88cc-9364d92a11d5-metrics-certs\") pod \"maas-api-5c48877c75-4qbxp\" (UID: \"5e911317-2a54-4fad-88cc-9364d92a11d5\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"
Nov 03 21:54:53.304022 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.303998    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e911317-2a54-4fad-88cc-9364d92a11d5-maas-api-tls\") pod \"maas-api-5c48877c75-4qbxp\" (UID: \"5e911317-2a54-4fad-88cc-9364d92a11d5\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"
Nov 03 21:54:53.318323 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.318302    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg4t7\" (UniqueName: \"kubernetes.io/projected/5e911317-2a54-4fad-88cc-9364d92a11d5-kube-api-access-mg4t7\") pod \"maas-api-5c48877c75-4qbxp\" (UID: \"5e911317-2a54-4fad-88cc-9364d92a11d5\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"
Nov 03 21:54:53.425050 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.424966    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"
Nov 03 21:54:53.706968 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:53.706946    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"]
Nov 03 21:54:53.709451 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:54:53.709419    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e911317_2a54_4fad_88cc_9364d92a11d5.slice/crio-91e0bb8df01be51daecdc31978f031908e11fc8e19d056d28b01a94d499f3c40 WatchSource:0}: Error finding container 91e0bb8df01be51daecdc31978f031908e11fc8e19d056d28b01a94d499f3c40: Status 404 returned error can't find the container with id 91e0bb8df01be51daecdc31978f031908e11fc8e19d056d28b01a94d499f3c40
Nov 03 21:54:54.642649 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:54.642608    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp" event={"ID":"5e911317-2a54-4fad-88cc-9364d92a11d5","Type":"ContainerStarted","Data":"91e0bb8df01be51daecdc31978f031908e11fc8e19d056d28b01a94d499f3c40"}
Nov 03 21:54:57.669273 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:57.669189    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp" event={"ID":"5e911317-2a54-4fad-88cc-9364d92a11d5","Type":"ContainerStarted","Data":"b5278ebdb505643e93b99b20666e5ca76da6e032726290146c6a39261fea5ee1"}
Nov 03 21:54:57.679273 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:57.670113    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"
Nov 03 21:54:57.696914 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:54:57.696860    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp" podStartSLOduration=1.820664297 podStartE2EDuration="4.696845152s" totalImagesPullingTime="2.876180855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:54:57.695869208 +0000 UTC m=+591.099530639" watchObservedRunningTime="2026-11-03 21:54:57.696845152 +0000 UTC m=+591.100506581"
Nov 03 21:54:59.925484 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:54:59.925438    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:55:03.709741 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:03.709709    5077 generic.go:356] "Generic (PLEG): container finished" podID="1c3d0988-497b-45b2-961e-5ce3fb3e6eeb" containerID="a0109b95926de7b33c5bfb38531142fe4f7782c84541fcfc5269f344f81a0ad1" exitCode=0
Nov 03 21:55:03.710283 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:03.709772    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz" event={"ID":"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb","Type":"ContainerDied","Data":"a0109b95926de7b33c5bfb38531142fe4f7782c84541fcfc5269f344f81a0ad1"}
Nov 03 21:55:03.710283 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:03.710228    5077 scope.go:122] "RemoveContainer" containerID="a0109b95926de7b33c5bfb38531142fe4f7782c84541fcfc5269f344f81a0ad1"
Nov 03 21:55:03.711380 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:03.711352    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:55:03.711491 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:03.711423    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:55:03.711491 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:03.711454    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:55:04.694015 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:04.693983    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"
Nov 03 21:55:04.716140 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:04.716100    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz" event={"ID":"1c3d0988-497b-45b2-961e-5ce3fb3e6eeb","Type":"ContainerStarted","Data":"e686de6c28fa63fda193b02e6c8076195e1e1067f6f32ffaa3791838d295489c"}
Nov 03 21:55:05.136757 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:05.136720    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:55:05.510075 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:05.509986    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:55:05.511276 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:05.511230    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-4vtdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Nov 03 21:55:05.511386 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:05.511315    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz" podUID="1c3d0988-497b-45b2-961e-5ce3fb3e6eeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Nov 03 21:55:06.510790 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:06.510753    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-4vtdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Nov 03 21:55:06.511322 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:06.510834    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz" podUID="1c3d0988-497b-45b2-961e-5ce3fb3e6eeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Nov 03 21:55:06.800716 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:06.800644    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pspgs_36598f65-5a1d-43e3-acc2-71c1e56f112c/console-operator/1.log"
Nov 03 21:55:06.801521 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:06.801500    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pspgs_36598f65-5a1d-43e3-acc2-71c1e56f112c/console-operator/1.log"
Nov 03 21:55:07.510698 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:07.510661    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-4vtdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Nov 03 21:55:07.510884 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:07.510726    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz" podUID="1c3d0988-497b-45b2-961e-5ce3fb3e6eeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Nov 03 21:55:08.510774 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:08.510727    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-4vtdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Nov 03 21:55:08.510984 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:08.510787    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz" podUID="1c3d0988-497b-45b2-961e-5ce3fb3e6eeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Nov 03 21:55:09.510680 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:09.510644    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-4vtdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Nov 03 21:55:09.510877 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:09.510714    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz" podUID="1c3d0988-497b-45b2-961e-5ce3fb3e6eeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Nov 03 21:55:10.514596 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:10.514560    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:55:10.515724 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:10.515704    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz"
Nov 03 21:55:29.925919 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:55:29.925869    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:55:57.038209 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.038172    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"]
Nov 03 21:55:57.042109 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.042085    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:55:57.050394 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.050373    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Nov 03 21:55:57.051454 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.051429    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Nov 03 21:55:57.051668 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.051461    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Nov 03 21:55:57.051668 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.051502    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lj52z\""
Nov 03 21:55:57.052528 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.052507    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"]
Nov 03 21:55:57.089165 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.089136    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/752408a7-a3d9-41e1-9187-729b9e575c7a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx\" (UID: \"752408a7-a3d9-41e1-9187-729b9e575c7a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:55:57.089360 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.089275    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/752408a7-a3d9-41e1-9187-729b9e575c7a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx\" (UID: \"752408a7-a3d9-41e1-9187-729b9e575c7a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:55:57.089360 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.089322    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvplm\" (UniqueName: \"kubernetes.io/projected/752408a7-a3d9-41e1-9187-729b9e575c7a-kube-api-access-xvplm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx\" (UID: \"752408a7-a3d9-41e1-9187-729b9e575c7a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:55:57.089360 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.089348    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/752408a7-a3d9-41e1-9187-729b9e575c7a-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx\" (UID: \"752408a7-a3d9-41e1-9187-729b9e575c7a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:55:57.089508 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.089493    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/752408a7-a3d9-41e1-9187-729b9e575c7a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx\" (UID: \"752408a7-a3d9-41e1-9187-729b9e575c7a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:55:57.089545 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.089534    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/752408a7-a3d9-41e1-9187-729b9e575c7a-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx\" (UID: \"752408a7-a3d9-41e1-9187-729b9e575c7a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:55:57.190962 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.190924    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/752408a7-a3d9-41e1-9187-729b9e575c7a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx\" (UID: \"752408a7-a3d9-41e1-9187-729b9e575c7a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:55:57.191145 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.190974    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/752408a7-a3d9-41e1-9187-729b9e575c7a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx\" (UID: \"752408a7-a3d9-41e1-9187-729b9e575c7a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:55:57.191145 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.191004    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvplm\" (UniqueName: \"kubernetes.io/projected/752408a7-a3d9-41e1-9187-729b9e575c7a-kube-api-access-xvplm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx\" (UID: \"752408a7-a3d9-41e1-9187-729b9e575c7a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:55:57.191145 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.191028    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/752408a7-a3d9-41e1-9187-729b9e575c7a-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx\" (UID: \"752408a7-a3d9-41e1-9187-729b9e575c7a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:55:57.191145 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.191077    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/752408a7-a3d9-41e1-9187-729b9e575c7a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx\" (UID: \"752408a7-a3d9-41e1-9187-729b9e575c7a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:55:57.191145 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.191115    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/752408a7-a3d9-41e1-9187-729b9e575c7a-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx\" (UID: \"752408a7-a3d9-41e1-9187-729b9e575c7a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:55:57.191741 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.191426    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/752408a7-a3d9-41e1-9187-729b9e575c7a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx\" (UID: \"752408a7-a3d9-41e1-9187-729b9e575c7a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:55:57.191912 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.191878    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/752408a7-a3d9-41e1-9187-729b9e575c7a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx\" (UID: \"752408a7-a3d9-41e1-9187-729b9e575c7a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:55:57.192195 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.192108    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/752408a7-a3d9-41e1-9187-729b9e575c7a-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx\" (UID: \"752408a7-a3d9-41e1-9187-729b9e575c7a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:55:57.193795 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.193760    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/752408a7-a3d9-41e1-9187-729b9e575c7a-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx\" (UID: \"752408a7-a3d9-41e1-9187-729b9e575c7a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:55:57.194036 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.194017    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/752408a7-a3d9-41e1-9187-729b9e575c7a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx\" (UID: \"752408a7-a3d9-41e1-9187-729b9e575c7a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:55:57.203721 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.203695    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvplm\" (UniqueName: \"kubernetes.io/projected/752408a7-a3d9-41e1-9187-729b9e575c7a-kube-api-access-xvplm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx\" (UID: \"752408a7-a3d9-41e1-9187-729b9e575c7a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:55:57.357005 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.356975    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:55:57.640305 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.640268    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"]
Nov 03 21:55:57.642228 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:55:57.642197    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod752408a7_a3d9_41e1_9187_729b9e575c7a.slice/crio-1fa3bf2bd9080277ab914ef0cb599604c40df16df2b2d833fa642099f10c0875 WatchSource:0}: Error finding container 1fa3bf2bd9080277ab914ef0cb599604c40df16df2b2d833fa642099f10c0875: Status 404 returned error can't find the container with id 1fa3bf2bd9080277ab914ef0cb599604c40df16df2b2d833fa642099f10c0875
Nov 03 21:55:57.643833 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.643813    5077 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 21:55:57.979692 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:57.979546    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx" event={"ID":"752408a7-a3d9-41e1-9187-729b9e575c7a","Type":"ContainerStarted","Data":"1fa3bf2bd9080277ab914ef0cb599604c40df16df2b2d833fa642099f10c0875"}
Nov 03 21:55:59.399400 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.399361    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"]
Nov 03 21:55:59.414650 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.414599    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:55:59.414924 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.414901    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"]
Nov 03 21:55:59.425786 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.425755    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Nov 03 21:55:59.516545 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.516508    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d775b45-9909-405d-a7f4-49a16ee311ed-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-pzn78\" (UID: \"3d775b45-9909-405d-a7f4-49a16ee311ed\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:55:59.516545 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.516547    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d775b45-9909-405d-a7f4-49a16ee311ed-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-pzn78\" (UID: \"3d775b45-9909-405d-a7f4-49a16ee311ed\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:55:59.516744 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.516680    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nhrj\" (UniqueName: \"kubernetes.io/projected/3d775b45-9909-405d-a7f4-49a16ee311ed-kube-api-access-7nhrj\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-pzn78\" (UID: \"3d775b45-9909-405d-a7f4-49a16ee311ed\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:55:59.516744 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.516714    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d775b45-9909-405d-a7f4-49a16ee311ed-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-pzn78\" (UID: \"3d775b45-9909-405d-a7f4-49a16ee311ed\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:55:59.516861 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.516749    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d775b45-9909-405d-a7f4-49a16ee311ed-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-pzn78\" (UID: \"3d775b45-9909-405d-a7f4-49a16ee311ed\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:55:59.516861 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.516832    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d775b45-9909-405d-a7f4-49a16ee311ed-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-pzn78\" (UID: \"3d775b45-9909-405d-a7f4-49a16ee311ed\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:55:59.617669 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.617634    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nhrj\" (UniqueName: \"kubernetes.io/projected/3d775b45-9909-405d-a7f4-49a16ee311ed-kube-api-access-7nhrj\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-pzn78\" (UID: \"3d775b45-9909-405d-a7f4-49a16ee311ed\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:55:59.617669 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.617674    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d775b45-9909-405d-a7f4-49a16ee311ed-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-pzn78\" (UID: \"3d775b45-9909-405d-a7f4-49a16ee311ed\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:55:59.617886 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.617698    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d775b45-9909-405d-a7f4-49a16ee311ed-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-pzn78\" (UID: \"3d775b45-9909-405d-a7f4-49a16ee311ed\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:55:59.617886 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.617720    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d775b45-9909-405d-a7f4-49a16ee311ed-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-pzn78\" (UID: \"3d775b45-9909-405d-a7f4-49a16ee311ed\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:55:59.617886 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.617760    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d775b45-9909-405d-a7f4-49a16ee311ed-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-pzn78\" (UID: \"3d775b45-9909-405d-a7f4-49a16ee311ed\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:55:59.617886 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.617776    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d775b45-9909-405d-a7f4-49a16ee311ed-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-pzn78\" (UID: \"3d775b45-9909-405d-a7f4-49a16ee311ed\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:55:59.618291 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.618235    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d775b45-9909-405d-a7f4-49a16ee311ed-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-pzn78\" (UID: \"3d775b45-9909-405d-a7f4-49a16ee311ed\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:55:59.618291 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.618289    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d775b45-9909-405d-a7f4-49a16ee311ed-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-pzn78\" (UID: \"3d775b45-9909-405d-a7f4-49a16ee311ed\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:55:59.618422 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.618305    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d775b45-9909-405d-a7f4-49a16ee311ed-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-pzn78\" (UID: \"3d775b45-9909-405d-a7f4-49a16ee311ed\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:55:59.620202 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.620180    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d775b45-9909-405d-a7f4-49a16ee311ed-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-pzn78\" (UID: \"3d775b45-9909-405d-a7f4-49a16ee311ed\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:55:59.620387 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.620369    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d775b45-9909-405d-a7f4-49a16ee311ed-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-pzn78\" (UID: \"3d775b45-9909-405d-a7f4-49a16ee311ed\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:55:59.630189 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.630167    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nhrj\" (UniqueName: \"kubernetes.io/projected/3d775b45-9909-405d-a7f4-49a16ee311ed-kube-api-access-7nhrj\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-pzn78\" (UID: \"3d775b45-9909-405d-a7f4-49a16ee311ed\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:55:59.731145 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.731064    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:55:59.927411 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:55:59.927365    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:55:59.997216 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:55:59.997130    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx" event={"ID":"752408a7-a3d9-41e1-9187-729b9e575c7a","Type":"ContainerStarted","Data":"373fc6ac8d9f86bb39aac8e7390e28ab3c9de21a720172263b382fc002dd3f81"}
Nov 03 21:56:00.011132 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:00.011097    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"]
Nov 03 21:56:00.015442 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:56:00.015405    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d775b45_9909_405d_a7f4_49a16ee311ed.slice/crio-d6459f3efc27155a2fad0c0605c7f75c900b840153c889024fef6ad32e6926a2 WatchSource:0}: Error finding container d6459f3efc27155a2fad0c0605c7f75c900b840153c889024fef6ad32e6926a2: Status 404 returned error can't find the container with id d6459f3efc27155a2fad0c0605c7f75c900b840153c889024fef6ad32e6926a2
Nov 03 21:56:00.018196 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:00.018149    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx" podStartSLOduration=1.708585107 podStartE2EDuration="3.018131546s" totalImagesPullingTime="1.309546439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:55:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:56:00.016627644 +0000 UTC m=+653.420289076" watchObservedRunningTime="2026-11-03 21:56:00.018131546 +0000 UTC m=+653.421792977"
Nov 03 21:56:00.358137 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:00.358092    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:56:01.004314 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.004275    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78" event={"ID":"3d775b45-9909-405d-a7f4-49a16ee311ed","Type":"ContainerStarted","Data":"d263dfd7110219d2ee35d513124f708897bb7e0b354c95b1b11fbef675d0a3cb"}
Nov 03 21:56:01.004728 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.004334    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78" event={"ID":"3d775b45-9909-405d-a7f4-49a16ee311ed","Type":"ContainerStarted","Data":"d6459f3efc27155a2fad0c0605c7f75c900b840153c889024fef6ad32e6926a2"}
Nov 03 21:56:01.033062 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.033006    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78" podStartSLOduration=1.7345288330000002 podStartE2EDuration="2.032992961s" totalImagesPullingTime="298.464128ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:56:01.030826563 +0000 UTC m=+654.434487993" watchObservedRunningTime="2026-11-03 21:56:01.032992961 +0000 UTC m=+654.436654391"
Nov 03 21:56:01.330970 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.330939    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"]
Nov 03 21:56:01.334890 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.334867    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:01.347181 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.347154    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"]
Nov 03 21:56:01.350066 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.350044    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Nov 03 21:56:01.435944 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.435909    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzzkc\" (UniqueName: \"kubernetes.io/projected/06ba5990-697e-4c7d-b759-35b5da881b81-kube-api-access-kzzkc\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8w46m\" (UID: \"06ba5990-697e-4c7d-b759-35b5da881b81\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:01.435944 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.435949    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06ba5990-697e-4c7d-b759-35b5da881b81-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8w46m\" (UID: \"06ba5990-697e-4c7d-b759-35b5da881b81\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:01.436174 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.435974    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06ba5990-697e-4c7d-b759-35b5da881b81-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8w46m\" (UID: \"06ba5990-697e-4c7d-b759-35b5da881b81\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:01.436174 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.436091    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06ba5990-697e-4c7d-b759-35b5da881b81-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8w46m\" (UID: \"06ba5990-697e-4c7d-b759-35b5da881b81\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:01.436174 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.436125    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06ba5990-697e-4c7d-b759-35b5da881b81-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8w46m\" (UID: \"06ba5990-697e-4c7d-b759-35b5da881b81\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:01.436174 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.436142    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06ba5990-697e-4c7d-b759-35b5da881b81-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8w46m\" (UID: \"06ba5990-697e-4c7d-b759-35b5da881b81\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:01.538065 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.538021    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzzkc\" (UniqueName: \"kubernetes.io/projected/06ba5990-697e-4c7d-b759-35b5da881b81-kube-api-access-kzzkc\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8w46m\" (UID: \"06ba5990-697e-4c7d-b759-35b5da881b81\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:01.538299 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.538083    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06ba5990-697e-4c7d-b759-35b5da881b81-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8w46m\" (UID: \"06ba5990-697e-4c7d-b759-35b5da881b81\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:01.538299 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.538118    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06ba5990-697e-4c7d-b759-35b5da881b81-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8w46m\" (UID: \"06ba5990-697e-4c7d-b759-35b5da881b81\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:01.538299 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.538161    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06ba5990-697e-4c7d-b759-35b5da881b81-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8w46m\" (UID: \"06ba5990-697e-4c7d-b759-35b5da881b81\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:01.538299 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.538193    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06ba5990-697e-4c7d-b759-35b5da881b81-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8w46m\" (UID: \"06ba5990-697e-4c7d-b759-35b5da881b81\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:01.538299 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.538222    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06ba5990-697e-4c7d-b759-35b5da881b81-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8w46m\" (UID: \"06ba5990-697e-4c7d-b759-35b5da881b81\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:01.538901 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.538777    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06ba5990-697e-4c7d-b759-35b5da881b81-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8w46m\" (UID: \"06ba5990-697e-4c7d-b759-35b5da881b81\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:01.538986 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.538967    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06ba5990-697e-4c7d-b759-35b5da881b81-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8w46m\" (UID: \"06ba5990-697e-4c7d-b759-35b5da881b81\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:01.539185 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.539095    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06ba5990-697e-4c7d-b759-35b5da881b81-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8w46m\" (UID: \"06ba5990-697e-4c7d-b759-35b5da881b81\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:01.540982 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.540957    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06ba5990-697e-4c7d-b759-35b5da881b81-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8w46m\" (UID: \"06ba5990-697e-4c7d-b759-35b5da881b81\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:01.541230 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.541213    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06ba5990-697e-4c7d-b759-35b5da881b81-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8w46m\" (UID: \"06ba5990-697e-4c7d-b759-35b5da881b81\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:01.551476 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.551450    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzzkc\" (UniqueName: \"kubernetes.io/projected/06ba5990-697e-4c7d-b759-35b5da881b81-kube-api-access-kzzkc\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8w46m\" (UID: \"06ba5990-697e-4c7d-b759-35b5da881b81\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:01.653050 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.652963    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:01.732372 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.732332    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:56:01.945965 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:01.945941    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"]
Nov 03 21:56:01.949023 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:56:01.948995    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ba5990_697e_4c7d_b759_35b5da881b81.slice/crio-05531edd32d95a0ad71eacabbf74d967684e5dd92908ba411eff0c5e3bdb68e3 WatchSource:0}: Error finding container 05531edd32d95a0ad71eacabbf74d967684e5dd92908ba411eff0c5e3bdb68e3: Status 404 returned error can't find the container with id 05531edd32d95a0ad71eacabbf74d967684e5dd92908ba411eff0c5e3bdb68e3
Nov 03 21:56:02.011684 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:02.011644    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m" event={"ID":"06ba5990-697e-4c7d-b759-35b5da881b81","Type":"ContainerStarted","Data":"05531edd32d95a0ad71eacabbf74d967684e5dd92908ba411eff0c5e3bdb68e3"}
Nov 03 21:56:03.018889 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.018852    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m" event={"ID":"06ba5990-697e-4c7d-b759-35b5da881b81","Type":"ContainerStarted","Data":"ab728578a58c35f6780702e8a3c1d02080fd4b0f256feb8df237b7163e83f7f1"}
Nov 03 21:56:03.042054 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.042004    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m" podStartSLOduration=1.713799287 podStartE2EDuration="2.041989573s" totalImagesPullingTime="328.190286ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:56:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:56:03.040567536 +0000 UTC m=+656.444228966" watchObservedRunningTime="2026-11-03 21:56:03.041989573 +0000 UTC m=+656.445651002"
Nov 03 21:56:03.653708 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.653674    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:03.742587 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.742555    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"]
Nov 03 21:56:03.747693 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.747665    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:03.759382 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.759357    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Nov 03 21:56:03.771119 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.771094    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"]
Nov 03 21:56:03.865683 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.865643    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/562ac3f4-ea83-486b-9422-04e1006b7bc4-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr\" (UID: \"562ac3f4-ea83-486b-9422-04e1006b7bc4\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:03.866091 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.866067    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/562ac3f4-ea83-486b-9422-04e1006b7bc4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr\" (UID: \"562ac3f4-ea83-486b-9422-04e1006b7bc4\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:03.866334 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.866318    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/562ac3f4-ea83-486b-9422-04e1006b7bc4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr\" (UID: \"562ac3f4-ea83-486b-9422-04e1006b7bc4\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:03.866459 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.866446    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckskh\" (UniqueName: \"kubernetes.io/projected/562ac3f4-ea83-486b-9422-04e1006b7bc4-kube-api-access-ckskh\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr\" (UID: \"562ac3f4-ea83-486b-9422-04e1006b7bc4\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:03.866607 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.866595    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/562ac3f4-ea83-486b-9422-04e1006b7bc4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr\" (UID: \"562ac3f4-ea83-486b-9422-04e1006b7bc4\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:03.866708 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.866688    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/562ac3f4-ea83-486b-9422-04e1006b7bc4-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr\" (UID: \"562ac3f4-ea83-486b-9422-04e1006b7bc4\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:03.967839 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.967743    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/562ac3f4-ea83-486b-9422-04e1006b7bc4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr\" (UID: \"562ac3f4-ea83-486b-9422-04e1006b7bc4\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:03.967839 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.967797    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/562ac3f4-ea83-486b-9422-04e1006b7bc4-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr\" (UID: \"562ac3f4-ea83-486b-9422-04e1006b7bc4\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:03.968083 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.967846    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/562ac3f4-ea83-486b-9422-04e1006b7bc4-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr\" (UID: \"562ac3f4-ea83-486b-9422-04e1006b7bc4\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:03.968083 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.967909    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/562ac3f4-ea83-486b-9422-04e1006b7bc4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr\" (UID: \"562ac3f4-ea83-486b-9422-04e1006b7bc4\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:03.968083 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.967991    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/562ac3f4-ea83-486b-9422-04e1006b7bc4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr\" (UID: \"562ac3f4-ea83-486b-9422-04e1006b7bc4\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:03.968083 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.968022    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckskh\" (UniqueName: \"kubernetes.io/projected/562ac3f4-ea83-486b-9422-04e1006b7bc4-kube-api-access-ckskh\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr\" (UID: \"562ac3f4-ea83-486b-9422-04e1006b7bc4\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:03.968814 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.968784    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/562ac3f4-ea83-486b-9422-04e1006b7bc4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr\" (UID: \"562ac3f4-ea83-486b-9422-04e1006b7bc4\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:03.969127 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.969105    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/562ac3f4-ea83-486b-9422-04e1006b7bc4-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr\" (UID: \"562ac3f4-ea83-486b-9422-04e1006b7bc4\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:03.969666 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.969647    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/562ac3f4-ea83-486b-9422-04e1006b7bc4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr\" (UID: \"562ac3f4-ea83-486b-9422-04e1006b7bc4\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:03.972117 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.972086    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/562ac3f4-ea83-486b-9422-04e1006b7bc4-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr\" (UID: \"562ac3f4-ea83-486b-9422-04e1006b7bc4\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:03.982009 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.977021    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/562ac3f4-ea83-486b-9422-04e1006b7bc4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr\" (UID: \"562ac3f4-ea83-486b-9422-04e1006b7bc4\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:03.989421 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:03.989390    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckskh\" (UniqueName: \"kubernetes.io/projected/562ac3f4-ea83-486b-9422-04e1006b7bc4-kube-api-access-ckskh\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr\" (UID: \"562ac3f4-ea83-486b-9422-04e1006b7bc4\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:04.073698 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:04.073660    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:04.360707 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:04.360680    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"]
Nov 03 21:56:04.362272 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:56:04.362216    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod562ac3f4_ea83_486b_9422_04e1006b7bc4.slice/crio-b473f06547d5eb4cd7db83bcecc878024a4b6b9aa7976471e7b643bd914e9f33 WatchSource:0}: Error finding container b473f06547d5eb4cd7db83bcecc878024a4b6b9aa7976471e7b643bd914e9f33: Status 404 returned error can't find the container with id b473f06547d5eb4cd7db83bcecc878024a4b6b9aa7976471e7b643bd914e9f33
Nov 03 21:56:05.032503 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:05.032394    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr" event={"ID":"562ac3f4-ea83-486b-9422-04e1006b7bc4","Type":"ContainerStarted","Data":"749d49b907a26772bfa0f04f84bc906e57c9438a8784ec71af3abd3c8a9aa337"}
Nov 03 21:56:05.032503 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:05.032465    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr" event={"ID":"562ac3f4-ea83-486b-9422-04e1006b7bc4","Type":"ContainerStarted","Data":"b473f06547d5eb4cd7db83bcecc878024a4b6b9aa7976471e7b643bd914e9f33"}
Nov 03 21:56:05.054739 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:05.054674    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr" podStartSLOduration=1.755203373 podStartE2EDuration="2.054659128s" totalImagesPullingTime="299.455755ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:56:05.053878057 +0000 UTC m=+658.457539544" watchObservedRunningTime="2026-11-03 21:56:05.054659128 +0000 UTC m=+658.458320557"
Nov 03 21:56:05.074172 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:05.074121    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:07.357276 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:07.357174    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:56:07.377834 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:07.377802    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:56:08.060190 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:08.060157    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx"
Nov 03 21:56:09.731613 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:09.731576    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:56:09.744115 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:09.744093    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:56:10.083537 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:10.083505    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-pzn78"
Nov 03 21:56:11.654209 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:11.654175    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:11.668003 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:11.667974    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:12.093375 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:12.093343    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8w46m"
Nov 03 21:56:14.073954 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:14.073919    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:14.090713 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:14.090683    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:14.102836 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:14.102812    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr"
Nov 03 21:56:22.773396 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:22.773319    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-5477499c6-wcqx6"]
Nov 03 21:56:22.777325 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:22.777299    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5477499c6-wcqx6"
Nov 03 21:56:22.788100 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:22.788069    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5477499c6-wcqx6"]
Nov 03 21:56:22.789917 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:22.789893    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\""
Nov 03 21:56:22.790061 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:22.789970    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-f8c6z\""
Nov 03 21:56:22.870538 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:22.870512    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Nov 03 21:56:22.963230 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:22.963197    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsf2d\" (UniqueName: \"kubernetes.io/projected/9a4d758a-f75b-403d-9c92-fa92d5e18fea-kube-api-access-hsf2d\") pod \"ai-gateway-controller-5477499c6-wcqx6\" (UID: \"9a4d758a-f75b-403d-9c92-fa92d5e18fea\") " pod="opendatahub/ai-gateway-controller-5477499c6-wcqx6"
Nov 03 21:56:22.963415 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:22.963315    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a4d758a-f75b-403d-9c92-fa92d5e18fea-metrics-certs\") pod \"ai-gateway-controller-5477499c6-wcqx6\" (UID: \"9a4d758a-f75b-403d-9c92-fa92d5e18fea\") " pod="opendatahub/ai-gateway-controller-5477499c6-wcqx6"
Nov 03 21:56:23.064889 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:23.064857    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsf2d\" (UniqueName: \"kubernetes.io/projected/9a4d758a-f75b-403d-9c92-fa92d5e18fea-kube-api-access-hsf2d\") pod \"ai-gateway-controller-5477499c6-wcqx6\" (UID: \"9a4d758a-f75b-403d-9c92-fa92d5e18fea\") " pod="opendatahub/ai-gateway-controller-5477499c6-wcqx6"
Nov 03 21:56:23.065091 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:23.064924    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a4d758a-f75b-403d-9c92-fa92d5e18fea-metrics-certs\") pod \"ai-gateway-controller-5477499c6-wcqx6\" (UID: \"9a4d758a-f75b-403d-9c92-fa92d5e18fea\") " pod="opendatahub/ai-gateway-controller-5477499c6-wcqx6"
Nov 03 21:56:23.067745 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:23.067718    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a4d758a-f75b-403d-9c92-fa92d5e18fea-metrics-certs\") pod \"ai-gateway-controller-5477499c6-wcqx6\" (UID: \"9a4d758a-f75b-403d-9c92-fa92d5e18fea\") " pod="opendatahub/ai-gateway-controller-5477499c6-wcqx6"
Nov 03 21:56:23.077817 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:23.077791    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsf2d\" (UniqueName: \"kubernetes.io/projected/9a4d758a-f75b-403d-9c92-fa92d5e18fea-kube-api-access-hsf2d\") pod \"ai-gateway-controller-5477499c6-wcqx6\" (UID: \"9a4d758a-f75b-403d-9c92-fa92d5e18fea\") " pod="opendatahub/ai-gateway-controller-5477499c6-wcqx6"
Nov 03 21:56:23.092027 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:23.092002    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5477499c6-wcqx6"
Nov 03 21:56:23.384098 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:23.384074    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5477499c6-wcqx6"]
Nov 03 21:56:23.385756 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:56:23.385725    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a4d758a_f75b_403d_9c92_fa92d5e18fea.slice/crio-0115e2ff600ce1f53a4c3083451c90546c514e52e3515117172db703f400a35d WatchSource:0}: Error finding container 0115e2ff600ce1f53a4c3083451c90546c514e52e3515117172db703f400a35d: Status 404 returned error can't find the container with id 0115e2ff600ce1f53a4c3083451c90546c514e52e3515117172db703f400a35d
Nov 03 21:56:24.143749 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:24.143712    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5477499c6-wcqx6" event={"ID":"9a4d758a-f75b-403d-9c92-fa92d5e18fea","Type":"ContainerStarted","Data":"0115e2ff600ce1f53a4c3083451c90546c514e52e3515117172db703f400a35d"}
Nov 03 21:56:27.164323 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:27.164283    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5477499c6-wcqx6" event={"ID":"9a4d758a-f75b-403d-9c92-fa92d5e18fea","Type":"ContainerStarted","Data":"0c5f0ada9e67d05d0c3803b8837435e4aa702df47eca0ef5fe2271541198ef64"}
Nov 03 21:56:27.164788 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:27.164450    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-5477499c6-wcqx6"
Nov 03 21:56:27.182835 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:27.182787    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-5477499c6-wcqx6" podStartSLOduration=1.5929540960000002 podStartE2EDuration="5.182772387s" totalImagesPullingTime="3.589818291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:56:27.181742392 +0000 UTC m=+680.585403823" watchObservedRunningTime="2026-11-03 21:56:27.182772387 +0000 UTC m=+680.586433816"
Nov 03 21:56:27.852971 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:27.852939    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-wlkwf"]
Nov 03 21:56:27.856872 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:27.856847    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-wlkwf"
Nov 03 21:56:27.866421 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:27.866400    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Nov 03 21:56:27.867222 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:27.866646    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7nk2m\""
Nov 03 21:56:27.869549 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:27.869528    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-wlkwf"]
Nov 03 21:56:27.920549 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:27.920520    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh9gh\" (UniqueName: \"kubernetes.io/projected/ba0fd87d-78b8-4a24-9e33-4904dafbbb63-kube-api-access-bh9gh\") pod \"payload-pre-processing-7b98bb678c-wlkwf\" (UID: \"ba0fd87d-78b8-4a24-9e33-4904dafbbb63\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-wlkwf"
Nov 03 21:56:27.920708 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:27.920590    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba0fd87d-78b8-4a24-9e33-4904dafbbb63-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-wlkwf\" (UID: \"ba0fd87d-78b8-4a24-9e33-4904dafbbb63\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-wlkwf"
Nov 03 21:56:27.948295 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:27.948265    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-xqtpq"]
Nov 03 21:56:27.952011 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:27.951994    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-xqtpq"
Nov 03 21:56:27.999278 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:27.999217    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-xqtpq"]
Nov 03 21:56:28.021812 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:28.021779    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/851f4598-e261-4024-8a45-a831aa9dd4a4-plugins-config-volume\") pod \"payload-processing-5f78687d5b-xqtpq\" (UID: \"851f4598-e261-4024-8a45-a831aa9dd4a4\") " pod="openshift-ingress/payload-processing-5f78687d5b-xqtpq"
Nov 03 21:56:28.022189 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:28.022155    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh9gh\" (UniqueName: \"kubernetes.io/projected/ba0fd87d-78b8-4a24-9e33-4904dafbbb63-kube-api-access-bh9gh\") pod \"payload-pre-processing-7b98bb678c-wlkwf\" (UID: \"ba0fd87d-78b8-4a24-9e33-4904dafbbb63\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-wlkwf"
Nov 03 21:56:28.022719 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:28.022694    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfvlr\" (UniqueName: \"kubernetes.io/projected/851f4598-e261-4024-8a45-a831aa9dd4a4-kube-api-access-kfvlr\") pod \"payload-processing-5f78687d5b-xqtpq\" (UID: \"851f4598-e261-4024-8a45-a831aa9dd4a4\") " pod="openshift-ingress/payload-processing-5f78687d5b-xqtpq"
Nov 03 21:56:28.022922 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:28.022903    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba0fd87d-78b8-4a24-9e33-4904dafbbb63-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-wlkwf\" (UID: \"ba0fd87d-78b8-4a24-9e33-4904dafbbb63\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-wlkwf"
Nov 03 21:56:28.023970 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:28.023945    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba0fd87d-78b8-4a24-9e33-4904dafbbb63-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-wlkwf\" (UID: \"ba0fd87d-78b8-4a24-9e33-4904dafbbb63\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-wlkwf"
Nov 03 21:56:28.035567 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:28.035540    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh9gh\" (UniqueName: \"kubernetes.io/projected/ba0fd87d-78b8-4a24-9e33-4904dafbbb63-kube-api-access-bh9gh\") pod \"payload-pre-processing-7b98bb678c-wlkwf\" (UID: \"ba0fd87d-78b8-4a24-9e33-4904dafbbb63\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-wlkwf"
Nov 03 21:56:28.123763 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:28.123686    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/851f4598-e261-4024-8a45-a831aa9dd4a4-plugins-config-volume\") pod \"payload-processing-5f78687d5b-xqtpq\" (UID: \"851f4598-e261-4024-8a45-a831aa9dd4a4\") " pod="openshift-ingress/payload-processing-5f78687d5b-xqtpq"
Nov 03 21:56:28.123763 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:28.123753    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfvlr\" (UniqueName: \"kubernetes.io/projected/851f4598-e261-4024-8a45-a831aa9dd4a4-kube-api-access-kfvlr\") pod \"payload-processing-5f78687d5b-xqtpq\" (UID: \"851f4598-e261-4024-8a45-a831aa9dd4a4\") " pod="openshift-ingress/payload-processing-5f78687d5b-xqtpq"
Nov 03 21:56:28.124394 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:28.124375    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/851f4598-e261-4024-8a45-a831aa9dd4a4-plugins-config-volume\") pod \"payload-processing-5f78687d5b-xqtpq\" (UID: \"851f4598-e261-4024-8a45-a831aa9dd4a4\") " pod="openshift-ingress/payload-processing-5f78687d5b-xqtpq"
Nov 03 21:56:28.136047 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:28.136016    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfvlr\" (UniqueName: \"kubernetes.io/projected/851f4598-e261-4024-8a45-a831aa9dd4a4-kube-api-access-kfvlr\") pod \"payload-processing-5f78687d5b-xqtpq\" (UID: \"851f4598-e261-4024-8a45-a831aa9dd4a4\") " pod="openshift-ingress/payload-processing-5f78687d5b-xqtpq"
Nov 03 21:56:28.173964 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:28.173935    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-wlkwf"
Nov 03 21:56:28.267858 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:28.267823    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-xqtpq"
Nov 03 21:56:28.459924 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:28.459894    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-wlkwf"]
Nov 03 21:56:28.461889 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:56:28.461862    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba0fd87d_78b8_4a24_9e33_4904dafbbb63.slice/crio-4ebee97157b1b3c0bad8829b6e0ea8f2e4cba545e78d4aa137790dc536e8ebcc WatchSource:0}: Error finding container 4ebee97157b1b3c0bad8829b6e0ea8f2e4cba545e78d4aa137790dc536e8ebcc: Status 404 returned error can't find the container with id 4ebee97157b1b3c0bad8829b6e0ea8f2e4cba545e78d4aa137790dc536e8ebcc
Nov 03 21:56:28.557171 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:28.556992    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-xqtpq"]
Nov 03 21:56:28.559510 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:56:28.559480    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod851f4598_e261_4024_8a45_a831aa9dd4a4.slice/crio-64a279876caba6e5cffc1317f3b6943d8459bdd9a5dd27d3c5bc0b0b76a96ffe WatchSource:0}: Error finding container 64a279876caba6e5cffc1317f3b6943d8459bdd9a5dd27d3c5bc0b0b76a96ffe: Status 404 returned error can't find the container with id 64a279876caba6e5cffc1317f3b6943d8459bdd9a5dd27d3c5bc0b0b76a96ffe
Nov 03 21:56:29.178848 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:29.178695    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-xqtpq" event={"ID":"851f4598-e261-4024-8a45-a831aa9dd4a4","Type":"ContainerStarted","Data":"64a279876caba6e5cffc1317f3b6943d8459bdd9a5dd27d3c5bc0b0b76a96ffe"}
Nov 03 21:56:29.180229 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:29.180201    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-wlkwf" event={"ID":"ba0fd87d-78b8-4a24-9e33-4904dafbbb63","Type":"ContainerStarted","Data":"4ebee97157b1b3c0bad8829b6e0ea8f2e4cba545e78d4aa137790dc536e8ebcc"}
Nov 03 21:56:29.928997 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:56:29.928920    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:56:31.194206 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:31.193915    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-wlkwf" event={"ID":"ba0fd87d-78b8-4a24-9e33-4904dafbbb63","Type":"ContainerStarted","Data":"a7c92b71f8a3f6cb9be430d3b8ad6659b0a888c2c9b54c33ce256970aeea48de"}
Nov 03 21:56:31.194206 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:31.193990    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-wlkwf"
Nov 03 21:56:31.195587 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:31.195554    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-xqtpq" event={"ID":"851f4598-e261-4024-8a45-a831aa9dd4a4","Type":"ContainerStarted","Data":"c943af97a270e80ca4a475d2070469112e603a6c55e318ed47b1e8edfa093366"}
Nov 03 21:56:31.195723 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:31.195622    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5f78687d5b-xqtpq"
Nov 03 21:56:31.213697 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:31.213630    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-wlkwf" podStartSLOduration=1.790099211 podStartE2EDuration="4.213614346s" totalImagesPullingTime="2.423515135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:56:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:56:31.212058438 +0000 UTC m=+684.615719870" watchObservedRunningTime="2026-11-03 21:56:31.213614346 +0000 UTC m=+684.617275776"
Nov 03 21:56:31.231075 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:31.231021    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5f78687d5b-xqtpq" podStartSLOduration=1.8584761379999999 podStartE2EDuration="4.231003698s" totalImagesPullingTime="2.37252756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:56:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:56:31.230178634 +0000 UTC m=+684.633840065" watchObservedRunningTime="2026-11-03 21:56:31.231003698 +0000 UTC m=+684.634665130"
Nov 03 21:56:33.900965 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:33.900931    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"]
Nov 03 21:56:33.904996 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:33.904976    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:33.922511 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:33.922483    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"]
Nov 03 21:56:33.991659 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:33.991617    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-workload-socket\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:33.991865 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:33.991703    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:33.991865 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:33.991811    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-istio-podinfo\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:33.991865 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:33.991848    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-istio-envoy\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:33.992052 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:33.991975    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-workload-certs\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:33.992052 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:33.992014    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-istio-token\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:33.992164 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:33.992062    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gfrf\" (UniqueName: \"kubernetes.io/projected/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-kube-api-access-5gfrf\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:33.992164 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:33.992111    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-istio-data\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:33.992164 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:33.992143    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-credential-socket\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:34.092961 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.092928    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-workload-socket\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:34.093147 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.092998    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:34.093147 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.093048    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-istio-podinfo\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:34.093147 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.093080    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-istio-envoy\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:34.093147 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.093136    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-workload-certs\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:34.093655 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.093167    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-istio-token\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:34.093655 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.093213    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gfrf\" (UniqueName: \"kubernetes.io/projected/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-kube-api-access-5gfrf\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:34.093655 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.093274    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-istio-data\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:34.093655 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.093314    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-credential-socket\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:34.093655 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.093390    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-workload-socket\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:34.093655 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.093606    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-credential-socket\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:34.093993 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.093717    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-istio-data\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:34.093993 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.093767    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:34.094108 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.094092    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-workload-certs\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:34.095846 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.095823    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-istio-envoy\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:34.095962 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.095892    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-istio-podinfo\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:34.105988 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.105969    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-istio-token\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:34.106139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.106122    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gfrf\" (UniqueName: \"kubernetes.io/projected/3d061d55-2d2d-4686-a694-4b2f1f7e4b35-kube-api-access-5gfrf\") pod \"maas-default-gateway-openshift-default-66db998887-wbrrh\" (UID: \"3d061d55-2d2d-4686-a694-4b2f1f7e4b35\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:34.220105 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.220021    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:34.505926 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.505845    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"]
Nov 03 21:56:34.509404 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:56:34.509376    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d061d55_2d2d_4686_a694_4b2f1f7e4b35.slice/crio-4edb661581c68f52558ce8ae03a3868b1f0943df4de593987ce823e45013789b WatchSource:0}: Error finding container 4edb661581c68f52558ce8ae03a3868b1f0943df4de593987ce823e45013789b: Status 404 returned error can't find the container with id 4edb661581c68f52558ce8ae03a3868b1f0943df4de593987ce823e45013789b
Nov 03 21:56:34.511862 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.511821    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:56:34.511947 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.511908    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:56:34.511985 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:34.511949    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:56:35.219197 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:35.219159    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh" event={"ID":"3d061d55-2d2d-4686-a694-4b2f1f7e4b35","Type":"ContainerStarted","Data":"3243105aae221df70f480f3af03e6781cab6a0e437351f20ae6d7bf6ad072105"}
Nov 03 21:56:35.219721 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:35.219212    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh" event={"ID":"3d061d55-2d2d-4686-a694-4b2f1f7e4b35","Type":"ContainerStarted","Data":"4edb661581c68f52558ce8ae03a3868b1f0943df4de593987ce823e45013789b"}
Nov 03 21:56:35.220509 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:35.220493    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:35.222134 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:35.222104    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-wbrrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Nov 03 21:56:35.222284 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:35.222155    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh" podUID="3d061d55-2d2d-4686-a694-4b2f1f7e4b35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Nov 03 21:56:35.243930 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:35.243877    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh" podStartSLOduration=2.243863296 podStartE2EDuration="2.243863296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:56:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:56:35.242926232 +0000 UTC m=+688.646587663" watchObservedRunningTime="2026-11-03 21:56:35.243863296 +0000 UTC m=+688.647524786"
Nov 03 21:56:36.221055 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:36.221018    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-wbrrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Nov 03 21:56:36.221517 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:36.221082    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh" podUID="3d061d55-2d2d-4686-a694-4b2f1f7e4b35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Nov 03 21:56:37.221339 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:37.221295    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-wbrrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Nov 03 21:56:37.221741 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:37.221358    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh" podUID="3d061d55-2d2d-4686-a694-4b2f1f7e4b35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Nov 03 21:56:38.179691 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:38.179661    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-5477499c6-wcqx6"
Nov 03 21:56:38.220925 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:38.220893    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-wbrrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Nov 03 21:56:38.221083 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:38.220949    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh" podUID="3d061d55-2d2d-4686-a694-4b2f1f7e4b35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Nov 03 21:56:39.221393 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:39.221356    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-wbrrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Nov 03 21:56:39.221791 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:39.221417    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh" podUID="3d061d55-2d2d-4686-a694-4b2f1f7e4b35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Nov 03 21:56:40.220627 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:40.220589    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-wbrrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Nov 03 21:56:40.220821 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:40.220661    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh" podUID="3d061d55-2d2d-4686-a694-4b2f1f7e4b35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Nov 03 21:56:41.221236 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:41.221195    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-wbrrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Nov 03 21:56:41.221628 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:41.221292    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh" podUID="3d061d55-2d2d-4686-a694-4b2f1f7e4b35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Nov 03 21:56:42.204215 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:42.204187    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5f78687d5b-xqtpq"
Nov 03 21:56:42.204520 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:42.204298    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-wlkwf"
Nov 03 21:56:42.736148 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:42.736123    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:42.736592 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:42.736474    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:42.737118 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:42.737101    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh"
Nov 03 21:56:48.930002 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:48.929964    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"]
Nov 03 21:56:48.935237 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:48.935212    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:48.947280 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:48.947225    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"]
Nov 03 21:56:49.068726 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.068688    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45431ac6-acc8-449c-8ed0-27975d792116-istio-token\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.068904 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.068756    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9db6\" (UniqueName: \"kubernetes.io/projected/45431ac6-acc8-449c-8ed0-27975d792116-kube-api-access-v9db6\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.068904 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.068834    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45431ac6-acc8-449c-8ed0-27975d792116-credential-socket\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.068904 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.068870    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45431ac6-acc8-449c-8ed0-27975d792116-istio-podinfo\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.069081 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.069012    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45431ac6-acc8-449c-8ed0-27975d792116-workload-certs\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.069081 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.069051    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45431ac6-acc8-449c-8ed0-27975d792116-istio-envoy\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.069189 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.069150    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45431ac6-acc8-449c-8ed0-27975d792116-istio-data\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.069189 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.069182    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45431ac6-acc8-449c-8ed0-27975d792116-workload-socket\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.069313 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.069217    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45431ac6-acc8-449c-8ed0-27975d792116-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.169914 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.169863    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45431ac6-acc8-449c-8ed0-27975d792116-istio-envoy\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.170095 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.169937    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45431ac6-acc8-449c-8ed0-27975d792116-istio-data\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.170095 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.169958    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45431ac6-acc8-449c-8ed0-27975d792116-workload-socket\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.170095 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.169978    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45431ac6-acc8-449c-8ed0-27975d792116-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.170095 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.170022    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45431ac6-acc8-449c-8ed0-27975d792116-istio-token\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.170095 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.170079    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9db6\" (UniqueName: \"kubernetes.io/projected/45431ac6-acc8-449c-8ed0-27975d792116-kube-api-access-v9db6\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.170396 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.170112    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45431ac6-acc8-449c-8ed0-27975d792116-credential-socket\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.170396 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.170155    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45431ac6-acc8-449c-8ed0-27975d792116-istio-podinfo\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.170396 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.170225    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45431ac6-acc8-449c-8ed0-27975d792116-workload-certs\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.170396 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.170377    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45431ac6-acc8-449c-8ed0-27975d792116-istio-data\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.170569 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.170402    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45431ac6-acc8-449c-8ed0-27975d792116-workload-socket\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.170604 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.170565    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45431ac6-acc8-449c-8ed0-27975d792116-credential-socket\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.170733 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.170712    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45431ac6-acc8-449c-8ed0-27975d792116-workload-certs\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.170890 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.170867    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45431ac6-acc8-449c-8ed0-27975d792116-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.172432 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.172412    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45431ac6-acc8-449c-8ed0-27975d792116-istio-envoy\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.172945 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.172927    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45431ac6-acc8-449c-8ed0-27975d792116-istio-podinfo\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.183075 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.183013    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45431ac6-acc8-449c-8ed0-27975d792116-istio-token\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.183160 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.183090    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9db6\" (UniqueName: \"kubernetes.io/projected/45431ac6-acc8-449c-8ed0-27975d792116-kube-api-access-v9db6\") pod \"maas-default-gateway-openshift-default-66db998887-f74lr\" (UID: \"45431ac6-acc8-449c-8ed0-27975d792116\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.255552 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.255523    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:49.539286 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.539264    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"]
Nov 03 21:56:49.541717 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:56:49.541689    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45431ac6_acc8_449c_8ed0_27975d792116.slice/crio-e8ce1fd5688eb4711ae214e78cb5e5f819cf40fa67b83d4abf8bdc2f6474170e WatchSource:0}: Error finding container e8ce1fd5688eb4711ae214e78cb5e5f819cf40fa67b83d4abf8bdc2f6474170e: Status 404 returned error can't find the container with id e8ce1fd5688eb4711ae214e78cb5e5f819cf40fa67b83d4abf8bdc2f6474170e
Nov 03 21:56:49.544194 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.544161    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:56:49.544311 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.544224    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:56:49.544311 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:49.544279    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:56:50.305088 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:50.305051    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr" event={"ID":"45431ac6-acc8-449c-8ed0-27975d792116","Type":"ContainerStarted","Data":"bf064048da12088850c158b5547f6f09cb739988e964fc53e9bb828fd506d436"}
Nov 03 21:56:50.305563 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:50.305107    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr" event={"ID":"45431ac6-acc8-449c-8ed0-27975d792116","Type":"ContainerStarted","Data":"e8ce1fd5688eb4711ae214e78cb5e5f819cf40fa67b83d4abf8bdc2f6474170e"}
Nov 03 21:56:50.330824 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:50.330777    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr" podStartSLOduration=2.330764968 podStartE2EDuration="2.330764968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:56:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:56:50.328285849 +0000 UTC m=+703.731947277" watchObservedRunningTime="2026-11-03 21:56:50.330764968 +0000 UTC m=+703.734426398"
Nov 03 21:56:51.261286 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:51.260357    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:51.261286 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:51.260523    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-f74lr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Nov 03 21:56:51.261286 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:51.260566    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr" podUID="45431ac6-acc8-449c-8ed0-27975d792116" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Nov 03 21:56:52.256805 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:52.256763    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-f74lr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Nov 03 21:56:52.257657 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:52.257609    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr" podUID="45431ac6-acc8-449c-8ed0-27975d792116" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Nov 03 21:56:53.259283 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:53.258616    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-f74lr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Nov 03 21:56:53.259283 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:53.258680    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr" podUID="45431ac6-acc8-449c-8ed0-27975d792116" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Nov 03 21:56:53.354967 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:53.354931    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-5477499c6-wcqx6"]
Nov 03 21:56:53.355522 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:53.355488    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-5477499c6-wcqx6" podUID="9a4d758a-f75b-403d-9c92-fa92d5e18fea" containerName="manager" containerID="cri-o://0c5f0ada9e67d05d0c3803b8837435e4aa702df47eca0ef5fe2271541198ef64" gracePeriod=30
Nov 03 21:56:53.646770 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:53.646510    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5477499c6-wcqx6"
Nov 03 21:56:53.714501 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:53.714470    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9a4d758a-f75b-403d-9c92-fa92d5e18fea-metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a4d758a-f75b-403d-9c92-fa92d5e18fea-metrics-certs\") pod \"9a4d758a-f75b-403d-9c92-fa92d5e18fea\" (UID: \"9a4d758a-f75b-403d-9c92-fa92d5e18fea\") "
Nov 03 21:56:53.714669 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:53.714535    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9a4d758a-f75b-403d-9c92-fa92d5e18fea-kube-api-access-hsf2d\" (UniqueName: \"kubernetes.io/projected/9a4d758a-f75b-403d-9c92-fa92d5e18fea-kube-api-access-hsf2d\") pod \"9a4d758a-f75b-403d-9c92-fa92d5e18fea\" (UID: \"9a4d758a-f75b-403d-9c92-fa92d5e18fea\") "
Nov 03 21:56:53.717104 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:53.717078    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a4d758a-f75b-403d-9c92-fa92d5e18fea-metrics-certs" pod "9a4d758a-f75b-403d-9c92-fa92d5e18fea" (UID: "9a4d758a-f75b-403d-9c92-fa92d5e18fea"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:56:53.717209 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:53.717120    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a4d758a-f75b-403d-9c92-fa92d5e18fea-kube-api-access-hsf2d" pod "9a4d758a-f75b-403d-9c92-fa92d5e18fea" (UID: "9a4d758a-f75b-403d-9c92-fa92d5e18fea"). InnerVolumeSpecName "kube-api-access-hsf2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:56:53.815189 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:53.815159    5077 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a4d758a-f75b-403d-9c92-fa92d5e18fea-metrics-certs\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:56:53.815403 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:53.815313    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsf2d\" (UniqueName: \"kubernetes.io/projected/9a4d758a-f75b-403d-9c92-fa92d5e18fea-kube-api-access-hsf2d\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:56:54.269331 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:54.259649    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-f74lr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Nov 03 21:56:54.269331 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:54.259708    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr" podUID="45431ac6-acc8-449c-8ed0-27975d792116" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Nov 03 21:56:54.327576 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:54.327541    5077 generic.go:356] "Generic (PLEG): container finished" podID="9a4d758a-f75b-403d-9c92-fa92d5e18fea" containerID="0c5f0ada9e67d05d0c3803b8837435e4aa702df47eca0ef5fe2271541198ef64" exitCode=0
Nov 03 21:56:54.327746 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:54.327600    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5477499c6-wcqx6" event={"ID":"9a4d758a-f75b-403d-9c92-fa92d5e18fea","Type":"ContainerDied","Data":"0c5f0ada9e67d05d0c3803b8837435e4aa702df47eca0ef5fe2271541198ef64"}
Nov 03 21:56:54.327746 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:54.327637    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5477499c6-wcqx6" event={"ID":"9a4d758a-f75b-403d-9c92-fa92d5e18fea","Type":"ContainerDied","Data":"0115e2ff600ce1f53a4c3083451c90546c514e52e3515117172db703f400a35d"}
Nov 03 21:56:54.327746 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:54.327658    5077 scope.go:122] "RemoveContainer" containerID="0c5f0ada9e67d05d0c3803b8837435e4aa702df47eca0ef5fe2271541198ef64"
Nov 03 21:56:54.327849 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:54.327771    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5477499c6-wcqx6"
Nov 03 21:56:54.338804 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:54.338786    5077 scope.go:122] "RemoveContainer" containerID="0c5f0ada9e67d05d0c3803b8837435e4aa702df47eca0ef5fe2271541198ef64"
Nov 03 21:56:54.339057 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:56:54.339039    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c5f0ada9e67d05d0c3803b8837435e4aa702df47eca0ef5fe2271541198ef64\": container with ID starting with 0c5f0ada9e67d05d0c3803b8837435e4aa702df47eca0ef5fe2271541198ef64 not found: ID does not exist" containerID="0c5f0ada9e67d05d0c3803b8837435e4aa702df47eca0ef5fe2271541198ef64"
Nov 03 21:56:54.339100 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:54.339066    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c5f0ada9e67d05d0c3803b8837435e4aa702df47eca0ef5fe2271541198ef64"} err="failed to get container status \"0c5f0ada9e67d05d0c3803b8837435e4aa702df47eca0ef5fe2271541198ef64\": rpc error: code = NotFound desc = could not find container \"0c5f0ada9e67d05d0c3803b8837435e4aa702df47eca0ef5fe2271541198ef64\": container with ID starting with 0c5f0ada9e67d05d0c3803b8837435e4aa702df47eca0ef5fe2271541198ef64 not found: ID does not exist"
Nov 03 21:56:54.351052 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:54.351026    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-5477499c6-wcqx6"]
Nov 03 21:56:54.371273 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:54.355841    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-5477499c6-wcqx6"]
Nov 03 21:56:54.735033 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:54.735003    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9a4d758a-f75b-403d-9c92-fa92d5e18fea" path="/var/lib/kubelet/pods/9a4d758a-f75b-403d-9c92-fa92d5e18fea/volumes"
Nov 03 21:56:55.268678 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:55.268640    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-f74lr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Nov 03 21:56:55.268965 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:55.268936    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr" podUID="45431ac6-acc8-449c-8ed0-27975d792116" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Nov 03 21:56:56.256676 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:56.256635    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-f74lr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Nov 03 21:56:56.257093 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:56.256706    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr" podUID="45431ac6-acc8-449c-8ed0-27975d792116" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Nov 03 21:56:57.781043 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:57.781009    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:57.781625 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:57.781396    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:57.782377 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:56:57.782356    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr"
Nov 03 21:56:59.925263 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:56:59.925206    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:57:03.951496 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:03.951464    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"]
Nov 03 21:57:03.951976 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:03.951963    5077 cpu_manager.go:414] "containerMap: removing container" podUID="9a4d758a-f75b-403d-9c92-fa92d5e18fea" containerName="manager"
Nov 03 21:57:03.952018 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:03.951976    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9a4d758a-f75b-403d-9c92-fa92d5e18fea" containerName="manager"
Nov 03 21:57:03.952101 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:03.952084    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="9a4d758a-f75b-403d-9c92-fa92d5e18fea" containerName="manager"
Nov 03 21:57:03.958357 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:03.958329    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:03.969055 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:03.969016    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"]
Nov 03 21:57:04.023693 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.023658    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-istio-data\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.023693 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.023697    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.023927 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.023719    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-istio-token\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.023927 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.023795    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-workload-certs\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.023927 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.023862    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-credential-socket\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.024051 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.023947    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-workload-socket\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.024051 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.023981    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psjl7\" (UniqueName: \"kubernetes.io/projected/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-kube-api-access-psjl7\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.024051 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.024018    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-istio-envoy\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.024051 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.024037    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.124919 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.124883    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-istio-envoy\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.124919 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.124918    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.125175 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.124975    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-istio-data\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.125175 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.124997    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.125175 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.125020    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-istio-token\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.125175 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.125051    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-workload-certs\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.125175 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.125112    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-credential-socket\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.125497 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.125220    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-workload-socket\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.125559 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.125512    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-istio-data\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.125559 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.125439    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-workload-certs\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.125681 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.125580    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-credential-socket\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.125681 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.125665    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psjl7\" (UniqueName: \"kubernetes.io/projected/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-kube-api-access-psjl7\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.125846 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.125822    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.125918 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.125898    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-workload-socket\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.127452 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.127432    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-istio-envoy\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.127561 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.127544    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.137707 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.137687    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-istio-token\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.137867 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.137850    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psjl7\" (UniqueName: \"kubernetes.io/projected/9a556d4c-2e33-47b3-9d99-25d4f88acfd6-kube-api-access-psjl7\") pod \"maas-default-gateway-openshift-default-66db998887-j4nv8\" (UID: \"9a556d4c-2e33-47b3-9d99-25d4f88acfd6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.273502 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.273414    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:04.560812 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.560786    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"]
Nov 03 21:57:04.562751 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:57:04.562726    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a556d4c_2e33_47b3_9d99_25d4f88acfd6.slice/crio-b7754b1adf1f5334a48900bdac586f1ac9fd4920b7edd8e0d7adc9dc2d584a33 WatchSource:0}: Error finding container b7754b1adf1f5334a48900bdac586f1ac9fd4920b7edd8e0d7adc9dc2d584a33: Status 404 returned error can't find the container with id b7754b1adf1f5334a48900bdac586f1ac9fd4920b7edd8e0d7adc9dc2d584a33
Nov 03 21:57:04.565008 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.564978    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:57:04.565094 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.565041    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:57:04.565094 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:04.565071    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:57:05.390405 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:05.390361    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8" event={"ID":"9a556d4c-2e33-47b3-9d99-25d4f88acfd6","Type":"ContainerStarted","Data":"b3971ca85d5dcfc6c0cdc88152498d0cdd87b1f7d4c877ebf9ff47d80a396e36"}
Nov 03 21:57:05.390816 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:05.390463    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8" event={"ID":"9a556d4c-2e33-47b3-9d99-25d4f88acfd6","Type":"ContainerStarted","Data":"b7754b1adf1f5334a48900bdac586f1ac9fd4920b7edd8e0d7adc9dc2d584a33"}
Nov 03 21:57:05.416272 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:05.416196    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8" podStartSLOduration=2.416183289 podStartE2EDuration="2.416183289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:57:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:57:05.414451896 +0000 UTC m=+718.818113327" watchObservedRunningTime="2026-11-03 21:57:05.416183289 +0000 UTC m=+718.819844718"
Nov 03 21:57:06.279490 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:06.279448    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:06.281366 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:06.281339    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-j4nv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Nov 03 21:57:06.281480 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:06.281390    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8" podUID="9a556d4c-2e33-47b3-9d99-25d4f88acfd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Nov 03 21:57:07.275221 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:07.274664    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-j4nv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Nov 03 21:57:07.275221 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:07.274751    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8" podUID="9a556d4c-2e33-47b3-9d99-25d4f88acfd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Nov 03 21:57:08.276275 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:08.275566    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-j4nv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Nov 03 21:57:08.276275 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:08.275645    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8" podUID="9a556d4c-2e33-47b3-9d99-25d4f88acfd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Nov 03 21:57:09.278106 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:09.277630    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-j4nv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Nov 03 21:57:09.278106 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:09.277707    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8" podUID="9a556d4c-2e33-47b3-9d99-25d4f88acfd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Nov 03 21:57:10.279418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:10.279367    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-j4nv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Nov 03 21:57:10.279864 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:10.279452    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8" podUID="9a556d4c-2e33-47b3-9d99-25d4f88acfd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Nov 03 21:57:11.274740 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:11.274703    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-j4nv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Nov 03 21:57:11.274945 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:11.274770    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8" podUID="9a556d4c-2e33-47b3-9d99-25d4f88acfd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Nov 03 21:57:12.802136 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:12.802101    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:12.802671 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:12.802530    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:12.803437 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:12.803407    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8"
Nov 03 21:57:26.474567 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.474530    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg"]
Nov 03 21:57:26.478746 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.478727    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg"
Nov 03 21:57:26.489619 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.489595    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w5-85b4ff-dockercfg-g7fqg\""
Nov 03 21:57:26.489820 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.489657    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w5-85b4ff\""
Nov 03 21:57:26.492636 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.492612    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg"]
Nov 03 21:57:26.495338 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.495314    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz"]
Nov 03 21:57:26.500155 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.500128    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz"
Nov 03 21:57:26.510555 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.510528    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz"]
Nov 03 21:57:26.591320 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.591285    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn6xp\" (UniqueName: \"kubernetes.io/projected/e0f13297-0097-446f-8f49-9b931e44a691-kube-api-access-rn6xp\") pod \"payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz\" (UID: \"e0f13297-0097-446f-8f49-9b931e44a691\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz"
Nov 03 21:57:26.591491 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.591396    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0f13297-0097-446f-8f49-9b931e44a691-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz\" (UID: \"e0f13297-0097-446f-8f49-9b931e44a691\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz"
Nov 03 21:57:26.591540 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.591487    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9dfk\" (UniqueName: \"kubernetes.io/projected/9ddd62a2-4835-4cc4-b04d-846c174b07b6-kube-api-access-m9dfk\") pod \"payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg\" (UID: \"9ddd62a2-4835-4cc4-b04d-846c174b07b6\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg"
Nov 03 21:57:26.591585 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.591552    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ddd62a2-4835-4cc4-b04d-846c174b07b6-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg\" (UID: \"9ddd62a2-4835-4cc4-b04d-846c174b07b6\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg"
Nov 03 21:57:26.692451 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.692417    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9dfk\" (UniqueName: \"kubernetes.io/projected/9ddd62a2-4835-4cc4-b04d-846c174b07b6-kube-api-access-m9dfk\") pod \"payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg\" (UID: \"9ddd62a2-4835-4cc4-b04d-846c174b07b6\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg"
Nov 03 21:57:26.692621 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.692476    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ddd62a2-4835-4cc4-b04d-846c174b07b6-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg\" (UID: \"9ddd62a2-4835-4cc4-b04d-846c174b07b6\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg"
Nov 03 21:57:26.692621 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.692528    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn6xp\" (UniqueName: \"kubernetes.io/projected/e0f13297-0097-446f-8f49-9b931e44a691-kube-api-access-rn6xp\") pod \"payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz\" (UID: \"e0f13297-0097-446f-8f49-9b931e44a691\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz"
Nov 03 21:57:26.692621 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.692583    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0f13297-0097-446f-8f49-9b931e44a691-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz\" (UID: \"e0f13297-0097-446f-8f49-9b931e44a691\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz"
Nov 03 21:57:26.693194 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.693174    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ddd62a2-4835-4cc4-b04d-846c174b07b6-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg\" (UID: \"9ddd62a2-4835-4cc4-b04d-846c174b07b6\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg"
Nov 03 21:57:26.693268 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.693234    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0f13297-0097-446f-8f49-9b931e44a691-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz\" (UID: \"e0f13297-0097-446f-8f49-9b931e44a691\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz"
Nov 03 21:57:26.705704 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.705663    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9dfk\" (UniqueName: \"kubernetes.io/projected/9ddd62a2-4835-4cc4-b04d-846c174b07b6-kube-api-access-m9dfk\") pod \"payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg\" (UID: \"9ddd62a2-4835-4cc4-b04d-846c174b07b6\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg"
Nov 03 21:57:26.705853 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.705796    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn6xp\" (UniqueName: \"kubernetes.io/projected/e0f13297-0097-446f-8f49-9b931e44a691-kube-api-access-rn6xp\") pod \"payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz\" (UID: \"e0f13297-0097-446f-8f49-9b931e44a691\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz"
Nov 03 21:57:26.751353 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.751275    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"]
Nov 03 21:57:26.755296 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.755265    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"
Nov 03 21:57:26.763635 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.763609    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-85b4ff-serving-cert\""
Nov 03 21:57:26.769087 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.769062    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"]
Nov 03 21:57:26.793682 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.793649    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg"
Nov 03 21:57:26.793973 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.793951    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/586bbac6-3107-4432-a636-0c83ece12573-maas-api-tls\") pod \"maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm\" (UID: \"586bbac6-3107-4432-a636-0c83ece12573\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"
Nov 03 21:57:26.794076 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.794001    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x2hf\" (UniqueName: \"kubernetes.io/projected/586bbac6-3107-4432-a636-0c83ece12573-kube-api-access-2x2hf\") pod \"maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm\" (UID: \"586bbac6-3107-4432-a636-0c83ece12573\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"
Nov 03 21:57:26.794631 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.794148    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/586bbac6-3107-4432-a636-0c83ece12573-metrics-certs\") pod \"maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm\" (UID: \"586bbac6-3107-4432-a636-0c83ece12573\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"
Nov 03 21:57:26.794631 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.794218    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/586bbac6-3107-4432-a636-0c83ece12573-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm\" (UID: \"586bbac6-3107-4432-a636-0c83ece12573\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"
Nov 03 21:57:26.822543 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.822516    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz"
Nov 03 21:57:26.911169 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.897466    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/586bbac6-3107-4432-a636-0c83ece12573-maas-api-tls\") pod \"maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm\" (UID: \"586bbac6-3107-4432-a636-0c83ece12573\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"
Nov 03 21:57:26.911169 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.897534    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x2hf\" (UniqueName: \"kubernetes.io/projected/586bbac6-3107-4432-a636-0c83ece12573-kube-api-access-2x2hf\") pod \"maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm\" (UID: \"586bbac6-3107-4432-a636-0c83ece12573\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"
Nov 03 21:57:26.911169 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.897615    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/586bbac6-3107-4432-a636-0c83ece12573-metrics-certs\") pod \"maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm\" (UID: \"586bbac6-3107-4432-a636-0c83ece12573\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"
Nov 03 21:57:26.911169 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.897665    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/586bbac6-3107-4432-a636-0c83ece12573-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm\" (UID: \"586bbac6-3107-4432-a636-0c83ece12573\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"
Nov 03 21:57:26.911169 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:57:26.910756    5077 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-serving-cert: secret "maas-api-e2e-worker-w5-85b4ff-serving-cert" not found
Nov 03 21:57:26.911169 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:57:26.910831    5077 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586bbac6-3107-4432-a636-0c83ece12573-maas-api-tls podName:586bbac6-3107-4432-a636-0c83ece12573 nodeName:}" failed. No retries permitted until 2026-11-03 21:57:27.410810354 +0000 UTC m=+740.814471763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/586bbac6-3107-4432-a636-0c83ece12573-maas-api-tls") pod "maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm" (UID: "586bbac6-3107-4432-a636-0c83ece12573") : secret "maas-api-e2e-worker-w5-85b4ff-serving-cert" not found
Nov 03 21:57:26.912834 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.912779    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/586bbac6-3107-4432-a636-0c83ece12573-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm\" (UID: \"586bbac6-3107-4432-a636-0c83ece12573\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"
Nov 03 21:57:26.917307 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.916630    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/586bbac6-3107-4432-a636-0c83ece12573-metrics-certs\") pod \"maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm\" (UID: \"586bbac6-3107-4432-a636-0c83ece12573\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"
Nov 03 21:57:26.925283 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:26.923928    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x2hf\" (UniqueName: \"kubernetes.io/projected/586bbac6-3107-4432-a636-0c83ece12573-kube-api-access-2x2hf\") pod \"maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm\" (UID: \"586bbac6-3107-4432-a636-0c83ece12573\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"
Nov 03 21:57:27.084564 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.084531    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg"]
Nov 03 21:57:27.088482 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:57:27.088454    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ddd62a2_4835_4cc4_b04d_846c174b07b6.slice/crio-e7d8c4ac8399e9c96779c59cb43aee908faad1aefa2e95d9129990d10af3eaaf WatchSource:0}: Error finding container e7d8c4ac8399e9c96779c59cb43aee908faad1aefa2e95d9129990d10af3eaaf: Status 404 returned error can't find the container with id e7d8c4ac8399e9c96779c59cb43aee908faad1aefa2e95d9129990d10af3eaaf
Nov 03 21:57:27.120148 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.120122    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz"]
Nov 03 21:57:27.121800 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:57:27.121777    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f13297_0097_446f_8f49_9b931e44a691.slice/crio-e434e53529d949bc6e946f819d6b36f812ff7e70c3ddda869e0c9456422d8809 WatchSource:0}: Error finding container e434e53529d949bc6e946f819d6b36f812ff7e70c3ddda869e0c9456422d8809: Status 404 returned error can't find the container with id e434e53529d949bc6e946f819d6b36f812ff7e70c3ddda869e0c9456422d8809
Nov 03 21:57:27.132044 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.132018    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm"]
Nov 03 21:57:27.138068 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.138047    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm"
Nov 03 21:57:27.149156 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.148365    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm"]
Nov 03 21:57:27.152519 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.152497    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-02e8ab-dockercfg-4b9cf\""
Nov 03 21:57:27.153504 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.153408    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-02e8ab\""
Nov 03 21:57:27.164507 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.164437    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p"]
Nov 03 21:57:27.180381 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.179296    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p"
Nov 03 21:57:27.189054 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.189035    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p"]
Nov 03 21:57:27.200907 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.200882    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb88q\" (UniqueName: \"kubernetes.io/projected/c5ac4b3b-8103-4b03-b2e7-84eda5cf4659-kube-api-access-gb88q\") pod \"payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm\" (UID: \"c5ac4b3b-8103-4b03-b2e7-84eda5cf4659\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm"
Nov 03 21:57:27.201021 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.200990    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5ac4b3b-8103-4b03-b2e7-84eda5cf4659-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm\" (UID: \"c5ac4b3b-8103-4b03-b2e7-84eda5cf4659\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm"
Nov 03 21:57:27.301937 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.301903    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb75cdb5-ccf7-4702-bc41-a180e1716b2b-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p\" (UID: \"eb75cdb5-ccf7-4702-bc41-a180e1716b2b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p"
Nov 03 21:57:27.302145 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.302042    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5ac4b3b-8103-4b03-b2e7-84eda5cf4659-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm\" (UID: \"c5ac4b3b-8103-4b03-b2e7-84eda5cf4659\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm"
Nov 03 21:57:27.302223 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.302166    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb88q\" (UniqueName: \"kubernetes.io/projected/c5ac4b3b-8103-4b03-b2e7-84eda5cf4659-kube-api-access-gb88q\") pod \"payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm\" (UID: \"c5ac4b3b-8103-4b03-b2e7-84eda5cf4659\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm"
Nov 03 21:57:27.302302 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.302228    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfbbw\" (UniqueName: \"kubernetes.io/projected/eb75cdb5-ccf7-4702-bc41-a180e1716b2b-kube-api-access-qfbbw\") pod \"payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p\" (UID: \"eb75cdb5-ccf7-4702-bc41-a180e1716b2b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p"
Nov 03 21:57:27.302841 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.302821    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5ac4b3b-8103-4b03-b2e7-84eda5cf4659-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm\" (UID: \"c5ac4b3b-8103-4b03-b2e7-84eda5cf4659\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm"
Nov 03 21:57:27.314304 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.314238    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb88q\" (UniqueName: \"kubernetes.io/projected/c5ac4b3b-8103-4b03-b2e7-84eda5cf4659-kube-api-access-gb88q\") pod \"payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm\" (UID: \"c5ac4b3b-8103-4b03-b2e7-84eda5cf4659\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm"
Nov 03 21:57:27.403773 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.403691    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfbbw\" (UniqueName: \"kubernetes.io/projected/eb75cdb5-ccf7-4702-bc41-a180e1716b2b-kube-api-access-qfbbw\") pod \"payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p\" (UID: \"eb75cdb5-ccf7-4702-bc41-a180e1716b2b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p"
Nov 03 21:57:27.403773 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.403752    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb75cdb5-ccf7-4702-bc41-a180e1716b2b-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p\" (UID: \"eb75cdb5-ccf7-4702-bc41-a180e1716b2b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p"
Nov 03 21:57:27.404430 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.404413    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb75cdb5-ccf7-4702-bc41-a180e1716b2b-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p\" (UID: \"eb75cdb5-ccf7-4702-bc41-a180e1716b2b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p"
Nov 03 21:57:27.415532 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.415510    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfbbw\" (UniqueName: \"kubernetes.io/projected/eb75cdb5-ccf7-4702-bc41-a180e1716b2b-kube-api-access-qfbbw\") pod \"payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p\" (UID: \"eb75cdb5-ccf7-4702-bc41-a180e1716b2b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p"
Nov 03 21:57:27.459064 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.459032    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm"
Nov 03 21:57:27.503542 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.503302    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p"
Nov 03 21:57:27.504777 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.504745    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/586bbac6-3107-4432-a636-0c83ece12573-maas-api-tls\") pod \"maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm\" (UID: \"586bbac6-3107-4432-a636-0c83ece12573\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"
Nov 03 21:57:27.507868 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.507842    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/586bbac6-3107-4432-a636-0c83ece12573-maas-api-tls\") pod \"maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm\" (UID: \"586bbac6-3107-4432-a636-0c83ece12573\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"
Nov 03 21:57:27.514877 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.514839    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz" event={"ID":"e0f13297-0097-446f-8f49-9b931e44a691","Type":"ContainerStarted","Data":"9a620028190d40857daaf62daf95f428d5724dcb5a5e19e0a3e46a476827c58b"}
Nov 03 21:57:27.515004 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.514910    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz" event={"ID":"e0f13297-0097-446f-8f49-9b931e44a691","Type":"ContainerStarted","Data":"e434e53529d949bc6e946f819d6b36f812ff7e70c3ddda869e0c9456422d8809"}
Nov 03 21:57:27.515820 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.515799    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz"
Nov 03 21:57:27.518037 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.517948    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg" event={"ID":"9ddd62a2-4835-4cc4-b04d-846c174b07b6","Type":"ContainerStarted","Data":"41ed39e8d2f92b1ad59c8ce574b1b2d96ad78232694d7e811ca013307fdc4835"}
Nov 03 21:57:27.518037 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.517999    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg" event={"ID":"9ddd62a2-4835-4cc4-b04d-846c174b07b6","Type":"ContainerStarted","Data":"e7d8c4ac8399e9c96779c59cb43aee908faad1aefa2e95d9129990d10af3eaaf"}
Nov 03 21:57:27.518206 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.518133    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg"
Nov 03 21:57:27.539962 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.539917    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz" podStartSLOduration=1.539902665 podStartE2EDuration="1.539902665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:57:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:57:27.53833601 +0000 UTC m=+740.941997443" watchObservedRunningTime="2026-11-03 21:57:27.539902665 +0000 UTC m=+740.943564095"
Nov 03 21:57:27.564569 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.564505    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg" podStartSLOduration=1.564484822 podStartE2EDuration="1.564484822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:57:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:57:27.557071371 +0000 UTC m=+740.960732802" watchObservedRunningTime="2026-11-03 21:57:27.564484822 +0000 UTC m=+740.968146245"
Nov 03 21:57:27.678654 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.678575    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"
Nov 03 21:57:27.744114 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.744066    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm"]
Nov 03 21:57:27.749987 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:57:27.745451    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ac4b3b_8103_4b03_b2e7_84eda5cf4659.slice/crio-220d0a49fed471e96228a7d67694c45b6c0668d58c300bca44a5e38d605b560d WatchSource:0}: Error finding container 220d0a49fed471e96228a7d67694c45b6c0668d58c300bca44a5e38d605b560d: Status 404 returned error can't find the container with id 220d0a49fed471e96228a7d67694c45b6c0668d58c300bca44a5e38d605b560d
Nov 03 21:57:27.828946 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.828915    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p"]
Nov 03 21:57:27.835897 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:57:27.835858    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb75cdb5_ccf7_4702_bc41_a180e1716b2b.slice/crio-effb8886b0ab4ee3944d9189dd46564a9990779b81b14fc1717f39b64c25aeac WatchSource:0}: Error finding container effb8886b0ab4ee3944d9189dd46564a9990779b81b14fc1717f39b64c25aeac: Status 404 returned error can't find the container with id effb8886b0ab4ee3944d9189dd46564a9990779b81b14fc1717f39b64c25aeac
Nov 03 21:57:27.972194 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:27.972024    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"]
Nov 03 21:57:27.977604 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:57:27.977568    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod586bbac6_3107_4432_a636_0c83ece12573.slice/crio-f418a1f02e10cb491bc7799d558ba07a564a235c25ec43fc72d8c7a58d6ee341 WatchSource:0}: Error finding container f418a1f02e10cb491bc7799d558ba07a564a235c25ec43fc72d8c7a58d6ee341: Status 404 returned error can't find the container with id f418a1f02e10cb491bc7799d558ba07a564a235c25ec43fc72d8c7a58d6ee341
Nov 03 21:57:28.103606 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.103571    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z"]
Nov 03 21:57:28.108353 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.108332    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz"]
Nov 03 21:57:28.108473 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.108452    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z"
Nov 03 21:57:28.113498 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.113475    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz"
Nov 03 21:57:28.119056 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.119031    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z"]
Nov 03 21:57:28.121406 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.121386    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz"]
Nov 03 21:57:28.149710 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.149669    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-fc16de\""
Nov 03 21:57:28.213588 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.213555    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbfl5\" (UniqueName: \"kubernetes.io/projected/09af1067-207c-44a7-b4c3-ca1bcba6fb82-kube-api-access-xbfl5\") pod \"payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz\" (UID: \"09af1067-207c-44a7-b4c3-ca1bcba6fb82\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz"
Nov 03 21:57:28.213780 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.213686    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a6a34c7-4517-4567-850d-65d354604bec-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z\" (UID: \"1a6a34c7-4517-4567-850d-65d354604bec\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z"
Nov 03 21:57:28.213780 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.213729    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09af1067-207c-44a7-b4c3-ca1bcba6fb82-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz\" (UID: \"09af1067-207c-44a7-b4c3-ca1bcba6fb82\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz"
Nov 03 21:57:28.213855 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.213788    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llml6\" (UniqueName: \"kubernetes.io/projected/1a6a34c7-4517-4567-850d-65d354604bec-kube-api-access-llml6\") pod \"payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z\" (UID: \"1a6a34c7-4517-4567-850d-65d354604bec\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z"
Nov 03 21:57:28.314799 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.314768    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbfl5\" (UniqueName: \"kubernetes.io/projected/09af1067-207c-44a7-b4c3-ca1bcba6fb82-kube-api-access-xbfl5\") pod \"payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz\" (UID: \"09af1067-207c-44a7-b4c3-ca1bcba6fb82\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz"
Nov 03 21:57:28.315004 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.314854    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a6a34c7-4517-4567-850d-65d354604bec-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z\" (UID: \"1a6a34c7-4517-4567-850d-65d354604bec\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z"
Nov 03 21:57:28.315004 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.314883    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09af1067-207c-44a7-b4c3-ca1bcba6fb82-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz\" (UID: \"09af1067-207c-44a7-b4c3-ca1bcba6fb82\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz"
Nov 03 21:57:28.315004 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.314949    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llml6\" (UniqueName: \"kubernetes.io/projected/1a6a34c7-4517-4567-850d-65d354604bec-kube-api-access-llml6\") pod \"payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z\" (UID: \"1a6a34c7-4517-4567-850d-65d354604bec\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z"
Nov 03 21:57:28.315811 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.315785    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a6a34c7-4517-4567-850d-65d354604bec-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z\" (UID: \"1a6a34c7-4517-4567-850d-65d354604bec\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z"
Nov 03 21:57:28.315891 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.315785    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09af1067-207c-44a7-b4c3-ca1bcba6fb82-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz\" (UID: \"09af1067-207c-44a7-b4c3-ca1bcba6fb82\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz"
Nov 03 21:57:28.327682 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.327651    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llml6\" (UniqueName: \"kubernetes.io/projected/1a6a34c7-4517-4567-850d-65d354604bec-kube-api-access-llml6\") pod \"payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z\" (UID: \"1a6a34c7-4517-4567-850d-65d354604bec\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z"
Nov 03 21:57:28.327801 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.327713    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbfl5\" (UniqueName: \"kubernetes.io/projected/09af1067-207c-44a7-b4c3-ca1bcba6fb82-kube-api-access-xbfl5\") pod \"payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz\" (UID: \"09af1067-207c-44a7-b4c3-ca1bcba6fb82\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz"
Nov 03 21:57:28.428338 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.428304    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z"
Nov 03 21:57:28.434382 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.434359    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz"
Nov 03 21:57:28.560999 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.560893    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm" event={"ID":"586bbac6-3107-4432-a636-0c83ece12573","Type":"ContainerStarted","Data":"f418a1f02e10cb491bc7799d558ba07a564a235c25ec43fc72d8c7a58d6ee341"}
Nov 03 21:57:28.565933 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.565784    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm" event={"ID":"c5ac4b3b-8103-4b03-b2e7-84eda5cf4659","Type":"ContainerStarted","Data":"a8158e42105a1c7bd7a1f0bf3865c0f724ff7def8e853a513e555c757073773c"}
Nov 03 21:57:28.565933 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.565865    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm" event={"ID":"c5ac4b3b-8103-4b03-b2e7-84eda5cf4659","Type":"ContainerStarted","Data":"220d0a49fed471e96228a7d67694c45b6c0668d58c300bca44a5e38d605b560d"}
Nov 03 21:57:28.567326 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.567308    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm"
Nov 03 21:57:28.596151 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.595347    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p" event={"ID":"eb75cdb5-ccf7-4702-bc41-a180e1716b2b","Type":"ContainerStarted","Data":"bbe7a6c49509b94cc68eff985fdd4ded2f652ac5cc383c7c1a97891088b2228a"}
Nov 03 21:57:28.596151 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.595423    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p"
Nov 03 21:57:28.596151 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.595446    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p" event={"ID":"eb75cdb5-ccf7-4702-bc41-a180e1716b2b","Type":"ContainerStarted","Data":"effb8886b0ab4ee3944d9189dd46564a9990779b81b14fc1717f39b64c25aeac"}
Nov 03 21:57:28.597321 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.597299    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l"]
Nov 03 21:57:28.619582 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.619395    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s"]
Nov 03 21:57:28.620537 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.620488    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm" podStartSLOduration=1.6204722459999998 podStartE2EDuration="1.620472246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:57:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:57:28.611521443 +0000 UTC m=+742.015182875" watchObservedRunningTime="2026-11-03 21:57:28.620472246 +0000 UTC m=+742.024133678"
Nov 03 21:57:28.621935 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.621915    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l"
Nov 03 21:57:28.626088 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.626070    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w1-f4fb1b-dockercfg-v9fxd\""
Nov 03 21:57:28.626330 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.626290    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-f4fb1b\""
Nov 03 21:57:28.626901 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.626884    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l"]
Nov 03 21:57:28.627014 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.626924    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s"]
Nov 03 21:57:28.627014 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.627009    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s"
Nov 03 21:57:28.634352 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.633640    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p" podStartSLOduration=1.633625876 podStartE2EDuration="1.633625876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:57:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:57:28.632609292 +0000 UTC m=+742.036270724" watchObservedRunningTime="2026-11-03 21:57:28.633625876 +0000 UTC m=+742.037287307"
Nov 03 21:57:28.723808 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.723772    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/998d8261-6d86-4f97-948f-abfb5fc704c9-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l\" (UID: \"998d8261-6d86-4f97-948f-abfb5fc704c9\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l"
Nov 03 21:57:28.724005 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.723816    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd4t4\" (UniqueName: \"kubernetes.io/projected/998d8261-6d86-4f97-948f-abfb5fc704c9-kube-api-access-wd4t4\") pod \"payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l\" (UID: \"998d8261-6d86-4f97-948f-abfb5fc704c9\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l"
Nov 03 21:57:28.724005 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.723846    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zhbt\" (UniqueName: \"kubernetes.io/projected/c61aad42-dcf9-4f3c-971a-03d03ddfc8ff-kube-api-access-2zhbt\") pod \"payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s\" (UID: \"c61aad42-dcf9-4f3c-971a-03d03ddfc8ff\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s"
Nov 03 21:57:28.724005 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.723889    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c61aad42-dcf9-4f3c-971a-03d03ddfc8ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s\" (UID: \"c61aad42-dcf9-4f3c-971a-03d03ddfc8ff\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s"
Nov 03 21:57:28.782818 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.782782    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z"]
Nov 03 21:57:28.816343 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.816287    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"]
Nov 03 21:57:28.822562 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.822539    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"
Nov 03 21:57:28.826671 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.826644    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz"]
Nov 03 21:57:28.832226 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.832192    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zhbt\" (UniqueName: \"kubernetes.io/projected/c61aad42-dcf9-4f3c-971a-03d03ddfc8ff-kube-api-access-2zhbt\") pod \"payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s\" (UID: \"c61aad42-dcf9-4f3c-971a-03d03ddfc8ff\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s"
Nov 03 21:57:28.832354 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.832315    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c61aad42-dcf9-4f3c-971a-03d03ddfc8ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s\" (UID: \"c61aad42-dcf9-4f3c-971a-03d03ddfc8ff\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s"
Nov 03 21:57:28.832551 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.832533    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/998d8261-6d86-4f97-948f-abfb5fc704c9-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l\" (UID: \"998d8261-6d86-4f97-948f-abfb5fc704c9\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l"
Nov 03 21:57:28.832619 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.832601    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd4t4\" (UniqueName: \"kubernetes.io/projected/998d8261-6d86-4f97-948f-abfb5fc704c9-kube-api-access-wd4t4\") pod \"payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l\" (UID: \"998d8261-6d86-4f97-948f-abfb5fc704c9\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l"
Nov 03 21:57:28.833983 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.833953    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c61aad42-dcf9-4f3c-971a-03d03ddfc8ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s\" (UID: \"c61aad42-dcf9-4f3c-971a-03d03ddfc8ff\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s"
Nov 03 21:57:28.834744 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.834707    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/998d8261-6d86-4f97-948f-abfb5fc704c9-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l\" (UID: \"998d8261-6d86-4f97-948f-abfb5fc704c9\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l"
Nov 03 21:57:28.849940 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.849902    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"]
Nov 03 21:57:28.857324 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.850981    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-02e8ab-serving-cert\""
Nov 03 21:57:28.857324 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.851515    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd4t4\" (UniqueName: \"kubernetes.io/projected/998d8261-6d86-4f97-948f-abfb5fc704c9-kube-api-access-wd4t4\") pod \"payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l\" (UID: \"998d8261-6d86-4f97-948f-abfb5fc704c9\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l"
Nov 03 21:57:28.857324 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.852986    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zhbt\" (UniqueName: \"kubernetes.io/projected/c61aad42-dcf9-4f3c-971a-03d03ddfc8ff-kube-api-access-2zhbt\") pod \"payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s\" (UID: \"c61aad42-dcf9-4f3c-971a-03d03ddfc8ff\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s"
Nov 03 21:57:28.934100 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.934069    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/113f2e13-e5b9-43b3-8d94-6b86d653aa85-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p\" (UID: \"113f2e13-e5b9-43b3-8d94-6b86d653aa85\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"
Nov 03 21:57:28.934462 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.934202    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5sxp\" (UniqueName: \"kubernetes.io/projected/113f2e13-e5b9-43b3-8d94-6b86d653aa85-kube-api-access-l5sxp\") pod \"maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p\" (UID: \"113f2e13-e5b9-43b3-8d94-6b86d653aa85\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"
Nov 03 21:57:28.934462 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.934233    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/113f2e13-e5b9-43b3-8d94-6b86d653aa85-metrics-certs\") pod \"maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p\" (UID: \"113f2e13-e5b9-43b3-8d94-6b86d653aa85\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"
Nov 03 21:57:28.934462 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.934314    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/113f2e13-e5b9-43b3-8d94-6b86d653aa85-maas-api-tls\") pod \"maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p\" (UID: \"113f2e13-e5b9-43b3-8d94-6b86d653aa85\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"
Nov 03 21:57:28.945212 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.945181    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l"
Nov 03 21:57:28.982675 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:28.982600    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s"
Nov 03 21:57:29.031214 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.031186    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8"]
Nov 03 21:57:29.044112 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.035297    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/113f2e13-e5b9-43b3-8d94-6b86d653aa85-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p\" (UID: \"113f2e13-e5b9-43b3-8d94-6b86d653aa85\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"
Nov 03 21:57:29.044112 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.035433    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5sxp\" (UniqueName: \"kubernetes.io/projected/113f2e13-e5b9-43b3-8d94-6b86d653aa85-kube-api-access-l5sxp\") pod \"maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p\" (UID: \"113f2e13-e5b9-43b3-8d94-6b86d653aa85\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"
Nov 03 21:57:29.044112 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.035467    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/113f2e13-e5b9-43b3-8d94-6b86d653aa85-metrics-certs\") pod \"maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p\" (UID: \"113f2e13-e5b9-43b3-8d94-6b86d653aa85\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"
Nov 03 21:57:29.044112 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.035514    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/113f2e13-e5b9-43b3-8d94-6b86d653aa85-maas-api-tls\") pod \"maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p\" (UID: \"113f2e13-e5b9-43b3-8d94-6b86d653aa85\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"
Nov 03 21:57:29.044112 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.036882    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/113f2e13-e5b9-43b3-8d94-6b86d653aa85-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p\" (UID: \"113f2e13-e5b9-43b3-8d94-6b86d653aa85\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"
Nov 03 21:57:29.044112 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.041760    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/113f2e13-e5b9-43b3-8d94-6b86d653aa85-maas-api-tls\") pod \"maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p\" (UID: \"113f2e13-e5b9-43b3-8d94-6b86d653aa85\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"
Nov 03 21:57:29.051291 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.045707    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/113f2e13-e5b9-43b3-8d94-6b86d653aa85-metrics-certs\") pod \"maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p\" (UID: \"113f2e13-e5b9-43b3-8d94-6b86d653aa85\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"
Nov 03 21:57:29.062139 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.062074    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5sxp\" (UniqueName: \"kubernetes.io/projected/113f2e13-e5b9-43b3-8d94-6b86d653aa85-kube-api-access-l5sxp\") pod \"maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p\" (UID: \"113f2e13-e5b9-43b3-8d94-6b86d653aa85\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"
Nov 03 21:57:29.068954 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.064866    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k"]
Nov 03 21:57:29.073839 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.073800    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8"
Nov 03 21:57:29.090030 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.089897    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k"
Nov 03 21:57:29.090331 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.089802    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8"]
Nov 03 21:57:29.104520 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.104497    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k"]
Nov 03 21:57:29.105405 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.105385    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-53a2cb-dockercfg-bx7sh\""
Nov 03 21:57:29.105616 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.105602    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-53a2cb\""
Nov 03 21:57:29.136625 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.136592    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05c6b884-526b-4acd-a645-a04b90fd35f1-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k\" (UID: \"05c6b884-526b-4acd-a645-a04b90fd35f1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k"
Nov 03 21:57:29.136778 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.136752    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql7l4\" (UniqueName: \"kubernetes.io/projected/05c6b884-526b-4acd-a645-a04b90fd35f1-kube-api-access-ql7l4\") pod \"payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k\" (UID: \"05c6b884-526b-4acd-a645-a04b90fd35f1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k"
Nov 03 21:57:29.136834 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.136802    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npgzf\" (UniqueName: \"kubernetes.io/projected/2e8a26a6-b242-4a01-b19b-48595024ce2f-kube-api-access-npgzf\") pod \"payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8\" (UID: \"2e8a26a6-b242-4a01-b19b-48595024ce2f\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8"
Nov 03 21:57:29.136895 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.136880    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e8a26a6-b242-4a01-b19b-48595024ce2f-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8\" (UID: \"2e8a26a6-b242-4a01-b19b-48595024ce2f\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8"
Nov 03 21:57:29.219848 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.219818    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"
Nov 03 21:57:29.237902 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.237865    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql7l4\" (UniqueName: \"kubernetes.io/projected/05c6b884-526b-4acd-a645-a04b90fd35f1-kube-api-access-ql7l4\") pod \"payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k\" (UID: \"05c6b884-526b-4acd-a645-a04b90fd35f1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k"
Nov 03 21:57:29.238035 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.237908    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npgzf\" (UniqueName: \"kubernetes.io/projected/2e8a26a6-b242-4a01-b19b-48595024ce2f-kube-api-access-npgzf\") pod \"payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8\" (UID: \"2e8a26a6-b242-4a01-b19b-48595024ce2f\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8"
Nov 03 21:57:29.238147 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.238061    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e8a26a6-b242-4a01-b19b-48595024ce2f-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8\" (UID: \"2e8a26a6-b242-4a01-b19b-48595024ce2f\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8"
Nov 03 21:57:29.238202 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.238180    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05c6b884-526b-4acd-a645-a04b90fd35f1-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k\" (UID: \"05c6b884-526b-4acd-a645-a04b90fd35f1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k"
Nov 03 21:57:29.238823 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.238799    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e8a26a6-b242-4a01-b19b-48595024ce2f-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8\" (UID: \"2e8a26a6-b242-4a01-b19b-48595024ce2f\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8"
Nov 03 21:57:29.239019 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.238999    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05c6b884-526b-4acd-a645-a04b90fd35f1-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k\" (UID: \"05c6b884-526b-4acd-a645-a04b90fd35f1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k"
Nov 03 21:57:29.247358 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.247334    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l"]
Nov 03 21:57:29.249070 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:57:29.249040    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod998d8261_6d86_4f97_948f_abfb5fc704c9.slice/crio-d7094e4b0d956b4d6090461d9b8e3412534797f1f90a8f0dce1910469cf0eb2a WatchSource:0}: Error finding container d7094e4b0d956b4d6090461d9b8e3412534797f1f90a8f0dce1910469cf0eb2a: Status 404 returned error can't find the container with id d7094e4b0d956b4d6090461d9b8e3412534797f1f90a8f0dce1910469cf0eb2a
Nov 03 21:57:29.252608 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.252585    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npgzf\" (UniqueName: \"kubernetes.io/projected/2e8a26a6-b242-4a01-b19b-48595024ce2f-kube-api-access-npgzf\") pod \"payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8\" (UID: \"2e8a26a6-b242-4a01-b19b-48595024ce2f\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8"
Nov 03 21:57:29.252719 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.252658    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql7l4\" (UniqueName: \"kubernetes.io/projected/05c6b884-526b-4acd-a645-a04b90fd35f1-kube-api-access-ql7l4\") pod \"payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k\" (UID: \"05c6b884-526b-4acd-a645-a04b90fd35f1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k"
Nov 03 21:57:29.342051 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.342013    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s"]
Nov 03 21:57:29.352226 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:57:29.351976    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc61aad42_dcf9_4f3c_971a_03d03ddfc8ff.slice/crio-7e40ece9b870915f5fb62f9c2c6acd625225663e5b2cb85efc3f07b68b489e60 WatchSource:0}: Error finding container 7e40ece9b870915f5fb62f9c2c6acd625225663e5b2cb85efc3f07b68b489e60: Status 404 returned error can't find the container with id 7e40ece9b870915f5fb62f9c2c6acd625225663e5b2cb85efc3f07b68b489e60
Nov 03 21:57:29.416963 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.416927    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8"
Nov 03 21:57:29.423067 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.423041    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k"
Nov 03 21:57:29.517614 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.517588    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"]
Nov 03 21:57:29.520970 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:57:29.520945    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod113f2e13_e5b9_43b3_8d94_6b86d653aa85.slice/crio-f03c642f58dfdb14cd25e24daa6e40264c312e816d430afd60d0ed165b66d7ea WatchSource:0}: Error finding container f03c642f58dfdb14cd25e24daa6e40264c312e816d430afd60d0ed165b66d7ea: Status 404 returned error can't find the container with id f03c642f58dfdb14cd25e24daa6e40264c312e816d430afd60d0ed165b66d7ea
Nov 03 21:57:29.608947 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.608845    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz" event={"ID":"09af1067-207c-44a7-b4c3-ca1bcba6fb82","Type":"ContainerStarted","Data":"fec9a85ed14b59f50991dd47febe3ae22ab1ab4cb41f4b8a837397f917aa5815"}
Nov 03 21:57:29.608947 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.608923    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz" event={"ID":"09af1067-207c-44a7-b4c3-ca1bcba6fb82","Type":"ContainerStarted","Data":"e809df8103fcf95ccbb55134f5e22944294e78f5cd5ef3d979db4b18603b1e99"}
Nov 03 21:57:29.609504 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.608975    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz"
Nov 03 21:57:29.612490 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.612461    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm" event={"ID":"586bbac6-3107-4432-a636-0c83ece12573","Type":"ContainerStarted","Data":"e4bce958fa6c6e92f47f708a23e7f9148f0acccb45c6b44c62077693cfb557f8"}
Nov 03 21:57:29.613810 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.612999    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"
Nov 03 21:57:29.615292 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.615262    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z" event={"ID":"1a6a34c7-4517-4567-850d-65d354604bec","Type":"ContainerStarted","Data":"3f68608422b86c213d7e7ca958e231f6be45ec68f871d501117c61a95f21f400"}
Nov 03 21:57:29.615412 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.615328    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z" event={"ID":"1a6a34c7-4517-4567-850d-65d354604bec","Type":"ContainerStarted","Data":"58497a29dbbf8032354ef84e43900174f8346523d4cfc5232f57432f9c0f95a1"}
Nov 03 21:57:29.615616 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.615597    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z"
Nov 03 21:57:29.617142 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.617119    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l" event={"ID":"998d8261-6d86-4f97-948f-abfb5fc704c9","Type":"ContainerStarted","Data":"4e84b87d6a45663c0e53bd02783008416eb708927953f9e2d777298b6ff5c36b"}
Nov 03 21:57:29.617237 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.617160    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l" event={"ID":"998d8261-6d86-4f97-948f-abfb5fc704c9","Type":"ContainerStarted","Data":"d7094e4b0d956b4d6090461d9b8e3412534797f1f90a8f0dce1910469cf0eb2a"}
Nov 03 21:57:29.617351 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.617269    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l"
Nov 03 21:57:29.619615 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.619577    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s" event={"ID":"c61aad42-dcf9-4f3c-971a-03d03ddfc8ff","Type":"ContainerStarted","Data":"ab9aca32bbabe034c09fb723ae66c725c003fe63207b818e0d6010ab24906465"}
Nov 03 21:57:29.619718 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.619625    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s"
Nov 03 21:57:29.619718 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.619650    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s" event={"ID":"c61aad42-dcf9-4f3c-971a-03d03ddfc8ff","Type":"ContainerStarted","Data":"7e40ece9b870915f5fb62f9c2c6acd625225663e5b2cb85efc3f07b68b489e60"}
Nov 03 21:57:29.621125 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.621086    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p" event={"ID":"113f2e13-e5b9-43b3-8d94-6b86d653aa85","Type":"ContainerStarted","Data":"f03c642f58dfdb14cd25e24daa6e40264c312e816d430afd60d0ed165b66d7ea"}
Nov 03 21:57:29.631001 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.630954    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz" podStartSLOduration=1.630943894 podStartE2EDuration="1.630943894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:57:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:57:29.629856165 +0000 UTC m=+743.033517593" watchObservedRunningTime="2026-11-03 21:57:29.630943894 +0000 UTC m=+743.034605356"
Nov 03 21:57:29.652962 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.652911    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s" podStartSLOduration=1.652900513 podStartE2EDuration="1.652900513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:57:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:57:29.651843122 +0000 UTC m=+743.055504554" watchObservedRunningTime="2026-11-03 21:57:29.652900513 +0000 UTC m=+743.056561992"
Nov 03 21:57:29.691992 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.691923    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm" podStartSLOduration=3.21894074 podStartE2EDuration="3.691908183s" totalImagesPullingTime="472.967443ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:57:29.687142997 +0000 UTC m=+743.090804426" watchObservedRunningTime="2026-11-03 21:57:29.691908183 +0000 UTC m=+743.095569624"
Nov 03 21:57:29.694381 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.694354    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb"]
Nov 03 21:57:29.700306 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.700285    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb"
Nov 03 21:57:29.707378 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.707342    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-c0caef-dockercfg-lbw8x\""
Nov 03 21:57:29.708135 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.708116    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb"]
Nov 03 21:57:29.710444 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.710423    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-c0caef\""
Nov 03 21:57:29.722525 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.722446    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8"]
Nov 03 21:57:29.725846 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.723509    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z" podStartSLOduration=1.723489802 podStartE2EDuration="1.723489802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:57:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:57:29.710435164 +0000 UTC m=+743.114096595" watchObservedRunningTime="2026-11-03 21:57:29.723489802 +0000 UTC m=+743.127151233"
Nov 03 21:57:29.727734 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:57:29.727704    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e8a26a6_b242_4a01_b19b_48595024ce2f.slice/crio-dda047031c263059dc1f3dbb13be04da33202e5fd23c958ff5799da1191c0c9b WatchSource:0}: Error finding container dda047031c263059dc1f3dbb13be04da33202e5fd23c958ff5799da1191c0c9b: Status 404 returned error can't find the container with id dda047031c263059dc1f3dbb13be04da33202e5fd23c958ff5799da1191c0c9b
Nov 03 21:57:29.744318 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.743680    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccf62\" (UniqueName: \"kubernetes.io/projected/7cdc96b4-12c6-4856-a587-81502006f757-kube-api-access-ccf62\") pod \"payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb\" (UID: \"7cdc96b4-12c6-4856-a587-81502006f757\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb"
Nov 03 21:57:29.744318 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.744097    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7cdc96b4-12c6-4856-a587-81502006f757-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb\" (UID: \"7cdc96b4-12c6-4856-a587-81502006f757\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb"
Nov 03 21:57:29.754138 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:57:29.754111    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05c6b884_526b_4acd_a645_a04b90fd35f1.slice/crio-4b5d040f281c15d43ad30edfd55ec664c8a5b3c24357370d005bd517aa25f859 WatchSource:0}: Error finding container 4b5d040f281c15d43ad30edfd55ec664c8a5b3c24357370d005bd517aa25f859: Status 404 returned error can't find the container with id 4b5d040f281c15d43ad30edfd55ec664c8a5b3c24357370d005bd517aa25f859
Nov 03 21:57:29.762876 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.762855    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k"]
Nov 03 21:57:29.766221 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.766167    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l" podStartSLOduration=1.766149914 podStartE2EDuration="1.766149914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:57:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:57:29.733167016 +0000 UTC m=+743.136828446" watchObservedRunningTime="2026-11-03 21:57:29.766149914 +0000 UTC m=+743.169811346"
Nov 03 21:57:29.845996 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.845798    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7cdc96b4-12c6-4856-a587-81502006f757-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb\" (UID: \"7cdc96b4-12c6-4856-a587-81502006f757\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb"
Nov 03 21:57:29.845996 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.845859    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccf62\" (UniqueName: \"kubernetes.io/projected/7cdc96b4-12c6-4856-a587-81502006f757-kube-api-access-ccf62\") pod \"payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb\" (UID: \"7cdc96b4-12c6-4856-a587-81502006f757\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb"
Nov 03 21:57:29.846696 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.846673    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7cdc96b4-12c6-4856-a587-81502006f757-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb\" (UID: \"7cdc96b4-12c6-4856-a587-81502006f757\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb"
Nov 03 21:57:29.862047 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:29.861983    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccf62\" (UniqueName: \"kubernetes.io/projected/7cdc96b4-12c6-4856-a587-81502006f757-kube-api-access-ccf62\") pod \"payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb\" (UID: \"7cdc96b4-12c6-4856-a587-81502006f757\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb"
Nov 03 21:57:29.949270 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:57:29.949215    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:57:30.128208 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.128118    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb"
Nov 03 21:57:30.429392 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.429356    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb"]
Nov 03 21:57:30.431825 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:57:30.431787    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cdc96b4_12c6_4856_a587_81502006f757.slice/crio-8dccd8c96988c111f0cfad1e893025e9f68dc2a8478b97313d7aa69b2b600770 WatchSource:0}: Error finding container 8dccd8c96988c111f0cfad1e893025e9f68dc2a8478b97313d7aa69b2b600770: Status 404 returned error can't find the container with id 8dccd8c96988c111f0cfad1e893025e9f68dc2a8478b97313d7aa69b2b600770
Nov 03 21:57:30.630071 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.630036    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p" event={"ID":"113f2e13-e5b9-43b3-8d94-6b86d653aa85","Type":"ContainerStarted","Data":"fd519daf5daf0396fc85d9a962522d82c3ba36cd549d1fe6dadd6aeee3613584"}
Nov 03 21:57:30.630585 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.630112    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"
Nov 03 21:57:30.632353 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.632323    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k" event={"ID":"05c6b884-526b-4acd-a645-a04b90fd35f1","Type":"ContainerStarted","Data":"b83c5f8ec497b7005e08025333c3e6b032a5c0d0597332e3bcc0153e121a842c"}
Nov 03 21:57:30.632475 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.632379    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k" event={"ID":"05c6b884-526b-4acd-a645-a04b90fd35f1","Type":"ContainerStarted","Data":"4b5d040f281c15d43ad30edfd55ec664c8a5b3c24357370d005bd517aa25f859"}
Nov 03 21:57:30.632846 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.632827    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k"
Nov 03 21:57:30.634151 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.634127    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb" event={"ID":"7cdc96b4-12c6-4856-a587-81502006f757","Type":"ContainerStarted","Data":"918935b66eb15e153d75d93f069d79e061b44dede9570a4702b88c2fa7bc7a60"}
Nov 03 21:57:30.634276 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.634172    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb" event={"ID":"7cdc96b4-12c6-4856-a587-81502006f757","Type":"ContainerStarted","Data":"8dccd8c96988c111f0cfad1e893025e9f68dc2a8478b97313d7aa69b2b600770"}
Nov 03 21:57:30.634276 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.634199    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb"
Nov 03 21:57:30.636909 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.636885    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8" event={"ID":"2e8a26a6-b242-4a01-b19b-48595024ce2f","Type":"ContainerStarted","Data":"84317b2acf0e160a320615bf1e3da27a4da1871adc43f6b2d406a8e8110810ed"}
Nov 03 21:57:30.637013 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.636927    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8" event={"ID":"2e8a26a6-b242-4a01-b19b-48595024ce2f","Type":"ContainerStarted","Data":"dda047031c263059dc1f3dbb13be04da33202e5fd23c958ff5799da1191c0c9b"}
Nov 03 21:57:30.651870 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.651838    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"]
Nov 03 21:57:30.656768 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.656747    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"
Nov 03 21:57:30.677673 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.665937    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p" podStartSLOduration=2.173106262 podStartE2EDuration="2.665918521s" totalImagesPullingTime="492.812259ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:57:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:57:30.657731505 +0000 UTC m=+744.061392933" watchObservedRunningTime="2026-11-03 21:57:30.665918521 +0000 UTC m=+744.069579953"
Nov 03 21:57:30.677673 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.672967    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-fc16de-serving-cert\""
Nov 03 21:57:30.677673 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.677206    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"]
Nov 03 21:57:30.744905 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.744775    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb" podStartSLOduration=1.7447590480000001 podStartE2EDuration="1.744759048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:57:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:57:30.742047234 +0000 UTC m=+744.145708697" watchObservedRunningTime="2026-11-03 21:57:30.744759048 +0000 UTC m=+744.148420478"
Nov 03 21:57:30.745126 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.745013    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k" podStartSLOduration=1.745001179 podStartE2EDuration="1.745001179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:57:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:57:30.715636063 +0000 UTC m=+744.119297493" watchObservedRunningTime="2026-11-03 21:57:30.745001179 +0000 UTC m=+744.148662606"
Nov 03 21:57:30.758823 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.758783    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb\" (UID: \"ac98e10f-7f46-4bf1-ae12-2de3f478af6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"
Nov 03 21:57:30.758969 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.758829    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-metrics-certs\") pod \"maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb\" (UID: \"ac98e10f-7f46-4bf1-ae12-2de3f478af6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"
Nov 03 21:57:30.758969 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.758960    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-maas-api-tls\") pod \"maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb\" (UID: \"ac98e10f-7f46-4bf1-ae12-2de3f478af6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"
Nov 03 21:57:30.760196 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.760160    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5sss\" (UniqueName: \"kubernetes.io/projected/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-kube-api-access-j5sss\") pod \"maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb\" (UID: \"ac98e10f-7f46-4bf1-ae12-2de3f478af6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"
Nov 03 21:57:30.763094 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.763046    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8" podStartSLOduration=1.763028611 podStartE2EDuration="1.763028611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:57:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:57:30.761148051 +0000 UTC m=+744.164809481" watchObservedRunningTime="2026-11-03 21:57:30.763028611 +0000 UTC m=+744.166690043"
Nov 03 21:57:30.862036 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.862006    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5sss\" (UniqueName: \"kubernetes.io/projected/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-kube-api-access-j5sss\") pod \"maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb\" (UID: \"ac98e10f-7f46-4bf1-ae12-2de3f478af6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"
Nov 03 21:57:30.862207 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.862173    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb\" (UID: \"ac98e10f-7f46-4bf1-ae12-2de3f478af6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"
Nov 03 21:57:30.862309 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.862217    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-metrics-certs\") pod \"maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb\" (UID: \"ac98e10f-7f46-4bf1-ae12-2de3f478af6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"
Nov 03 21:57:30.862412 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.862386    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-maas-api-tls\") pod \"maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb\" (UID: \"ac98e10f-7f46-4bf1-ae12-2de3f478af6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"
Nov 03 21:57:30.863911 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.863883    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb\" (UID: \"ac98e10f-7f46-4bf1-ae12-2de3f478af6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"
Nov 03 21:57:30.865387 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.865359    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-maas-api-tls\") pod \"maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb\" (UID: \"ac98e10f-7f46-4bf1-ae12-2de3f478af6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"
Nov 03 21:57:30.865387 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.865389    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-metrics-certs\") pod \"maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb\" (UID: \"ac98e10f-7f46-4bf1-ae12-2de3f478af6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"
Nov 03 21:57:30.878345 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.878312    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5sss\" (UniqueName: \"kubernetes.io/projected/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-kube-api-access-j5sss\") pod \"maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb\" (UID: \"ac98e10f-7f46-4bf1-ae12-2de3f478af6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"
Nov 03 21:57:30.986865 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:30.986772    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"
Nov 03 21:57:31.274921 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:31.274889    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"]
Nov 03 21:57:31.276935 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:57:31.276906    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac98e10f_7f46_4bf1_ae12_2de3f478af6a.slice/crio-58da7edaac435b1d5a31a2b47fae38f9f719ac61575eef57a0d9e3f1291dc357 WatchSource:0}: Error finding container 58da7edaac435b1d5a31a2b47fae38f9f719ac61575eef57a0d9e3f1291dc357: Status 404 returned error can't find the container with id 58da7edaac435b1d5a31a2b47fae38f9f719ac61575eef57a0d9e3f1291dc357
Nov 03 21:57:31.540434 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:31.540349    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"]
Nov 03 21:57:31.546162 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:31.546140    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"
Nov 03 21:57:31.550349 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:31.550323    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-f4fb1b-serving-cert\""
Nov 03 21:57:31.556418 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:31.556395    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"]
Nov 03 21:57:31.645107 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:31.645074    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb" event={"ID":"ac98e10f-7f46-4bf1-ae12-2de3f478af6a","Type":"ContainerStarted","Data":"58da7edaac435b1d5a31a2b47fae38f9f719ac61575eef57a0d9e3f1291dc357"}
Nov 03 21:57:31.646212 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:31.646183    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8"
Nov 03 21:57:31.672804 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:31.672770    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2154964b-4add-4fce-9b61-7a98ddfb0fa5-maas-api-tls\") pod \"maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf\" (UID: \"2154964b-4add-4fce-9b61-7a98ddfb0fa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"
Nov 03 21:57:31.673053 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:31.672897    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvt49\" (UniqueName: \"kubernetes.io/projected/2154964b-4add-4fce-9b61-7a98ddfb0fa5-kube-api-access-dvt49\") pod \"maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf\" (UID: \"2154964b-4add-4fce-9b61-7a98ddfb0fa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"
Nov 03 21:57:31.673053 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:31.672987    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2154964b-4add-4fce-9b61-7a98ddfb0fa5-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf\" (UID: \"2154964b-4add-4fce-9b61-7a98ddfb0fa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"
Nov 03 21:57:31.673053 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:31.673034    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2154964b-4add-4fce-9b61-7a98ddfb0fa5-metrics-certs\") pod \"maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf\" (UID: \"2154964b-4add-4fce-9b61-7a98ddfb0fa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"
Nov 03 21:57:31.780296 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:31.774510    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvt49\" (UniqueName: \"kubernetes.io/projected/2154964b-4add-4fce-9b61-7a98ddfb0fa5-kube-api-access-dvt49\") pod \"maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf\" (UID: \"2154964b-4add-4fce-9b61-7a98ddfb0fa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"
Nov 03 21:57:31.780296 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:31.774869    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2154964b-4add-4fce-9b61-7a98ddfb0fa5-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf\" (UID: \"2154964b-4add-4fce-9b61-7a98ddfb0fa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"
Nov 03 21:57:31.780296 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:31.774933    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2154964b-4add-4fce-9b61-7a98ddfb0fa5-metrics-certs\") pod \"maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf\" (UID: \"2154964b-4add-4fce-9b61-7a98ddfb0fa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"
Nov 03 21:57:31.780296 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:31.775134    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2154964b-4add-4fce-9b61-7a98ddfb0fa5-maas-api-tls\") pod \"maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf\" (UID: \"2154964b-4add-4fce-9b61-7a98ddfb0fa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"
Nov 03 21:57:31.780296 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:31.780162    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2154964b-4add-4fce-9b61-7a98ddfb0fa5-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf\" (UID: \"2154964b-4add-4fce-9b61-7a98ddfb0fa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"
Nov 03 21:57:31.782452 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:31.782425    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2154964b-4add-4fce-9b61-7a98ddfb0fa5-maas-api-tls\") pod \"maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf\" (UID: \"2154964b-4add-4fce-9b61-7a98ddfb0fa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"
Nov 03 21:57:31.782569 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:31.782435    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2154964b-4add-4fce-9b61-7a98ddfb0fa5-metrics-certs\") pod \"maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf\" (UID: \"2154964b-4add-4fce-9b61-7a98ddfb0fa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"
Nov 03 21:57:31.790355 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:31.790301    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvt49\" (UniqueName: \"kubernetes.io/projected/2154964b-4add-4fce-9b61-7a98ddfb0fa5-kube-api-access-dvt49\") pod \"maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf\" (UID: \"2154964b-4add-4fce-9b61-7a98ddfb0fa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"
Nov 03 21:57:31.864162 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:31.864127    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"
Nov 03 21:57:32.157212 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.157113    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"]
Nov 03 21:57:32.162989 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:57:32.162961    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2154964b_4add_4fce_9b61_7a98ddfb0fa5.slice/crio-b65a4dbb8d69d7169267655a185a84ea14d6caa560815970e1d7ccb0fbf5fc4b WatchSource:0}: Error finding container b65a4dbb8d69d7169267655a185a84ea14d6caa560815970e1d7ccb0fbf5fc4b: Status 404 returned error can't find the container with id b65a4dbb8d69d7169267655a185a84ea14d6caa560815970e1d7ccb0fbf5fc4b
Nov 03 21:57:32.447682 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.447589    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"]
Nov 03 21:57:32.454685 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.454660    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"
Nov 03 21:57:32.465115 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.465089    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-53a2cb-serving-cert\""
Nov 03 21:57:32.468238 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.468208    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"]
Nov 03 21:57:32.585087 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.584706    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1242837c-1912-43aa-9ec6-72301fc61d62-maas-api-tls\") pod \"maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng\" (UID: \"1242837c-1912-43aa-9ec6-72301fc61d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"
Nov 03 21:57:32.585087 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.584782    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmd8j\" (UniqueName: \"kubernetes.io/projected/1242837c-1912-43aa-9ec6-72301fc61d62-kube-api-access-tmd8j\") pod \"maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng\" (UID: \"1242837c-1912-43aa-9ec6-72301fc61d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"
Nov 03 21:57:32.585087 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.584883    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1242837c-1912-43aa-9ec6-72301fc61d62-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng\" (UID: \"1242837c-1912-43aa-9ec6-72301fc61d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"
Nov 03 21:57:32.585087 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.584938    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1242837c-1912-43aa-9ec6-72301fc61d62-metrics-certs\") pod \"maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng\" (UID: \"1242837c-1912-43aa-9ec6-72301fc61d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"
Nov 03 21:57:32.652698 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.652663    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf" event={"ID":"2154964b-4add-4fce-9b61-7a98ddfb0fa5","Type":"ContainerStarted","Data":"658f78dfb49e319003ef215f189234b92cf9ca124096067fde9d7d2ae31d9eb7"}
Nov 03 21:57:32.653153 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.652731    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"
Nov 03 21:57:32.653153 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.652753    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf" event={"ID":"2154964b-4add-4fce-9b61-7a98ddfb0fa5","Type":"ContainerStarted","Data":"b65a4dbb8d69d7169267655a185a84ea14d6caa560815970e1d7ccb0fbf5fc4b"}
Nov 03 21:57:32.654762 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.654308    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb" event={"ID":"ac98e10f-7f46-4bf1-ae12-2de3f478af6a","Type":"ContainerStarted","Data":"937d63c0798fb49c69b6004dcebe62e7127f65ad76a9791250f452484e7dd5c4"}
Nov 03 21:57:32.654990 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.654966    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"
Nov 03 21:57:32.675468 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.675418    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf" podStartSLOduration=1.289167486 podStartE2EDuration="1.675404453s" totalImagesPullingTime="386.236967ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:57:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:57:32.672583643 +0000 UTC m=+746.076245064" watchObservedRunningTime="2026-11-03 21:57:32.675404453 +0000 UTC m=+746.079065882"
Nov 03 21:57:32.686155 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.686129    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1242837c-1912-43aa-9ec6-72301fc61d62-maas-api-tls\") pod \"maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng\" (UID: \"1242837c-1912-43aa-9ec6-72301fc61d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"
Nov 03 21:57:32.686330 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.686168    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmd8j\" (UniqueName: \"kubernetes.io/projected/1242837c-1912-43aa-9ec6-72301fc61d62-kube-api-access-tmd8j\") pod \"maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng\" (UID: \"1242837c-1912-43aa-9ec6-72301fc61d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"
Nov 03 21:57:32.686330 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.686231    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1242837c-1912-43aa-9ec6-72301fc61d62-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng\" (UID: \"1242837c-1912-43aa-9ec6-72301fc61d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"
Nov 03 21:57:32.686330 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.686286    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1242837c-1912-43aa-9ec6-72301fc61d62-metrics-certs\") pod \"maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng\" (UID: \"1242837c-1912-43aa-9ec6-72301fc61d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"
Nov 03 21:57:32.687235 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.687192    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1242837c-1912-43aa-9ec6-72301fc61d62-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng\" (UID: \"1242837c-1912-43aa-9ec6-72301fc61d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"
Nov 03 21:57:32.688871 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.688850    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1242837c-1912-43aa-9ec6-72301fc61d62-maas-api-tls\") pod \"maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng\" (UID: \"1242837c-1912-43aa-9ec6-72301fc61d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"
Nov 03 21:57:32.689025 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.689003    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1242837c-1912-43aa-9ec6-72301fc61d62-metrics-certs\") pod \"maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng\" (UID: \"1242837c-1912-43aa-9ec6-72301fc61d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"
Nov 03 21:57:32.694179 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.694139    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb" podStartSLOduration=2.261212215 podStartE2EDuration="2.694127813s" totalImagesPullingTime="432.915598ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:57:32.69311947 +0000 UTC m=+746.096780902" watchObservedRunningTime="2026-11-03 21:57:32.694127813 +0000 UTC m=+746.097789240"
Nov 03 21:57:32.701812 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.701762    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmd8j\" (UniqueName: \"kubernetes.io/projected/1242837c-1912-43aa-9ec6-72301fc61d62-kube-api-access-tmd8j\") pod \"maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng\" (UID: \"1242837c-1912-43aa-9ec6-72301fc61d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"
Nov 03 21:57:32.779046 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:32.779006    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"
Nov 03 21:57:33.076785 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:33.075884    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"]
Nov 03 21:57:33.079326 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:57:33.079293    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1242837c_1912_43aa_9ec6_72301fc61d62.slice/crio-1b947b61a2a293c6e9a7e5cccd6775a50f468de9662dab7f58412318c5ed8918 WatchSource:0}: Error finding container 1b947b61a2a293c6e9a7e5cccd6775a50f468de9662dab7f58412318c5ed8918: Status 404 returned error can't find the container with id 1b947b61a2a293c6e9a7e5cccd6775a50f468de9662dab7f58412318c5ed8918
Nov 03 21:57:33.227494 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:33.227457    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"]
Nov 03 21:57:33.233080 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:33.233062    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"
Nov 03 21:57:33.238914 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:33.238816    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-c0caef-serving-cert\""
Nov 03 21:57:33.242169 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:33.242142    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"]
Nov 03 21:57:33.295667 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:33.295630    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78203c60-a1eb-4ff5-a378-30cc8eda784f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r\" (UID: \"78203c60-a1eb-4ff5-a378-30cc8eda784f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"
Nov 03 21:57:33.295864 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:33.295784    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2rcs\" (UniqueName: \"kubernetes.io/projected/78203c60-a1eb-4ff5-a378-30cc8eda784f-kube-api-access-x2rcs\") pod \"maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r\" (UID: \"78203c60-a1eb-4ff5-a378-30cc8eda784f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"
Nov 03 21:57:33.295864 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:33.295841    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78203c60-a1eb-4ff5-a378-30cc8eda784f-metrics-certs\") pod \"maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r\" (UID: \"78203c60-a1eb-4ff5-a378-30cc8eda784f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"
Nov 03 21:57:33.296045 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:33.296024    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78203c60-a1eb-4ff5-a378-30cc8eda784f-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r\" (UID: \"78203c60-a1eb-4ff5-a378-30cc8eda784f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"
Nov 03 21:57:33.397502 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:33.397415    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2rcs\" (UniqueName: \"kubernetes.io/projected/78203c60-a1eb-4ff5-a378-30cc8eda784f-kube-api-access-x2rcs\") pod \"maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r\" (UID: \"78203c60-a1eb-4ff5-a378-30cc8eda784f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"
Nov 03 21:57:33.397502 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:33.397472    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78203c60-a1eb-4ff5-a378-30cc8eda784f-metrics-certs\") pod \"maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r\" (UID: \"78203c60-a1eb-4ff5-a378-30cc8eda784f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"
Nov 03 21:57:33.397718 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:33.397568    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78203c60-a1eb-4ff5-a378-30cc8eda784f-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r\" (UID: \"78203c60-a1eb-4ff5-a378-30cc8eda784f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"
Nov 03 21:57:33.397718 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:33.397610    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78203c60-a1eb-4ff5-a378-30cc8eda784f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r\" (UID: \"78203c60-a1eb-4ff5-a378-30cc8eda784f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"
Nov 03 21:57:33.398446 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:33.398341    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78203c60-a1eb-4ff5-a378-30cc8eda784f-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r\" (UID: \"78203c60-a1eb-4ff5-a378-30cc8eda784f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"
Nov 03 21:57:33.400345 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:33.400317    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78203c60-a1eb-4ff5-a378-30cc8eda784f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r\" (UID: \"78203c60-a1eb-4ff5-a378-30cc8eda784f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"
Nov 03 21:57:33.400445 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:33.400326    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78203c60-a1eb-4ff5-a378-30cc8eda784f-metrics-certs\") pod \"maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r\" (UID: \"78203c60-a1eb-4ff5-a378-30cc8eda784f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"
Nov 03 21:57:33.410115 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:33.410086    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2rcs\" (UniqueName: \"kubernetes.io/projected/78203c60-a1eb-4ff5-a378-30cc8eda784f-kube-api-access-x2rcs\") pod \"maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r\" (UID: \"78203c60-a1eb-4ff5-a378-30cc8eda784f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"
Nov 03 21:57:33.552762 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:33.552726    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"
Nov 03 21:57:33.672158 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:33.672062    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng" event={"ID":"1242837c-1912-43aa-9ec6-72301fc61d62","Type":"ContainerStarted","Data":"1b947b61a2a293c6e9a7e5cccd6775a50f468de9662dab7f58412318c5ed8918"}
Nov 03 21:57:33.835479 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:33.835452    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"]
Nov 03 21:57:33.837377 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:57:33.837347    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78203c60_a1eb_4ff5_a378_30cc8eda784f.slice/crio-e51cff1ab746fbee785eb28365b7715411c8285d6aebe040026e04beac13a8f8 WatchSource:0}: Error finding container e51cff1ab746fbee785eb28365b7715411c8285d6aebe040026e04beac13a8f8: Status 404 returned error can't find the container with id e51cff1ab746fbee785eb28365b7715411c8285d6aebe040026e04beac13a8f8
Nov 03 21:57:34.685072 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:34.684951    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng" event={"ID":"1242837c-1912-43aa-9ec6-72301fc61d62","Type":"ContainerStarted","Data":"1cf3d8c206d891fb0b0cc4eab263de8319045e096b1807d74c7fe38340fe1148"}
Nov 03 21:57:34.685072 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:34.685031    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"
Nov 03 21:57:34.687850 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:34.687808    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r" event={"ID":"78203c60-a1eb-4ff5-a378-30cc8eda784f","Type":"ContainerStarted","Data":"72495724ea6471918786a9e1882c11c72bf4bd5693bde39267087af9d70106f1"}
Nov 03 21:57:34.688013 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:34.687869    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r" event={"ID":"78203c60-a1eb-4ff5-a378-30cc8eda784f","Type":"ContainerStarted","Data":"e51cff1ab746fbee785eb28365b7715411c8285d6aebe040026e04beac13a8f8"}
Nov 03 21:57:34.688837 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:34.688422    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"
Nov 03 21:57:34.707285 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:34.707202    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng" podStartSLOduration=2.176793008 podStartE2EDuration="2.707189751s" totalImagesPullingTime="530.396743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:57:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:57:34.705581754 +0000 UTC m=+748.109243200" watchObservedRunningTime="2026-11-03 21:57:34.707189751 +0000 UTC m=+748.110851180"
Nov 03 21:57:34.727937 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:34.727885    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r" podStartSLOduration=1.332805448 podStartE2EDuration="1.727871357s" totalImagesPullingTime="395.065909ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:57:34.726552357 +0000 UTC m=+748.130213799" watchObservedRunningTime="2026-11-03 21:57:34.727871357 +0000 UTC m=+748.131532787"
Nov 03 21:57:36.651578 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:36.651542    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"
Nov 03 21:57:36.652069 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:36.652049    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"
Nov 03 21:57:38.600106 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:38.600075    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg"
Nov 03 21:57:38.679329 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:38.679300    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"
Nov 03 21:57:38.680050 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:38.680027    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"
Nov 03 21:57:39.624024 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:39.623997    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p"
Nov 03 21:57:39.624425 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:39.624063    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz"
Nov 03 21:57:40.640263 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:40.640216    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm"
Nov 03 21:57:40.640691 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:40.640309    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz"
Nov 03 21:57:40.640691 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:40.640445    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s"
Nov 03 21:57:40.640691 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:40.640539    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l"
Nov 03 21:57:40.705040 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:40.705012    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"
Nov 03 21:57:40.705386 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:40.705366    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"
Nov 03 21:57:41.649145 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:41.649116    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb"
Nov 03 21:57:41.649668 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:41.649385    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z"
Nov 03 21:57:42.658972 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:42.658933    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8"
Nov 03 21:57:42.659485 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:57:42.659121    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k"
Nov 03 21:57:59.934169 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:57:59.934086    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:58:13.743675 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.743633    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"]
Nov 03 21:58:13.750279 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.750238    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:13.756360 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.756327    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"]
Nov 03 21:58:13.763315 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.759162    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-85b4ff\"/\"kube-root-ca.crt\""
Nov 03 21:58:13.763315 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.759176    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-85b4ff\"/\"openshift-service-ca.crt\""
Nov 03 21:58:13.763315 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.759674    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-85b4ff\"/\"premium-w5-85b4ff-kserve-self-signed-certs\""
Nov 03 21:58:13.763315 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.759760    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-85b4ff\"/\"default-dockercfg-2bw27\""
Nov 03 21:58:13.878694 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.878654    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-dshm\") pod \"premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") " pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:13.878878 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.878731    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-home\") pod \"premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") " pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:13.878878 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.878768    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-model-cache\") pod \"premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") " pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:13.879042 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.879013    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlgxh\" (UniqueName: \"kubernetes.io/projected/3817624c-e11a-46af-ac60-c181b4fa8a76-kube-api-access-mlgxh\") pod \"premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") " pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:13.879109 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.879060    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-tmp-dir\") pod \"premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") " pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:13.879194 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.879161    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3817624c-e11a-46af-ac60-c181b4fa8a76-tls-certs\") pod \"premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") " pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:13.980285 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.980229    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlgxh\" (UniqueName: \"kubernetes.io/projected/3817624c-e11a-46af-ac60-c181b4fa8a76-kube-api-access-mlgxh\") pod \"premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") " pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:13.980450 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.980298    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-tmp-dir\") pod \"premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") " pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:13.980450 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.980345    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3817624c-e11a-46af-ac60-c181b4fa8a76-tls-certs\") pod \"premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") " pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:13.980450 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.980428    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-dshm\") pod \"premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") " pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:13.980603 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.980482    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-home\") pod \"premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") " pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:13.980603 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.980504    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-model-cache\") pod \"premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") " pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:13.980737 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.980721    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-tmp-dir\") pod \"premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") " pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:13.980834 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.980809    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-home\") pod \"premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") " pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:13.980925 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.980908    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-model-cache\") pod \"premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") " pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:13.982946 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.982919    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-dshm\") pod \"premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") " pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:13.983169 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.983150    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3817624c-e11a-46af-ac60-c181b4fa8a76-tls-certs\") pod \"premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") " pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:13.995329 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:13.995230    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlgxh\" (UniqueName: \"kubernetes.io/projected/3817624c-e11a-46af-ac60-c181b4fa8a76-kube-api-access-mlgxh\") pod \"premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") " pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:14.087336 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:14.087301    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:14.378545 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:14.378520    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"]
Nov 03 21:58:14.380524 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:58:14.380495    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3817624c_e11a_46af_ac60_c181b4fa8a76.slice/crio-13cb4e8895f32285ddad3e06ee6d9e8f38630525b8d60fd568213ce714f7729f WatchSource:0}: Error finding container 13cb4e8895f32285ddad3e06ee6d9e8f38630525b8d60fd568213ce714f7729f: Status 404 returned error can't find the container with id 13cb4e8895f32285ddad3e06ee6d9e8f38630525b8d60fd568213ce714f7729f
Nov 03 21:58:14.974859 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:14.974706    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw" event={"ID":"3817624c-e11a-46af-ac60-c181b4fa8a76","Type":"ContainerStarted","Data":"89d12be9748bee0e820fbee0ac268203da6652f95c5dc4aae1e11d086b6af076"}
Nov 03 21:58:14.974859 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:14.974754    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw" event={"ID":"3817624c-e11a-46af-ac60-c181b4fa8a76","Type":"ContainerStarted","Data":"13cb4e8895f32285ddad3e06ee6d9e8f38630525b8d60fd568213ce714f7729f"}
Nov 03 21:58:14.997672 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:14.997627    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw" podStartSLOduration=1.9976121230000001 podStartE2EDuration="1.997612123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:58:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:58:14.995626699 +0000 UTC m=+788.399288129" watchObservedRunningTime="2026-11-03 21:58:14.997612123 +0000 UTC m=+788.401273553"
Nov 03 21:58:15.088099 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:15.088069    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:24.088399 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:24.088363    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:24.106826 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:24.106791    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:25.053605 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:25.053576    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:58:27.582302 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.582267    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"]
Nov 03 21:58:27.588225 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.588197    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:27.595002 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.594963    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-53a2cb\"/\"openshift-service-ca.crt\""
Nov 03 21:58:27.600095 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.600006    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"]
Nov 03 21:58:27.600869 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.600847    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-53a2cb\"/\"premium-w2-53a2cb-kserve-self-signed-certs\""
Nov 03 21:58:27.601000 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.600985    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-53a2cb\"/\"default-dockercfg-tj995\""
Nov 03 21:58:27.601081 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.601068    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-53a2cb\"/\"kube-root-ca.crt\""
Nov 03 21:58:27.640153 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.640116    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bftg\" (UniqueName: \"kubernetes.io/projected/937b976e-61f3-4d4b-95df-ac70dc941d38-kube-api-access-4bftg\") pod \"premium-w2-53a2cb-kserve-6bcc46d94-drgtn\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") " pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:27.640153 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.640157    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-model-cache\") pod \"premium-w2-53a2cb-kserve-6bcc46d94-drgtn\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") " pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:27.640466 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.640190    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-dshm\") pod \"premium-w2-53a2cb-kserve-6bcc46d94-drgtn\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") " pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:27.640466 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.640236    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/937b976e-61f3-4d4b-95df-ac70dc941d38-tls-certs\") pod \"premium-w2-53a2cb-kserve-6bcc46d94-drgtn\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") " pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:27.640466 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.640295    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-home\") pod \"premium-w2-53a2cb-kserve-6bcc46d94-drgtn\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") " pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:27.640466 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.640353    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-tmp-dir\") pod \"premium-w2-53a2cb-kserve-6bcc46d94-drgtn\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") " pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:27.742012 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.741979    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bftg\" (UniqueName: \"kubernetes.io/projected/937b976e-61f3-4d4b-95df-ac70dc941d38-kube-api-access-4bftg\") pod \"premium-w2-53a2cb-kserve-6bcc46d94-drgtn\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") " pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:27.742012 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.742025    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-model-cache\") pod \"premium-w2-53a2cb-kserve-6bcc46d94-drgtn\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") " pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:27.742306 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.742073    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-dshm\") pod \"premium-w2-53a2cb-kserve-6bcc46d94-drgtn\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") " pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:27.742306 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.742121    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/937b976e-61f3-4d4b-95df-ac70dc941d38-tls-certs\") pod \"premium-w2-53a2cb-kserve-6bcc46d94-drgtn\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") " pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:27.742306 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.742150    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-home\") pod \"premium-w2-53a2cb-kserve-6bcc46d94-drgtn\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") " pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:27.742306 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.742203    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-tmp-dir\") pod \"premium-w2-53a2cb-kserve-6bcc46d94-drgtn\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") " pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:27.742913 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.742885    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-home\") pod \"premium-w2-53a2cb-kserve-6bcc46d94-drgtn\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") " pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:27.743109 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.743082    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-model-cache\") pod \"premium-w2-53a2cb-kserve-6bcc46d94-drgtn\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") " pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:27.743179 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.743085    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-tmp-dir\") pod \"premium-w2-53a2cb-kserve-6bcc46d94-drgtn\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") " pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:27.745906 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.745872    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/937b976e-61f3-4d4b-95df-ac70dc941d38-tls-certs\") pod \"premium-w2-53a2cb-kserve-6bcc46d94-drgtn\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") " pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:27.753992 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.753962    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-dshm\") pod \"premium-w2-53a2cb-kserve-6bcc46d94-drgtn\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") " pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:27.754509 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.754490    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bftg\" (UniqueName: \"kubernetes.io/projected/937b976e-61f3-4d4b-95df-ac70dc941d38-kube-api-access-4bftg\") pod \"premium-w2-53a2cb-kserve-6bcc46d94-drgtn\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") " pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:27.907953 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:27.907860    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:28.206919 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:28.206885    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"]
Nov 03 21:58:28.208439 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:58:28.208395    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod937b976e_61f3_4d4b_95df_ac70dc941d38.slice/crio-bd446168f1ee48c77ea6931aad1ea29cff6347c08b7f1daca70141e5d9c4f592 WatchSource:0}: Error finding container bd446168f1ee48c77ea6931aad1ea29cff6347c08b7f1daca70141e5d9c4f592: Status 404 returned error can't find the container with id bd446168f1ee48c77ea6931aad1ea29cff6347c08b7f1daca70141e5d9c4f592
Nov 03 21:58:29.070870 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.070834    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn" event={"ID":"937b976e-61f3-4d4b-95df-ac70dc941d38","Type":"ContainerStarted","Data":"d248fc8a1cd9a77ca6affb7f8c7b8ba52667d2547405829a1a42a0aaa680091a"}
Nov 03 21:58:29.071363 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.070884    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn" event={"ID":"937b976e-61f3-4d4b-95df-ac70dc941d38","Type":"ContainerStarted","Data":"bd446168f1ee48c77ea6931aad1ea29cff6347c08b7f1daca70141e5d9c4f592"}
Nov 03 21:58:29.093846 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.093800    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn" podStartSLOduration=2.093786764 podStartE2EDuration="2.093786764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:58:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:58:29.090292705 +0000 UTC m=+802.493954132" watchObservedRunningTime="2026-11-03 21:58:29.093786764 +0000 UTC m=+802.497448194"
Nov 03 21:58:29.811820 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.811779    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"]
Nov 03 21:58:29.816575 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.816506    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:29.823077 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.823039    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-c0caef\"/\"premium-w0-c0caef-kserve-self-signed-certs\""
Nov 03 21:58:29.823277 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.823145    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-c0caef\"/\"default-dockercfg-zzvmd\""
Nov 03 21:58:29.823277 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.823219    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-c0caef\"/\"kube-root-ca.crt\""
Nov 03 21:58:29.823428 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.823287    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-c0caef\"/\"openshift-service-ca.crt\""
Nov 03 21:58:29.827427 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.827397    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"]
Nov 03 21:58:29.868713 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.868676    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-model-cache\") pod \"premium-w0-c0caef-kserve-5594b7b4f8-qw6rq\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") " pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:29.868884 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.868827    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-tls-certs\") pod \"premium-w0-c0caef-kserve-5594b7b4f8-qw6rq\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") " pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:29.869054 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.869032    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-tmp-dir\") pod \"premium-w0-c0caef-kserve-5594b7b4f8-qw6rq\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") " pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:29.869151 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.869071    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-home\") pod \"premium-w0-c0caef-kserve-5594b7b4f8-qw6rq\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") " pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:29.869348 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.869323    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-dshm\") pod \"premium-w0-c0caef-kserve-5594b7b4f8-qw6rq\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") " pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:29.869545 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.869393    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c4fc\" (UniqueName: \"kubernetes.io/projected/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-kube-api-access-8c4fc\") pod \"premium-w0-c0caef-kserve-5594b7b4f8-qw6rq\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") " pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:29.908053 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.908022    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:29.934448 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:58:29.934402    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:58:29.972323 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.972283    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-dshm\") pod \"premium-w0-c0caef-kserve-5594b7b4f8-qw6rq\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") " pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:29.972537 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.972363    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c4fc\" (UniqueName: \"kubernetes.io/projected/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-kube-api-access-8c4fc\") pod \"premium-w0-c0caef-kserve-5594b7b4f8-qw6rq\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") " pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:29.972537 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.972402    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-model-cache\") pod \"premium-w0-c0caef-kserve-5594b7b4f8-qw6rq\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") " pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:29.972537 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.972463    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-tls-certs\") pod \"premium-w0-c0caef-kserve-5594b7b4f8-qw6rq\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") " pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:29.972696 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.972597    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-tmp-dir\") pod \"premium-w0-c0caef-kserve-5594b7b4f8-qw6rq\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") " pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:29.972696 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.972631    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-home\") pod \"premium-w0-c0caef-kserve-5594b7b4f8-qw6rq\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") " pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:29.973176 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.973140    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-home\") pod \"premium-w0-c0caef-kserve-5594b7b4f8-qw6rq\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") " pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:29.973441 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.973422    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-model-cache\") pod \"premium-w0-c0caef-kserve-5594b7b4f8-qw6rq\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") " pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:29.975958 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.975588    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-tmp-dir\") pod \"premium-w0-c0caef-kserve-5594b7b4f8-qw6rq\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") " pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:29.976114 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.976089    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-dshm\") pod \"premium-w0-c0caef-kserve-5594b7b4f8-qw6rq\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") " pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:29.994297 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.992202    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-tls-certs\") pod \"premium-w0-c0caef-kserve-5594b7b4f8-qw6rq\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") " pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:29.994297 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:29.994101    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c4fc\" (UniqueName: \"kubernetes.io/projected/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-kube-api-access-8c4fc\") pod \"premium-w0-c0caef-kserve-5594b7b4f8-qw6rq\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") " pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:30.139720 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:30.139632    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:30.432366 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:30.432344    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"]
Nov 03 21:58:30.434545 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:58:30.434515    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf469226d_5a72_4c9e_8c68_d45f3aeaad7a.slice/crio-d77b66e7929c38de20c279f0346c4d2a3e20f0cd76a619c6d767f156ada56a4f WatchSource:0}: Error finding container d77b66e7929c38de20c279f0346c4d2a3e20f0cd76a619c6d767f156ada56a4f: Status 404 returned error can't find the container with id d77b66e7929c38de20c279f0346c4d2a3e20f0cd76a619c6d767f156ada56a4f
Nov 03 21:58:31.090544 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:31.090486    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq" event={"ID":"f469226d-5a72-4c9e-8c68-d45f3aeaad7a","Type":"ContainerStarted","Data":"ca3056c9406da03eeeae505e060cf2dec37ab7654d1948e4896dbd92e893ba13"}
Nov 03 21:58:31.090796 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:31.090564    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq" event={"ID":"f469226d-5a72-4c9e-8c68-d45f3aeaad7a","Type":"ContainerStarted","Data":"d77b66e7929c38de20c279f0346c4d2a3e20f0cd76a619c6d767f156ada56a4f"}
Nov 03 21:58:31.121218 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:31.121162    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq" podStartSLOduration=2.121146962 podStartE2EDuration="2.121146962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:58:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:58:31.119980094 +0000 UTC m=+804.523641539" watchObservedRunningTime="2026-11-03 21:58:31.121146962 +0000 UTC m=+804.524808393"
Nov 03 21:58:31.140318 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:31.140276    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:37.909081 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:37.909045    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:37.922156 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:37.922133    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:38.152111 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:38.152080    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 21:58:40.140038 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:40.140002    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:40.154111 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:40.154085    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:40.165867 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:58:40.165836    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:58:59.927725 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:58:59.927687    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:59:19.454707 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:19.454623    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"]
Nov 03 21:59:24.792637 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:24.792563    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb"]
Nov 03 21:59:26.804042 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:26.804007    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"]
Nov 03 21:59:29.615506 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:29.615468    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l"]
Nov 03 21:59:29.616181 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:29.616159    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s"]
Nov 03 21:59:29.797405 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:29.797330    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb" podUID="7cdc96b4-12c6-4856-a587-81502006f757" containerName="payload-pre-processing" containerID="cri-o://918935b66eb15e153d75d93f069d79e061b44dede9570a4702b88c2fa7bc7a60" gracePeriod=25
Nov 03 21:59:30.029751 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:59:30.029645    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 21:59:31.646620 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:31.646580    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb" podUID="7cdc96b4-12c6-4856-a587-81502006f757" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 21:59:32.159831 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:32.159798    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg"]
Nov 03 21:59:32.175265 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:32.175199    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz"]
Nov 03 21:59:33.462545 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:33.462511    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm"]
Nov 03 21:59:33.480648 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:33.480614    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p"]
Nov 03 21:59:34.483890 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.483843    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq" podUID="f469226d-5a72-4c9e-8c68-d45f3aeaad7a" containerName="main" containerID="cri-o://ca3056c9406da03eeeae505e060cf2dec37ab7654d1948e4896dbd92e893ba13" gracePeriod=45
Nov 03 21:59:34.616873 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.616822    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s" podUID="c61aad42-dcf9-4f3c-971a-03d03ddfc8ff" containerName="payload-pre-processing" containerID="cri-o://ab9aca32bbabe034c09fb723ae66c725c003fe63207b818e0d6010ab24906465" gracePeriod=25
Nov 03 21:59:34.618289 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.618255    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l" podUID="998d8261-6d86-4f97-948f-abfb5fc704c9" containerName="payload-processing" containerID="cri-o://4e84b87d6a45663c0e53bd02783008416eb708927953f9e2d777298b6ff5c36b" gracePeriod=25
Nov 03 21:59:34.798987 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.798956    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:59:34.886786 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.886757    5077 generic.go:356] "Generic (PLEG): container finished" podID="f469226d-5a72-4c9e-8c68-d45f3aeaad7a" containerID="ca3056c9406da03eeeae505e060cf2dec37ab7654d1948e4896dbd92e893ba13" exitCode=0
Nov 03 21:59:34.886978 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.886873    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq" event={"ID":"f469226d-5a72-4c9e-8c68-d45f3aeaad7a","Type":"ContainerDied","Data":"ca3056c9406da03eeeae505e060cf2dec37ab7654d1948e4896dbd92e893ba13"}
Nov 03 21:59:34.886978 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.886911    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq" event={"ID":"f469226d-5a72-4c9e-8c68-d45f3aeaad7a","Type":"ContainerDied","Data":"d77b66e7929c38de20c279f0346c4d2a3e20f0cd76a619c6d767f156ada56a4f"}
Nov 03 21:59:34.886978 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.886936    5077 scope.go:122] "RemoveContainer" containerID="ca3056c9406da03eeeae505e060cf2dec37ab7654d1948e4896dbd92e893ba13"
Nov 03 21:59:34.887154 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.887077    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"
Nov 03 21:59:34.899969 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.899940    5077 scope.go:122] "RemoveContainer" containerID="ca3056c9406da03eeeae505e060cf2dec37ab7654d1948e4896dbd92e893ba13"
Nov 03 21:59:34.900378 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:59:34.900351    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca3056c9406da03eeeae505e060cf2dec37ab7654d1948e4896dbd92e893ba13\": container with ID starting with ca3056c9406da03eeeae505e060cf2dec37ab7654d1948e4896dbd92e893ba13 not found: ID does not exist" containerID="ca3056c9406da03eeeae505e060cf2dec37ab7654d1948e4896dbd92e893ba13"
Nov 03 21:59:34.900502 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.900391    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca3056c9406da03eeeae505e060cf2dec37ab7654d1948e4896dbd92e893ba13"} err="failed to get container status \"ca3056c9406da03eeeae505e060cf2dec37ab7654d1948e4896dbd92e893ba13\": rpc error: code = NotFound desc = could not find container \"ca3056c9406da03eeeae505e060cf2dec37ab7654d1948e4896dbd92e893ba13\": container with ID starting with ca3056c9406da03eeeae505e060cf2dec37ab7654d1948e4896dbd92e893ba13 not found: ID does not exist"
Nov 03 21:59:34.907694 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.907667    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-kube-api-access-8c4fc\" (UniqueName: \"kubernetes.io/projected/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-kube-api-access-8c4fc\") pod \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") "
Nov 03 21:59:34.907814 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.907790    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-tls-certs\" (UniqueName: \"kubernetes.io/secret/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-tls-certs\") pod \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") "
Nov 03 21:59:34.907868 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.907821    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-dshm\") pod \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") "
Nov 03 21:59:34.907910 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.907879    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-model-cache\") pod \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") "
Nov 03 21:59:34.907970 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.907911    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-tmp-dir\") pod \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") "
Nov 03 21:59:34.908072 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.908053    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-home\" (UniqueName: \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-home\") pod \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\" (UID: \"f469226d-5a72-4c9e-8c68-d45f3aeaad7a\") "
Nov 03 21:59:34.908308 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.908278    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-model-cache" pod "f469226d-5a72-4c9e-8c68-d45f3aeaad7a" (UID: "f469226d-5a72-4c9e-8c68-d45f3aeaad7a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:59:34.908452 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.908431    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-home" pod "f469226d-5a72-4c9e-8c68-d45f3aeaad7a" (UID: "f469226d-5a72-4c9e-8c68-d45f3aeaad7a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:59:34.908452 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.908431    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-tmp-dir" pod "f469226d-5a72-4c9e-8c68-d45f3aeaad7a" (UID: "f469226d-5a72-4c9e-8c68-d45f3aeaad7a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:59:34.908702 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.908685    5077 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-model-cache\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:34.908772 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.908710    5077 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-tmp-dir\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:34.908772 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.908726    5077 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-home\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:34.910647 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.910621    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-dshm" pod "f469226d-5a72-4c9e-8c68-d45f3aeaad7a" (UID: "f469226d-5a72-4c9e-8c68-d45f3aeaad7a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:59:34.910747 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.910728    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-tls-certs" pod "f469226d-5a72-4c9e-8c68-d45f3aeaad7a" (UID: "f469226d-5a72-4c9e-8c68-d45f3aeaad7a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:59:34.910807 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:34.910789    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-kube-api-access-8c4fc" pod "f469226d-5a72-4c9e-8c68-d45f3aeaad7a" (UID: "f469226d-5a72-4c9e-8c68-d45f3aeaad7a"). InnerVolumeSpecName "kube-api-access-8c4fc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:59:35.010214 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:35.010174    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8c4fc\" (UniqueName: \"kubernetes.io/projected/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-kube-api-access-8c4fc\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:35.010214 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:35.010204    5077 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-tls-certs\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:35.010214 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:35.010213    5077 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f469226d-5a72-4c9e-8c68-d45f3aeaad7a-dshm\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:35.211345 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:35.211312    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"]
Nov 03 21:59:35.216906 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:35.216880    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-c0caef/premium-w0-c0caef-kserve-5594b7b4f8-qw6rq"]
Nov 03 21:59:36.738226 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:36.738193    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f469226d-5a72-4c9e-8c68-d45f3aeaad7a" path="/var/lib/kubelet/pods/f469226d-5a72-4c9e-8c68-d45f3aeaad7a/volumes"
Nov 03 21:59:37.160505 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:37.160439    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg" podUID="9ddd62a2-4835-4cc4-b04d-846c174b07b6" containerName="payload-processing" containerID="cri-o://41ed39e8d2f92b1ad59c8ce574b1b2d96ad78232694d7e811ca013307fdc4835" gracePeriod=25
Nov 03 21:59:37.176663 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:37.176622    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz" podUID="e0f13297-0097-446f-8f49-9b931e44a691" containerName="payload-pre-processing" containerID="cri-o://9a620028190d40857daaf62daf95f428d5724dcb5a5e19e0a3e46a476827c58b" gracePeriod=25
Nov 03 21:59:38.463668 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:38.463609    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm" podUID="c5ac4b3b-8103-4b03-b2e7-84eda5cf4659" containerName="payload-processing" containerID="cri-o://a8158e42105a1c7bd7a1f0bf3865c0f724ff7def8e853a513e555c757073773c" gracePeriod=25
Nov 03 21:59:38.481300 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:38.481213    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p" podUID="eb75cdb5-ccf7-4702-bc41-a180e1716b2b" containerName="payload-pre-processing" containerID="cri-o://bbe7a6c49509b94cc68eff985fdd4ded2f652ac5cc383c7c1a97891088b2228a" gracePeriod=25
Nov 03 21:59:38.598509 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:38.598468    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg" podUID="9ddd62a2-4835-4cc4-b04d-846c174b07b6" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 21:59:39.622393 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:39.622348    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p" podUID="eb75cdb5-ccf7-4702-bc41-a180e1716b2b" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 21:59:39.622840 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:39.622346    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz" podUID="e0f13297-0097-446f-8f49-9b931e44a691" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 21:59:40.638652 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:40.638610    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l" podUID="998d8261-6d86-4f97-948f-abfb5fc704c9" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 21:59:40.639077 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:40.638672    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s" podUID="c61aad42-dcf9-4f3c-971a-03d03ddfc8ff" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 21:59:40.639077 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:40.638759    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm" podUID="c5ac4b3b-8103-4b03-b2e7-84eda5cf4659" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 21:59:41.106402 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.106367    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"]
Nov 03 21:59:41.106889 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.106854    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r" podUID="78203c60-a1eb-4ff5-a378-30cc8eda784f" containerName="maas-api" containerID="cri-o://72495724ea6471918786a9e1882c11c72bf4bd5693bde39267087af9d70106f1" gracePeriod=30
Nov 03 21:59:41.412751 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.412724    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"
Nov 03 21:59:41.487817 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.487775    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/78203c60-a1eb-4ff5-a378-30cc8eda784f-kube-api-access-x2rcs\" (UniqueName: \"kubernetes.io/projected/78203c60-a1eb-4ff5-a378-30cc8eda784f-kube-api-access-x2rcs\") pod \"78203c60-a1eb-4ff5-a378-30cc8eda784f\" (UID: \"78203c60-a1eb-4ff5-a378-30cc8eda784f\") "
Nov 03 21:59:41.487992 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.487895    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/78203c60-a1eb-4ff5-a378-30cc8eda784f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78203c60-a1eb-4ff5-a378-30cc8eda784f-openshift-service-ca\") pod \"78203c60-a1eb-4ff5-a378-30cc8eda784f\" (UID: \"78203c60-a1eb-4ff5-a378-30cc8eda784f\") "
Nov 03 21:59:41.488047 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.488000    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/78203c60-a1eb-4ff5-a378-30cc8eda784f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/78203c60-a1eb-4ff5-a378-30cc8eda784f-metrics-certs\") pod \"78203c60-a1eb-4ff5-a378-30cc8eda784f\" (UID: \"78203c60-a1eb-4ff5-a378-30cc8eda784f\") "
Nov 03 21:59:41.488047 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.488034    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/78203c60-a1eb-4ff5-a378-30cc8eda784f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78203c60-a1eb-4ff5-a378-30cc8eda784f-maas-api-tls\") pod \"78203c60-a1eb-4ff5-a378-30cc8eda784f\" (UID: \"78203c60-a1eb-4ff5-a378-30cc8eda784f\") "
Nov 03 21:59:41.488329 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.488299    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78203c60-a1eb-4ff5-a378-30cc8eda784f-openshift-service-ca" pod "78203c60-a1eb-4ff5-a378-30cc8eda784f" (UID: "78203c60-a1eb-4ff5-a378-30cc8eda784f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:59:41.488841 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.488805    5077 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78203c60-a1eb-4ff5-a378-30cc8eda784f-openshift-service-ca\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:41.490688 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.490657    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78203c60-a1eb-4ff5-a378-30cc8eda784f-kube-api-access-x2rcs" pod "78203c60-a1eb-4ff5-a378-30cc8eda784f" (UID: "78203c60-a1eb-4ff5-a378-30cc8eda784f"). InnerVolumeSpecName "kube-api-access-x2rcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:59:41.490875 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.490847    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78203c60-a1eb-4ff5-a378-30cc8eda784f-metrics-certs" pod "78203c60-a1eb-4ff5-a378-30cc8eda784f" (UID: "78203c60-a1eb-4ff5-a378-30cc8eda784f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:59:41.491554 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.491533    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78203c60-a1eb-4ff5-a378-30cc8eda784f-maas-api-tls" pod "78203c60-a1eb-4ff5-a378-30cc8eda784f" (UID: "78203c60-a1eb-4ff5-a378-30cc8eda784f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:59:41.589547 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.589515    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2rcs\" (UniqueName: \"kubernetes.io/projected/78203c60-a1eb-4ff5-a378-30cc8eda784f-kube-api-access-x2rcs\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:41.589547 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.589543    5077 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78203c60-a1eb-4ff5-a378-30cc8eda784f-metrics-certs\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:41.589547 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.589553    5077 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78203c60-a1eb-4ff5-a378-30cc8eda784f-maas-api-tls\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:41.649344 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.647779    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb" podUID="7cdc96b4-12c6-4856-a587-81502006f757" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 21:59:41.826239 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.826204    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw" podUID="3817624c-e11a-46af-ac60-c181b4fa8a76" containerName="main" containerID="cri-o://89d12be9748bee0e820fbee0ac268203da6652f95c5dc4aae1e11d086b6af076" gracePeriod=45
Nov 03 21:59:41.935547 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.935452    5077 generic.go:356] "Generic (PLEG): container finished" podID="78203c60-a1eb-4ff5-a378-30cc8eda784f" containerID="72495724ea6471918786a9e1882c11c72bf4bd5693bde39267087af9d70106f1" exitCode=0
Nov 03 21:59:41.935547 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.935507    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"
Nov 03 21:59:41.935735 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.935542    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r" event={"ID":"78203c60-a1eb-4ff5-a378-30cc8eda784f","Type":"ContainerDied","Data":"72495724ea6471918786a9e1882c11c72bf4bd5693bde39267087af9d70106f1"}
Nov 03 21:59:41.935735 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.935612    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r" event={"ID":"78203c60-a1eb-4ff5-a378-30cc8eda784f","Type":"ContainerDied","Data":"e51cff1ab746fbee785eb28365b7715411c8285d6aebe040026e04beac13a8f8"}
Nov 03 21:59:41.935735 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.935642    5077 scope.go:122] "RemoveContainer" containerID="72495724ea6471918786a9e1882c11c72bf4bd5693bde39267087af9d70106f1"
Nov 03 21:59:41.948162 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.948134    5077 scope.go:122] "RemoveContainer" containerID="72495724ea6471918786a9e1882c11c72bf4bd5693bde39267087af9d70106f1"
Nov 03 21:59:41.948526 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:59:41.948496    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72495724ea6471918786a9e1882c11c72bf4bd5693bde39267087af9d70106f1\": container with ID starting with 72495724ea6471918786a9e1882c11c72bf4bd5693bde39267087af9d70106f1 not found: ID does not exist" containerID="72495724ea6471918786a9e1882c11c72bf4bd5693bde39267087af9d70106f1"
Nov 03 21:59:41.948634 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.948536    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72495724ea6471918786a9e1882c11c72bf4bd5693bde39267087af9d70106f1"} err="failed to get container status \"72495724ea6471918786a9e1882c11c72bf4bd5693bde39267087af9d70106f1\": rpc error: code = NotFound desc = could not find container \"72495724ea6471918786a9e1882c11c72bf4bd5693bde39267087af9d70106f1\": container with ID starting with 72495724ea6471918786a9e1882c11c72bf4bd5693bde39267087af9d70106f1 not found: ID does not exist"
Nov 03 21:59:41.960299 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.960271    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"]
Nov 03 21:59:41.964350 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:41.964318    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-c0caef-78fd9ccfc6-zr45r"]
Nov 03 21:59:42.115509 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.115481    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:59:42.197315 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.197174    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-home\" (UniqueName: \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-home\") pod \"3817624c-e11a-46af-ac60-c181b4fa8a76\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") "
Nov 03 21:59:42.197498 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.197337    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3817624c-e11a-46af-ac60-c181b4fa8a76-kube-api-access-mlgxh\" (UniqueName: \"kubernetes.io/projected/3817624c-e11a-46af-ac60-c181b4fa8a76-kube-api-access-mlgxh\") pod \"3817624c-e11a-46af-ac60-c181b4fa8a76\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") "
Nov 03 21:59:42.197498 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.197407    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-tmp-dir\") pod \"3817624c-e11a-46af-ac60-c181b4fa8a76\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") "
Nov 03 21:59:42.197628 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.197523    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3817624c-e11a-46af-ac60-c181b4fa8a76-tls-certs\" (UniqueName: \"kubernetes.io/secret/3817624c-e11a-46af-ac60-c181b4fa8a76-tls-certs\") pod \"3817624c-e11a-46af-ac60-c181b4fa8a76\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") "
Nov 03 21:59:42.197628 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.197577    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-model-cache\") pod \"3817624c-e11a-46af-ac60-c181b4fa8a76\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") "
Nov 03 21:59:42.197758 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.197631    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-dshm\" (UniqueName: \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-dshm\") pod \"3817624c-e11a-46af-ac60-c181b4fa8a76\" (UID: \"3817624c-e11a-46af-ac60-c181b4fa8a76\") "
Nov 03 21:59:42.198141 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.198102    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-home" pod "3817624c-e11a-46af-ac60-c181b4fa8a76" (UID: "3817624c-e11a-46af-ac60-c181b4fa8a76"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:59:42.198473 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.198447    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-model-cache" pod "3817624c-e11a-46af-ac60-c181b4fa8a76" (UID: "3817624c-e11a-46af-ac60-c181b4fa8a76"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:59:42.199187 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.199086    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-tmp-dir" pod "3817624c-e11a-46af-ac60-c181b4fa8a76" (UID: "3817624c-e11a-46af-ac60-c181b4fa8a76"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:59:42.204286 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.201500    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3817624c-e11a-46af-ac60-c181b4fa8a76-tls-certs" pod "3817624c-e11a-46af-ac60-c181b4fa8a76" (UID: "3817624c-e11a-46af-ac60-c181b4fa8a76"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:59:42.204286 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.201835    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-dshm" pod "3817624c-e11a-46af-ac60-c181b4fa8a76" (UID: "3817624c-e11a-46af-ac60-c181b4fa8a76"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:59:42.204286 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.203944    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3817624c-e11a-46af-ac60-c181b4fa8a76-kube-api-access-mlgxh" pod "3817624c-e11a-46af-ac60-c181b4fa8a76" (UID: "3817624c-e11a-46af-ac60-c181b4fa8a76"). InnerVolumeSpecName "kube-api-access-mlgxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:59:42.299294 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.299223    5077 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-tmp-dir\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:42.299294 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.299293    5077 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3817624c-e11a-46af-ac60-c181b4fa8a76-tls-certs\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:42.299503 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.299308    5077 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-model-cache\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:42.299503 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.299323    5077 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-dshm\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:42.299503 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.299337    5077 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3817624c-e11a-46af-ac60-c181b4fa8a76-home\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:42.299503 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.299352    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlgxh\" (UniqueName: \"kubernetes.io/projected/3817624c-e11a-46af-ac60-c181b4fa8a76-kube-api-access-mlgxh\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:42.736851 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.736819    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="78203c60-a1eb-4ff5-a378-30cc8eda784f" path="/var/lib/kubelet/pods/78203c60-a1eb-4ff5-a378-30cc8eda784f/volumes"
Nov 03 21:59:42.943908 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.943873    5077 generic.go:356] "Generic (PLEG): container finished" podID="3817624c-e11a-46af-ac60-c181b4fa8a76" containerID="89d12be9748bee0e820fbee0ac268203da6652f95c5dc4aae1e11d086b6af076" exitCode=0
Nov 03 21:59:42.944097 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.943925    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"
Nov 03 21:59:42.944097 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.943965    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw" event={"ID":"3817624c-e11a-46af-ac60-c181b4fa8a76","Type":"ContainerDied","Data":"89d12be9748bee0e820fbee0ac268203da6652f95c5dc4aae1e11d086b6af076"}
Nov 03 21:59:42.944097 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.944010    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw" event={"ID":"3817624c-e11a-46af-ac60-c181b4fa8a76","Type":"ContainerDied","Data":"13cb4e8895f32285ddad3e06ee6d9e8f38630525b8d60fd568213ce714f7729f"}
Nov 03 21:59:42.944097 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.944028    5077 scope.go:122] "RemoveContainer" containerID="89d12be9748bee0e820fbee0ac268203da6652f95c5dc4aae1e11d086b6af076"
Nov 03 21:59:42.956603 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.956410    5077 scope.go:122] "RemoveContainer" containerID="89d12be9748bee0e820fbee0ac268203da6652f95c5dc4aae1e11d086b6af076"
Nov 03 21:59:42.957014 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:59:42.956988    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89d12be9748bee0e820fbee0ac268203da6652f95c5dc4aae1e11d086b6af076\": container with ID starting with 89d12be9748bee0e820fbee0ac268203da6652f95c5dc4aae1e11d086b6af076 not found: ID does not exist" containerID="89d12be9748bee0e820fbee0ac268203da6652f95c5dc4aae1e11d086b6af076"
Nov 03 21:59:42.957140 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:42.957018    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89d12be9748bee0e820fbee0ac268203da6652f95c5dc4aae1e11d086b6af076"} err="failed to get container status \"89d12be9748bee0e820fbee0ac268203da6652f95c5dc4aae1e11d086b6af076\": rpc error: code = NotFound desc = could not find container \"89d12be9748bee0e820fbee0ac268203da6652f95c5dc4aae1e11d086b6af076\": container with ID starting with 89d12be9748bee0e820fbee0ac268203da6652f95c5dc4aae1e11d086b6af076 not found: ID does not exist"
Nov 03 21:59:43.005330 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.005227    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"]
Nov 03 21:59:43.009729 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.009700    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw"]
Nov 03 21:59:43.043158 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.043116    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-85b4ff/premium-w5-85b4ff-kserve-849f5cbdf4-9qbjw" podUID="3817624c-e11a-46af-ac60-c181b4fa8a76" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:59:43.324565 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.324531    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"]
Nov 03 21:59:43.324822 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.324792    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm" podUID="586bbac6-3107-4432-a636-0c83ece12573" containerName="maas-api" containerID="cri-o://e4bce958fa6c6e92f47f708a23e7f9148f0acccb45c6b44c62077693cfb557f8" gracePeriod=30
Nov 03 21:59:43.682111 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.682070    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"
Nov 03 21:59:43.818530 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.818500    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/586bbac6-3107-4432-a636-0c83ece12573-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/586bbac6-3107-4432-a636-0c83ece12573-maas-api-tls\") pod \"586bbac6-3107-4432-a636-0c83ece12573\" (UID: \"586bbac6-3107-4432-a636-0c83ece12573\") "
Nov 03 21:59:43.818963 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.818564    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/586bbac6-3107-4432-a636-0c83ece12573-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/586bbac6-3107-4432-a636-0c83ece12573-openshift-service-ca\") pod \"586bbac6-3107-4432-a636-0c83ece12573\" (UID: \"586bbac6-3107-4432-a636-0c83ece12573\") "
Nov 03 21:59:43.818963 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.818669    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/586bbac6-3107-4432-a636-0c83ece12573-kube-api-access-2x2hf\" (UniqueName: \"kubernetes.io/projected/586bbac6-3107-4432-a636-0c83ece12573-kube-api-access-2x2hf\") pod \"586bbac6-3107-4432-a636-0c83ece12573\" (UID: \"586bbac6-3107-4432-a636-0c83ece12573\") "
Nov 03 21:59:43.818963 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.818808    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/586bbac6-3107-4432-a636-0c83ece12573-metrics-certs\" (UniqueName: \"kubernetes.io/secret/586bbac6-3107-4432-a636-0c83ece12573-metrics-certs\") pod \"586bbac6-3107-4432-a636-0c83ece12573\" (UID: \"586bbac6-3107-4432-a636-0c83ece12573\") "
Nov 03 21:59:43.818963 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.818878    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/586bbac6-3107-4432-a636-0c83ece12573-openshift-service-ca" pod "586bbac6-3107-4432-a636-0c83ece12573" (UID: "586bbac6-3107-4432-a636-0c83ece12573"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:59:43.819992 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.819968    5077 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/586bbac6-3107-4432-a636-0c83ece12573-openshift-service-ca\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:43.821525 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.821499    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/586bbac6-3107-4432-a636-0c83ece12573-maas-api-tls" pod "586bbac6-3107-4432-a636-0c83ece12573" (UID: "586bbac6-3107-4432-a636-0c83ece12573"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:59:43.821653 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.821637    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/586bbac6-3107-4432-a636-0c83ece12573-metrics-certs" pod "586bbac6-3107-4432-a636-0c83ece12573" (UID: "586bbac6-3107-4432-a636-0c83ece12573"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:59:43.821984 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.821963    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/586bbac6-3107-4432-a636-0c83ece12573-kube-api-access-2x2hf" pod "586bbac6-3107-4432-a636-0c83ece12573" (UID: "586bbac6-3107-4432-a636-0c83ece12573"). InnerVolumeSpecName "kube-api-access-2x2hf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:59:43.929371 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.921721    5077 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/586bbac6-3107-4432-a636-0c83ece12573-maas-api-tls\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:43.929371 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.921754    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x2hf\" (UniqueName: \"kubernetes.io/projected/586bbac6-3107-4432-a636-0c83ece12573-kube-api-access-2x2hf\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:43.929371 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.921796    5077 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/586bbac6-3107-4432-a636-0c83ece12573-metrics-certs\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:43.952115 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.952079    5077 generic.go:356] "Generic (PLEG): container finished" podID="586bbac6-3107-4432-a636-0c83ece12573" containerID="e4bce958fa6c6e92f47f708a23e7f9148f0acccb45c6b44c62077693cfb557f8" exitCode=0
Nov 03 21:59:43.952317 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.952139    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"
Nov 03 21:59:43.952317 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.952171    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm" event={"ID":"586bbac6-3107-4432-a636-0c83ece12573","Type":"ContainerDied","Data":"e4bce958fa6c6e92f47f708a23e7f9148f0acccb45c6b44c62077693cfb557f8"}
Nov 03 21:59:43.952317 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.952257    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm" event={"ID":"586bbac6-3107-4432-a636-0c83ece12573","Type":"ContainerDied","Data":"f418a1f02e10cb491bc7799d558ba07a564a235c25ec43fc72d8c7a58d6ee341"}
Nov 03 21:59:43.952317 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.952295    5077 scope.go:122] "RemoveContainer" containerID="e4bce958fa6c6e92f47f708a23e7f9148f0acccb45c6b44c62077693cfb557f8"
Nov 03 21:59:43.969563 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.969538    5077 scope.go:122] "RemoveContainer" containerID="e4bce958fa6c6e92f47f708a23e7f9148f0acccb45c6b44c62077693cfb557f8"
Nov 03 21:59:43.969897 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:59:43.969873    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4bce958fa6c6e92f47f708a23e7f9148f0acccb45c6b44c62077693cfb557f8\": container with ID starting with e4bce958fa6c6e92f47f708a23e7f9148f0acccb45c6b44c62077693cfb557f8 not found: ID does not exist" containerID="e4bce958fa6c6e92f47f708a23e7f9148f0acccb45c6b44c62077693cfb557f8"
Nov 03 21:59:43.969959 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.969905    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4bce958fa6c6e92f47f708a23e7f9148f0acccb45c6b44c62077693cfb557f8"} err="failed to get container status \"e4bce958fa6c6e92f47f708a23e7f9148f0acccb45c6b44c62077693cfb557f8\": rpc error: code = NotFound desc = could not find container \"e4bce958fa6c6e92f47f708a23e7f9148f0acccb45c6b44c62077693cfb557f8\": container with ID starting with e4bce958fa6c6e92f47f708a23e7f9148f0acccb45c6b44c62077693cfb557f8 not found: ID does not exist"
Nov 03 21:59:43.980054 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.980032    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"]
Nov 03 21:59:43.985710 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:43.985689    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-85b4ff-588f687f6-sgcwm"]
Nov 03 21:59:44.415216 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:44.415184    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"]
Nov 03 21:59:44.415573 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:44.415515    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf" podUID="2154964b-4add-4fce-9b61-7a98ddfb0fa5" containerName="maas-api" containerID="cri-o://658f78dfb49e319003ef215f189234b92cf9ca124096067fde9d7d2ae31d9eb7" gracePeriod=30
Nov 03 21:59:44.738120 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:44.738080    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3817624c-e11a-46af-ac60-c181b4fa8a76" path="/var/lib/kubelet/pods/3817624c-e11a-46af-ac60-c181b4fa8a76/volumes"
Nov 03 21:59:44.738555 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:44.738540    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="586bbac6-3107-4432-a636-0c83ece12573" path="/var/lib/kubelet/pods/586bbac6-3107-4432-a636-0c83ece12573/volumes"
Nov 03 21:59:44.919758 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:44.919727    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"
Nov 03 21:59:44.965756 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:44.965302    5077 generic.go:356] "Generic (PLEG): container finished" podID="2154964b-4add-4fce-9b61-7a98ddfb0fa5" containerID="658f78dfb49e319003ef215f189234b92cf9ca124096067fde9d7d2ae31d9eb7" exitCode=0
Nov 03 21:59:44.965756 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:44.965439    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf" event={"ID":"2154964b-4add-4fce-9b61-7a98ddfb0fa5","Type":"ContainerDied","Data":"658f78dfb49e319003ef215f189234b92cf9ca124096067fde9d7d2ae31d9eb7"}
Nov 03 21:59:44.965756 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:44.965531    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf" event={"ID":"2154964b-4add-4fce-9b61-7a98ddfb0fa5","Type":"ContainerDied","Data":"b65a4dbb8d69d7169267655a185a84ea14d6caa560815970e1d7ccb0fbf5fc4b"}
Nov 03 21:59:44.965756 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:44.965536    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"
Nov 03 21:59:44.965756 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:44.965564    5077 scope.go:122] "RemoveContainer" containerID="658f78dfb49e319003ef215f189234b92cf9ca124096067fde9d7d2ae31d9eb7"
Nov 03 21:59:44.978093 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:44.978041    5077 scope.go:122] "RemoveContainer" containerID="658f78dfb49e319003ef215f189234b92cf9ca124096067fde9d7d2ae31d9eb7"
Nov 03 21:59:44.978451 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:59:44.978422    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"658f78dfb49e319003ef215f189234b92cf9ca124096067fde9d7d2ae31d9eb7\": container with ID starting with 658f78dfb49e319003ef215f189234b92cf9ca124096067fde9d7d2ae31d9eb7 not found: ID does not exist" containerID="658f78dfb49e319003ef215f189234b92cf9ca124096067fde9d7d2ae31d9eb7"
Nov 03 21:59:44.978559 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:44.978465    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"658f78dfb49e319003ef215f189234b92cf9ca124096067fde9d7d2ae31d9eb7"} err="failed to get container status \"658f78dfb49e319003ef215f189234b92cf9ca124096067fde9d7d2ae31d9eb7\": rpc error: code = NotFound desc = could not find container \"658f78dfb49e319003ef215f189234b92cf9ca124096067fde9d7d2ae31d9eb7\": container with ID starting with 658f78dfb49e319003ef215f189234b92cf9ca124096067fde9d7d2ae31d9eb7 not found: ID does not exist"
Nov 03 21:59:45.034457 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:45.034427    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2154964b-4add-4fce-9b61-7a98ddfb0fa5-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2154964b-4add-4fce-9b61-7a98ddfb0fa5-metrics-certs\") pod \"2154964b-4add-4fce-9b61-7a98ddfb0fa5\" (UID: \"2154964b-4add-4fce-9b61-7a98ddfb0fa5\") "
Nov 03 21:59:45.034615 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:45.034505    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2154964b-4add-4fce-9b61-7a98ddfb0fa5-kube-api-access-dvt49\" (UniqueName: \"kubernetes.io/projected/2154964b-4add-4fce-9b61-7a98ddfb0fa5-kube-api-access-dvt49\") pod \"2154964b-4add-4fce-9b61-7a98ddfb0fa5\" (UID: \"2154964b-4add-4fce-9b61-7a98ddfb0fa5\") "
Nov 03 21:59:45.034615 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:45.034605    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2154964b-4add-4fce-9b61-7a98ddfb0fa5-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2154964b-4add-4fce-9b61-7a98ddfb0fa5-openshift-service-ca\") pod \"2154964b-4add-4fce-9b61-7a98ddfb0fa5\" (UID: \"2154964b-4add-4fce-9b61-7a98ddfb0fa5\") "
Nov 03 21:59:45.034727 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:45.034669    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2154964b-4add-4fce-9b61-7a98ddfb0fa5-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2154964b-4add-4fce-9b61-7a98ddfb0fa5-maas-api-tls\") pod \"2154964b-4add-4fce-9b61-7a98ddfb0fa5\" (UID: \"2154964b-4add-4fce-9b61-7a98ddfb0fa5\") "
Nov 03 21:59:45.035027 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:45.034999    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2154964b-4add-4fce-9b61-7a98ddfb0fa5-openshift-service-ca" pod "2154964b-4add-4fce-9b61-7a98ddfb0fa5" (UID: "2154964b-4add-4fce-9b61-7a98ddfb0fa5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:59:45.035320 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:45.035266    5077 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2154964b-4add-4fce-9b61-7a98ddfb0fa5-openshift-service-ca\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:45.036881 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:45.036855    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2154964b-4add-4fce-9b61-7a98ddfb0fa5-kube-api-access-dvt49" pod "2154964b-4add-4fce-9b61-7a98ddfb0fa5" (UID: "2154964b-4add-4fce-9b61-7a98ddfb0fa5"). InnerVolumeSpecName "kube-api-access-dvt49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:59:45.037329 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:45.037305    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2154964b-4add-4fce-9b61-7a98ddfb0fa5-metrics-certs" pod "2154964b-4add-4fce-9b61-7a98ddfb0fa5" (UID: "2154964b-4add-4fce-9b61-7a98ddfb0fa5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:59:45.037402 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:45.037334    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2154964b-4add-4fce-9b61-7a98ddfb0fa5-maas-api-tls" pod "2154964b-4add-4fce-9b61-7a98ddfb0fa5" (UID: "2154964b-4add-4fce-9b61-7a98ddfb0fa5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:59:45.136785 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:45.136754    5077 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2154964b-4add-4fce-9b61-7a98ddfb0fa5-metrics-certs\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:45.136785 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:45.136782    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvt49\" (UniqueName: \"kubernetes.io/projected/2154964b-4add-4fce-9b61-7a98ddfb0fa5-kube-api-access-dvt49\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:45.136785 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:45.136791    5077 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2154964b-4add-4fce-9b61-7a98ddfb0fa5-maas-api-tls\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:45.297153 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:45.297105    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"]
Nov 03 21:59:45.301137 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:45.301109    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f4fb1b-558dd4c956-cj4zf"]
Nov 03 21:59:46.738169 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:46.738133    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2154964b-4add-4fce-9b61-7a98ddfb0fa5" path="/var/lib/kubelet/pods/2154964b-4add-4fce-9b61-7a98ddfb0fa5/volumes"
Nov 03 21:59:47.430551 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:47.430520    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"]
Nov 03 21:59:47.430751 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:47.430725    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p" podUID="113f2e13-e5b9-43b3-8d94-6b86d653aa85" containerName="maas-api" containerID="cri-o://fd519daf5daf0396fc85d9a962522d82c3ba36cd549d1fe6dadd6aeee3613584" gracePeriod=30
Nov 03 21:59:47.915987 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:47.915964    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"
Nov 03 21:59:47.992722 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:47.992629    5077 generic.go:356] "Generic (PLEG): container finished" podID="113f2e13-e5b9-43b3-8d94-6b86d653aa85" containerID="fd519daf5daf0396fc85d9a962522d82c3ba36cd549d1fe6dadd6aeee3613584" exitCode=0
Nov 03 21:59:47.992722 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:47.992683    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"
Nov 03 21:59:47.992961 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:47.992711    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p" event={"ID":"113f2e13-e5b9-43b3-8d94-6b86d653aa85","Type":"ContainerDied","Data":"fd519daf5daf0396fc85d9a962522d82c3ba36cd549d1fe6dadd6aeee3613584"}
Nov 03 21:59:47.992961 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:47.992785    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p" event={"ID":"113f2e13-e5b9-43b3-8d94-6b86d653aa85","Type":"ContainerDied","Data":"f03c642f58dfdb14cd25e24daa6e40264c312e816d430afd60d0ed165b66d7ea"}
Nov 03 21:59:47.992961 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:47.992821    5077 scope.go:122] "RemoveContainer" containerID="fd519daf5daf0396fc85d9a962522d82c3ba36cd549d1fe6dadd6aeee3613584"
Nov 03 21:59:48.003512 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:48.003483    5077 scope.go:122] "RemoveContainer" containerID="fd519daf5daf0396fc85d9a962522d82c3ba36cd549d1fe6dadd6aeee3613584"
Nov 03 21:59:48.003868 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:59:48.003837    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd519daf5daf0396fc85d9a962522d82c3ba36cd549d1fe6dadd6aeee3613584\": container with ID starting with fd519daf5daf0396fc85d9a962522d82c3ba36cd549d1fe6dadd6aeee3613584 not found: ID does not exist" containerID="fd519daf5daf0396fc85d9a962522d82c3ba36cd549d1fe6dadd6aeee3613584"
Nov 03 21:59:48.003956 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:48.003884    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd519daf5daf0396fc85d9a962522d82c3ba36cd549d1fe6dadd6aeee3613584"} err="failed to get container status \"fd519daf5daf0396fc85d9a962522d82c3ba36cd549d1fe6dadd6aeee3613584\": rpc error: code = NotFound desc = could not find container \"fd519daf5daf0396fc85d9a962522d82c3ba36cd549d1fe6dadd6aeee3613584\": container with ID starting with fd519daf5daf0396fc85d9a962522d82c3ba36cd549d1fe6dadd6aeee3613584 not found: ID does not exist"
Nov 03 21:59:48.087073 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:48.087040    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/113f2e13-e5b9-43b3-8d94-6b86d653aa85-kube-api-access-l5sxp\" (UniqueName: \"kubernetes.io/projected/113f2e13-e5b9-43b3-8d94-6b86d653aa85-kube-api-access-l5sxp\") pod \"113f2e13-e5b9-43b3-8d94-6b86d653aa85\" (UID: \"113f2e13-e5b9-43b3-8d94-6b86d653aa85\") "
Nov 03 21:59:48.087296 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:48.087091    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/113f2e13-e5b9-43b3-8d94-6b86d653aa85-metrics-certs\" (UniqueName: \"kubernetes.io/secret/113f2e13-e5b9-43b3-8d94-6b86d653aa85-metrics-certs\") pod \"113f2e13-e5b9-43b3-8d94-6b86d653aa85\" (UID: \"113f2e13-e5b9-43b3-8d94-6b86d653aa85\") "
Nov 03 21:59:48.087296 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:48.087120    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/113f2e13-e5b9-43b3-8d94-6b86d653aa85-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/113f2e13-e5b9-43b3-8d94-6b86d653aa85-openshift-service-ca\") pod \"113f2e13-e5b9-43b3-8d94-6b86d653aa85\" (UID: \"113f2e13-e5b9-43b3-8d94-6b86d653aa85\") "
Nov 03 21:59:48.087296 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:48.087173    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/113f2e13-e5b9-43b3-8d94-6b86d653aa85-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/113f2e13-e5b9-43b3-8d94-6b86d653aa85-maas-api-tls\") pod \"113f2e13-e5b9-43b3-8d94-6b86d653aa85\" (UID: \"113f2e13-e5b9-43b3-8d94-6b86d653aa85\") "
Nov 03 21:59:48.087768 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:48.087595    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/113f2e13-e5b9-43b3-8d94-6b86d653aa85-openshift-service-ca" pod "113f2e13-e5b9-43b3-8d94-6b86d653aa85" (UID: "113f2e13-e5b9-43b3-8d94-6b86d653aa85"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:59:48.087768 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:48.087741    5077 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/113f2e13-e5b9-43b3-8d94-6b86d653aa85-openshift-service-ca\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:48.089866 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:48.089838    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/113f2e13-e5b9-43b3-8d94-6b86d653aa85-kube-api-access-l5sxp" pod "113f2e13-e5b9-43b3-8d94-6b86d653aa85" (UID: "113f2e13-e5b9-43b3-8d94-6b86d653aa85"). InnerVolumeSpecName "kube-api-access-l5sxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:59:48.090011 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:48.089986    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/113f2e13-e5b9-43b3-8d94-6b86d653aa85-metrics-certs" pod "113f2e13-e5b9-43b3-8d94-6b86d653aa85" (UID: "113f2e13-e5b9-43b3-8d94-6b86d653aa85"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:59:48.090096 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:48.090047    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/113f2e13-e5b9-43b3-8d94-6b86d653aa85-maas-api-tls" pod "113f2e13-e5b9-43b3-8d94-6b86d653aa85" (UID: "113f2e13-e5b9-43b3-8d94-6b86d653aa85"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:59:48.189113 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:48.189074    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5sxp\" (UniqueName: \"kubernetes.io/projected/113f2e13-e5b9-43b3-8d94-6b86d653aa85-kube-api-access-l5sxp\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:48.189113 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:48.189112    5077 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/113f2e13-e5b9-43b3-8d94-6b86d653aa85-metrics-certs\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:48.189354 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:48.189128    5077 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/113f2e13-e5b9-43b3-8d94-6b86d653aa85-maas-api-tls\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:48.318945 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:48.318911    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"]
Nov 03 21:59:48.322975 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:48.322950    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-02e8ab-7885b886f9-lj64p"]
Nov 03 21:59:48.598708 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:48.598673    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg" podUID="9ddd62a2-4835-4cc4-b04d-846c174b07b6" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 21:59:48.736491 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:48.736452    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="113f2e13-e5b9-43b3-8d94-6b86d653aa85" path="/var/lib/kubelet/pods/113f2e13-e5b9-43b3-8d94-6b86d653aa85/volumes"
Nov 03 21:59:49.623312 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:49.623271    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz" podUID="e0f13297-0097-446f-8f49-9b931e44a691" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 21:59:49.623863 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:49.623446    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p" podUID="eb75cdb5-ccf7-4702-bc41-a180e1716b2b" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 21:59:50.012149 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:50.012110    5077 generic.go:356] "Generic (PLEG): container finished" podID="7cdc96b4-12c6-4856-a587-81502006f757" containerID="918935b66eb15e153d75d93f069d79e061b44dede9570a4702b88c2fa7bc7a60" exitCode=0
Nov 03 21:59:50.012308 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:50.012197    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb" event={"ID":"7cdc96b4-12c6-4856-a587-81502006f757","Type":"ContainerDied","Data":"918935b66eb15e153d75d93f069d79e061b44dede9570a4702b88c2fa7bc7a60"}
Nov 03 21:59:50.136400 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:50.136374    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb"
Nov 03 21:59:50.211791 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:50.211175    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7cdc96b4-12c6-4856-a587-81502006f757-kube-api-access-ccf62\" (UniqueName: \"kubernetes.io/projected/7cdc96b4-12c6-4856-a587-81502006f757-kube-api-access-ccf62\") pod \"7cdc96b4-12c6-4856-a587-81502006f757\" (UID: \"7cdc96b4-12c6-4856-a587-81502006f757\") "
Nov 03 21:59:50.211791 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:50.211284    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7cdc96b4-12c6-4856-a587-81502006f757-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7cdc96b4-12c6-4856-a587-81502006f757-plugins-config-volume\") pod \"7cdc96b4-12c6-4856-a587-81502006f757\" (UID: \"7cdc96b4-12c6-4856-a587-81502006f757\") "
Nov 03 21:59:50.216705 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:50.216666    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cdc96b4-12c6-4856-a587-81502006f757-plugins-config-volume" pod "7cdc96b4-12c6-4856-a587-81502006f757" (UID: "7cdc96b4-12c6-4856-a587-81502006f757"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:59:50.222276 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:50.219597    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cdc96b4-12c6-4856-a587-81502006f757-kube-api-access-ccf62" pod "7cdc96b4-12c6-4856-a587-81502006f757" (UID: "7cdc96b4-12c6-4856-a587-81502006f757"). InnerVolumeSpecName "kube-api-access-ccf62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:59:50.318214 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:50.318143    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccf62\" (UniqueName: \"kubernetes.io/projected/7cdc96b4-12c6-4856-a587-81502006f757-kube-api-access-ccf62\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:50.318214 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:50.318187    5077 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7cdc96b4-12c6-4856-a587-81502006f757-plugins-config-volume\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:50.638832 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:50.638787    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm" podUID="c5ac4b3b-8103-4b03-b2e7-84eda5cf4659" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 21:59:50.639392 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:50.638802    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l" podUID="998d8261-6d86-4f97-948f-abfb5fc704c9" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 21:59:50.639392 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:50.639087    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s" podUID="c61aad42-dcf9-4f3c-971a-03d03ddfc8ff" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 21:59:50.707310 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:50.707277    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z"]
Nov 03 21:59:50.728545 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:50.719618    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz"]
Nov 03 21:59:51.021113 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.021027    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb"
Nov 03 21:59:51.021113 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.021036    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb" event={"ID":"7cdc96b4-12c6-4856-a587-81502006f757","Type":"ContainerDied","Data":"8dccd8c96988c111f0cfad1e893025e9f68dc2a8478b97313d7aa69b2b600770"}
Nov 03 21:59:51.021372 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.021115    5077 scope.go:122] "RemoveContainer" containerID="918935b66eb15e153d75d93f069d79e061b44dede9570a4702b88c2fa7bc7a60"
Nov 03 21:59:51.040369 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.040344    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb"]
Nov 03 21:59:51.045994 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.045962    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-c0caef-7869d667f-srkzb"]
Nov 03 21:59:51.860776 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.860730    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"]
Nov 03 21:59:51.861626 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861605    5077 cpu_manager.go:414] "containerMap: removing container" podUID="78203c60-a1eb-4ff5-a378-30cc8eda784f" containerName="maas-api"
Nov 03 21:59:51.861626 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861626    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="78203c60-a1eb-4ff5-a378-30cc8eda784f" containerName="maas-api"
Nov 03 21:59:51.861841 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861636    5077 cpu_manager.go:414] "containerMap: removing container" podUID="f469226d-5a72-4c9e-8c68-d45f3aeaad7a" containerName="main"
Nov 03 21:59:51.861841 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861641    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f469226d-5a72-4c9e-8c68-d45f3aeaad7a" containerName="main"
Nov 03 21:59:51.861841 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861665    5077 cpu_manager.go:414] "containerMap: removing container" podUID="113f2e13-e5b9-43b3-8d94-6b86d653aa85" containerName="maas-api"
Nov 03 21:59:51.861841 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861680    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="113f2e13-e5b9-43b3-8d94-6b86d653aa85" containerName="maas-api"
Nov 03 21:59:51.861841 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861700    5077 cpu_manager.go:414] "containerMap: removing container" podUID="3817624c-e11a-46af-ac60-c181b4fa8a76" containerName="main"
Nov 03 21:59:51.861841 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861706    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3817624c-e11a-46af-ac60-c181b4fa8a76" containerName="main"
Nov 03 21:59:51.861841 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861713    5077 cpu_manager.go:414] "containerMap: removing container" podUID="586bbac6-3107-4432-a636-0c83ece12573" containerName="maas-api"
Nov 03 21:59:51.861841 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861717    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="586bbac6-3107-4432-a636-0c83ece12573" containerName="maas-api"
Nov 03 21:59:51.861841 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861723    5077 cpu_manager.go:414] "containerMap: removing container" podUID="2154964b-4add-4fce-9b61-7a98ddfb0fa5" containerName="maas-api"
Nov 03 21:59:51.861841 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861727    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2154964b-4add-4fce-9b61-7a98ddfb0fa5" containerName="maas-api"
Nov 03 21:59:51.861841 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861748    5077 cpu_manager.go:414] "containerMap: removing container" podUID="7cdc96b4-12c6-4856-a587-81502006f757" containerName="payload-pre-processing"
Nov 03 21:59:51.861841 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861755    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7cdc96b4-12c6-4856-a587-81502006f757" containerName="payload-pre-processing"
Nov 03 21:59:51.861841 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861851    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="f469226d-5a72-4c9e-8c68-d45f3aeaad7a" containerName="main"
Nov 03 21:59:51.861841 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861866    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="113f2e13-e5b9-43b3-8d94-6b86d653aa85" containerName="maas-api"
Nov 03 21:59:51.862607 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861877    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="3817624c-e11a-46af-ac60-c181b4fa8a76" containerName="main"
Nov 03 21:59:51.862607 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861884    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="586bbac6-3107-4432-a636-0c83ece12573" containerName="maas-api"
Nov 03 21:59:51.862607 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861889    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="2154964b-4add-4fce-9b61-7a98ddfb0fa5" containerName="maas-api"
Nov 03 21:59:51.862607 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861900    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="7cdc96b4-12c6-4856-a587-81502006f757" containerName="payload-pre-processing"
Nov 03 21:59:51.862607 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.861912    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="78203c60-a1eb-4ff5-a378-30cc8eda784f" containerName="maas-api"
Nov 03 21:59:51.867109 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.867083    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:51.876788 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.876607    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-02e8ab-openshift-default-dockercfg-4kgqm\""
Nov 03 21:59:51.881777 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.881749    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"]
Nov 03 21:59:51.937526 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.937496    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-data\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:51.937526 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.937536    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-envoy\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:51.937813 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.937632    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-token\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:51.937813 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.937703    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-workload-certs\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:51.937813 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.937758    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istiod-ca-cert\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:51.937985 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.937856    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-credential-socket\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:51.937985 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.937917    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-podinfo\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:51.937985 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.937959    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6gvk\" (UniqueName: \"kubernetes.io/projected/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-kube-api-access-z6gvk\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:51.938104 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:51.938033    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-workload-socket\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:52.039394 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.039357    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6gvk\" (UniqueName: \"kubernetes.io/projected/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-kube-api-access-z6gvk\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:52.039643 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.039420    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-workload-socket\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:52.039643 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.039501    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-data\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:52.039643 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.039537    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-envoy\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:52.039643 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.039569    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-token\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:52.039643 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.039616    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-workload-certs\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:52.039643 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.039641    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istiod-ca-cert\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:52.039986 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.039671    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-credential-socket\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:52.039986 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.039734    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-podinfo\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:52.040729 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.040703    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-workload-certs\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:52.041284 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.041229    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istiod-ca-cert\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:52.041536 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.041497    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-workload-socket\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:52.041795 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.041727    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-credential-socket\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:52.041986 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.041964    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-data\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:52.081108 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.081039    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6gvk\" (UniqueName: \"kubernetes.io/projected/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-kube-api-access-z6gvk\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:52.084323 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.084277    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-envoy\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:52.091030 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.090758    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-token\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:52.091030 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.090828    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-podinfo\") pod \"e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") " pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:52.186540 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.186452    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:52.551137 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.551108    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"]
Nov 03 21:59:52.552619 ip-10-0-128-183 kubenswrapper[5077]: W1103 21:59:52.552595    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba5e5c0_deaa_4f58_a959_c281aa2c0e5f.slice/crio-46bf4fac5f32d240222c6782cfcebcb1a18450a1eca91263b10fdc4fb4c4e181 WatchSource:0}: Error finding container 46bf4fac5f32d240222c6782cfcebcb1a18450a1eca91263b10fdc4fb4c4e181: Status 404 returned error can't find the container with id 46bf4fac5f32d240222c6782cfcebcb1a18450a1eca91263b10fdc4fb4c4e181
Nov 03 21:59:52.555212 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.555174    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:59:52.555340 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.555292    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:59:52.555340 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.555328    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 21:59:52.739045 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:52.739008    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7cdc96b4-12c6-4856-a587-81502006f757" path="/var/lib/kubelet/pods/7cdc96b4-12c6-4856-a587-81502006f757/volumes"
Nov 03 21:59:53.050651 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:53.050611    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn" event={"ID":"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f","Type":"ContainerStarted","Data":"559b629b3ef672badeb996712d109a2010aea0aba13d351bfa37cc10256afa8b"}
Nov 03 21:59:53.051045 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:53.050703    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn" event={"ID":"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f","Type":"ContainerStarted","Data":"46bf4fac5f32d240222c6782cfcebcb1a18450a1eca91263b10fdc4fb4c4e181"}
Nov 03 21:59:53.077364 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:53.077305    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn" podStartSLOduration=2.077287428 podStartE2EDuration="2.077287428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:59:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:59:53.074412282 +0000 UTC m=+886.478073711" watchObservedRunningTime="2026-11-03 21:59:53.077287428 +0000 UTC m=+886.480948858"
Nov 03 21:59:53.237030 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:53.236767    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 21:59:53.239534 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:53.239498    5077 patch_prober.go:29] interesting pod/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Nov 03 21:59:53.239705 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:53.239557    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn" podUID="bba5e5c0-deaa-4f58-a959-c281aa2c0e5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Nov 03 21:59:54.187834 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:54.187793    5077 patch_prober.go:29] interesting pod/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Nov 03 21:59:54.188237 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:54.187853    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn" podUID="bba5e5c0-deaa-4f58-a959-c281aa2c0e5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Nov 03 21:59:55.114929 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.114896    5077 generic.go:356] "Generic (PLEG): container finished" podID="998d8261-6d86-4f97-948f-abfb5fc704c9" containerID="4e84b87d6a45663c0e53bd02783008416eb708927953f9e2d777298b6ff5c36b" exitCode=0
Nov 03 21:59:55.115127 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.114998    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l" event={"ID":"998d8261-6d86-4f97-948f-abfb5fc704c9","Type":"ContainerDied","Data":"4e84b87d6a45663c0e53bd02783008416eb708927953f9e2d777298b6ff5c36b"}
Nov 03 21:59:55.116632 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.116608    5077 generic.go:356] "Generic (PLEG): container finished" podID="c61aad42-dcf9-4f3c-971a-03d03ddfc8ff" containerID="ab9aca32bbabe034c09fb723ae66c725c003fe63207b818e0d6010ab24906465" exitCode=0
Nov 03 21:59:55.117568 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.117026    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s" event={"ID":"c61aad42-dcf9-4f3c-971a-03d03ddfc8ff","Type":"ContainerDied","Data":"ab9aca32bbabe034c09fb723ae66c725c003fe63207b818e0d6010ab24906465"}
Nov 03 21:59:55.117790 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.117770    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s" event={"ID":"c61aad42-dcf9-4f3c-971a-03d03ddfc8ff","Type":"ContainerDied","Data":"7e40ece9b870915f5fb62f9c2c6acd625225663e5b2cb85efc3f07b68b489e60"}
Nov 03 21:59:55.117976 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.117960    5077 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e40ece9b870915f5fb62f9c2c6acd625225663e5b2cb85efc3f07b68b489e60"
Nov 03 21:59:55.118084 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.117321    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s"
Nov 03 21:59:55.119839 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.119823    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l"
Nov 03 21:59:55.194445 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.194367    5077 patch_prober.go:29] interesting pod/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Nov 03 21:59:55.195060 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.194971    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn" podUID="bba5e5c0-deaa-4f58-a959-c281aa2c0e5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Nov 03 21:59:55.221888 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.221848    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c61aad42-dcf9-4f3c-971a-03d03ddfc8ff-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c61aad42-dcf9-4f3c-971a-03d03ddfc8ff-plugins-config-volume\") pod \"c61aad42-dcf9-4f3c-971a-03d03ddfc8ff\" (UID: \"c61aad42-dcf9-4f3c-971a-03d03ddfc8ff\") "
Nov 03 21:59:55.222652 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.222631    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/998d8261-6d86-4f97-948f-abfb5fc704c9-kube-api-access-wd4t4\" (UniqueName: \"kubernetes.io/projected/998d8261-6d86-4f97-948f-abfb5fc704c9-kube-api-access-wd4t4\") pod \"998d8261-6d86-4f97-948f-abfb5fc704c9\" (UID: \"998d8261-6d86-4f97-948f-abfb5fc704c9\") "
Nov 03 21:59:55.222826 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.222807    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/998d8261-6d86-4f97-948f-abfb5fc704c9-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/998d8261-6d86-4f97-948f-abfb5fc704c9-plugins-config-volume\") pod \"998d8261-6d86-4f97-948f-abfb5fc704c9\" (UID: \"998d8261-6d86-4f97-948f-abfb5fc704c9\") "
Nov 03 21:59:55.222992 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.222979    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c61aad42-dcf9-4f3c-971a-03d03ddfc8ff-kube-api-access-2zhbt\" (UniqueName: \"kubernetes.io/projected/c61aad42-dcf9-4f3c-971a-03d03ddfc8ff-kube-api-access-2zhbt\") pod \"c61aad42-dcf9-4f3c-971a-03d03ddfc8ff\" (UID: \"c61aad42-dcf9-4f3c-971a-03d03ddfc8ff\") "
Nov 03 21:59:55.224002 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.222532    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c61aad42-dcf9-4f3c-971a-03d03ddfc8ff-plugins-config-volume" pod "c61aad42-dcf9-4f3c-971a-03d03ddfc8ff" (UID: "c61aad42-dcf9-4f3c-971a-03d03ddfc8ff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:59:55.228558 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.228516    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/998d8261-6d86-4f97-948f-abfb5fc704c9-plugins-config-volume" pod "998d8261-6d86-4f97-948f-abfb5fc704c9" (UID: "998d8261-6d86-4f97-948f-abfb5fc704c9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:59:55.238237 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.238194    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/998d8261-6d86-4f97-948f-abfb5fc704c9-kube-api-access-wd4t4" pod "998d8261-6d86-4f97-948f-abfb5fc704c9" (UID: "998d8261-6d86-4f97-948f-abfb5fc704c9"). InnerVolumeSpecName "kube-api-access-wd4t4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:59:55.240075 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.240041    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c61aad42-dcf9-4f3c-971a-03d03ddfc8ff-kube-api-access-2zhbt" pod "c61aad42-dcf9-4f3c-971a-03d03ddfc8ff" (UID: "c61aad42-dcf9-4f3c-971a-03d03ddfc8ff"). InnerVolumeSpecName "kube-api-access-2zhbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:59:55.324517 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.324475    5077 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c61aad42-dcf9-4f3c-971a-03d03ddfc8ff-plugins-config-volume\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:55.324517 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.324510    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wd4t4\" (UniqueName: \"kubernetes.io/projected/998d8261-6d86-4f97-948f-abfb5fc704c9-kube-api-access-wd4t4\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:55.324517 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.324524    5077 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/998d8261-6d86-4f97-948f-abfb5fc704c9-plugins-config-volume\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:55.324755 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.324536    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zhbt\" (UniqueName: \"kubernetes.io/projected/c61aad42-dcf9-4f3c-971a-03d03ddfc8ff-kube-api-access-2zhbt\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:55.386014 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.385177    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"]
Nov 03 21:59:55.710483 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.710307    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z" podUID="1a6a34c7-4517-4567-850d-65d354604bec" containerName="payload-processing" containerID="cri-o://3f68608422b86c213d7e7ca958e231f6be45ec68f871d501117c61a95f21f400" gracePeriod=25
Nov 03 21:59:55.720128 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:55.720086    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz" podUID="09af1067-207c-44a7-b4c3-ca1bcba6fb82" containerName="payload-pre-processing" containerID="cri-o://fec9a85ed14b59f50991dd47febe3ae22ab1ab4cb41f4b8a837397f917aa5815" gracePeriod=25
Nov 03 21:59:56.133234 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:56.133207    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s"
Nov 03 21:59:56.137377 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:56.137294    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l" event={"ID":"998d8261-6d86-4f97-948f-abfb5fc704c9","Type":"ContainerDied","Data":"d7094e4b0d956b4d6090461d9b8e3412534797f1f90a8f0dce1910469cf0eb2a"}
Nov 03 21:59:56.137700 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:56.137578    5077 scope.go:122] "RemoveContainer" containerID="4e84b87d6a45663c0e53bd02783008416eb708927953f9e2d777298b6ff5c36b"
Nov 03 21:59:56.137887 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:56.137868    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l"
Nov 03 21:59:56.194368 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:56.190512    5077 patch_prober.go:29] interesting pod/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Nov 03 21:59:56.194368 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:56.190566    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn" podUID="bba5e5c0-deaa-4f58-a959-c281aa2c0e5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Nov 03 21:59:56.217797 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:56.217761    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l"]
Nov 03 21:59:56.222715 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:56.222134    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-f4fb1b-7c6bc7647d-lm92l"]
Nov 03 21:59:56.272301 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:56.253197    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s"]
Nov 03 21:59:56.301646 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:56.278323    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-f4fb1b-b75cc6899-j7q7s"]
Nov 03 21:59:56.726671 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:56.726639    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"]
Nov 03 21:59:56.726871 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:56.726815    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn" podUID="bba5e5c0-deaa-4f58-a959-c281aa2c0e5f" containerName="istio-proxy" containerID="cri-o://559b629b3ef672badeb996712d109a2010aea0aba13d351bfa37cc10256afa8b" gracePeriod=30
Nov 03 21:59:56.744934 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:56.744903    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="998d8261-6d86-4f97-948f-abfb5fc704c9" path="/var/lib/kubelet/pods/998d8261-6d86-4f97-948f-abfb5fc704c9/volumes"
Nov 03 21:59:56.745693 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:56.745664    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c61aad42-dcf9-4f3c-971a-03d03ddfc8ff" path="/var/lib/kubelet/pods/c61aad42-dcf9-4f3c-971a-03d03ddfc8ff/volumes"
Nov 03 21:59:57.584275 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:57.572459    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz"
Nov 03 21:59:57.612789 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:57.612764    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg"
Nov 03 21:59:57.710953 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:57.710924    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e0f13297-0097-446f-8f49-9b931e44a691-kube-api-access-rn6xp\" (UniqueName: \"kubernetes.io/projected/e0f13297-0097-446f-8f49-9b931e44a691-kube-api-access-rn6xp\") pod \"e0f13297-0097-446f-8f49-9b931e44a691\" (UID: \"e0f13297-0097-446f-8f49-9b931e44a691\") "
Nov 03 21:59:57.711148 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:57.710983    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ddd62a2-4835-4cc4-b04d-846c174b07b6-kube-api-access-m9dfk\" (UniqueName: \"kubernetes.io/projected/9ddd62a2-4835-4cc4-b04d-846c174b07b6-kube-api-access-m9dfk\") pod \"9ddd62a2-4835-4cc4-b04d-846c174b07b6\" (UID: \"9ddd62a2-4835-4cc4-b04d-846c174b07b6\") "
Nov 03 21:59:57.711148 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:57.711057    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9ddd62a2-4835-4cc4-b04d-846c174b07b6-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ddd62a2-4835-4cc4-b04d-846c174b07b6-plugins-config-volume\") pod \"9ddd62a2-4835-4cc4-b04d-846c174b07b6\" (UID: \"9ddd62a2-4835-4cc4-b04d-846c174b07b6\") "
Nov 03 21:59:57.711148 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:57.711146    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e0f13297-0097-446f-8f49-9b931e44a691-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0f13297-0097-446f-8f49-9b931e44a691-plugins-config-volume\") pod \"e0f13297-0097-446f-8f49-9b931e44a691\" (UID: \"e0f13297-0097-446f-8f49-9b931e44a691\") "
Nov 03 21:59:57.711595 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:57.711567    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ddd62a2-4835-4cc4-b04d-846c174b07b6-plugins-config-volume" pod "9ddd62a2-4835-4cc4-b04d-846c174b07b6" (UID: "9ddd62a2-4835-4cc4-b04d-846c174b07b6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:59:57.711723 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:57.711698    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0f13297-0097-446f-8f49-9b931e44a691-plugins-config-volume" pod "e0f13297-0097-446f-8f49-9b931e44a691" (UID: "e0f13297-0097-446f-8f49-9b931e44a691"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:59:57.713459 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:57.713432    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0f13297-0097-446f-8f49-9b931e44a691-kube-api-access-rn6xp" pod "e0f13297-0097-446f-8f49-9b931e44a691" (UID: "e0f13297-0097-446f-8f49-9b931e44a691"). InnerVolumeSpecName "kube-api-access-rn6xp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:59:57.713554 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:57.713491    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ddd62a2-4835-4cc4-b04d-846c174b07b6-kube-api-access-m9dfk" pod "9ddd62a2-4835-4cc4-b04d-846c174b07b6" (UID: "9ddd62a2-4835-4cc4-b04d-846c174b07b6"). InnerVolumeSpecName "kube-api-access-m9dfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:59:57.812895 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:57.812862    5077 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0f13297-0097-446f-8f49-9b931e44a691-plugins-config-volume\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:57.812895 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:57.812897    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn6xp\" (UniqueName: \"kubernetes.io/projected/e0f13297-0097-446f-8f49-9b931e44a691-kube-api-access-rn6xp\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:57.813136 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:57.812912    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9dfk\" (UniqueName: \"kubernetes.io/projected/9ddd62a2-4835-4cc4-b04d-846c174b07b6-kube-api-access-m9dfk\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:57.813136 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:57.812925    5077 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ddd62a2-4835-4cc4-b04d-846c174b07b6-plugins-config-volume\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:58.150926 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.150834    5077 generic.go:356] "Generic (PLEG): container finished" podID="9ddd62a2-4835-4cc4-b04d-846c174b07b6" containerID="41ed39e8d2f92b1ad59c8ce574b1b2d96ad78232694d7e811ca013307fdc4835" exitCode=0
Nov 03 21:59:58.150926 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.150890    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg"
Nov 03 21:59:58.150926 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.150891    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg" event={"ID":"9ddd62a2-4835-4cc4-b04d-846c174b07b6","Type":"ContainerDied","Data":"41ed39e8d2f92b1ad59c8ce574b1b2d96ad78232694d7e811ca013307fdc4835"}
Nov 03 21:59:58.151237 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.150962    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg" event={"ID":"9ddd62a2-4835-4cc4-b04d-846c174b07b6","Type":"ContainerDied","Data":"e7d8c4ac8399e9c96779c59cb43aee908faad1aefa2e95d9129990d10af3eaaf"}
Nov 03 21:59:58.151237 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.150992    5077 scope.go:122] "RemoveContainer" containerID="41ed39e8d2f92b1ad59c8ce574b1b2d96ad78232694d7e811ca013307fdc4835"
Nov 03 21:59:58.153638 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.153610    5077 generic.go:356] "Generic (PLEG): container finished" podID="e0f13297-0097-446f-8f49-9b931e44a691" containerID="9a620028190d40857daaf62daf95f428d5724dcb5a5e19e0a3e46a476827c58b" exitCode=0
Nov 03 21:59:58.153759 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.153690    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz" event={"ID":"e0f13297-0097-446f-8f49-9b931e44a691","Type":"ContainerDied","Data":"9a620028190d40857daaf62daf95f428d5724dcb5a5e19e0a3e46a476827c58b"}
Nov 03 21:59:58.153759 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.153731    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz" event={"ID":"e0f13297-0097-446f-8f49-9b931e44a691","Type":"ContainerDied","Data":"e434e53529d949bc6e946f819d6b36f812ff7e70c3ddda869e0c9456422d8809"}
Nov 03 21:59:58.153935 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.153912    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz"
Nov 03 21:59:58.196113 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.196090    5077 scope.go:122] "RemoveContainer" containerID="41ed39e8d2f92b1ad59c8ce574b1b2d96ad78232694d7e811ca013307fdc4835"
Nov 03 21:59:58.196542 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:59:58.196522    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41ed39e8d2f92b1ad59c8ce574b1b2d96ad78232694d7e811ca013307fdc4835\": container with ID starting with 41ed39e8d2f92b1ad59c8ce574b1b2d96ad78232694d7e811ca013307fdc4835 not found: ID does not exist" containerID="41ed39e8d2f92b1ad59c8ce574b1b2d96ad78232694d7e811ca013307fdc4835"
Nov 03 21:59:58.196644 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.196555    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41ed39e8d2f92b1ad59c8ce574b1b2d96ad78232694d7e811ca013307fdc4835"} err="failed to get container status \"41ed39e8d2f92b1ad59c8ce574b1b2d96ad78232694d7e811ca013307fdc4835\": rpc error: code = NotFound desc = could not find container \"41ed39e8d2f92b1ad59c8ce574b1b2d96ad78232694d7e811ca013307fdc4835\": container with ID starting with 41ed39e8d2f92b1ad59c8ce574b1b2d96ad78232694d7e811ca013307fdc4835 not found: ID does not exist"
Nov 03 21:59:58.196644 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.196572    5077 scope.go:122] "RemoveContainer" containerID="9a620028190d40857daaf62daf95f428d5724dcb5a5e19e0a3e46a476827c58b"
Nov 03 21:59:58.202898 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.202871    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz"]
Nov 03 21:59:58.205773 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.205753    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-85b4ff-89d64c87f-bghdz"]
Nov 03 21:59:58.208312 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.208296    5077 scope.go:122] "RemoveContainer" containerID="9a620028190d40857daaf62daf95f428d5724dcb5a5e19e0a3e46a476827c58b"
Nov 03 21:59:58.208585 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:59:58.208568    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a620028190d40857daaf62daf95f428d5724dcb5a5e19e0a3e46a476827c58b\": container with ID starting with 9a620028190d40857daaf62daf95f428d5724dcb5a5e19e0a3e46a476827c58b not found: ID does not exist" containerID="9a620028190d40857daaf62daf95f428d5724dcb5a5e19e0a3e46a476827c58b"
Nov 03 21:59:58.208636 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.208593    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a620028190d40857daaf62daf95f428d5724dcb5a5e19e0a3e46a476827c58b"} err="failed to get container status \"9a620028190d40857daaf62daf95f428d5724dcb5a5e19e0a3e46a476827c58b\": rpc error: code = NotFound desc = could not find container \"9a620028190d40857daaf62daf95f428d5724dcb5a5e19e0a3e46a476827c58b\": container with ID starting with 9a620028190d40857daaf62daf95f428d5724dcb5a5e19e0a3e46a476827c58b not found: ID does not exist"
Nov 03 21:59:58.219384 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.219366    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg"]
Nov 03 21:59:58.223792 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.223773    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-85b4ff-768d7bcd74-sgfgg"]
Nov 03 21:59:58.749175 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.749145    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ddd62a2-4835-4cc4-b04d-846c174b07b6" path="/var/lib/kubelet/pods/9ddd62a2-4835-4cc4-b04d-846c174b07b6/volumes"
Nov 03 21:59:58.749777 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.749756    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e0f13297-0097-446f-8f49-9b931e44a691" path="/var/lib/kubelet/pods/e0f13297-0097-446f-8f49-9b931e44a691/volumes"
Nov 03 21:59:58.759413 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.759392    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p"
Nov 03 21:59:58.795427 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.795088    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm"
Nov 03 21:59:58.927026 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.926995    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c5ac4b3b-8103-4b03-b2e7-84eda5cf4659-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5ac4b3b-8103-4b03-b2e7-84eda5cf4659-plugins-config-volume\") pod \"c5ac4b3b-8103-4b03-b2e7-84eda5cf4659\" (UID: \"c5ac4b3b-8103-4b03-b2e7-84eda5cf4659\") "
Nov 03 21:59:58.927230 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.927034    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/eb75cdb5-ccf7-4702-bc41-a180e1716b2b-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb75cdb5-ccf7-4702-bc41-a180e1716b2b-plugins-config-volume\") pod \"eb75cdb5-ccf7-4702-bc41-a180e1716b2b\" (UID: \"eb75cdb5-ccf7-4702-bc41-a180e1716b2b\") "
Nov 03 21:59:58.927230 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.927170    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5ac4b3b-8103-4b03-b2e7-84eda5cf4659-kube-api-access-gb88q\" (UniqueName: \"kubernetes.io/projected/c5ac4b3b-8103-4b03-b2e7-84eda5cf4659-kube-api-access-gb88q\") pod \"c5ac4b3b-8103-4b03-b2e7-84eda5cf4659\" (UID: \"c5ac4b3b-8103-4b03-b2e7-84eda5cf4659\") "
Nov 03 21:59:58.927230 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.927194    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eb75cdb5-ccf7-4702-bc41-a180e1716b2b-kube-api-access-qfbbw\" (UniqueName: \"kubernetes.io/projected/eb75cdb5-ccf7-4702-bc41-a180e1716b2b-kube-api-access-qfbbw\") pod \"eb75cdb5-ccf7-4702-bc41-a180e1716b2b\" (UID: \"eb75cdb5-ccf7-4702-bc41-a180e1716b2b\") "
Nov 03 21:59:58.927486 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.927463    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5ac4b3b-8103-4b03-b2e7-84eda5cf4659-plugins-config-volume" pod "c5ac4b3b-8103-4b03-b2e7-84eda5cf4659" (UID: "c5ac4b3b-8103-4b03-b2e7-84eda5cf4659"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:59:58.927549 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.927522    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb75cdb5-ccf7-4702-bc41-a180e1716b2b-plugins-config-volume" pod "eb75cdb5-ccf7-4702-bc41-a180e1716b2b" (UID: "eb75cdb5-ccf7-4702-bc41-a180e1716b2b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:59:58.927625 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.927610    5077 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5ac4b3b-8103-4b03-b2e7-84eda5cf4659-plugins-config-volume\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:58.929429 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.929406    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5ac4b3b-8103-4b03-b2e7-84eda5cf4659-kube-api-access-gb88q" pod "c5ac4b3b-8103-4b03-b2e7-84eda5cf4659" (UID: "c5ac4b3b-8103-4b03-b2e7-84eda5cf4659"). InnerVolumeSpecName "kube-api-access-gb88q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:59:58.929525 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:58.929446    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb75cdb5-ccf7-4702-bc41-a180e1716b2b-kube-api-access-qfbbw" pod "eb75cdb5-ccf7-4702-bc41-a180e1716b2b" (UID: "eb75cdb5-ccf7-4702-bc41-a180e1716b2b"). InnerVolumeSpecName "kube-api-access-qfbbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:59:59.029079 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.028998    5077 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb75cdb5-ccf7-4702-bc41-a180e1716b2b-plugins-config-volume\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:59.029079 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.029028    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb88q\" (UniqueName: \"kubernetes.io/projected/c5ac4b3b-8103-4b03-b2e7-84eda5cf4659-kube-api-access-gb88q\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:59.029079 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.029038    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfbbw\" (UniqueName: \"kubernetes.io/projected/eb75cdb5-ccf7-4702-bc41-a180e1716b2b-kube-api-access-qfbbw\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 21:59:59.166322 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.166284    5077 generic.go:356] "Generic (PLEG): container finished" podID="c5ac4b3b-8103-4b03-b2e7-84eda5cf4659" containerID="a8158e42105a1c7bd7a1f0bf3865c0f724ff7def8e853a513e555c757073773c" exitCode=0
Nov 03 21:59:59.166521 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.166389    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm" event={"ID":"c5ac4b3b-8103-4b03-b2e7-84eda5cf4659","Type":"ContainerDied","Data":"a8158e42105a1c7bd7a1f0bf3865c0f724ff7def8e853a513e555c757073773c"}
Nov 03 21:59:59.166521 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.166408    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm"
Nov 03 21:59:59.166521 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.166443    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm" event={"ID":"c5ac4b3b-8103-4b03-b2e7-84eda5cf4659","Type":"ContainerDied","Data":"220d0a49fed471e96228a7d67694c45b6c0668d58c300bca44a5e38d605b560d"}
Nov 03 21:59:59.166521 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.166474    5077 scope.go:122] "RemoveContainer" containerID="a8158e42105a1c7bd7a1f0bf3865c0f724ff7def8e853a513e555c757073773c"
Nov 03 21:59:59.168107 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.168078    5077 generic.go:356] "Generic (PLEG): container finished" podID="eb75cdb5-ccf7-4702-bc41-a180e1716b2b" containerID="bbe7a6c49509b94cc68eff985fdd4ded2f652ac5cc383c7c1a97891088b2228a" exitCode=0
Nov 03 21:59:59.168354 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.168328    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p"
Nov 03 21:59:59.170375 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.170313    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p" event={"ID":"eb75cdb5-ccf7-4702-bc41-a180e1716b2b","Type":"ContainerDied","Data":"bbe7a6c49509b94cc68eff985fdd4ded2f652ac5cc383c7c1a97891088b2228a"}
Nov 03 21:59:59.170662 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.170602    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p" event={"ID":"eb75cdb5-ccf7-4702-bc41-a180e1716b2b","Type":"ContainerDied","Data":"effb8886b0ab4ee3944d9189dd46564a9990779b81b14fc1717f39b64c25aeac"}
Nov 03 21:59:59.179240 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.179218    5077 scope.go:122] "RemoveContainer" containerID="a8158e42105a1c7bd7a1f0bf3865c0f724ff7def8e853a513e555c757073773c"
Nov 03 21:59:59.179591 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:59:59.179564    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8158e42105a1c7bd7a1f0bf3865c0f724ff7def8e853a513e555c757073773c\": container with ID starting with a8158e42105a1c7bd7a1f0bf3865c0f724ff7def8e853a513e555c757073773c not found: ID does not exist" containerID="a8158e42105a1c7bd7a1f0bf3865c0f724ff7def8e853a513e555c757073773c"
Nov 03 21:59:59.179736 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.179603    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8158e42105a1c7bd7a1f0bf3865c0f724ff7def8e853a513e555c757073773c"} err="failed to get container status \"a8158e42105a1c7bd7a1f0bf3865c0f724ff7def8e853a513e555c757073773c\": rpc error: code = NotFound desc = could not find container \"a8158e42105a1c7bd7a1f0bf3865c0f724ff7def8e853a513e555c757073773c\": container with ID starting with a8158e42105a1c7bd7a1f0bf3865c0f724ff7def8e853a513e555c757073773c not found: ID does not exist"
Nov 03 21:59:59.179736 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.179624    5077 scope.go:122] "RemoveContainer" containerID="bbe7a6c49509b94cc68eff985fdd4ded2f652ac5cc383c7c1a97891088b2228a"
Nov 03 21:59:59.207619 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.207596    5077 scope.go:122] "RemoveContainer" containerID="bbe7a6c49509b94cc68eff985fdd4ded2f652ac5cc383c7c1a97891088b2228a"
Nov 03 21:59:59.207993 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:59:59.207965    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbe7a6c49509b94cc68eff985fdd4ded2f652ac5cc383c7c1a97891088b2228a\": container with ID starting with bbe7a6c49509b94cc68eff985fdd4ded2f652ac5cc383c7c1a97891088b2228a not found: ID does not exist" containerID="bbe7a6c49509b94cc68eff985fdd4ded2f652ac5cc383c7c1a97891088b2228a"
Nov 03 21:59:59.208102 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.208001    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbe7a6c49509b94cc68eff985fdd4ded2f652ac5cc383c7c1a97891088b2228a"} err="failed to get container status \"bbe7a6c49509b94cc68eff985fdd4ded2f652ac5cc383c7c1a97891088b2228a\": rpc error: code = NotFound desc = could not find container \"bbe7a6c49509b94cc68eff985fdd4ded2f652ac5cc383c7c1a97891088b2228a\": container with ID starting with bbe7a6c49509b94cc68eff985fdd4ded2f652ac5cc383c7c1a97891088b2228a not found: ID does not exist"
Nov 03 21:59:59.217083 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.217055    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm"]
Nov 03 21:59:59.225497 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.225470    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-02e8ab-74d8b6fffb-x9btm"]
Nov 03 21:59:59.237481 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.236710    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p"]
Nov 03 21:59:59.241982 ip-10-0-128-183 kubenswrapper[5077]: I1103 21:59:59.241401    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-02e8ab-5c5b9f479f-mqq5p"]
Nov 03 21:59:59.926033 ip-10-0-128-183 kubenswrapper[5077]: E1103 21:59:59.926002    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:00:00.639935 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:00.639807    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz" podUID="09af1067-207c-44a7-b4c3-ca1bcba6fb82" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 22:00:00.721902 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:00.721862    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8"]
Nov 03 22:00:00.743679 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:00.743642    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c5ac4b3b-8103-4b03-b2e7-84eda5cf4659" path="/var/lib/kubelet/pods/c5ac4b3b-8103-4b03-b2e7-84eda5cf4659/volumes"
Nov 03 22:00:00.744584 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:00.744556    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eb75cdb5-ccf7-4702-bc41-a180e1716b2b" path="/var/lib/kubelet/pods/eb75cdb5-ccf7-4702-bc41-a180e1716b2b/volumes"
Nov 03 22:00:00.744977 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:00.744959    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k"]
Nov 03 22:00:01.646834 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:01.646800    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z" podUID="1a6a34c7-4517-4567-850d-65d354604bec" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 22:00:04.525459 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.525425    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 22:00:04.602847 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.602586    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"]
Nov 03 22:00:04.603346 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.603310    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb" podUID="ac98e10f-7f46-4bf1-ae12-2de3f478af6a" containerName="maas-api" containerID="cri-o://937d63c0798fb49c69b6004dcebe62e7127f65ad76a9791250f452484e7dd5c4" gracePeriod=30
Nov 03 22:00:04.700737 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.700699    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-credential-socket\") pod \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") "
Nov 03 22:00:04.700920 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.700751    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-envoy\") pod \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") "
Nov 03 22:00:04.700920 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.700789    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-data\") pod \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") "
Nov 03 22:00:04.700920 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.700820    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-kube-api-access-z6gvk\" (UniqueName: \"kubernetes.io/projected/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-kube-api-access-z6gvk\") pod \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") "
Nov 03 22:00:04.700920 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.700847    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-workload-socket\") pod \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") "
Nov 03 22:00:04.700920 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.700903    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-token\" (UniqueName: \"kubernetes.io/projected/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-token\") pod \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") "
Nov 03 22:00:04.700920 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.700922    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istiod-ca-cert\") pod \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") "
Nov 03 22:00:04.701218 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.700974    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-podinfo\") pod \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") "
Nov 03 22:00:04.701218 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.701041    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-credential-socket" pod "bba5e5c0-deaa-4f58-a959-c281aa2c0e5f" (UID: "bba5e5c0-deaa-4f58-a959-c281aa2c0e5f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:04.701218 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.701075    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-workload-certs\") pod \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\" (UID: \"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f\") "
Nov 03 22:00:04.701384 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.701207    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-data" pod "bba5e5c0-deaa-4f58-a959-c281aa2c0e5f" (UID: "bba5e5c0-deaa-4f58-a959-c281aa2c0e5f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:04.701384 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.701276    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-workload-socket" pod "bba5e5c0-deaa-4f58-a959-c281aa2c0e5f" (UID: "bba5e5c0-deaa-4f58-a959-c281aa2c0e5f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:04.701472 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.701453    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-workload-certs" pod "bba5e5c0-deaa-4f58-a959-c281aa2c0e5f" (UID: "bba5e5c0-deaa-4f58-a959-c281aa2c0e5f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:04.701513 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.701474    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istiod-ca-cert" pod "bba5e5c0-deaa-4f58-a959-c281aa2c0e5f" (UID: "bba5e5c0-deaa-4f58-a959-c281aa2c0e5f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 22:00:04.701849 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.701804    5077 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-workload-certs\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:04.701849 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.701833    5077 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-credential-socket\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:04.701849 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.701848    5077 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-data\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:04.702367 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.701861    5077 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-workload-socket\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:04.702367 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.701876    5077 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istiod-ca-cert\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:04.703419 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.703391    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-kube-api-access-z6gvk" pod "bba5e5c0-deaa-4f58-a959-c281aa2c0e5f" (UID: "bba5e5c0-deaa-4f58-a959-c281aa2c0e5f"). InnerVolumeSpecName "kube-api-access-z6gvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:00:04.703589 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.703556    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-podinfo" pod "bba5e5c0-deaa-4f58-a959-c281aa2c0e5f" (UID: "bba5e5c0-deaa-4f58-a959-c281aa2c0e5f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 22:00:04.703717 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.703702    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-token" pod "bba5e5c0-deaa-4f58-a959-c281aa2c0e5f" (UID: "bba5e5c0-deaa-4f58-a959-c281aa2c0e5f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:00:04.704342 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.704324    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-envoy" pod "bba5e5c0-deaa-4f58-a959-c281aa2c0e5f" (UID: "bba5e5c0-deaa-4f58-a959-c281aa2c0e5f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:04.803283 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.803213    5077 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-envoy\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:04.803283 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.803265    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6gvk\" (UniqueName: \"kubernetes.io/projected/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-kube-api-access-z6gvk\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:04.803283 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.803282    5077 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-token\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:04.803589 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.803295    5077 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f-istio-podinfo\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:04.868472 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.868445    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"
Nov 03 22:00:04.912272 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.907735    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-openshift-service-ca\") pod \"ac98e10f-7f46-4bf1-ae12-2de3f478af6a\" (UID: \"ac98e10f-7f46-4bf1-ae12-2de3f478af6a\") "
Nov 03 22:00:04.912272 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:04.909388    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-openshift-service-ca" pod "ac98e10f-7f46-4bf1-ae12-2de3f478af6a" (UID: "ac98e10f-7f46-4bf1-ae12-2de3f478af6a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 22:00:05.009430 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.009392    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-maas-api-tls\") pod \"ac98e10f-7f46-4bf1-ae12-2de3f478af6a\" (UID: \"ac98e10f-7f46-4bf1-ae12-2de3f478af6a\") "
Nov 03 22:00:05.009617 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.009460    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-metrics-certs\") pod \"ac98e10f-7f46-4bf1-ae12-2de3f478af6a\" (UID: \"ac98e10f-7f46-4bf1-ae12-2de3f478af6a\") "
Nov 03 22:00:05.009617 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.009495    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-kube-api-access-j5sss\" (UniqueName: \"kubernetes.io/projected/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-kube-api-access-j5sss\") pod \"ac98e10f-7f46-4bf1-ae12-2de3f478af6a\" (UID: \"ac98e10f-7f46-4bf1-ae12-2de3f478af6a\") "
Nov 03 22:00:05.009974 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.009950    5077 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-openshift-service-ca\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:05.011933 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.011903    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-maas-api-tls" pod "ac98e10f-7f46-4bf1-ae12-2de3f478af6a" (UID: "ac98e10f-7f46-4bf1-ae12-2de3f478af6a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 22:00:05.011933 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.011934    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-kube-api-access-j5sss" pod "ac98e10f-7f46-4bf1-ae12-2de3f478af6a" (UID: "ac98e10f-7f46-4bf1-ae12-2de3f478af6a"). InnerVolumeSpecName "kube-api-access-j5sss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:00:05.012099 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.011959    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-metrics-certs" pod "ac98e10f-7f46-4bf1-ae12-2de3f478af6a" (UID: "ac98e10f-7f46-4bf1-ae12-2de3f478af6a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 22:00:05.111001 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.110891    5077 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-maas-api-tls\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:05.111001 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.110942    5077 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-metrics-certs\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:05.111001 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.110974    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5sss\" (UniqueName: \"kubernetes.io/projected/ac98e10f-7f46-4bf1-ae12-2de3f478af6a-kube-api-access-j5sss\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:05.224420 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.224388    5077 generic.go:356] "Generic (PLEG): container finished" podID="bba5e5c0-deaa-4f58-a959-c281aa2c0e5f" containerID="559b629b3ef672badeb996712d109a2010aea0aba13d351bfa37cc10256afa8b" exitCode=0
Nov 03 22:00:05.224605 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.224434    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"
Nov 03 22:00:05.224605 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.224466    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn" event={"ID":"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f","Type":"ContainerDied","Data":"559b629b3ef672badeb996712d109a2010aea0aba13d351bfa37cc10256afa8b"}
Nov 03 22:00:05.224605 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.224520    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn" event={"ID":"bba5e5c0-deaa-4f58-a959-c281aa2c0e5f","Type":"ContainerDied","Data":"46bf4fac5f32d240222c6782cfcebcb1a18450a1eca91263b10fdc4fb4c4e181"}
Nov 03 22:00:05.224605 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.224550    5077 scope.go:122] "RemoveContainer" containerID="559b629b3ef672badeb996712d109a2010aea0aba13d351bfa37cc10256afa8b"
Nov 03 22:00:05.226168 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.226143    5077 generic.go:356] "Generic (PLEG): container finished" podID="ac98e10f-7f46-4bf1-ae12-2de3f478af6a" containerID="937d63c0798fb49c69b6004dcebe62e7127f65ad76a9791250f452484e7dd5c4" exitCode=0
Nov 03 22:00:05.226325 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.226187    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"
Nov 03 22:00:05.226325 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.226211    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb" event={"ID":"ac98e10f-7f46-4bf1-ae12-2de3f478af6a","Type":"ContainerDied","Data":"937d63c0798fb49c69b6004dcebe62e7127f65ad76a9791250f452484e7dd5c4"}
Nov 03 22:00:05.226470 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.226336    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb" event={"ID":"ac98e10f-7f46-4bf1-ae12-2de3f478af6a","Type":"ContainerDied","Data":"58da7edaac435b1d5a31a2b47fae38f9f719ac61575eef57a0d9e3f1291dc357"}
Nov 03 22:00:05.236192 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.236175    5077 scope.go:122] "RemoveContainer" containerID="559b629b3ef672badeb996712d109a2010aea0aba13d351bfa37cc10256afa8b"
Nov 03 22:00:05.236553 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:00:05.236528    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"559b629b3ef672badeb996712d109a2010aea0aba13d351bfa37cc10256afa8b\": container with ID starting with 559b629b3ef672badeb996712d109a2010aea0aba13d351bfa37cc10256afa8b not found: ID does not exist" containerID="559b629b3ef672badeb996712d109a2010aea0aba13d351bfa37cc10256afa8b"
Nov 03 22:00:05.236635 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.236562    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"559b629b3ef672badeb996712d109a2010aea0aba13d351bfa37cc10256afa8b"} err="failed to get container status \"559b629b3ef672badeb996712d109a2010aea0aba13d351bfa37cc10256afa8b\": rpc error: code = NotFound desc = could not find container \"559b629b3ef672badeb996712d109a2010aea0aba13d351bfa37cc10256afa8b\": container with ID starting with 559b629b3ef672badeb996712d109a2010aea0aba13d351bfa37cc10256afa8b not found: ID does not exist"
Nov 03 22:00:05.236635 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.236581    5077 scope.go:122] "RemoveContainer" containerID="937d63c0798fb49c69b6004dcebe62e7127f65ad76a9791250f452484e7dd5c4"
Nov 03 22:00:05.246258 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.246223    5077 scope.go:122] "RemoveContainer" containerID="937d63c0798fb49c69b6004dcebe62e7127f65ad76a9791250f452484e7dd5c4"
Nov 03 22:00:05.246614 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:00:05.246593    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"937d63c0798fb49c69b6004dcebe62e7127f65ad76a9791250f452484e7dd5c4\": container with ID starting with 937d63c0798fb49c69b6004dcebe62e7127f65ad76a9791250f452484e7dd5c4 not found: ID does not exist" containerID="937d63c0798fb49c69b6004dcebe62e7127f65ad76a9791250f452484e7dd5c4"
Nov 03 22:00:05.246687 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.246628    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"937d63c0798fb49c69b6004dcebe62e7127f65ad76a9791250f452484e7dd5c4"} err="failed to get container status \"937d63c0798fb49c69b6004dcebe62e7127f65ad76a9791250f452484e7dd5c4\": rpc error: code = NotFound desc = could not find container \"937d63c0798fb49c69b6004dcebe62e7127f65ad76a9791250f452484e7dd5c4\": container with ID starting with 937d63c0798fb49c69b6004dcebe62e7127f65ad76a9791250f452484e7dd5c4 not found: ID does not exist"
Nov 03 22:00:05.252720 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.252691    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"]
Nov 03 22:00:05.277783 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.277745    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-02e8ab-openshift-default-6f4974886c-c7zqn"]
Nov 03 22:00:05.297351 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.297316    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"]
Nov 03 22:00:05.297956 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.297937    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-fc16de-74f5449f95-hzmgb"]
Nov 03 22:00:05.724122 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.724043    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8" podUID="2e8a26a6-b242-4a01-b19b-48595024ce2f" containerName="payload-processing" containerID="cri-o://84317b2acf0e160a320615bf1e3da27a4da1871adc43f6b2d406a8e8110810ed" gracePeriod=25
Nov 03 22:00:05.745382 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:05.745300    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k" podUID="05c6b884-526b-4acd-a645-a04b90fd35f1" containerName="payload-pre-processing" containerID="cri-o://b83c5f8ec497b7005e08025333c3e6b032a5c0d0597332e3bcc0153e121a842c" gracePeriod=25
Nov 03 22:00:06.737529 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.737498    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ac98e10f-7f46-4bf1-ae12-2de3f478af6a" path="/var/lib/kubelet/pods/ac98e10f-7f46-4bf1-ae12-2de3f478af6a/volumes"
Nov 03 22:00:06.738059 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.738036    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bba5e5c0-deaa-4f58-a959-c281aa2c0e5f" path="/var/lib/kubelet/pods/bba5e5c0-deaa-4f58-a959-c281aa2c0e5f/volumes"
Nov 03 22:00:06.791583 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.791552    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"]
Nov 03 22:00:06.792390 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792371    5077 cpu_manager.go:414] "containerMap: removing container" podUID="9ddd62a2-4835-4cc4-b04d-846c174b07b6" containerName="payload-processing"
Nov 03 22:00:06.792453 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792393    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ddd62a2-4835-4cc4-b04d-846c174b07b6" containerName="payload-processing"
Nov 03 22:00:06.792453 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792410    5077 cpu_manager.go:414] "containerMap: removing container" podUID="bba5e5c0-deaa-4f58-a959-c281aa2c0e5f" containerName="istio-proxy"
Nov 03 22:00:06.792453 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792418    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bba5e5c0-deaa-4f58-a959-c281aa2c0e5f" containerName="istio-proxy"
Nov 03 22:00:06.792453 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792436    5077 cpu_manager.go:414] "containerMap: removing container" podUID="c61aad42-dcf9-4f3c-971a-03d03ddfc8ff" containerName="payload-pre-processing"
Nov 03 22:00:06.792453 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792444    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c61aad42-dcf9-4f3c-971a-03d03ddfc8ff" containerName="payload-pre-processing"
Nov 03 22:00:06.792611 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792473    5077 cpu_manager.go:414] "containerMap: removing container" podUID="e0f13297-0097-446f-8f49-9b931e44a691" containerName="payload-pre-processing"
Nov 03 22:00:06.792611 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792481    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e0f13297-0097-446f-8f49-9b931e44a691" containerName="payload-pre-processing"
Nov 03 22:00:06.792611 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792496    5077 cpu_manager.go:414] "containerMap: removing container" podUID="c5ac4b3b-8103-4b03-b2e7-84eda5cf4659" containerName="payload-processing"
Nov 03 22:00:06.792611 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792503    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5ac4b3b-8103-4b03-b2e7-84eda5cf4659" containerName="payload-processing"
Nov 03 22:00:06.792611 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792513    5077 cpu_manager.go:414] "containerMap: removing container" podUID="eb75cdb5-ccf7-4702-bc41-a180e1716b2b" containerName="payload-pre-processing"
Nov 03 22:00:06.792611 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792520    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eb75cdb5-ccf7-4702-bc41-a180e1716b2b" containerName="payload-pre-processing"
Nov 03 22:00:06.792611 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792542    5077 cpu_manager.go:414] "containerMap: removing container" podUID="998d8261-6d86-4f97-948f-abfb5fc704c9" containerName="payload-processing"
Nov 03 22:00:06.792611 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792549    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="998d8261-6d86-4f97-948f-abfb5fc704c9" containerName="payload-processing"
Nov 03 22:00:06.792611 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792561    5077 cpu_manager.go:414] "containerMap: removing container" podUID="ac98e10f-7f46-4bf1-ae12-2de3f478af6a" containerName="maas-api"
Nov 03 22:00:06.792611 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792568    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ac98e10f-7f46-4bf1-ae12-2de3f478af6a" containerName="maas-api"
Nov 03 22:00:06.792965 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792718    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ddd62a2-4835-4cc4-b04d-846c174b07b6" containerName="payload-processing"
Nov 03 22:00:06.792965 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792729    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="bba5e5c0-deaa-4f58-a959-c281aa2c0e5f" containerName="istio-proxy"
Nov 03 22:00:06.792965 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792740    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="c61aad42-dcf9-4f3c-971a-03d03ddfc8ff" containerName="payload-pre-processing"
Nov 03 22:00:06.792965 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792752    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="e0f13297-0097-446f-8f49-9b931e44a691" containerName="payload-pre-processing"
Nov 03 22:00:06.792965 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792762    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="c5ac4b3b-8103-4b03-b2e7-84eda5cf4659" containerName="payload-processing"
Nov 03 22:00:06.792965 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792770    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="eb75cdb5-ccf7-4702-bc41-a180e1716b2b" containerName="payload-pre-processing"
Nov 03 22:00:06.792965 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792782    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="998d8261-6d86-4f97-948f-abfb5fc704c9" containerName="payload-processing"
Nov 03 22:00:06.792965 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.792790    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="ac98e10f-7f46-4bf1-ae12-2de3f478af6a" containerName="maas-api"
Nov 03 22:00:06.798185 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.798163    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.811201 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.811175    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-fc16de-openshift-default-dockercfg-thxpt\""
Nov 03 22:00:06.829070 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.829036    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-token\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.829289 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.829117    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-workload-socket\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.829289 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.829143    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-podinfo\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.829289 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.829264    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gpb5\" (UniqueName: \"kubernetes.io/projected/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-kube-api-access-8gpb5\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.829472 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.829369    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-workload-certs\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.829472 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.829411    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-envoy\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.829554 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.829470    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-data\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.829707 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.829675    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istiod-ca-cert\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.829843 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.829727    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-credential-socket\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.841638 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.841618    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pspgs_36598f65-5a1d-43e3-acc2-71c1e56f112c/console-operator/1.log"
Nov 03 22:00:06.842060 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.842040    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pspgs_36598f65-5a1d-43e3-acc2-71c1e56f112c/console-operator/1.log"
Nov 03 22:00:06.928085 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.928060    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"]
Nov 03 22:00:06.930802 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.930778    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gpb5\" (UniqueName: \"kubernetes.io/projected/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-kube-api-access-8gpb5\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.930945 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.930887    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-workload-certs\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.935407 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.931229    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-envoy\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.935407 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.931298    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-data\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.935407 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.931320    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-workload-certs\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.935407 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.931418    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istiod-ca-cert\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.935407 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.931449    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-credential-socket\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.935407 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.931478    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-token\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.935407 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.931509    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-workload-socket\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.935407 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.931530    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-podinfo\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.935407 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.931577    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-data\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.935407 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.932166    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istiod-ca-cert\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.935407 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.932966    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-workload-socket\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.935407 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.933511    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-credential-socket\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.935407 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.934437    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-envoy\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.936628 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.936607    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-podinfo\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.946227 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.946203    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-token\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:06.946785 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:06.946764    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gpb5\" (UniqueName: \"kubernetes.io/projected/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-kube-api-access-8gpb5\") pod \"e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") " pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:07.111749 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:07.111716    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:07.406309 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:07.406278    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"]
Nov 03 22:00:07.407497 ip-10-0-128-183 kubenswrapper[5077]: W1103 22:00:07.407472    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b2055a_6c5e_4e26_aae2_eac9e670ead5.slice/crio-bcb0740cb2d04648bdb9ac4d3dcf6b4886596e982f198aa85d8a2ea70dd1bbff WatchSource:0}: Error finding container bcb0740cb2d04648bdb9ac4d3dcf6b4886596e982f198aa85d8a2ea70dd1bbff: Status 404 returned error can't find the container with id bcb0740cb2d04648bdb9ac4d3dcf6b4886596e982f198aa85d8a2ea70dd1bbff
Nov 03 22:00:07.410302 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:07.410272    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 22:00:07.410363 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:07.410334    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 22:00:07.410397 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:07.410363    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 22:00:08.248357 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:08.248319    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2" event={"ID":"c0b2055a-6c5e-4e26-aae2-eac9e670ead5","Type":"ContainerStarted","Data":"4f898b3d70cbb097c5f5cab5b0b1ea247e9773b34ff694bccc9e3bcffcd5e523"}
Nov 03 22:00:08.248793 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:08.248371    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2" event={"ID":"c0b2055a-6c5e-4e26-aae2-eac9e670ead5","Type":"ContainerStarted","Data":"bcb0740cb2d04648bdb9ac4d3dcf6b4886596e982f198aa85d8a2ea70dd1bbff"}
Nov 03 22:00:08.273482 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:08.273430    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2" podStartSLOduration=2.273415963 podStartE2EDuration="2.273415963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:00:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:00:08.271758974 +0000 UTC m=+901.675420405" watchObservedRunningTime="2026-11-03 22:00:08.273415963 +0000 UTC m=+901.677077393"
Nov 03 22:00:09.112071 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:09.112040    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:09.118317 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:09.118288    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:09.254538 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:09.254501    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:09.255474 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:09.255456    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:10.416354 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.416307    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn" podUID="937b976e-61f3-4d4b-95df-ac70dc941d38" containerName="main" containerID="cri-o://d248fc8a1cd9a77ca6affb7f8c7b8ba52667d2547405829a1a42a0aaa680091a" gracePeriod=45
Nov 03 22:00:10.639125 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.639085    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz" podUID="09af1067-207c-44a7-b4c3-ca1bcba6fb82" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 22:00:10.713356 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.713314    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 22:00:10.773763 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.773729    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-tmp-dir\") pod \"937b976e-61f3-4d4b-95df-ac70dc941d38\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") "
Nov 03 22:00:10.773969 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.773791    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/937b976e-61f3-4d4b-95df-ac70dc941d38-kube-api-access-4bftg\" (UniqueName: \"kubernetes.io/projected/937b976e-61f3-4d4b-95df-ac70dc941d38-kube-api-access-4bftg\") pod \"937b976e-61f3-4d4b-95df-ac70dc941d38\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") "
Nov 03 22:00:10.773969 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.773848    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-dshm\" (UniqueName: \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-dshm\") pod \"937b976e-61f3-4d4b-95df-ac70dc941d38\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") "
Nov 03 22:00:10.773969 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.773911    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-model-cache\") pod \"937b976e-61f3-4d4b-95df-ac70dc941d38\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") "
Nov 03 22:00:10.773969 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.773939    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-home\" (UniqueName: \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-home\") pod \"937b976e-61f3-4d4b-95df-ac70dc941d38\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") "
Nov 03 22:00:10.774207 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.773973    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/937b976e-61f3-4d4b-95df-ac70dc941d38-tls-certs\" (UniqueName: \"kubernetes.io/secret/937b976e-61f3-4d4b-95df-ac70dc941d38-tls-certs\") pod \"937b976e-61f3-4d4b-95df-ac70dc941d38\" (UID: \"937b976e-61f3-4d4b-95df-ac70dc941d38\") "
Nov 03 22:00:10.774725 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.774359    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-home" pod "937b976e-61f3-4d4b-95df-ac70dc941d38" (UID: "937b976e-61f3-4d4b-95df-ac70dc941d38"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:10.774725 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.774492    5077 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-home\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:10.774725 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.774553    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-model-cache" pod "937b976e-61f3-4d4b-95df-ac70dc941d38" (UID: "937b976e-61f3-4d4b-95df-ac70dc941d38"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:10.774953 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.774745    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-tmp-dir" pod "937b976e-61f3-4d4b-95df-ac70dc941d38" (UID: "937b976e-61f3-4d4b-95df-ac70dc941d38"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:10.777072 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.777050    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/937b976e-61f3-4d4b-95df-ac70dc941d38-kube-api-access-4bftg" pod "937b976e-61f3-4d4b-95df-ac70dc941d38" (UID: "937b976e-61f3-4d4b-95df-ac70dc941d38"). InnerVolumeSpecName "kube-api-access-4bftg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:00:10.777202 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.777178    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-dshm" pod "937b976e-61f3-4d4b-95df-ac70dc941d38" (UID: "937b976e-61f3-4d4b-95df-ac70dc941d38"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:10.778567 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.778545    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/937b976e-61f3-4d4b-95df-ac70dc941d38-tls-certs" pod "937b976e-61f3-4d4b-95df-ac70dc941d38" (UID: "937b976e-61f3-4d4b-95df-ac70dc941d38"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 22:00:10.875330 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.875289    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bftg\" (UniqueName: \"kubernetes.io/projected/937b976e-61f3-4d4b-95df-ac70dc941d38-kube-api-access-4bftg\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:10.875330 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.875322    5077 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-dshm\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:10.875330 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.875336    5077 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-model-cache\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:10.875566 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.875349    5077 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/937b976e-61f3-4d4b-95df-ac70dc941d38-tls-certs\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:10.875566 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:10.875361    5077 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/937b976e-61f3-4d4b-95df-ac70dc941d38-tmp-dir\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:11.267925 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:11.267892    5077 generic.go:356] "Generic (PLEG): container finished" podID="937b976e-61f3-4d4b-95df-ac70dc941d38" containerID="d248fc8a1cd9a77ca6affb7f8c7b8ba52667d2547405829a1a42a0aaa680091a" exitCode=0
Nov 03 22:00:11.268100 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:11.267937    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"
Nov 03 22:00:11.268100 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:11.267974    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn" event={"ID":"937b976e-61f3-4d4b-95df-ac70dc941d38","Type":"ContainerDied","Data":"d248fc8a1cd9a77ca6affb7f8c7b8ba52667d2547405829a1a42a0aaa680091a"}
Nov 03 22:00:11.268100 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:11.268016    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn" event={"ID":"937b976e-61f3-4d4b-95df-ac70dc941d38","Type":"ContainerDied","Data":"bd446168f1ee48c77ea6931aad1ea29cff6347c08b7f1daca70141e5d9c4f592"}
Nov 03 22:00:11.268100 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:11.268033    5077 scope.go:122] "RemoveContainer" containerID="d248fc8a1cd9a77ca6affb7f8c7b8ba52667d2547405829a1a42a0aaa680091a"
Nov 03 22:00:11.278720 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:11.278705    5077 scope.go:122] "RemoveContainer" containerID="d248fc8a1cd9a77ca6affb7f8c7b8ba52667d2547405829a1a42a0aaa680091a"
Nov 03 22:00:11.278998 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:00:11.278982    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d248fc8a1cd9a77ca6affb7f8c7b8ba52667d2547405829a1a42a0aaa680091a\": container with ID starting with d248fc8a1cd9a77ca6affb7f8c7b8ba52667d2547405829a1a42a0aaa680091a not found: ID does not exist" containerID="d248fc8a1cd9a77ca6affb7f8c7b8ba52667d2547405829a1a42a0aaa680091a"
Nov 03 22:00:11.279038 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:11.279009    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d248fc8a1cd9a77ca6affb7f8c7b8ba52667d2547405829a1a42a0aaa680091a"} err="failed to get container status \"d248fc8a1cd9a77ca6affb7f8c7b8ba52667d2547405829a1a42a0aaa680091a\": rpc error: code = NotFound desc = could not find container \"d248fc8a1cd9a77ca6affb7f8c7b8ba52667d2547405829a1a42a0aaa680091a\": container with ID starting with d248fc8a1cd9a77ca6affb7f8c7b8ba52667d2547405829a1a42a0aaa680091a not found: ID does not exist"
Nov 03 22:00:11.290868 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:11.290844    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"]
Nov 03 22:00:11.293859 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:11.293838    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-53a2cb/premium-w2-53a2cb-kserve-6bcc46d94-drgtn"]
Nov 03 22:00:11.646654 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:11.646615    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z" podUID="1a6a34c7-4517-4567-850d-65d354604bec" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 22:00:12.032634 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:12.032517    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"]
Nov 03 22:00:12.277022 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:12.276987    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2" podUID="c0b2055a-6c5e-4e26-aae2-eac9e670ead5" containerName="istio-proxy" containerID="cri-o://4f898b3d70cbb097c5f5cab5b0b1ea247e9773b34ff694bccc9e3bcffcd5e523" gracePeriod=30
Nov 03 22:00:12.656525 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:12.656491    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8" podUID="2e8a26a6-b242-4a01-b19b-48595024ce2f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 22:00:12.657002 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:12.656481    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k" podUID="05c6b884-526b-4acd-a645-a04b90fd35f1" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 22:00:12.744362 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:12.744325    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="937b976e-61f3-4d4b-95df-ac70dc941d38" path="/var/lib/kubelet/pods/937b976e-61f3-4d4b-95df-ac70dc941d38/volumes"
Nov 03 22:00:15.071225 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:15.071187    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"]
Nov 03 22:00:15.071866 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:15.071425    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng" podUID="1242837c-1912-43aa-9ec6-72301fc61d62" containerName="maas-api" containerID="cri-o://1cf3d8c206d891fb0b0cc4eab263de8319045e096b1807d74c7fe38340fe1148" gracePeriod=30
Nov 03 22:00:15.300210 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:15.300108    5077 generic.go:356] "Generic (PLEG): container finished" podID="1242837c-1912-43aa-9ec6-72301fc61d62" containerID="1cf3d8c206d891fb0b0cc4eab263de8319045e096b1807d74c7fe38340fe1148" exitCode=0
Nov 03 22:00:15.300210 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:15.300157    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng" event={"ID":"1242837c-1912-43aa-9ec6-72301fc61d62","Type":"ContainerDied","Data":"1cf3d8c206d891fb0b0cc4eab263de8319045e096b1807d74c7fe38340fe1148"}
Nov 03 22:00:15.346078 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:15.346055    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"
Nov 03 22:00:15.423061 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:15.423021    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1242837c-1912-43aa-9ec6-72301fc61d62-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1242837c-1912-43aa-9ec6-72301fc61d62-maas-api-tls\") pod \"1242837c-1912-43aa-9ec6-72301fc61d62\" (UID: \"1242837c-1912-43aa-9ec6-72301fc61d62\") "
Nov 03 22:00:15.423235 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:15.423132    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1242837c-1912-43aa-9ec6-72301fc61d62-metrics-certs\" (UniqueName: \"kubernetes.io/secret/1242837c-1912-43aa-9ec6-72301fc61d62-metrics-certs\") pod \"1242837c-1912-43aa-9ec6-72301fc61d62\" (UID: \"1242837c-1912-43aa-9ec6-72301fc61d62\") "
Nov 03 22:00:15.423235 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:15.423198    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1242837c-1912-43aa-9ec6-72301fc61d62-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1242837c-1912-43aa-9ec6-72301fc61d62-openshift-service-ca\") pod \"1242837c-1912-43aa-9ec6-72301fc61d62\" (UID: \"1242837c-1912-43aa-9ec6-72301fc61d62\") "
Nov 03 22:00:15.423403 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:15.423236    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1242837c-1912-43aa-9ec6-72301fc61d62-kube-api-access-tmd8j\" (UniqueName: \"kubernetes.io/projected/1242837c-1912-43aa-9ec6-72301fc61d62-kube-api-access-tmd8j\") pod \"1242837c-1912-43aa-9ec6-72301fc61d62\" (UID: \"1242837c-1912-43aa-9ec6-72301fc61d62\") "
Nov 03 22:00:15.423622 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:15.423589    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1242837c-1912-43aa-9ec6-72301fc61d62-openshift-service-ca" pod "1242837c-1912-43aa-9ec6-72301fc61d62" (UID: "1242837c-1912-43aa-9ec6-72301fc61d62"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 22:00:15.423769 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:15.423749    5077 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1242837c-1912-43aa-9ec6-72301fc61d62-openshift-service-ca\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:15.425861 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:15.425830    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1242837c-1912-43aa-9ec6-72301fc61d62-kube-api-access-tmd8j" pod "1242837c-1912-43aa-9ec6-72301fc61d62" (UID: "1242837c-1912-43aa-9ec6-72301fc61d62"). InnerVolumeSpecName "kube-api-access-tmd8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:00:15.426096 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:15.426077    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1242837c-1912-43aa-9ec6-72301fc61d62-metrics-certs" pod "1242837c-1912-43aa-9ec6-72301fc61d62" (UID: "1242837c-1912-43aa-9ec6-72301fc61d62"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 22:00:15.426170 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:15.426103    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1242837c-1912-43aa-9ec6-72301fc61d62-maas-api-tls" pod "1242837c-1912-43aa-9ec6-72301fc61d62" (UID: "1242837c-1912-43aa-9ec6-72301fc61d62"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 22:00:15.524864 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:15.524828    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmd8j\" (UniqueName: \"kubernetes.io/projected/1242837c-1912-43aa-9ec6-72301fc61d62-kube-api-access-tmd8j\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:15.524864 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:15.524860    5077 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1242837c-1912-43aa-9ec6-72301fc61d62-maas-api-tls\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:15.525047 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:15.524877    5077 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1242837c-1912-43aa-9ec6-72301fc61d62-metrics-certs\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:15.996500 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:15.996468    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z"
Nov 03 22:00:16.031269 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.030459    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1a6a34c7-4517-4567-850d-65d354604bec-kube-api-access-llml6\" (UniqueName: \"kubernetes.io/projected/1a6a34c7-4517-4567-850d-65d354604bec-kube-api-access-llml6\") pod \"1a6a34c7-4517-4567-850d-65d354604bec\" (UID: \"1a6a34c7-4517-4567-850d-65d354604bec\") "
Nov 03 22:00:16.031269 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.030556    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1a6a34c7-4517-4567-850d-65d354604bec-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a6a34c7-4517-4567-850d-65d354604bec-plugins-config-volume\") pod \"1a6a34c7-4517-4567-850d-65d354604bec\" (UID: \"1a6a34c7-4517-4567-850d-65d354604bec\") "
Nov 03 22:00:16.031269 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.030912    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a6a34c7-4517-4567-850d-65d354604bec-plugins-config-volume" pod "1a6a34c7-4517-4567-850d-65d354604bec" (UID: "1a6a34c7-4517-4567-850d-65d354604bec"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 22:00:16.033008 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.032980    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a6a34c7-4517-4567-850d-65d354604bec-kube-api-access-llml6" pod "1a6a34c7-4517-4567-850d-65d354604bec" (UID: "1a6a34c7-4517-4567-850d-65d354604bec"). InnerVolumeSpecName "kube-api-access-llml6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:00:16.048684 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.048658    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz"
Nov 03 22:00:16.131887 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.131857    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/09af1067-207c-44a7-b4c3-ca1bcba6fb82-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09af1067-207c-44a7-b4c3-ca1bcba6fb82-plugins-config-volume\") pod \"09af1067-207c-44a7-b4c3-ca1bcba6fb82\" (UID: \"09af1067-207c-44a7-b4c3-ca1bcba6fb82\") "
Nov 03 22:00:16.132290 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.131949    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/09af1067-207c-44a7-b4c3-ca1bcba6fb82-kube-api-access-xbfl5\" (UniqueName: \"kubernetes.io/projected/09af1067-207c-44a7-b4c3-ca1bcba6fb82-kube-api-access-xbfl5\") pod \"09af1067-207c-44a7-b4c3-ca1bcba6fb82\" (UID: \"09af1067-207c-44a7-b4c3-ca1bcba6fb82\") "
Nov 03 22:00:16.132290 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.132175    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llml6\" (UniqueName: \"kubernetes.io/projected/1a6a34c7-4517-4567-850d-65d354604bec-kube-api-access-llml6\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:16.132290 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.132187    5077 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a6a34c7-4517-4567-850d-65d354604bec-plugins-config-volume\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:16.132290 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.132170    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09af1067-207c-44a7-b4c3-ca1bcba6fb82-plugins-config-volume" pod "09af1067-207c-44a7-b4c3-ca1bcba6fb82" (UID: "09af1067-207c-44a7-b4c3-ca1bcba6fb82"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 22:00:16.134236 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.134210    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09af1067-207c-44a7-b4c3-ca1bcba6fb82-kube-api-access-xbfl5" pod "09af1067-207c-44a7-b4c3-ca1bcba6fb82" (UID: "09af1067-207c-44a7-b4c3-ca1bcba6fb82"). InnerVolumeSpecName "kube-api-access-xbfl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:00:16.233665 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.233627    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbfl5\" (UniqueName: \"kubernetes.io/projected/09af1067-207c-44a7-b4c3-ca1bcba6fb82-kube-api-access-xbfl5\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:16.233665 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.233659    5077 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09af1067-207c-44a7-b4c3-ca1bcba6fb82-plugins-config-volume\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:16.308227 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.308197    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"
Nov 03 22:00:16.308441 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.308223    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng" event={"ID":"1242837c-1912-43aa-9ec6-72301fc61d62","Type":"ContainerDied","Data":"1b947b61a2a293c6e9a7e5cccd6775a50f468de9662dab7f58412318c5ed8918"}
Nov 03 22:00:16.308441 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.308308    5077 scope.go:122] "RemoveContainer" containerID="1cf3d8c206d891fb0b0cc4eab263de8319045e096b1807d74c7fe38340fe1148"
Nov 03 22:00:16.310035 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.310007    5077 generic.go:356] "Generic (PLEG): container finished" podID="09af1067-207c-44a7-b4c3-ca1bcba6fb82" containerID="fec9a85ed14b59f50991dd47febe3ae22ab1ab4cb41f4b8a837397f917aa5815" exitCode=0
Nov 03 22:00:16.310126 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.310112    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz" event={"ID":"09af1067-207c-44a7-b4c3-ca1bcba6fb82","Type":"ContainerDied","Data":"fec9a85ed14b59f50991dd47febe3ae22ab1ab4cb41f4b8a837397f917aa5815"}
Nov 03 22:00:16.310163 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.310144    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz"
Nov 03 22:00:16.310163 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.310153    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz" event={"ID":"09af1067-207c-44a7-b4c3-ca1bcba6fb82","Type":"ContainerDied","Data":"e809df8103fcf95ccbb55134f5e22944294e78f5cd5ef3d979db4b18603b1e99"}
Nov 03 22:00:16.311842 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.311806    5077 generic.go:356] "Generic (PLEG): container finished" podID="1a6a34c7-4517-4567-850d-65d354604bec" containerID="3f68608422b86c213d7e7ca958e231f6be45ec68f871d501117c61a95f21f400" exitCode=0
Nov 03 22:00:16.311959 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.311942    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z" event={"ID":"1a6a34c7-4517-4567-850d-65d354604bec","Type":"ContainerDied","Data":"3f68608422b86c213d7e7ca958e231f6be45ec68f871d501117c61a95f21f400"}
Nov 03 22:00:16.312012 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.311982    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z" event={"ID":"1a6a34c7-4517-4567-850d-65d354604bec","Type":"ContainerDied","Data":"58497a29dbbf8032354ef84e43900174f8346523d4cfc5232f57432f9c0f95a1"}
Nov 03 22:00:16.312060 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.312048    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z"
Nov 03 22:00:16.319241 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.319218    5077 scope.go:122] "RemoveContainer" containerID="fec9a85ed14b59f50991dd47febe3ae22ab1ab4cb41f4b8a837397f917aa5815"
Nov 03 22:00:16.331302 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.331280    5077 scope.go:122] "RemoveContainer" containerID="fec9a85ed14b59f50991dd47febe3ae22ab1ab4cb41f4b8a837397f917aa5815"
Nov 03 22:00:16.331938 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:00:16.331915    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fec9a85ed14b59f50991dd47febe3ae22ab1ab4cb41f4b8a837397f917aa5815\": container with ID starting with fec9a85ed14b59f50991dd47febe3ae22ab1ab4cb41f4b8a837397f917aa5815 not found: ID does not exist" containerID="fec9a85ed14b59f50991dd47febe3ae22ab1ab4cb41f4b8a837397f917aa5815"
Nov 03 22:00:16.332020 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.331949    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fec9a85ed14b59f50991dd47febe3ae22ab1ab4cb41f4b8a837397f917aa5815"} err="failed to get container status \"fec9a85ed14b59f50991dd47febe3ae22ab1ab4cb41f4b8a837397f917aa5815\": rpc error: code = NotFound desc = could not find container \"fec9a85ed14b59f50991dd47febe3ae22ab1ab4cb41f4b8a837397f917aa5815\": container with ID starting with fec9a85ed14b59f50991dd47febe3ae22ab1ab4cb41f4b8a837397f917aa5815 not found: ID does not exist"
Nov 03 22:00:16.332020 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.331970    5077 scope.go:122] "RemoveContainer" containerID="3f68608422b86c213d7e7ca958e231f6be45ec68f871d501117c61a95f21f400"
Nov 03 22:00:16.340391 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.340375    5077 scope.go:122] "RemoveContainer" containerID="3f68608422b86c213d7e7ca958e231f6be45ec68f871d501117c61a95f21f400"
Nov 03 22:00:16.340635 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:00:16.340618    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f68608422b86c213d7e7ca958e231f6be45ec68f871d501117c61a95f21f400\": container with ID starting with 3f68608422b86c213d7e7ca958e231f6be45ec68f871d501117c61a95f21f400 not found: ID does not exist" containerID="3f68608422b86c213d7e7ca958e231f6be45ec68f871d501117c61a95f21f400"
Nov 03 22:00:16.340695 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.340643    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f68608422b86c213d7e7ca958e231f6be45ec68f871d501117c61a95f21f400"} err="failed to get container status \"3f68608422b86c213d7e7ca958e231f6be45ec68f871d501117c61a95f21f400\": rpc error: code = NotFound desc = could not find container \"3f68608422b86c213d7e7ca958e231f6be45ec68f871d501117c61a95f21f400\": container with ID starting with 3f68608422b86c213d7e7ca958e231f6be45ec68f871d501117c61a95f21f400 not found: ID does not exist"
Nov 03 22:00:16.347785 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.347763    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z"]
Nov 03 22:00:16.349991 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.349969    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-fc16de-d4df6cfdd-pd92z"]
Nov 03 22:00:16.361075 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.361049    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz"]
Nov 03 22:00:16.367732 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.367709    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-fc16de-848f86c8cf-fq2vz"]
Nov 03 22:00:16.379207 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.379182    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"]
Nov 03 22:00:16.383675 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.383653    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-53a2cb-85df6486c6-k52ng"]
Nov 03 22:00:16.735960 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.735886    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="09af1067-207c-44a7-b4c3-ca1bcba6fb82" path="/var/lib/kubelet/pods/09af1067-207c-44a7-b4c3-ca1bcba6fb82/volumes"
Nov 03 22:00:16.736287 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.736274    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1242837c-1912-43aa-9ec6-72301fc61d62" path="/var/lib/kubelet/pods/1242837c-1912-43aa-9ec6-72301fc61d62/volumes"
Nov 03 22:00:16.736589 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:16.736577    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1a6a34c7-4517-4567-850d-65d354604bec" path="/var/lib/kubelet/pods/1a6a34c7-4517-4567-850d-65d354604bec/volumes"
Nov 03 22:00:17.536496 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.536438    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:17.647790 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.647755    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-credential-socket\") pod \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") "
Nov 03 22:00:17.647938 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.647841    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-workload-certs\") pod \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") "
Nov 03 22:00:17.647938 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.647897    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-workload-socket\") pod \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") "
Nov 03 22:00:17.648055 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.647973    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-kube-api-access-8gpb5\" (UniqueName: \"kubernetes.io/projected/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-kube-api-access-8gpb5\") pod \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") "
Nov 03 22:00:17.648055 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.648007    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-envoy\") pod \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") "
Nov 03 22:00:17.648174 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.648055    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-podinfo\") pod \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") "
Nov 03 22:00:17.648174 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.648085    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-data\") pod \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") "
Nov 03 22:00:17.648174 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.648103    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-credential-socket" pod "c0b2055a-6c5e-4e26-aae2-eac9e670ead5" (UID: "c0b2055a-6c5e-4e26-aae2-eac9e670ead5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:17.648174 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.648115    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-workload-certs" pod "c0b2055a-6c5e-4e26-aae2-eac9e670ead5" (UID: "c0b2055a-6c5e-4e26-aae2-eac9e670ead5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:17.648414 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.648211    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-token\" (UniqueName: \"kubernetes.io/projected/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-token\") pod \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") "
Nov 03 22:00:17.648414 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.648225    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-workload-socket" pod "c0b2055a-6c5e-4e26-aae2-eac9e670ead5" (UID: "c0b2055a-6c5e-4e26-aae2-eac9e670ead5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:17.648414 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.648281    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istiod-ca-cert\") pod \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\" (UID: \"c0b2055a-6c5e-4e26-aae2-eac9e670ead5\") "
Nov 03 22:00:17.648414 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.648376    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-data" pod "c0b2055a-6c5e-4e26-aae2-eac9e670ead5" (UID: "c0b2055a-6c5e-4e26-aae2-eac9e670ead5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:17.648720 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.648696    5077 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-workload-socket\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:17.648789 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.648757    5077 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-data\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:17.648789 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.648774    5077 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-credential-socket\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:17.648903 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.648789    5077 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-workload-certs\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:17.649038 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.649008    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istiod-ca-cert" pod "c0b2055a-6c5e-4e26-aae2-eac9e670ead5" (UID: "c0b2055a-6c5e-4e26-aae2-eac9e670ead5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 22:00:17.650559 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.650535    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-envoy" pod "c0b2055a-6c5e-4e26-aae2-eac9e670ead5" (UID: "c0b2055a-6c5e-4e26-aae2-eac9e670ead5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:17.650981 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.650950    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-podinfo" pod "c0b2055a-6c5e-4e26-aae2-eac9e670ead5" (UID: "c0b2055a-6c5e-4e26-aae2-eac9e670ead5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 22:00:17.651311 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.651289    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-token" pod "c0b2055a-6c5e-4e26-aae2-eac9e670ead5" (UID: "c0b2055a-6c5e-4e26-aae2-eac9e670ead5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:00:17.651409 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.651304    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-kube-api-access-8gpb5" pod "c0b2055a-6c5e-4e26-aae2-eac9e670ead5" (UID: "c0b2055a-6c5e-4e26-aae2-eac9e670ead5"). InnerVolumeSpecName "kube-api-access-8gpb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:00:17.749684 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.749638    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gpb5\" (UniqueName: \"kubernetes.io/projected/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-kube-api-access-8gpb5\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:17.749684 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.749668    5077 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-envoy\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:17.749684 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.749684    5077 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-podinfo\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:17.749684 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.749694    5077 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istio-token\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:17.749948 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:17.749703    5077 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0b2055a-6c5e-4e26-aae2-eac9e670ead5-istiod-ca-cert\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:18.329843 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:18.329809    5077 generic.go:356] "Generic (PLEG): container finished" podID="c0b2055a-6c5e-4e26-aae2-eac9e670ead5" containerID="4f898b3d70cbb097c5f5cab5b0b1ea247e9773b34ff694bccc9e3bcffcd5e523" exitCode=0
Nov 03 22:00:18.330021 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:18.329872    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"
Nov 03 22:00:18.330021 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:18.329902    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2" event={"ID":"c0b2055a-6c5e-4e26-aae2-eac9e670ead5","Type":"ContainerDied","Data":"4f898b3d70cbb097c5f5cab5b0b1ea247e9773b34ff694bccc9e3bcffcd5e523"}
Nov 03 22:00:18.330021 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:18.330000    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2" event={"ID":"c0b2055a-6c5e-4e26-aae2-eac9e670ead5","Type":"ContainerDied","Data":"bcb0740cb2d04648bdb9ac4d3dcf6b4886596e982f198aa85d8a2ea70dd1bbff"}
Nov 03 22:00:18.330229 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:18.330030    5077 scope.go:122] "RemoveContainer" containerID="4f898b3d70cbb097c5f5cab5b0b1ea247e9773b34ff694bccc9e3bcffcd5e523"
Nov 03 22:00:18.339878 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:18.339862    5077 scope.go:122] "RemoveContainer" containerID="4f898b3d70cbb097c5f5cab5b0b1ea247e9773b34ff694bccc9e3bcffcd5e523"
Nov 03 22:00:18.340133 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:00:18.340114    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f898b3d70cbb097c5f5cab5b0b1ea247e9773b34ff694bccc9e3bcffcd5e523\": container with ID starting with 4f898b3d70cbb097c5f5cab5b0b1ea247e9773b34ff694bccc9e3bcffcd5e523 not found: ID does not exist" containerID="4f898b3d70cbb097c5f5cab5b0b1ea247e9773b34ff694bccc9e3bcffcd5e523"
Nov 03 22:00:18.340177 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:18.340140    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f898b3d70cbb097c5f5cab5b0b1ea247e9773b34ff694bccc9e3bcffcd5e523"} err="failed to get container status \"4f898b3d70cbb097c5f5cab5b0b1ea247e9773b34ff694bccc9e3bcffcd5e523\": rpc error: code = NotFound desc = could not find container \"4f898b3d70cbb097c5f5cab5b0b1ea247e9773b34ff694bccc9e3bcffcd5e523\": container with ID starting with 4f898b3d70cbb097c5f5cab5b0b1ea247e9773b34ff694bccc9e3bcffcd5e523 not found: ID does not exist"
Nov 03 22:00:18.354052 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:18.354028    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"]
Nov 03 22:00:18.358063 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:18.358043    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-fc16de-openshift-default-85fdcb545f-zgwv2"]
Nov 03 22:00:18.734923 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:18.734846    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c0b2055a-6c5e-4e26-aae2-eac9e670ead5" path="/var/lib/kubelet/pods/c0b2055a-6c5e-4e26-aae2-eac9e670ead5/volumes"
Nov 03 22:00:21.672202 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.672166    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"]
Nov 03 22:00:21.672946 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.672924    5077 cpu_manager.go:414] "containerMap: removing container" podUID="1242837c-1912-43aa-9ec6-72301fc61d62" containerName="maas-api"
Nov 03 22:00:21.673042 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.672948    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1242837c-1912-43aa-9ec6-72301fc61d62" containerName="maas-api"
Nov 03 22:00:21.673042 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.672983    5077 cpu_manager.go:414] "containerMap: removing container" podUID="09af1067-207c-44a7-b4c3-ca1bcba6fb82" containerName="payload-pre-processing"
Nov 03 22:00:21.673042 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.672991    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="09af1067-207c-44a7-b4c3-ca1bcba6fb82" containerName="payload-pre-processing"
Nov 03 22:00:21.673042 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.673017    5077 cpu_manager.go:414] "containerMap: removing container" podUID="c0b2055a-6c5e-4e26-aae2-eac9e670ead5" containerName="istio-proxy"
Nov 03 22:00:21.673042 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.673024    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c0b2055a-6c5e-4e26-aae2-eac9e670ead5" containerName="istio-proxy"
Nov 03 22:00:21.673337 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.673045    5077 cpu_manager.go:414] "containerMap: removing container" podUID="1a6a34c7-4517-4567-850d-65d354604bec" containerName="payload-processing"
Nov 03 22:00:21.673337 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.673053    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a6a34c7-4517-4567-850d-65d354604bec" containerName="payload-processing"
Nov 03 22:00:21.673337 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.673069    5077 cpu_manager.go:414] "containerMap: removing container" podUID="937b976e-61f3-4d4b-95df-ac70dc941d38" containerName="main"
Nov 03 22:00:21.673337 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.673077    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="937b976e-61f3-4d4b-95df-ac70dc941d38" containerName="main"
Nov 03 22:00:21.673337 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.673194    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="c0b2055a-6c5e-4e26-aae2-eac9e670ead5" containerName="istio-proxy"
Nov 03 22:00:21.673337 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.673210    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a6a34c7-4517-4567-850d-65d354604bec" containerName="payload-processing"
Nov 03 22:00:21.673337 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.673221    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="937b976e-61f3-4d4b-95df-ac70dc941d38" containerName="main"
Nov 03 22:00:21.673337 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.673233    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="1242837c-1912-43aa-9ec6-72301fc61d62" containerName="maas-api"
Nov 03 22:00:21.673337 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.673265    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="09af1067-207c-44a7-b4c3-ca1bcba6fb82" containerName="payload-pre-processing"
Nov 03 22:00:21.676854 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.676832    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.687195 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.687013    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-53a2cb-openshift-default-dockercfg-6hq7h\""
Nov 03 22:00:21.715536 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.715503    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"]
Nov 03 22:00:21.795627 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.795585    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-token\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.795834 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.795637    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-envoy\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.795834 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.795750    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-podinfo\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.795834 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.795816    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-workload-socket\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.795834 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.795834    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istiod-ca-cert\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.796046 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.795919    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-data\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.796046 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.795989    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-workload-certs\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.796116 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.796059    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-credential-socket\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.796150 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.796121    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfbg4\" (UniqueName: \"kubernetes.io/projected/4cd5d43d-9b28-446f-8df0-2e4da39245e8-kube-api-access-kfbg4\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.896866 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.896829    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-workload-socket\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.896866 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.896867    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istiod-ca-cert\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.897122 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.896901    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-data\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.897122 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.896955    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-workload-certs\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.897122 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.897007    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-credential-socket\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.897122 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.897065    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfbg4\" (UniqueName: \"kubernetes.io/projected/4cd5d43d-9b28-446f-8df0-2e4da39245e8-kube-api-access-kfbg4\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.897122 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.897105    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-token\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.897489 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.897148    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-envoy\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.897489 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.897218    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-podinfo\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.897489 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.897305    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-workload-socket\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.897489 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.897361    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-data\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.897489 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.897382    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-workload-certs\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.897489 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.897487    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-credential-socket\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.898188 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.898163    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istiod-ca-cert\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.899632 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.899604    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-envoy\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.900455 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.900435    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-podinfo\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.910160 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.910136    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-token\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:21.910335 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:21.910315    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfbg4\" (UniqueName: \"kubernetes.io/projected/4cd5d43d-9b28-446f-8df0-2e4da39245e8-kube-api-access-kfbg4\") pod \"e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") " pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:22.010857 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:22.010772    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:22.298505 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:22.298478    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"]
Nov 03 22:00:22.300610 ip-10-0-128-183 kubenswrapper[5077]: W1103 22:00:22.300575    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd5d43d_9b28_446f_8df0_2e4da39245e8.slice/crio-f9b5d5a94bfdad48b125104d4bb5fc3b5b6213b02a0e41718c6817d9084c3312 WatchSource:0}: Error finding container f9b5d5a94bfdad48b125104d4bb5fc3b5b6213b02a0e41718c6817d9084c3312: Status 404 returned error can't find the container with id f9b5d5a94bfdad48b125104d4bb5fc3b5b6213b02a0e41718c6817d9084c3312
Nov 03 22:00:22.303100 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:22.303063    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 22:00:22.303196 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:22.303142    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 22:00:22.303196 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:22.303173    5077 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 03 22:00:22.353655 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:22.353555    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5" event={"ID":"4cd5d43d-9b28-446f-8df0-2e4da39245e8","Type":"ContainerStarted","Data":"f9b5d5a94bfdad48b125104d4bb5fc3b5b6213b02a0e41718c6817d9084c3312"}
Nov 03 22:00:22.651715 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:22.651684    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"]
Nov 03 22:00:22.661810 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:22.661769    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8" podUID="2e8a26a6-b242-4a01-b19b-48595024ce2f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 22:00:22.666474 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:22.666432    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k" podUID="05c6b884-526b-4acd-a645-a04b90fd35f1" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 22:00:23.361485 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:23.361444    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5" event={"ID":"4cd5d43d-9b28-446f-8df0-2e4da39245e8","Type":"ContainerStarted","Data":"62b1d6ed4a2bba55ace09f33e66ce2f1d4187054c5d55c9e6f470c947760c31a"}
Nov 03 22:00:23.361963 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:23.361652    5077 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5" secret="" err="secret \"e2e-worker-w2-53a2cb-openshift-default-dockercfg-6hq7h\" not found"
Nov 03 22:00:23.388154 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:23.388087    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5" podStartSLOduration=2.388070813 podStartE2EDuration="2.388070813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:00:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:00:23.385061608 +0000 UTC m=+916.788723039" watchObservedRunningTime="2026-11-03 22:00:23.388070813 +0000 UTC m=+916.791732324"
Nov 03 22:00:24.011352 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:24.011300    5077 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:24.013229 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:24.013206    5077 patch_prober.go:29] interesting pod/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Nov 03 22:00:24.013349 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:24.013266    5077 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5" podUID="4cd5d43d-9b28-446f-8df0-2e4da39245e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Nov 03 22:00:24.367417 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:24.367380    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5" podUID="4cd5d43d-9b28-446f-8df0-2e4da39245e8" containerName="istio-proxy" containerID="cri-o://62b1d6ed4a2bba55ace09f33e66ce2f1d4187054c5d55c9e6f470c947760c31a" gracePeriod=30
Nov 03 22:00:25.160429 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:25.160393    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8f6bb67b9-7k7fc"]
Nov 03 22:00:25.160659 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:25.160632    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-8f6bb67b9-7k7fc" podUID="da6cd283-1c72-4bb9-9638-09c359a2730b" containerName="manager" containerID="cri-o://73a828fce2e960eb8629258ce6a0bd26f2efed9739dee36dab25e9ec6f14c971" gracePeriod=30
Nov 03 22:00:25.379681 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:25.379646    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f6bb67b9-7k7fc" event={"ID":"da6cd283-1c72-4bb9-9638-09c359a2730b","Type":"ContainerDied","Data":"73a828fce2e960eb8629258ce6a0bd26f2efed9739dee36dab25e9ec6f14c971"}
Nov 03 22:00:25.380182 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:25.379568    5077 generic.go:356] "Generic (PLEG): container finished" podID="da6cd283-1c72-4bb9-9638-09c359a2730b" containerID="73a828fce2e960eb8629258ce6a0bd26f2efed9739dee36dab25e9ec6f14c971" exitCode=0
Nov 03 22:00:25.445665 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:25.445642    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f6bb67b9-7k7fc"
Nov 03 22:00:25.554898 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:25.554862    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/da6cd283-1c72-4bb9-9638-09c359a2730b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/da6cd283-1c72-4bb9-9638-09c359a2730b-metrics-certs\") pod \"da6cd283-1c72-4bb9-9638-09c359a2730b\" (UID: \"da6cd283-1c72-4bb9-9638-09c359a2730b\") "
Nov 03 22:00:25.555086 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:25.554903    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/da6cd283-1c72-4bb9-9638-09c359a2730b-webhook-cert\" (UniqueName: \"kubernetes.io/secret/da6cd283-1c72-4bb9-9638-09c359a2730b-webhook-cert\") pod \"da6cd283-1c72-4bb9-9638-09c359a2730b\" (UID: \"da6cd283-1c72-4bb9-9638-09c359a2730b\") "
Nov 03 22:00:25.555086 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:25.554960    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/da6cd283-1c72-4bb9-9638-09c359a2730b-kube-api-access-5b94j\" (UniqueName: \"kubernetes.io/projected/da6cd283-1c72-4bb9-9638-09c359a2730b-kube-api-access-5b94j\") pod \"da6cd283-1c72-4bb9-9638-09c359a2730b\" (UID: \"da6cd283-1c72-4bb9-9638-09c359a2730b\") "
Nov 03 22:00:25.557308 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:25.557271    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da6cd283-1c72-4bb9-9638-09c359a2730b-webhook-cert" pod "da6cd283-1c72-4bb9-9638-09c359a2730b" (UID: "da6cd283-1c72-4bb9-9638-09c359a2730b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 22:00:25.557437 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:25.557371    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da6cd283-1c72-4bb9-9638-09c359a2730b-kube-api-access-5b94j" pod "da6cd283-1c72-4bb9-9638-09c359a2730b" (UID: "da6cd283-1c72-4bb9-9638-09c359a2730b"). InnerVolumeSpecName "kube-api-access-5b94j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:00:25.557507 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:25.557478    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da6cd283-1c72-4bb9-9638-09c359a2730b-metrics-certs" pod "da6cd283-1c72-4bb9-9638-09c359a2730b" (UID: "da6cd283-1c72-4bb9-9638-09c359a2730b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 22:00:25.656875 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:25.656836    5077 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da6cd283-1c72-4bb9-9638-09c359a2730b-metrics-certs\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:25.656875 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:25.656867    5077 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da6cd283-1c72-4bb9-9638-09c359a2730b-webhook-cert\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:25.656875 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:25.656883    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5b94j\" (UniqueName: \"kubernetes.io/projected/da6cd283-1c72-4bb9-9638-09c359a2730b-kube-api-access-5b94j\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:26.013263 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.013218    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8"
Nov 03 22:00:26.037222 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.036909    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k"
Nov 03 22:00:26.167418 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.167376    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/05c6b884-526b-4acd-a645-a04b90fd35f1-kube-api-access-ql7l4\" (UniqueName: \"kubernetes.io/projected/05c6b884-526b-4acd-a645-a04b90fd35f1-kube-api-access-ql7l4\") pod \"05c6b884-526b-4acd-a645-a04b90fd35f1\" (UID: \"05c6b884-526b-4acd-a645-a04b90fd35f1\") "
Nov 03 22:00:26.167634 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.167437    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/05c6b884-526b-4acd-a645-a04b90fd35f1-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05c6b884-526b-4acd-a645-a04b90fd35f1-plugins-config-volume\") pod \"05c6b884-526b-4acd-a645-a04b90fd35f1\" (UID: \"05c6b884-526b-4acd-a645-a04b90fd35f1\") "
Nov 03 22:00:26.167634 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.167551    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e8a26a6-b242-4a01-b19b-48595024ce2f-kube-api-access-npgzf\" (UniqueName: \"kubernetes.io/projected/2e8a26a6-b242-4a01-b19b-48595024ce2f-kube-api-access-npgzf\") pod \"2e8a26a6-b242-4a01-b19b-48595024ce2f\" (UID: \"2e8a26a6-b242-4a01-b19b-48595024ce2f\") "
Nov 03 22:00:26.167634 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.167596    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2e8a26a6-b242-4a01-b19b-48595024ce2f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e8a26a6-b242-4a01-b19b-48595024ce2f-plugins-config-volume\") pod \"2e8a26a6-b242-4a01-b19b-48595024ce2f\" (UID: \"2e8a26a6-b242-4a01-b19b-48595024ce2f\") "
Nov 03 22:00:26.168199 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.168171    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e8a26a6-b242-4a01-b19b-48595024ce2f-plugins-config-volume" pod "2e8a26a6-b242-4a01-b19b-48595024ce2f" (UID: "2e8a26a6-b242-4a01-b19b-48595024ce2f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 22:00:26.168759 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.168729    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05c6b884-526b-4acd-a645-a04b90fd35f1-plugins-config-volume" pod "05c6b884-526b-4acd-a645-a04b90fd35f1" (UID: "05c6b884-526b-4acd-a645-a04b90fd35f1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 22:00:26.170534 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.170509    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05c6b884-526b-4acd-a645-a04b90fd35f1-kube-api-access-ql7l4" pod "05c6b884-526b-4acd-a645-a04b90fd35f1" (UID: "05c6b884-526b-4acd-a645-a04b90fd35f1"). InnerVolumeSpecName "kube-api-access-ql7l4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:00:26.170712 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.170690    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e8a26a6-b242-4a01-b19b-48595024ce2f-kube-api-access-npgzf" pod "2e8a26a6-b242-4a01-b19b-48595024ce2f" (UID: "2e8a26a6-b242-4a01-b19b-48595024ce2f"). InnerVolumeSpecName "kube-api-access-npgzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:00:26.269143 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.269028    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ql7l4\" (UniqueName: \"kubernetes.io/projected/05c6b884-526b-4acd-a645-a04b90fd35f1-kube-api-access-ql7l4\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:26.269143 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.269073    5077 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05c6b884-526b-4acd-a645-a04b90fd35f1-plugins-config-volume\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:26.269143 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.269089    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npgzf\" (UniqueName: \"kubernetes.io/projected/2e8a26a6-b242-4a01-b19b-48595024ce2f-kube-api-access-npgzf\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:26.269143 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.269106    5077 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e8a26a6-b242-4a01-b19b-48595024ce2f-plugins-config-volume\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:26.395020 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.394979    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f6bb67b9-7k7fc"
Nov 03 22:00:26.396170 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.395679    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f6bb67b9-7k7fc" event={"ID":"da6cd283-1c72-4bb9-9638-09c359a2730b","Type":"ContainerDied","Data":"be5561e189581dfeecd6e3eaa874425852f1df5f5a82e927ee2592b1a46244da"}
Nov 03 22:00:26.396170 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.395746    5077 scope.go:122] "RemoveContainer" containerID="73a828fce2e960eb8629258ce6a0bd26f2efed9739dee36dab25e9ec6f14c971"
Nov 03 22:00:26.408088 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.408051    5077 generic.go:356] "Generic (PLEG): container finished" podID="05c6b884-526b-4acd-a645-a04b90fd35f1" containerID="b83c5f8ec497b7005e08025333c3e6b032a5c0d0597332e3bcc0153e121a842c" exitCode=0
Nov 03 22:00:26.408226 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.408175    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k" event={"ID":"05c6b884-526b-4acd-a645-a04b90fd35f1","Type":"ContainerDied","Data":"b83c5f8ec497b7005e08025333c3e6b032a5c0d0597332e3bcc0153e121a842c"}
Nov 03 22:00:26.408334 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.408225    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k" event={"ID":"05c6b884-526b-4acd-a645-a04b90fd35f1","Type":"ContainerDied","Data":"4b5d040f281c15d43ad30edfd55ec664c8a5b3c24357370d005bd517aa25f859"}
Nov 03 22:00:26.408403 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.408347    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k"
Nov 03 22:00:26.420310 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.419658    5077 generic.go:356] "Generic (PLEG): container finished" podID="2e8a26a6-b242-4a01-b19b-48595024ce2f" containerID="84317b2acf0e160a320615bf1e3da27a4da1871adc43f6b2d406a8e8110810ed" exitCode=0
Nov 03 22:00:26.420310 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.419775    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8" event={"ID":"2e8a26a6-b242-4a01-b19b-48595024ce2f","Type":"ContainerDied","Data":"84317b2acf0e160a320615bf1e3da27a4da1871adc43f6b2d406a8e8110810ed"}
Nov 03 22:00:26.420310 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.419820    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8" event={"ID":"2e8a26a6-b242-4a01-b19b-48595024ce2f","Type":"ContainerDied","Data":"dda047031c263059dc1f3dbb13be04da33202e5fd23c958ff5799da1191c0c9b"}
Nov 03 22:00:26.420310 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.419895    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8"
Nov 03 22:00:26.421963 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.421934    5077 scope.go:122] "RemoveContainer" containerID="b83c5f8ec497b7005e08025333c3e6b032a5c0d0597332e3bcc0153e121a842c"
Nov 03 22:00:26.432654 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.432628    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8f6bb67b9-7k7fc"]
Nov 03 22:00:26.438292 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.438228    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8f6bb67b9-7k7fc"]
Nov 03 22:00:26.445514 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.445492    5077 scope.go:122] "RemoveContainer" containerID="b83c5f8ec497b7005e08025333c3e6b032a5c0d0597332e3bcc0153e121a842c"
Nov 03 22:00:26.446057 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:00:26.446025    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b83c5f8ec497b7005e08025333c3e6b032a5c0d0597332e3bcc0153e121a842c\": container with ID starting with b83c5f8ec497b7005e08025333c3e6b032a5c0d0597332e3bcc0153e121a842c not found: ID does not exist" containerID="b83c5f8ec497b7005e08025333c3e6b032a5c0d0597332e3bcc0153e121a842c"
Nov 03 22:00:26.446155 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.446070    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b83c5f8ec497b7005e08025333c3e6b032a5c0d0597332e3bcc0153e121a842c"} err="failed to get container status \"b83c5f8ec497b7005e08025333c3e6b032a5c0d0597332e3bcc0153e121a842c\": rpc error: code = NotFound desc = could not find container \"b83c5f8ec497b7005e08025333c3e6b032a5c0d0597332e3bcc0153e121a842c\": container with ID starting with b83c5f8ec497b7005e08025333c3e6b032a5c0d0597332e3bcc0153e121a842c not found: ID does not exist"
Nov 03 22:00:26.446155 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.446112    5077 scope.go:122] "RemoveContainer" containerID="84317b2acf0e160a320615bf1e3da27a4da1871adc43f6b2d406a8e8110810ed"
Nov 03 22:00:26.453062 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.452069    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k"]
Nov 03 22:00:26.461567 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.461542    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-53a2cb-6f648d47ff-gqr2k"]
Nov 03 22:00:26.464097 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.464076    5077 scope.go:122] "RemoveContainer" containerID="84317b2acf0e160a320615bf1e3da27a4da1871adc43f6b2d406a8e8110810ed"
Nov 03 22:00:26.464552 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:00:26.464527    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84317b2acf0e160a320615bf1e3da27a4da1871adc43f6b2d406a8e8110810ed\": container with ID starting with 84317b2acf0e160a320615bf1e3da27a4da1871adc43f6b2d406a8e8110810ed not found: ID does not exist" containerID="84317b2acf0e160a320615bf1e3da27a4da1871adc43f6b2d406a8e8110810ed"
Nov 03 22:00:26.464733 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.464698    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84317b2acf0e160a320615bf1e3da27a4da1871adc43f6b2d406a8e8110810ed"} err="failed to get container status \"84317b2acf0e160a320615bf1e3da27a4da1871adc43f6b2d406a8e8110810ed\": rpc error: code = NotFound desc = could not find container \"84317b2acf0e160a320615bf1e3da27a4da1871adc43f6b2d406a8e8110810ed\": container with ID starting with 84317b2acf0e160a320615bf1e3da27a4da1871adc43f6b2d406a8e8110810ed not found: ID does not exist"
Nov 03 22:00:26.477742 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.477711    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8"]
Nov 03 22:00:26.485133 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.485100    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-53a2cb-6f75c7ddcd-jptq8"]
Nov 03 22:00:26.741343 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.741308    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="05c6b884-526b-4acd-a645-a04b90fd35f1" path="/var/lib/kubelet/pods/05c6b884-526b-4acd-a645-a04b90fd35f1/volumes"
Nov 03 22:00:26.741928 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.741902    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e8a26a6-b242-4a01-b19b-48595024ce2f" path="/var/lib/kubelet/pods/2e8a26a6-b242-4a01-b19b-48595024ce2f/volumes"
Nov 03 22:00:26.742495 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:26.742475    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="da6cd283-1c72-4bb9-9638-09c359a2730b" path="/var/lib/kubelet/pods/da6cd283-1c72-4bb9-9638-09c359a2730b/volumes"
Nov 03 22:00:27.304276 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.303502    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8f6bb67b9-v6sx7"]
Nov 03 22:00:27.336361 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.336327    5077 cpu_manager.go:414] "containerMap: removing container" podUID="05c6b884-526b-4acd-a645-a04b90fd35f1" containerName="payload-pre-processing"
Nov 03 22:00:27.336642 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.336621    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="05c6b884-526b-4acd-a645-a04b90fd35f1" containerName="payload-pre-processing"
Nov 03 22:00:27.336852 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.336837    5077 cpu_manager.go:414] "containerMap: removing container" podUID="da6cd283-1c72-4bb9-9638-09c359a2730b" containerName="manager"
Nov 03 22:00:27.336978 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.336964    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="da6cd283-1c72-4bb9-9638-09c359a2730b" containerName="manager"
Nov 03 22:00:27.337123 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.337110    5077 cpu_manager.go:414] "containerMap: removing container" podUID="2e8a26a6-b242-4a01-b19b-48595024ce2f" containerName="payload-processing"
Nov 03 22:00:27.337222 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.337209    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e8a26a6-b242-4a01-b19b-48595024ce2f" containerName="payload-processing"
Nov 03 22:00:27.337716 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.337695    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e8a26a6-b242-4a01-b19b-48595024ce2f" containerName="payload-processing"
Nov 03 22:00:27.337877 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.337863    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="05c6b884-526b-4acd-a645-a04b90fd35f1" containerName="payload-pre-processing"
Nov 03 22:00:27.337999 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.337986    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="da6cd283-1c72-4bb9-9638-09c359a2730b" containerName="manager"
Nov 03 22:00:27.398529 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.398491    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f6bb67b9-v6sx7"]
Nov 03 22:00:27.399234 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.399211    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f6bb67b9-v6sx7"
Nov 03 22:00:27.450394 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.448909    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Nov 03 22:00:27.450394 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.448993    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tv22x\""
Nov 03 22:00:27.450394 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.449092    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Nov 03 22:00:27.450394 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.449180    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Nov 03 22:00:27.506297 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.501352    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnlpp\" (UniqueName: \"kubernetes.io/projected/e529fae2-15a1-4e48-b772-0d0692c3aedb-kube-api-access-gnlpp\") pod \"maas-controller-8f6bb67b9-v6sx7\" (UID: \"e529fae2-15a1-4e48-b772-0d0692c3aedb\") " pod="opendatahub/maas-controller-8f6bb67b9-v6sx7"
Nov 03 22:00:27.506297 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.501477    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e529fae2-15a1-4e48-b772-0d0692c3aedb-webhook-cert\") pod \"maas-controller-8f6bb67b9-v6sx7\" (UID: \"e529fae2-15a1-4e48-b772-0d0692c3aedb\") " pod="opendatahub/maas-controller-8f6bb67b9-v6sx7"
Nov 03 22:00:27.506297 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.501514    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e529fae2-15a1-4e48-b772-0d0692c3aedb-metrics-certs\") pod \"maas-controller-8f6bb67b9-v6sx7\" (UID: \"e529fae2-15a1-4e48-b772-0d0692c3aedb\") " pod="opendatahub/maas-controller-8f6bb67b9-v6sx7"
Nov 03 22:00:27.605273 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.602533    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e529fae2-15a1-4e48-b772-0d0692c3aedb-webhook-cert\") pod \"maas-controller-8f6bb67b9-v6sx7\" (UID: \"e529fae2-15a1-4e48-b772-0d0692c3aedb\") " pod="opendatahub/maas-controller-8f6bb67b9-v6sx7"
Nov 03 22:00:27.605273 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.602591    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e529fae2-15a1-4e48-b772-0d0692c3aedb-metrics-certs\") pod \"maas-controller-8f6bb67b9-v6sx7\" (UID: \"e529fae2-15a1-4e48-b772-0d0692c3aedb\") " pod="opendatahub/maas-controller-8f6bb67b9-v6sx7"
Nov 03 22:00:27.605273 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.602709    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnlpp\" (UniqueName: \"kubernetes.io/projected/e529fae2-15a1-4e48-b772-0d0692c3aedb-kube-api-access-gnlpp\") pod \"maas-controller-8f6bb67b9-v6sx7\" (UID: \"e529fae2-15a1-4e48-b772-0d0692c3aedb\") " pod="opendatahub/maas-controller-8f6bb67b9-v6sx7"
Nov 03 22:00:27.634272 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.617973    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnlpp\" (UniqueName: \"kubernetes.io/projected/e529fae2-15a1-4e48-b772-0d0692c3aedb-kube-api-access-gnlpp\") pod \"maas-controller-8f6bb67b9-v6sx7\" (UID: \"e529fae2-15a1-4e48-b772-0d0692c3aedb\") " pod="opendatahub/maas-controller-8f6bb67b9-v6sx7"
Nov 03 22:00:27.674270 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.668111    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e529fae2-15a1-4e48-b772-0d0692c3aedb-webhook-cert\") pod \"maas-controller-8f6bb67b9-v6sx7\" (UID: \"e529fae2-15a1-4e48-b772-0d0692c3aedb\") " pod="opendatahub/maas-controller-8f6bb67b9-v6sx7"
Nov 03 22:00:27.674270 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.668675    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e529fae2-15a1-4e48-b772-0d0692c3aedb-metrics-certs\") pod \"maas-controller-8f6bb67b9-v6sx7\" (UID: \"e529fae2-15a1-4e48-b772-0d0692c3aedb\") " pod="opendatahub/maas-controller-8f6bb67b9-v6sx7"
Nov 03 22:00:27.855238 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:27.855205    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f6bb67b9-v6sx7"
Nov 03 22:00:28.810810 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:28.795820    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-wbrrh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 22:00:28.810810 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:28.795897    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh" podUID="3d061d55-2d2d-4686-a694-4b2f1f7e4b35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 22:00:28.862388 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:28.843487    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-f74lr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 22:00:28.862388 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:28.843605    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr" podUID="45431ac6-acc8-449c-8ed0-27975d792116" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 22:00:28.863942 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:28.863806    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-j4nv8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 22:00:28.863942 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:28.863865    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8" podUID="9a556d4c-2e33-47b3-9d99-25d4f88acfd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 22:00:28.949612 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:28.949566    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f6bb67b9-v6sx7"]
Nov 03 22:00:29.673385 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.673357    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:29.701509 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.701480    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f6bb67b9-v6sx7" event={"ID":"e529fae2-15a1-4e48-b772-0d0692c3aedb","Type":"ContainerStarted","Data":"57f588e5e612cb92a9c88d4693536ff84dd2a6800bbe2f1233a0d343d97ccfad"}
Nov 03 22:00:29.702385 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.702363    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8f6bb67b9-v6sx7"
Nov 03 22:00:29.702532 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.702407    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f6bb67b9-v6sx7" event={"ID":"e529fae2-15a1-4e48-b772-0d0692c3aedb","Type":"ContainerStarted","Data":"c0106e7aa5ef10ce2f8c2c2c3355557bbc11d83c8fd0b35fc98251b268655a69"}
Nov 03 22:00:29.703845 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.703820    5077 generic.go:356] "Generic (PLEG): container finished" podID="4cd5d43d-9b28-446f-8df0-2e4da39245e8" containerID="62b1d6ed4a2bba55ace09f33e66ce2f1d4187054c5d55c9e6f470c947760c31a" exitCode=0
Nov 03 22:00:29.703983 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.703859    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"
Nov 03 22:00:29.703983 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.703879    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5" event={"ID":"4cd5d43d-9b28-446f-8df0-2e4da39245e8","Type":"ContainerDied","Data":"62b1d6ed4a2bba55ace09f33e66ce2f1d4187054c5d55c9e6f470c947760c31a"}
Nov 03 22:00:29.703983 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.703917    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5" event={"ID":"4cd5d43d-9b28-446f-8df0-2e4da39245e8","Type":"ContainerDied","Data":"f9b5d5a94bfdad48b125104d4bb5fc3b5b6213b02a0e41718c6817d9084c3312"}
Nov 03 22:00:29.703983 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.703943    5077 scope.go:122] "RemoveContainer" containerID="62b1d6ed4a2bba55ace09f33e66ce2f1d4187054c5d55c9e6f470c947760c31a"
Nov 03 22:00:29.714352 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.714334    5077 scope.go:122] "RemoveContainer" containerID="62b1d6ed4a2bba55ace09f33e66ce2f1d4187054c5d55c9e6f470c947760c31a"
Nov 03 22:00:29.714661 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:00:29.714637    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62b1d6ed4a2bba55ace09f33e66ce2f1d4187054c5d55c9e6f470c947760c31a\": container with ID starting with 62b1d6ed4a2bba55ace09f33e66ce2f1d4187054c5d55c9e6f470c947760c31a not found: ID does not exist" containerID="62b1d6ed4a2bba55ace09f33e66ce2f1d4187054c5d55c9e6f470c947760c31a"
Nov 03 22:00:29.714720 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.714675    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62b1d6ed4a2bba55ace09f33e66ce2f1d4187054c5d55c9e6f470c947760c31a"} err="failed to get container status \"62b1d6ed4a2bba55ace09f33e66ce2f1d4187054c5d55c9e6f470c947760c31a\": rpc error: code = NotFound desc = could not find container \"62b1d6ed4a2bba55ace09f33e66ce2f1d4187054c5d55c9e6f470c947760c31a\": container with ID starting with 62b1d6ed4a2bba55ace09f33e66ce2f1d4187054c5d55c9e6f470c947760c31a not found: ID does not exist"
Nov 03 22:00:29.728549 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.728496    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-8f6bb67b9-v6sx7" podStartSLOduration=2.1294275320000002 podStartE2EDuration="2.728481484s" totalImagesPullingTime="599.053952ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:00:29.724547467 +0000 UTC m=+923.128208898" watchObservedRunningTime="2026-11-03 22:00:29.728481484 +0000 UTC m=+923.132142914"
Nov 03 22:00:29.797795 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.797764    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-token\" (UniqueName: \"kubernetes.io/projected/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-token\") pod \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") "
Nov 03 22:00:29.798001 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.797817    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-credential-socket\") pod \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") "
Nov 03 22:00:29.798001 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.797862    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4cd5d43d-9b28-446f-8df0-2e4da39245e8-kube-api-access-kfbg4\" (UniqueName: \"kubernetes.io/projected/4cd5d43d-9b28-446f-8df0-2e4da39245e8-kube-api-access-kfbg4\") pod \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") "
Nov 03 22:00:29.798001 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.797974    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istiod-ca-cert\") pod \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") "
Nov 03 22:00:29.798179 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.798053    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-workload-socket\") pod \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") "
Nov 03 22:00:29.798179 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.798101    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-podinfo\") pod \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") "
Nov 03 22:00:29.798179 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.798146    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-workload-certs\") pod \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") "
Nov 03 22:00:29.798368 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.798194    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-envoy\") pod \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") "
Nov 03 22:00:29.798368 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.798180    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-credential-socket" pod "4cd5d43d-9b28-446f-8df0-2e4da39245e8" (UID: "4cd5d43d-9b28-446f-8df0-2e4da39245e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:29.798368 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.798233    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-data\") pod \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\" (UID: \"4cd5d43d-9b28-446f-8df0-2e4da39245e8\") "
Nov 03 22:00:29.798519 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.798431    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istiod-ca-cert" pod "4cd5d43d-9b28-446f-8df0-2e4da39245e8" (UID: "4cd5d43d-9b28-446f-8df0-2e4da39245e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 22:00:29.798698 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.798638    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-workload-socket" pod "4cd5d43d-9b28-446f-8df0-2e4da39245e8" (UID: "4cd5d43d-9b28-446f-8df0-2e4da39245e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:29.798698 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.798652    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-data" pod "4cd5d43d-9b28-446f-8df0-2e4da39245e8" (UID: "4cd5d43d-9b28-446f-8df0-2e4da39245e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:29.798698 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.798676    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-workload-certs" pod "4cd5d43d-9b28-446f-8df0-2e4da39245e8" (UID: "4cd5d43d-9b28-446f-8df0-2e4da39245e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:29.799010 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.798990    5077 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istiod-ca-cert\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:29.799073 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.799016    5077 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-workload-socket\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:29.799073 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.799032    5077 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-workload-certs\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:29.799073 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.799045    5077 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-data\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:29.799073 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.799060    5077 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-credential-socket\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:29.800411 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.800318    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-token" pod "4cd5d43d-9b28-446f-8df0-2e4da39245e8" (UID: "4cd5d43d-9b28-446f-8df0-2e4da39245e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:00:29.800411 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.800388    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cd5d43d-9b28-446f-8df0-2e4da39245e8-kube-api-access-kfbg4" pod "4cd5d43d-9b28-446f-8df0-2e4da39245e8" (UID: "4cd5d43d-9b28-446f-8df0-2e4da39245e8"). InnerVolumeSpecName "kube-api-access-kfbg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:00:29.800785 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.800767    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-podinfo" pod "4cd5d43d-9b28-446f-8df0-2e4da39245e8" (UID: "4cd5d43d-9b28-446f-8df0-2e4da39245e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 22:00:29.801092 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.801074    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-envoy" pod "4cd5d43d-9b28-446f-8df0-2e4da39245e8" (UID: "4cd5d43d-9b28-446f-8df0-2e4da39245e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:29.899792 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.899713    5077 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-token\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:29.899792 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.899748    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfbg4\" (UniqueName: \"kubernetes.io/projected/4cd5d43d-9b28-446f-8df0-2e4da39245e8-kube-api-access-kfbg4\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:29.899792 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.899763    5077 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-podinfo\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:29.899792 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:29.899776    5077 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cd5d43d-9b28-446f-8df0-2e4da39245e8-istio-envoy\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:29.932899 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:00:29.932857    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:00:30.030819 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:30.030792    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"]
Nov 03 22:00:30.035094 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:30.035066    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-53a2cb-openshift-default-7fc9bd965c-zh4x5"]
Nov 03 22:00:30.734867 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:30.734835    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4cd5d43d-9b28-446f-8df0-2e4da39245e8" path="/var/lib/kubelet/pods/4cd5d43d-9b28-446f-8df0-2e4da39245e8/volumes"
Nov 03 22:00:41.717885 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:41.717853    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8f6bb67b9-v6sx7"
Nov 03 22:00:59.211556 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.211458    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8f6bb67b9-v6sx7"]
Nov 03 22:00:59.212150 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.211705    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-8f6bb67b9-v6sx7" podUID="e529fae2-15a1-4e48-b772-0d0692c3aedb" containerName="manager" containerID="cri-o://57f588e5e612cb92a9c88d4693536ff84dd2a6800bbe2f1233a0d343d97ccfad" gracePeriod=30
Nov 03 22:00:59.463169 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.463107    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f6bb67b9-v6sx7"
Nov 03 22:00:59.478063 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.478038    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e529fae2-15a1-4e48-b772-0d0692c3aedb-metrics-certs\" (UniqueName: \"kubernetes.io/secret/e529fae2-15a1-4e48-b772-0d0692c3aedb-metrics-certs\") pod \"e529fae2-15a1-4e48-b772-0d0692c3aedb\" (UID: \"e529fae2-15a1-4e48-b772-0d0692c3aedb\") "
Nov 03 22:00:59.478220 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.478077    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e529fae2-15a1-4e48-b772-0d0692c3aedb-kube-api-access-gnlpp\" (UniqueName: \"kubernetes.io/projected/e529fae2-15a1-4e48-b772-0d0692c3aedb-kube-api-access-gnlpp\") pod \"e529fae2-15a1-4e48-b772-0d0692c3aedb\" (UID: \"e529fae2-15a1-4e48-b772-0d0692c3aedb\") "
Nov 03 22:00:59.478220 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.478178    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e529fae2-15a1-4e48-b772-0d0692c3aedb-webhook-cert\" (UniqueName: \"kubernetes.io/secret/e529fae2-15a1-4e48-b772-0d0692c3aedb-webhook-cert\") pod \"e529fae2-15a1-4e48-b772-0d0692c3aedb\" (UID: \"e529fae2-15a1-4e48-b772-0d0692c3aedb\") "
Nov 03 22:00:59.480389 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.480359    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e529fae2-15a1-4e48-b772-0d0692c3aedb-metrics-certs" pod "e529fae2-15a1-4e48-b772-0d0692c3aedb" (UID: "e529fae2-15a1-4e48-b772-0d0692c3aedb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 22:00:59.480486 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.480405    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e529fae2-15a1-4e48-b772-0d0692c3aedb-kube-api-access-gnlpp" pod "e529fae2-15a1-4e48-b772-0d0692c3aedb" (UID: "e529fae2-15a1-4e48-b772-0d0692c3aedb"). InnerVolumeSpecName "kube-api-access-gnlpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:00:59.480486 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.480471    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e529fae2-15a1-4e48-b772-0d0692c3aedb-webhook-cert" pod "e529fae2-15a1-4e48-b772-0d0692c3aedb" (UID: "e529fae2-15a1-4e48-b772-0d0692c3aedb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 22:00:59.579672 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.579642    5077 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e529fae2-15a1-4e48-b772-0d0692c3aedb-metrics-certs\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:59.579672 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.579670    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnlpp\" (UniqueName: \"kubernetes.io/projected/e529fae2-15a1-4e48-b772-0d0692c3aedb-kube-api-access-gnlpp\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:59.579874 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.579682    5077 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e529fae2-15a1-4e48-b772-0d0692c3aedb-webhook-cert\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:00:59.879269 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.879208    5077 generic.go:356] "Generic (PLEG): container finished" podID="e529fae2-15a1-4e48-b772-0d0692c3aedb" containerID="57f588e5e612cb92a9c88d4693536ff84dd2a6800bbe2f1233a0d343d97ccfad" exitCode=0
Nov 03 22:00:59.879435 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.879284    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f6bb67b9-v6sx7"
Nov 03 22:00:59.879435 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.879299    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f6bb67b9-v6sx7" event={"ID":"e529fae2-15a1-4e48-b772-0d0692c3aedb","Type":"ContainerDied","Data":"57f588e5e612cb92a9c88d4693536ff84dd2a6800bbe2f1233a0d343d97ccfad"}
Nov 03 22:00:59.879435 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.879360    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f6bb67b9-v6sx7" event={"ID":"e529fae2-15a1-4e48-b772-0d0692c3aedb","Type":"ContainerDied","Data":"c0106e7aa5ef10ce2f8c2c2c3355557bbc11d83c8fd0b35fc98251b268655a69"}
Nov 03 22:00:59.879435 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.879390    5077 scope.go:122] "RemoveContainer" containerID="57f588e5e612cb92a9c88d4693536ff84dd2a6800bbe2f1233a0d343d97ccfad"
Nov 03 22:00:59.889321 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.889305    5077 scope.go:122] "RemoveContainer" containerID="57f588e5e612cb92a9c88d4693536ff84dd2a6800bbe2f1233a0d343d97ccfad"
Nov 03 22:00:59.889594 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:00:59.889576    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57f588e5e612cb92a9c88d4693536ff84dd2a6800bbe2f1233a0d343d97ccfad\": container with ID starting with 57f588e5e612cb92a9c88d4693536ff84dd2a6800bbe2f1233a0d343d97ccfad not found: ID does not exist" containerID="57f588e5e612cb92a9c88d4693536ff84dd2a6800bbe2f1233a0d343d97ccfad"
Nov 03 22:00:59.889651 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.889602    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57f588e5e612cb92a9c88d4693536ff84dd2a6800bbe2f1233a0d343d97ccfad"} err="failed to get container status \"57f588e5e612cb92a9c88d4693536ff84dd2a6800bbe2f1233a0d343d97ccfad\": rpc error: code = NotFound desc = could not find container \"57f588e5e612cb92a9c88d4693536ff84dd2a6800bbe2f1233a0d343d97ccfad\": container with ID starting with 57f588e5e612cb92a9c88d4693536ff84dd2a6800bbe2f1233a0d343d97ccfad not found: ID does not exist"
Nov 03 22:00:59.902994 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.902968    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8f6bb67b9-v6sx7"]
Nov 03 22:00:59.906691 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:00:59.906661    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8f6bb67b9-v6sx7"]
Nov 03 22:00:59.926710 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:00:59.926680    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:01:00.735272 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:00.735224    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e529fae2-15a1-4e48-b772-0d0692c3aedb" path="/var/lib/kubelet/pods/e529fae2-15a1-4e48-b772-0d0692c3aedb/volumes"
Nov 03 22:01:01.140092 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.140058    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8f6bb67b9-scb4p"]
Nov 03 22:01:01.140614 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.140597    5077 cpu_manager.go:414] "containerMap: removing container" podUID="4cd5d43d-9b28-446f-8df0-2e4da39245e8" containerName="istio-proxy"
Nov 03 22:01:01.140673 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.140616    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4cd5d43d-9b28-446f-8df0-2e4da39245e8" containerName="istio-proxy"
Nov 03 22:01:01.140673 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.140634    5077 cpu_manager.go:414] "containerMap: removing container" podUID="e529fae2-15a1-4e48-b772-0d0692c3aedb" containerName="manager"
Nov 03 22:01:01.140673 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.140639    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e529fae2-15a1-4e48-b772-0d0692c3aedb" containerName="manager"
Nov 03 22:01:01.140766 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.140718    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="4cd5d43d-9b28-446f-8df0-2e4da39245e8" containerName="istio-proxy"
Nov 03 22:01:01.140766 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.140727    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="e529fae2-15a1-4e48-b772-0d0692c3aedb" containerName="manager"
Nov 03 22:01:01.145230 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.145214    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f6bb67b9-scb4p"
Nov 03 22:01:01.151625 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.151573    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Nov 03 22:01:01.152772 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.152565    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Nov 03 22:01:01.152845 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.152806    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tv22x\""
Nov 03 22:01:01.152845 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.152813    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Nov 03 22:01:01.155044 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.155018    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f6bb67b9-scb4p"]
Nov 03 22:01:01.195196 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.195168    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab73c329-b80c-4253-be63-15748b8d2442-webhook-cert\") pod \"maas-controller-8f6bb67b9-scb4p\" (UID: \"ab73c329-b80c-4253-be63-15748b8d2442\") " pod="opendatahub/maas-controller-8f6bb67b9-scb4p"
Nov 03 22:01:01.195367 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.195227    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab73c329-b80c-4253-be63-15748b8d2442-metrics-certs\") pod \"maas-controller-8f6bb67b9-scb4p\" (UID: \"ab73c329-b80c-4253-be63-15748b8d2442\") " pod="opendatahub/maas-controller-8f6bb67b9-scb4p"
Nov 03 22:01:01.195414 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.195380    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qc6c\" (UniqueName: \"kubernetes.io/projected/ab73c329-b80c-4253-be63-15748b8d2442-kube-api-access-8qc6c\") pod \"maas-controller-8f6bb67b9-scb4p\" (UID: \"ab73c329-b80c-4253-be63-15748b8d2442\") " pod="opendatahub/maas-controller-8f6bb67b9-scb4p"
Nov 03 22:01:01.296183 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.296102    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qc6c\" (UniqueName: \"kubernetes.io/projected/ab73c329-b80c-4253-be63-15748b8d2442-kube-api-access-8qc6c\") pod \"maas-controller-8f6bb67b9-scb4p\" (UID: \"ab73c329-b80c-4253-be63-15748b8d2442\") " pod="opendatahub/maas-controller-8f6bb67b9-scb4p"
Nov 03 22:01:01.296418 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.296231    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab73c329-b80c-4253-be63-15748b8d2442-webhook-cert\") pod \"maas-controller-8f6bb67b9-scb4p\" (UID: \"ab73c329-b80c-4253-be63-15748b8d2442\") " pod="opendatahub/maas-controller-8f6bb67b9-scb4p"
Nov 03 22:01:01.296418 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.296331    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab73c329-b80c-4253-be63-15748b8d2442-metrics-certs\") pod \"maas-controller-8f6bb67b9-scb4p\" (UID: \"ab73c329-b80c-4253-be63-15748b8d2442\") " pod="opendatahub/maas-controller-8f6bb67b9-scb4p"
Nov 03 22:01:01.298818 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.298789    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab73c329-b80c-4253-be63-15748b8d2442-metrics-certs\") pod \"maas-controller-8f6bb67b9-scb4p\" (UID: \"ab73c329-b80c-4253-be63-15748b8d2442\") " pod="opendatahub/maas-controller-8f6bb67b9-scb4p"
Nov 03 22:01:01.298934 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.298899    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab73c329-b80c-4253-be63-15748b8d2442-webhook-cert\") pod \"maas-controller-8f6bb67b9-scb4p\" (UID: \"ab73c329-b80c-4253-be63-15748b8d2442\") " pod="opendatahub/maas-controller-8f6bb67b9-scb4p"
Nov 03 22:01:01.308399 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.308365    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qc6c\" (UniqueName: \"kubernetes.io/projected/ab73c329-b80c-4253-be63-15748b8d2442-kube-api-access-8qc6c\") pod \"maas-controller-8f6bb67b9-scb4p\" (UID: \"ab73c329-b80c-4253-be63-15748b8d2442\") " pod="opendatahub/maas-controller-8f6bb67b9-scb4p"
Nov 03 22:01:01.459496 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.459407    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f6bb67b9-scb4p"
Nov 03 22:01:01.739208 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.739182    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f6bb67b9-scb4p"]
Nov 03 22:01:01.741209 ip-10-0-128-183 kubenswrapper[5077]: W1103 22:01:01.741182    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab73c329_b80c_4253_be63_15748b8d2442.slice/crio-e2cb92a1d6fb72eff3c37c303187377e171db85ddd95f9abbfb415c16c443ef6 WatchSource:0}: Error finding container e2cb92a1d6fb72eff3c37c303187377e171db85ddd95f9abbfb415c16c443ef6: Status 404 returned error can't find the container with id e2cb92a1d6fb72eff3c37c303187377e171db85ddd95f9abbfb415c16c443ef6
Nov 03 22:01:01.742588 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.742571    5077 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 22:01:01.893285 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:01.893240    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f6bb67b9-scb4p" event={"ID":"ab73c329-b80c-4253-be63-15748b8d2442","Type":"ContainerStarted","Data":"e2cb92a1d6fb72eff3c37c303187377e171db85ddd95f9abbfb415c16c443ef6"}
Nov 03 22:01:02.901316 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:02.901284    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f6bb67b9-scb4p" event={"ID":"ab73c329-b80c-4253-be63-15748b8d2442","Type":"ContainerStarted","Data":"a400a32972789e6358dc36c2f75bc4a95ffb872fdbeb64eb6cafc9bace206b5c"}
Nov 03 22:01:02.901732 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:02.901416    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8f6bb67b9-scb4p"
Nov 03 22:01:02.923686 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:02.923637    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-8f6bb67b9-scb4p" podStartSLOduration=1.453394939 podStartE2EDuration="1.923624137s" totalImagesPullingTime="470.229198ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:01:02.922505124 +0000 UTC m=+956.326166556" watchObservedRunningTime="2026-11-03 22:01:02.923624137 +0000 UTC m=+956.327285567"
Nov 03 22:01:13.908653 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:01:13.908622    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8f6bb67b9-scb4p"
Nov 03 22:01:29.945847 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:01:29.945771    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:01:59.927144 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:01:59.927104    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:02:29.927839 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:02:29.927743    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:02:43.785393 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:02:43.785350    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-wbrrh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 22:02:43.829577 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:02:43.829526    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh" podUID="3d061d55-2d2d-4686-a694-4b2f1f7e4b35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 22:02:43.830358 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:02:43.793333    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-f74lr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 22:02:43.830558 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:02:43.830534    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr" podUID="45431ac6-acc8-449c-8ed0-27975d792116" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 22:02:43.877383 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:02:43.877341    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-j4nv8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 22:02:43.877715 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:02:43.877679    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8" podUID="9a556d4c-2e33-47b3-9d99-25d4f88acfd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 22:02:59.925480 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:02:59.925433    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:03:29.941134 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:03:29.941086    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:03:59.925521 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:03:59.925441    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:04:07.082157 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:07.082124    5077 scope.go:122] "RemoveContainer" containerID="ab9aca32bbabe034c09fb723ae66c725c003fe63207b818e0d6010ab24906465"
Nov 03 22:04:29.930691 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:04:29.930654    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:04:55.297150 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:55.297107    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-w9lrd-jxl8h"]
Nov 03 22:04:55.301133 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:55.301106    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-w9lrd-jxl8h"
Nov 03 22:04:55.308109 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:55.308080    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5f6rr\""
Nov 03 22:04:55.310352 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:55.310316    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-w9lrd-jxl8h"]
Nov 03 22:04:55.378231 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:55.378194    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c66a68b-cfcb-4c04-91de-604994b1a6d3-service-ca-bundle\") pod \"periodic-gathering-w9lrd-jxl8h\" (UID: \"7c66a68b-cfcb-4c04-91de-604994b1a6d3\") " pod="openshift-insights/periodic-gathering-w9lrd-jxl8h"
Nov 03 22:04:55.378424 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:55.378264    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6h9b\" (UniqueName: \"kubernetes.io/projected/7c66a68b-cfcb-4c04-91de-604994b1a6d3-kube-api-access-d6h9b\") pod \"periodic-gathering-w9lrd-jxl8h\" (UID: \"7c66a68b-cfcb-4c04-91de-604994b1a6d3\") " pod="openshift-insights/periodic-gathering-w9lrd-jxl8h"
Nov 03 22:04:55.378424 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:55.378384    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c66a68b-cfcb-4c04-91de-604994b1a6d3-trusted-ca-bundle\") pod \"periodic-gathering-w9lrd-jxl8h\" (UID: \"7c66a68b-cfcb-4c04-91de-604994b1a6d3\") " pod="openshift-insights/periodic-gathering-w9lrd-jxl8h"
Nov 03 22:04:55.378529 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:55.378510    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/7c66a68b-cfcb-4c04-91de-604994b1a6d3-archives-path\") pod \"periodic-gathering-w9lrd-jxl8h\" (UID: \"7c66a68b-cfcb-4c04-91de-604994b1a6d3\") " pod="openshift-insights/periodic-gathering-w9lrd-jxl8h"
Nov 03 22:04:55.479531 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:55.479485    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c66a68b-cfcb-4c04-91de-604994b1a6d3-service-ca-bundle\") pod \"periodic-gathering-w9lrd-jxl8h\" (UID: \"7c66a68b-cfcb-4c04-91de-604994b1a6d3\") " pod="openshift-insights/periodic-gathering-w9lrd-jxl8h"
Nov 03 22:04:55.479734 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:55.479554    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6h9b\" (UniqueName: \"kubernetes.io/projected/7c66a68b-cfcb-4c04-91de-604994b1a6d3-kube-api-access-d6h9b\") pod \"periodic-gathering-w9lrd-jxl8h\" (UID: \"7c66a68b-cfcb-4c04-91de-604994b1a6d3\") " pod="openshift-insights/periodic-gathering-w9lrd-jxl8h"
Nov 03 22:04:55.479734 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:55.479598    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c66a68b-cfcb-4c04-91de-604994b1a6d3-trusted-ca-bundle\") pod \"periodic-gathering-w9lrd-jxl8h\" (UID: \"7c66a68b-cfcb-4c04-91de-604994b1a6d3\") " pod="openshift-insights/periodic-gathering-w9lrd-jxl8h"
Nov 03 22:04:55.479734 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:55.479674    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/7c66a68b-cfcb-4c04-91de-604994b1a6d3-archives-path\") pod \"periodic-gathering-w9lrd-jxl8h\" (UID: \"7c66a68b-cfcb-4c04-91de-604994b1a6d3\") " pod="openshift-insights/periodic-gathering-w9lrd-jxl8h"
Nov 03 22:04:55.480079 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:55.480051    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/7c66a68b-cfcb-4c04-91de-604994b1a6d3-archives-path\") pod \"periodic-gathering-w9lrd-jxl8h\" (UID: \"7c66a68b-cfcb-4c04-91de-604994b1a6d3\") " pod="openshift-insights/periodic-gathering-w9lrd-jxl8h"
Nov 03 22:04:55.480297 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:55.480274    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c66a68b-cfcb-4c04-91de-604994b1a6d3-service-ca-bundle\") pod \"periodic-gathering-w9lrd-jxl8h\" (UID: \"7c66a68b-cfcb-4c04-91de-604994b1a6d3\") " pod="openshift-insights/periodic-gathering-w9lrd-jxl8h"
Nov 03 22:04:55.480427 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:55.480409    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c66a68b-cfcb-4c04-91de-604994b1a6d3-trusted-ca-bundle\") pod \"periodic-gathering-w9lrd-jxl8h\" (UID: \"7c66a68b-cfcb-4c04-91de-604994b1a6d3\") " pod="openshift-insights/periodic-gathering-w9lrd-jxl8h"
Nov 03 22:04:55.491925 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:55.491899    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6h9b\" (UniqueName: \"kubernetes.io/projected/7c66a68b-cfcb-4c04-91de-604994b1a6d3-kube-api-access-d6h9b\") pod \"periodic-gathering-w9lrd-jxl8h\" (UID: \"7c66a68b-cfcb-4c04-91de-604994b1a6d3\") " pod="openshift-insights/periodic-gathering-w9lrd-jxl8h"
Nov 03 22:04:55.615693 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:55.615661    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-w9lrd-jxl8h"
Nov 03 22:04:55.896192 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:55.896160    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-w9lrd-jxl8h"]
Nov 03 22:04:55.897937 ip-10-0-128-183 kubenswrapper[5077]: W1103 22:04:55.897907    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c66a68b_cfcb_4c04_91de_604994b1a6d3.slice/crio-151ea9097e61b7f04bfe3d19b28a275587d2ef64dc39461f4bda4500a3d97d43 WatchSource:0}: Error finding container 151ea9097e61b7f04bfe3d19b28a275587d2ef64dc39461f4bda4500a3d97d43: Status 404 returned error can't find the container with id 151ea9097e61b7f04bfe3d19b28a275587d2ef64dc39461f4bda4500a3d97d43
Nov 03 22:04:56.717423 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:56.717384    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-w9lrd-jxl8h" event={"ID":"7c66a68b-cfcb-4c04-91de-604994b1a6d3","Type":"ContainerStarted","Data":"0899e431f194129da4a0c6aa05c805a82d32ed11726b16b31136c91f7f2a79b3"}
Nov 03 22:04:56.717963 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:56.717444    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-w9lrd-jxl8h" event={"ID":"7c66a68b-cfcb-4c04-91de-604994b1a6d3","Type":"ContainerStarted","Data":"151ea9097e61b7f04bfe3d19b28a275587d2ef64dc39461f4bda4500a3d97d43"}
Nov 03 22:04:56.739336 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:04:56.739275    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-w9lrd-jxl8h" podStartSLOduration=1.739241626 podStartE2EDuration="1.739241626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:04:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:04:56.736668032 +0000 UTC m=+1190.140329462" watchObservedRunningTime="2026-11-03 22:04:56.739241626 +0000 UTC m=+1190.142903056"
Nov 03 22:04:59.927066 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:04:59.927032    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:05:06.883416 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:06.883390    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pspgs_36598f65-5a1d-43e3-acc2-71c1e56f112c/console-operator/1.log"
Nov 03 22:05:06.886016 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:06.883626    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pspgs_36598f65-5a1d-43e3-acc2-71c1e56f112c/console-operator/1.log"
Nov 03 22:05:08.235415 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:08.235378    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"]
Nov 03 22:05:08.239114 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:08.239093    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"
Nov 03 22:05:08.255595 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:08.255557    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"]
Nov 03 22:05:08.273111 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:08.273084    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-94e879-serving-cert\""
Nov 03 22:05:08.341332 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:08.341290    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q75jh\" (UniqueName: \"kubernetes.io/projected/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-kube-api-access-q75jh\") pod \"maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv\" (UID: \"fdb26e17-ec50-4a4e-9e78-951eabe90fd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"
Nov 03 22:05:08.341550 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:08.341367    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv\" (UID: \"fdb26e17-ec50-4a4e-9e78-951eabe90fd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"
Nov 03 22:05:08.341550 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:08.341418    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv\" (UID: \"fdb26e17-ec50-4a4e-9e78-951eabe90fd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"
Nov 03 22:05:08.341550 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:08.341481    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-metrics-certs\") pod \"maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv\" (UID: \"fdb26e17-ec50-4a4e-9e78-951eabe90fd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"
Nov 03 22:05:08.442677 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:08.442645    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q75jh\" (UniqueName: \"kubernetes.io/projected/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-kube-api-access-q75jh\") pod \"maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv\" (UID: \"fdb26e17-ec50-4a4e-9e78-951eabe90fd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"
Nov 03 22:05:08.442876 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:08.442690    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv\" (UID: \"fdb26e17-ec50-4a4e-9e78-951eabe90fd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"
Nov 03 22:05:08.442876 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:08.442735    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv\" (UID: \"fdb26e17-ec50-4a4e-9e78-951eabe90fd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"
Nov 03 22:05:08.442876 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:08.442772    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-metrics-certs\") pod \"maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv\" (UID: \"fdb26e17-ec50-4a4e-9e78-951eabe90fd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"
Nov 03 22:05:08.443668 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:08.443637    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv\" (UID: \"fdb26e17-ec50-4a4e-9e78-951eabe90fd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"
Nov 03 22:05:08.445920 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:08.445893    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv\" (UID: \"fdb26e17-ec50-4a4e-9e78-951eabe90fd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"
Nov 03 22:05:08.446066 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:08.445953    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-metrics-certs\") pod \"maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv\" (UID: \"fdb26e17-ec50-4a4e-9e78-951eabe90fd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"
Nov 03 22:05:08.455226 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:08.455201    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q75jh\" (UniqueName: \"kubernetes.io/projected/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-kube-api-access-q75jh\") pod \"maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv\" (UID: \"fdb26e17-ec50-4a4e-9e78-951eabe90fd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"
Nov 03 22:05:08.560390 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:08.560362    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"
Nov 03 22:05:08.844322 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:08.844286    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"]
Nov 03 22:05:08.846581 ip-10-0-128-183 kubenswrapper[5077]: W1103 22:05:08.846556    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb26e17_ec50_4a4e_9e78_951eabe90fd9.slice/crio-c03455f59db7fb63d29b59f591459bbc7e56e38a888c432b48496f6ce0eb62f1 WatchSource:0}: Error finding container c03455f59db7fb63d29b59f591459bbc7e56e38a888c432b48496f6ce0eb62f1: Status 404 returned error can't find the container with id c03455f59db7fb63d29b59f591459bbc7e56e38a888c432b48496f6ce0eb62f1
Nov 03 22:05:09.798390 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:09.798290    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv" event={"ID":"fdb26e17-ec50-4a4e-9e78-951eabe90fd9","Type":"ContainerStarted","Data":"53e2dafacc0754d5223f66406227dc844a80f2f71999d4678a3ca5562423cf0d"}
Nov 03 22:05:09.798390 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:09.798353    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv" event={"ID":"fdb26e17-ec50-4a4e-9e78-951eabe90fd9","Type":"ContainerStarted","Data":"c03455f59db7fb63d29b59f591459bbc7e56e38a888c432b48496f6ce0eb62f1"}
Nov 03 22:05:09.798819 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:09.798409    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"
Nov 03 22:05:09.819527 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:09.819478    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv" podStartSLOduration=1.191709516 podStartE2EDuration="1.819463259s" totalImagesPullingTime="627.753743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:05:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:05:09.818064358 +0000 UTC m=+1203.221725789" watchObservedRunningTime="2026-11-03 22:05:09.819463259 +0000 UTC m=+1203.223124689"
Nov 03 22:05:15.810066 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:05:15.810037    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"
Nov 03 22:05:29.925893 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:05:29.925851    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:05:59.925804 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:05:59.925765    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:06:06.086334 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:06.086297    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"]
Nov 03 22:06:06.087140 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:06.087106    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv" podUID="fdb26e17-ec50-4a4e-9e78-951eabe90fd9" containerName="maas-api" containerID="cri-o://53e2dafacc0754d5223f66406227dc844a80f2f71999d4678a3ca5562423cf0d" gracePeriod=30
Nov 03 22:06:06.558311 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:06.558286    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"
Nov 03 22:06:06.619065 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:06.619024    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-maas-api-tls\") pod \"fdb26e17-ec50-4a4e-9e78-951eabe90fd9\" (UID: \"fdb26e17-ec50-4a4e-9e78-951eabe90fd9\") "
Nov 03 22:06:06.619065 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:06.619069    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-metrics-certs\" (UniqueName: \"kubernetes.io/secret/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-metrics-certs\") pod \"fdb26e17-ec50-4a4e-9e78-951eabe90fd9\" (UID: \"fdb26e17-ec50-4a4e-9e78-951eabe90fd9\") "
Nov 03 22:06:06.619369 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:06.619115    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-kube-api-access-q75jh\" (UniqueName: \"kubernetes.io/projected/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-kube-api-access-q75jh\") pod \"fdb26e17-ec50-4a4e-9e78-951eabe90fd9\" (UID: \"fdb26e17-ec50-4a4e-9e78-951eabe90fd9\") "
Nov 03 22:06:06.619369 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:06.619140    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-openshift-service-ca\") pod \"fdb26e17-ec50-4a4e-9e78-951eabe90fd9\" (UID: \"fdb26e17-ec50-4a4e-9e78-951eabe90fd9\") "
Nov 03 22:06:06.619654 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:06.619622    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-openshift-service-ca" pod "fdb26e17-ec50-4a4e-9e78-951eabe90fd9" (UID: "fdb26e17-ec50-4a4e-9e78-951eabe90fd9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 22:06:06.619788 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:06.619713    5077 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-openshift-service-ca\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:06:06.621804 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:06.621780    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-metrics-certs" pod "fdb26e17-ec50-4a4e-9e78-951eabe90fd9" (UID: "fdb26e17-ec50-4a4e-9e78-951eabe90fd9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 22:06:06.621980 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:06.621960    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-maas-api-tls" pod "fdb26e17-ec50-4a4e-9e78-951eabe90fd9" (UID: "fdb26e17-ec50-4a4e-9e78-951eabe90fd9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 22:06:06.622174 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:06.622148    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-kube-api-access-q75jh" pod "fdb26e17-ec50-4a4e-9e78-951eabe90fd9" (UID: "fdb26e17-ec50-4a4e-9e78-951eabe90fd9"). InnerVolumeSpecName "kube-api-access-q75jh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:06:06.720382 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:06.720348    5077 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-maas-api-tls\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:06:06.720382 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:06.720375    5077 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-metrics-certs\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:06:06.720650 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:06.720394    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q75jh\" (UniqueName: \"kubernetes.io/projected/fdb26e17-ec50-4a4e-9e78-951eabe90fd9-kube-api-access-q75jh\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:06:07.143206 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:07.143171    5077 generic.go:356] "Generic (PLEG): container finished" podID="fdb26e17-ec50-4a4e-9e78-951eabe90fd9" containerID="53e2dafacc0754d5223f66406227dc844a80f2f71999d4678a3ca5562423cf0d" exitCode=0
Nov 03 22:06:07.143206 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:07.143214    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv" event={"ID":"fdb26e17-ec50-4a4e-9e78-951eabe90fd9","Type":"ContainerDied","Data":"53e2dafacc0754d5223f66406227dc844a80f2f71999d4678a3ca5562423cf0d"}
Nov 03 22:06:07.143789 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:07.143227    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"
Nov 03 22:06:07.143789 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:07.143275    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv" event={"ID":"fdb26e17-ec50-4a4e-9e78-951eabe90fd9","Type":"ContainerDied","Data":"c03455f59db7fb63d29b59f591459bbc7e56e38a888c432b48496f6ce0eb62f1"}
Nov 03 22:06:07.143789 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:07.143301    5077 scope.go:122] "RemoveContainer" containerID="53e2dafacc0754d5223f66406227dc844a80f2f71999d4678a3ca5562423cf0d"
Nov 03 22:06:07.153985 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:07.153966    5077 scope.go:122] "RemoveContainer" containerID="53e2dafacc0754d5223f66406227dc844a80f2f71999d4678a3ca5562423cf0d"
Nov 03 22:06:07.154280 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:06:07.154241    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53e2dafacc0754d5223f66406227dc844a80f2f71999d4678a3ca5562423cf0d\": container with ID starting with 53e2dafacc0754d5223f66406227dc844a80f2f71999d4678a3ca5562423cf0d not found: ID does not exist" containerID="53e2dafacc0754d5223f66406227dc844a80f2f71999d4678a3ca5562423cf0d"
Nov 03 22:06:07.154349 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:07.154296    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53e2dafacc0754d5223f66406227dc844a80f2f71999d4678a3ca5562423cf0d"} err="failed to get container status \"53e2dafacc0754d5223f66406227dc844a80f2f71999d4678a3ca5562423cf0d\": rpc error: code = NotFound desc = could not find container \"53e2dafacc0754d5223f66406227dc844a80f2f71999d4678a3ca5562423cf0d\": container with ID starting with 53e2dafacc0754d5223f66406227dc844a80f2f71999d4678a3ca5562423cf0d not found: ID does not exist"
Nov 03 22:06:07.162273 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:07.162218    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"]
Nov 03 22:06:07.166500 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:07.166479    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-94e879-7bbbb6bf77-7qfnv"]
Nov 03 22:06:08.735893 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:08.735859    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fdb26e17-ec50-4a4e-9e78-951eabe90fd9" path="/var/lib/kubelet/pods/fdb26e17-ec50-4a4e-9e78-951eabe90fd9/volumes"
Nov 03 22:06:29.932691 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:06:29.932649    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:06:30.322330 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:30.322288    5077 generic.go:356] "Generic (PLEG): container finished" podID="7c66a68b-cfcb-4c04-91de-604994b1a6d3" containerID="0899e431f194129da4a0c6aa05c805a82d32ed11726b16b31136c91f7f2a79b3" exitCode=0
Nov 03 22:06:30.322536 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:30.322335    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-w9lrd-jxl8h" event={"ID":"7c66a68b-cfcb-4c04-91de-604994b1a6d3","Type":"ContainerDied","Data":"0899e431f194129da4a0c6aa05c805a82d32ed11726b16b31136c91f7f2a79b3"}
Nov 03 22:06:31.479090 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:31.479065    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-w9lrd-jxl8h"
Nov 03 22:06:31.544556 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:31.544526    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7c66a68b-cfcb-4c04-91de-604994b1a6d3-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c66a68b-cfcb-4c04-91de-604994b1a6d3-service-ca-bundle\") pod \"7c66a68b-cfcb-4c04-91de-604994b1a6d3\" (UID: \"7c66a68b-cfcb-4c04-91de-604994b1a6d3\") "
Nov 03 22:06:31.544725 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:31.544580    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7c66a68b-cfcb-4c04-91de-604994b1a6d3-kube-api-access-d6h9b\" (UniqueName: \"kubernetes.io/projected/7c66a68b-cfcb-4c04-91de-604994b1a6d3-kube-api-access-d6h9b\") pod \"7c66a68b-cfcb-4c04-91de-604994b1a6d3\" (UID: \"7c66a68b-cfcb-4c04-91de-604994b1a6d3\") "
Nov 03 22:06:31.544725 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:31.544666    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7c66a68b-cfcb-4c04-91de-604994b1a6d3-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c66a68b-cfcb-4c04-91de-604994b1a6d3-trusted-ca-bundle\") pod \"7c66a68b-cfcb-4c04-91de-604994b1a6d3\" (UID: \"7c66a68b-cfcb-4c04-91de-604994b1a6d3\") "
Nov 03 22:06:31.544830 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:31.544813    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c66a68b-cfcb-4c04-91de-604994b1a6d3-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/7c66a68b-cfcb-4c04-91de-604994b1a6d3-archives-path\") pod \"7c66a68b-cfcb-4c04-91de-604994b1a6d3\" (UID: \"7c66a68b-cfcb-4c04-91de-604994b1a6d3\") "
Nov 03 22:06:31.544975 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:31.544956    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c66a68b-cfcb-4c04-91de-604994b1a6d3-service-ca-bundle" pod "7c66a68b-cfcb-4c04-91de-604994b1a6d3" (UID: "7c66a68b-cfcb-4c04-91de-604994b1a6d3"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 22:06:31.545137 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:31.545109    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c66a68b-cfcb-4c04-91de-604994b1a6d3-trusted-ca-bundle" pod "7c66a68b-cfcb-4c04-91de-604994b1a6d3" (UID: "7c66a68b-cfcb-4c04-91de-604994b1a6d3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 22:06:31.545216 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:31.545178    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c66a68b-cfcb-4c04-91de-604994b1a6d3-archives-path" pod "7c66a68b-cfcb-4c04-91de-604994b1a6d3" (UID: "7c66a68b-cfcb-4c04-91de-604994b1a6d3"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:06:31.545314 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:31.545297    5077 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c66a68b-cfcb-4c04-91de-604994b1a6d3-trusted-ca-bundle\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:06:31.545542 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:31.545319    5077 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c66a68b-cfcb-4c04-91de-604994b1a6d3-service-ca-bundle\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:06:31.546953 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:31.546933    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c66a68b-cfcb-4c04-91de-604994b1a6d3-kube-api-access-d6h9b" pod "7c66a68b-cfcb-4c04-91de-604994b1a6d3" (UID: "7c66a68b-cfcb-4c04-91de-604994b1a6d3"). InnerVolumeSpecName "kube-api-access-d6h9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:06:31.646123 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:31.646031    5077 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/7c66a68b-cfcb-4c04-91de-604994b1a6d3-archives-path\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:06:31.646123 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:31.646062    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6h9b\" (UniqueName: \"kubernetes.io/projected/7c66a68b-cfcb-4c04-91de-604994b1a6d3-kube-api-access-d6h9b\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:06:32.334752 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:32.334723    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-w9lrd-jxl8h"
Nov 03 22:06:32.334955 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:32.334770    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-w9lrd-jxl8h" event={"ID":"7c66a68b-cfcb-4c04-91de-604994b1a6d3","Type":"ContainerDied","Data":"151ea9097e61b7f04bfe3d19b28a275587d2ef64dc39461f4bda4500a3d97d43"}
Nov 03 22:06:32.334955 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:32.334824    5077 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="151ea9097e61b7f04bfe3d19b28a275587d2ef64dc39461f4bda4500a3d97d43"
Nov 03 22:06:33.454203 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:33.454165    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc"]
Nov 03 22:06:33.455064 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:33.455028    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc" podUID="4eb24628-9a15-475b-922b-e0aa4280697d" containerName="manager" containerID="cri-o://8503634c706b524149d937f5d0ef232a7ef3258f1b34e19946b051c080e68d54" gracePeriod=10
Nov 03 22:06:33.717226 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:33.717159    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc"
Nov 03 22:06:33.868988 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:33.868955    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4eb24628-9a15-475b-922b-e0aa4280697d-kube-api-access-mcf8z\" (UniqueName: \"kubernetes.io/projected/4eb24628-9a15-475b-922b-e0aa4280697d-kube-api-access-mcf8z\") pod \"4eb24628-9a15-475b-922b-e0aa4280697d\" (UID: \"4eb24628-9a15-475b-922b-e0aa4280697d\") "
Nov 03 22:06:33.869271 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:33.869027    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4eb24628-9a15-475b-922b-e0aa4280697d-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4eb24628-9a15-475b-922b-e0aa4280697d-extensions-socket-volume\") pod \"4eb24628-9a15-475b-922b-e0aa4280697d\" (UID: \"4eb24628-9a15-475b-922b-e0aa4280697d\") "
Nov 03 22:06:33.869476 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:33.869453    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eb24628-9a15-475b-922b-e0aa4280697d-extensions-socket-volume" pod "4eb24628-9a15-475b-922b-e0aa4280697d" (UID: "4eb24628-9a15-475b-922b-e0aa4280697d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:06:33.871363 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:33.871332    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eb24628-9a15-475b-922b-e0aa4280697d-kube-api-access-mcf8z" pod "4eb24628-9a15-475b-922b-e0aa4280697d" (UID: "4eb24628-9a15-475b-922b-e0aa4280697d"). InnerVolumeSpecName "kube-api-access-mcf8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:06:33.970917 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:33.970830    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcf8z\" (UniqueName: \"kubernetes.io/projected/4eb24628-9a15-475b-922b-e0aa4280697d-kube-api-access-mcf8z\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:06:33.970917 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:33.970866    5077 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4eb24628-9a15-475b-922b-e0aa4280697d-extensions-socket-volume\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:06:34.349217 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:34.349179    5077 generic.go:356] "Generic (PLEG): container finished" podID="4eb24628-9a15-475b-922b-e0aa4280697d" containerID="8503634c706b524149d937f5d0ef232a7ef3258f1b34e19946b051c080e68d54" exitCode=0
Nov 03 22:06:34.349217 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:34.349219    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc" event={"ID":"4eb24628-9a15-475b-922b-e0aa4280697d","Type":"ContainerDied","Data":"8503634c706b524149d937f5d0ef232a7ef3258f1b34e19946b051c080e68d54"}
Nov 03 22:06:34.349514 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:34.349223    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc"
Nov 03 22:06:34.349514 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:34.349307    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc" event={"ID":"4eb24628-9a15-475b-922b-e0aa4280697d","Type":"ContainerDied","Data":"b8dd223974c7f17cbef383be5de117930fc84be11d752655a66b4d7ddfd20363"}
Nov 03 22:06:34.349514 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:34.349338    5077 scope.go:122] "RemoveContainer" containerID="8503634c706b524149d937f5d0ef232a7ef3258f1b34e19946b051c080e68d54"
Nov 03 22:06:34.359807 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:34.359782    5077 scope.go:122] "RemoveContainer" containerID="8503634c706b524149d937f5d0ef232a7ef3258f1b34e19946b051c080e68d54"
Nov 03 22:06:34.360074 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:06:34.360054    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8503634c706b524149d937f5d0ef232a7ef3258f1b34e19946b051c080e68d54\": container with ID starting with 8503634c706b524149d937f5d0ef232a7ef3258f1b34e19946b051c080e68d54 not found: ID does not exist" containerID="8503634c706b524149d937f5d0ef232a7ef3258f1b34e19946b051c080e68d54"
Nov 03 22:06:34.360125 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:34.360083    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8503634c706b524149d937f5d0ef232a7ef3258f1b34e19946b051c080e68d54"} err="failed to get container status \"8503634c706b524149d937f5d0ef232a7ef3258f1b34e19946b051c080e68d54\": rpc error: code = NotFound desc = could not find container \"8503634c706b524149d937f5d0ef232a7ef3258f1b34e19946b051c080e68d54\": container with ID starting with 8503634c706b524149d937f5d0ef232a7ef3258f1b34e19946b051c080e68d54 not found: ID does not exist"
Nov 03 22:06:34.372378 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:34.372355    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc"]
Nov 03 22:06:34.376964 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:34.376941    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-n6rqc"]
Nov 03 22:06:34.734843 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:06:34.734764    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4eb24628-9a15-475b-922b-e0aa4280697d" path="/var/lib/kubelet/pods/4eb24628-9a15-475b-922b-e0aa4280697d/volumes"
Nov 03 22:06:59.926615 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:06:59.926537    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:07:29.927469 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:07:29.927425    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:07:34.461072 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:34.461040    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-lvzzp"]
Nov 03 22:07:34.461559 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:34.461544    5077 cpu_manager.go:414] "containerMap: removing container" podUID="fdb26e17-ec50-4a4e-9e78-951eabe90fd9" containerName="maas-api"
Nov 03 22:07:34.461604 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:34.461561    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fdb26e17-ec50-4a4e-9e78-951eabe90fd9" containerName="maas-api"
Nov 03 22:07:34.461604 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:34.461573    5077 cpu_manager.go:414] "containerMap: removing container" podUID="7c66a68b-cfcb-4c04-91de-604994b1a6d3" containerName="insights-gathering"
Nov 03 22:07:34.461604 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:34.461578    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7c66a68b-cfcb-4c04-91de-604994b1a6d3" containerName="insights-gathering"
Nov 03 22:07:34.461706 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:34.461610    5077 cpu_manager.go:414] "containerMap: removing container" podUID="4eb24628-9a15-475b-922b-e0aa4280697d" containerName="manager"
Nov 03 22:07:34.461706 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:34.461615    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4eb24628-9a15-475b-922b-e0aa4280697d" containerName="manager"
Nov 03 22:07:34.461706 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:34.461702    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="4eb24628-9a15-475b-922b-e0aa4280697d" containerName="manager"
Nov 03 22:07:34.461803 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:34.461715    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="fdb26e17-ec50-4a4e-9e78-951eabe90fd9" containerName="maas-api"
Nov 03 22:07:34.461803 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:34.461724    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="7c66a68b-cfcb-4c04-91de-604994b1a6d3" containerName="insights-gathering"
Nov 03 22:07:34.465108 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:34.465089    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-lvzzp"
Nov 03 22:07:34.469101 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:34.469077    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x87xv\""
Nov 03 22:07:34.476823 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:34.476794    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-lvzzp"]
Nov 03 22:07:34.570582 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:34.570540    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98gr8\" (UniqueName: \"kubernetes.io/projected/2cf8aa60-6887-4243-a9b7-bb33143336df-kube-api-access-98gr8\") pod \"kuadrant-operator-controller-manager-57bb9bfff-lvzzp\" (UID: \"2cf8aa60-6887-4243-a9b7-bb33143336df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-lvzzp"
Nov 03 22:07:34.570789 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:34.570696    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cf8aa60-6887-4243-a9b7-bb33143336df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-lvzzp\" (UID: \"2cf8aa60-6887-4243-a9b7-bb33143336df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-lvzzp"
Nov 03 22:07:34.671554 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:34.671518    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98gr8\" (UniqueName: \"kubernetes.io/projected/2cf8aa60-6887-4243-a9b7-bb33143336df-kube-api-access-98gr8\") pod \"kuadrant-operator-controller-manager-57bb9bfff-lvzzp\" (UID: \"2cf8aa60-6887-4243-a9b7-bb33143336df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-lvzzp"
Nov 03 22:07:34.671754 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:34.671609    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cf8aa60-6887-4243-a9b7-bb33143336df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-lvzzp\" (UID: \"2cf8aa60-6887-4243-a9b7-bb33143336df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-lvzzp"
Nov 03 22:07:34.671956 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:34.671938    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cf8aa60-6887-4243-a9b7-bb33143336df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-lvzzp\" (UID: \"2cf8aa60-6887-4243-a9b7-bb33143336df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-lvzzp"
Nov 03 22:07:34.684356 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:34.684322    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98gr8\" (UniqueName: \"kubernetes.io/projected/2cf8aa60-6887-4243-a9b7-bb33143336df-kube-api-access-98gr8\") pod \"kuadrant-operator-controller-manager-57bb9bfff-lvzzp\" (UID: \"2cf8aa60-6887-4243-a9b7-bb33143336df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-lvzzp"
Nov 03 22:07:34.779606 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:34.779508    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-lvzzp"
Nov 03 22:07:35.065799 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:35.065769    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-lvzzp"]
Nov 03 22:07:35.069932 ip-10-0-128-183 kubenswrapper[5077]: W1103 22:07:35.069904    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cf8aa60_6887_4243_a9b7_bb33143336df.slice/crio-59a585f08f3af1583b407574d243c5003e51909501add5340f3d29d30e285f7a WatchSource:0}: Error finding container 59a585f08f3af1583b407574d243c5003e51909501add5340f3d29d30e285f7a: Status 404 returned error can't find the container with id 59a585f08f3af1583b407574d243c5003e51909501add5340f3d29d30e285f7a
Nov 03 22:07:35.689239 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:35.689207    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-lvzzp" event={"ID":"2cf8aa60-6887-4243-a9b7-bb33143336df","Type":"ContainerStarted","Data":"e0757c31c4646f73dd2e67e2896d576b4c3c8da2d80583a4900e1881d20e4a48"}
Nov 03 22:07:35.689967 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:35.689279    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-lvzzp" event={"ID":"2cf8aa60-6887-4243-a9b7-bb33143336df","Type":"ContainerStarted","Data":"59a585f08f3af1583b407574d243c5003e51909501add5340f3d29d30e285f7a"}
Nov 03 22:07:35.689967 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:35.689433    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-lvzzp"
Nov 03 22:07:35.712444 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:35.712388    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-lvzzp" podStartSLOduration=1.71237605 podStartE2EDuration="1.71237605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:07:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:07:35.711160654 +0000 UTC m=+1349.114822084" watchObservedRunningTime="2026-11-03 22:07:35.71237605 +0000 UTC m=+1349.116037479"
Nov 03 22:07:46.697230 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:46.697199    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-lvzzp"
Nov 03 22:07:56.567272 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:56.566438    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-4vtdz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 22:07:56.567272 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:07:56.566529    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz" podUID="1c3d0988-497b-45b2-961e-5ce3fb3e6eeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 22:07:59.926217 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:07:59.926181    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:08:29.425328 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:29.425111    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"]
Nov 03 22:08:29.430458 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:29.430429    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"
Nov 03 22:08:29.441189 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:29.441166    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-26be95-serving-cert\""
Nov 03 22:08:29.444454 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:29.444427    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"]
Nov 03 22:08:29.583223 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:29.583186    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/038ee809-5502-4fb1-976c-b357b1bd9b0c-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b\" (UID: \"038ee809-5502-4fb1-976c-b357b1bd9b0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"
Nov 03 22:08:29.583464 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:29.583236    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/038ee809-5502-4fb1-976c-b357b1bd9b0c-metrics-certs\") pod \"maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b\" (UID: \"038ee809-5502-4fb1-976c-b357b1bd9b0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"
Nov 03 22:08:29.583464 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:29.583318    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpvxg\" (UniqueName: \"kubernetes.io/projected/038ee809-5502-4fb1-976c-b357b1bd9b0c-kube-api-access-hpvxg\") pod \"maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b\" (UID: \"038ee809-5502-4fb1-976c-b357b1bd9b0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"
Nov 03 22:08:29.583464 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:29.583344    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/038ee809-5502-4fb1-976c-b357b1bd9b0c-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b\" (UID: \"038ee809-5502-4fb1-976c-b357b1bd9b0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"
Nov 03 22:08:29.684585 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:29.684483    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/038ee809-5502-4fb1-976c-b357b1bd9b0c-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b\" (UID: \"038ee809-5502-4fb1-976c-b357b1bd9b0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"
Nov 03 22:08:29.684585 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:29.684522    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/038ee809-5502-4fb1-976c-b357b1bd9b0c-metrics-certs\") pod \"maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b\" (UID: \"038ee809-5502-4fb1-976c-b357b1bd9b0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"
Nov 03 22:08:29.684585 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:29.684550    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpvxg\" (UniqueName: \"kubernetes.io/projected/038ee809-5502-4fb1-976c-b357b1bd9b0c-kube-api-access-hpvxg\") pod \"maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b\" (UID: \"038ee809-5502-4fb1-976c-b357b1bd9b0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"
Nov 03 22:08:29.684585 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:29.684578    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/038ee809-5502-4fb1-976c-b357b1bd9b0c-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b\" (UID: \"038ee809-5502-4fb1-976c-b357b1bd9b0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"
Nov 03 22:08:29.685223 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:29.685196    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/038ee809-5502-4fb1-976c-b357b1bd9b0c-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b\" (UID: \"038ee809-5502-4fb1-976c-b357b1bd9b0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"
Nov 03 22:08:29.687173 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:29.687150    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/038ee809-5502-4fb1-976c-b357b1bd9b0c-metrics-certs\") pod \"maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b\" (UID: \"038ee809-5502-4fb1-976c-b357b1bd9b0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"
Nov 03 22:08:29.687304 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:29.687191    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/038ee809-5502-4fb1-976c-b357b1bd9b0c-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b\" (UID: \"038ee809-5502-4fb1-976c-b357b1bd9b0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"
Nov 03 22:08:29.696274 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:29.696228    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpvxg\" (UniqueName: \"kubernetes.io/projected/038ee809-5502-4fb1-976c-b357b1bd9b0c-kube-api-access-hpvxg\") pod \"maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b\" (UID: \"038ee809-5502-4fb1-976c-b357b1bd9b0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"
Nov 03 22:08:29.750527 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:29.750496    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"
Nov 03 22:08:29.928563 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:08:29.928530    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:08:30.030066 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:30.030039    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"]
Nov 03 22:08:30.033671 ip-10-0-128-183 kubenswrapper[5077]: W1103 22:08:30.033612    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod038ee809_5502_4fb1_976c_b357b1bd9b0c.slice/crio-095b7c65edd40f0c8e02ed36c6f9f3a2713e89c5a169ab438df5e8b0e62f5b2a WatchSource:0}: Error finding container 095b7c65edd40f0c8e02ed36c6f9f3a2713e89c5a169ab438df5e8b0e62f5b2a: Status 404 returned error can't find the container with id 095b7c65edd40f0c8e02ed36c6f9f3a2713e89c5a169ab438df5e8b0e62f5b2a
Nov 03 22:08:30.035412 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:30.035392    5077 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 22:08:30.059754 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:30.059716    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b" event={"ID":"038ee809-5502-4fb1-976c-b357b1bd9b0c","Type":"ContainerStarted","Data":"095b7c65edd40f0c8e02ed36c6f9f3a2713e89c5a169ab438df5e8b0e62f5b2a"}
Nov 03 22:08:31.068819 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:31.068766    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b" event={"ID":"038ee809-5502-4fb1-976c-b357b1bd9b0c","Type":"ContainerStarted","Data":"d9bfefbc7069fea25ddc6da3e0ed23ed75f4aebeeb96a6df799fa89b1f664ab3"}
Nov 03 22:08:31.069241 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:31.068972    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"
Nov 03 22:08:31.101479 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:31.101417    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b" podStartSLOduration=1.556347524 podStartE2EDuration="2.101397153s" totalImagesPullingTime="545.049629ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:08:31.100837595 +0000 UTC m=+1404.504499017" watchObservedRunningTime="2026-11-03 22:08:31.101397153 +0000 UTC m=+1404.505058586"
Nov 03 22:08:37.083296 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:08:37.083239    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"
Nov 03 22:08:59.927162 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:08:59.927127    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:09:24.299406 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:24.299370    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"]
Nov 03 22:09:24.301455 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:24.301397    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b" podUID="038ee809-5502-4fb1-976c-b357b1bd9b0c" containerName="maas-api" containerID="cri-o://d9bfefbc7069fea25ddc6da3e0ed23ed75f4aebeeb96a6df799fa89b1f664ab3" gracePeriod=30
Nov 03 22:09:24.605506 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:24.605481    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"
Nov 03 22:09:24.663387 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:24.663353    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/038ee809-5502-4fb1-976c-b357b1bd9b0c-kube-api-access-hpvxg\" (UniqueName: \"kubernetes.io/projected/038ee809-5502-4fb1-976c-b357b1bd9b0c-kube-api-access-hpvxg\") pod \"038ee809-5502-4fb1-976c-b357b1bd9b0c\" (UID: \"038ee809-5502-4fb1-976c-b357b1bd9b0c\") "
Nov 03 22:09:24.663577 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:24.663457    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/038ee809-5502-4fb1-976c-b357b1bd9b0c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/038ee809-5502-4fb1-976c-b357b1bd9b0c-metrics-certs\") pod \"038ee809-5502-4fb1-976c-b357b1bd9b0c\" (UID: \"038ee809-5502-4fb1-976c-b357b1bd9b0c\") "
Nov 03 22:09:24.663577 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:24.663495    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/038ee809-5502-4fb1-976c-b357b1bd9b0c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/038ee809-5502-4fb1-976c-b357b1bd9b0c-maas-api-tls\") pod \"038ee809-5502-4fb1-976c-b357b1bd9b0c\" (UID: \"038ee809-5502-4fb1-976c-b357b1bd9b0c\") "
Nov 03 22:09:24.663577 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:24.663537    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/038ee809-5502-4fb1-976c-b357b1bd9b0c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/038ee809-5502-4fb1-976c-b357b1bd9b0c-openshift-service-ca\") pod \"038ee809-5502-4fb1-976c-b357b1bd9b0c\" (UID: \"038ee809-5502-4fb1-976c-b357b1bd9b0c\") "
Nov 03 22:09:24.663947 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:24.663918    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/038ee809-5502-4fb1-976c-b357b1bd9b0c-openshift-service-ca" pod "038ee809-5502-4fb1-976c-b357b1bd9b0c" (UID: "038ee809-5502-4fb1-976c-b357b1bd9b0c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 22:09:24.664080 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:24.664024    5077 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/038ee809-5502-4fb1-976c-b357b1bd9b0c-openshift-service-ca\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:09:24.666377 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:24.666350    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/038ee809-5502-4fb1-976c-b357b1bd9b0c-maas-api-tls" pod "038ee809-5502-4fb1-976c-b357b1bd9b0c" (UID: "038ee809-5502-4fb1-976c-b357b1bd9b0c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 22:09:24.666474 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:24.666383    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/038ee809-5502-4fb1-976c-b357b1bd9b0c-kube-api-access-hpvxg" pod "038ee809-5502-4fb1-976c-b357b1bd9b0c" (UID: "038ee809-5502-4fb1-976c-b357b1bd9b0c"). InnerVolumeSpecName "kube-api-access-hpvxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:09:24.666537 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:24.666517    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/038ee809-5502-4fb1-976c-b357b1bd9b0c-metrics-certs" pod "038ee809-5502-4fb1-976c-b357b1bd9b0c" (UID: "038ee809-5502-4fb1-976c-b357b1bd9b0c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 22:09:24.765572 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:24.765541    5077 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/038ee809-5502-4fb1-976c-b357b1bd9b0c-metrics-certs\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:09:24.765572 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:24.765573    5077 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/038ee809-5502-4fb1-976c-b357b1bd9b0c-maas-api-tls\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:09:24.765798 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:24.765588    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpvxg\" (UniqueName: \"kubernetes.io/projected/038ee809-5502-4fb1-976c-b357b1bd9b0c-kube-api-access-hpvxg\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:09:25.388192 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:25.388153    5077 generic.go:356] "Generic (PLEG): container finished" podID="038ee809-5502-4fb1-976c-b357b1bd9b0c" containerID="d9bfefbc7069fea25ddc6da3e0ed23ed75f4aebeeb96a6df799fa89b1f664ab3" exitCode=0
Nov 03 22:09:25.388628 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:25.388200    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b" event={"ID":"038ee809-5502-4fb1-976c-b357b1bd9b0c","Type":"ContainerDied","Data":"d9bfefbc7069fea25ddc6da3e0ed23ed75f4aebeeb96a6df799fa89b1f664ab3"}
Nov 03 22:09:25.388628 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:25.388239    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b" event={"ID":"038ee809-5502-4fb1-976c-b357b1bd9b0c","Type":"ContainerDied","Data":"095b7c65edd40f0c8e02ed36c6f9f3a2713e89c5a169ab438df5e8b0e62f5b2a"}
Nov 03 22:09:25.388628 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:25.388202    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"
Nov 03 22:09:25.388628 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:25.388283    5077 scope.go:122] "RemoveContainer" containerID="d9bfefbc7069fea25ddc6da3e0ed23ed75f4aebeeb96a6df799fa89b1f664ab3"
Nov 03 22:09:25.397937 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:25.397917    5077 scope.go:122] "RemoveContainer" containerID="d9bfefbc7069fea25ddc6da3e0ed23ed75f4aebeeb96a6df799fa89b1f664ab3"
Nov 03 22:09:25.398210 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:09:25.398186    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9bfefbc7069fea25ddc6da3e0ed23ed75f4aebeeb96a6df799fa89b1f664ab3\": container with ID starting with d9bfefbc7069fea25ddc6da3e0ed23ed75f4aebeeb96a6df799fa89b1f664ab3 not found: ID does not exist" containerID="d9bfefbc7069fea25ddc6da3e0ed23ed75f4aebeeb96a6df799fa89b1f664ab3"
Nov 03 22:09:25.398288 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:25.398220    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9bfefbc7069fea25ddc6da3e0ed23ed75f4aebeeb96a6df799fa89b1f664ab3"} err="failed to get container status \"d9bfefbc7069fea25ddc6da3e0ed23ed75f4aebeeb96a6df799fa89b1f664ab3\": rpc error: code = NotFound desc = could not find container \"d9bfefbc7069fea25ddc6da3e0ed23ed75f4aebeeb96a6df799fa89b1f664ab3\": container with ID starting with d9bfefbc7069fea25ddc6da3e0ed23ed75f4aebeeb96a6df799fa89b1f664ab3 not found: ID does not exist"
Nov 03 22:09:25.405510 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:25.405488    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"]
Nov 03 22:09:25.409775 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:25.409751    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-26be95-857b96cd74-dfb2b"]
Nov 03 22:09:26.735058 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:09:26.735023    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="038ee809-5502-4fb1-976c-b357b1bd9b0c" path="/var/lib/kubelet/pods/038ee809-5502-4fb1-976c-b357b1bd9b0c/volumes"
Nov 03 22:09:29.936832 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:09:29.936774    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:09:59.927979 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:09:59.927901    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:10:06.922137 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:06.922022    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pspgs_36598f65-5a1d-43e3-acc2-71c1e56f112c/console-operator/1.log"
Nov 03 22:10:06.926236 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:06.923081    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pspgs_36598f65-5a1d-43e3-acc2-71c1e56f112c/console-operator/1.log"
Nov 03 22:10:13.791270 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:13.790362    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-wbrrh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 22:10:13.791270 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:13.790448    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-wbrrh" podUID="3d061d55-2d2d-4686-a694-4b2f1f7e4b35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 22:10:13.835465 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:13.835429    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-f74lr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 22:10:13.835754 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:13.835722    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-f74lr" podUID="45431ac6-acc8-449c-8ed0-27975d792116" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 22:10:13.858279 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:13.857338    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-j4nv8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 22:10:13.858279 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:13.857428    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-j4nv8" podUID="9a556d4c-2e33-47b3-9d99-25d4f88acfd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 22:10:29.928457 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:10:29.928422    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:10:41.561408 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:41.561365    5077 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-66db998887-4vtdz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 22:10:41.562200 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:41.562162    5077 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-66db998887-4vtdz" podUID="1c3d0988-497b-45b2-961e-5ce3fb3e6eeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 22:10:58.155868 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:58.155838    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-595cc648c-stwhf"]
Nov 03 22:10:58.156552 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:58.156534    5077 cpu_manager.go:414] "containerMap: removing container" podUID="038ee809-5502-4fb1-976c-b357b1bd9b0c" containerName="maas-api"
Nov 03 22:10:58.156665 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:58.156555    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="038ee809-5502-4fb1-976c-b357b1bd9b0c" containerName="maas-api"
Nov 03 22:10:58.156665 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:58.156653    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="038ee809-5502-4fb1-976c-b357b1bd9b0c" containerName="maas-api"
Nov 03 22:10:58.160065 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:58.160045    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-595cc648c-stwhf"
Nov 03 22:10:58.173489 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:58.173461    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-595cc648c-stwhf"]
Nov 03 22:10:58.272318 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:58.272283    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90d10f07-e44f-463d-99a8-eb665ff1dc13-openshift-service-ca\") pod \"maas-api-595cc648c-stwhf\" (UID: \"90d10f07-e44f-463d-99a8-eb665ff1dc13\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-stwhf"
Nov 03 22:10:58.272527 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:58.272337    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90d10f07-e44f-463d-99a8-eb665ff1dc13-metrics-certs\") pod \"maas-api-595cc648c-stwhf\" (UID: \"90d10f07-e44f-463d-99a8-eb665ff1dc13\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-stwhf"
Nov 03 22:10:58.272527 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:58.272367    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90d10f07-e44f-463d-99a8-eb665ff1dc13-maas-api-tls\") pod \"maas-api-595cc648c-stwhf\" (UID: \"90d10f07-e44f-463d-99a8-eb665ff1dc13\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-stwhf"
Nov 03 22:10:58.272527 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:58.272485    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5tcw\" (UniqueName: \"kubernetes.io/projected/90d10f07-e44f-463d-99a8-eb665ff1dc13-kube-api-access-v5tcw\") pod \"maas-api-595cc648c-stwhf\" (UID: \"90d10f07-e44f-463d-99a8-eb665ff1dc13\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-stwhf"
Nov 03 22:10:58.373811 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:58.373767    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90d10f07-e44f-463d-99a8-eb665ff1dc13-openshift-service-ca\") pod \"maas-api-595cc648c-stwhf\" (UID: \"90d10f07-e44f-463d-99a8-eb665ff1dc13\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-stwhf"
Nov 03 22:10:58.374022 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:58.373857    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90d10f07-e44f-463d-99a8-eb665ff1dc13-metrics-certs\") pod \"maas-api-595cc648c-stwhf\" (UID: \"90d10f07-e44f-463d-99a8-eb665ff1dc13\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-stwhf"
Nov 03 22:10:58.374022 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:58.373884    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90d10f07-e44f-463d-99a8-eb665ff1dc13-maas-api-tls\") pod \"maas-api-595cc648c-stwhf\" (UID: \"90d10f07-e44f-463d-99a8-eb665ff1dc13\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-stwhf"
Nov 03 22:10:58.374022 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:58.373938    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5tcw\" (UniqueName: \"kubernetes.io/projected/90d10f07-e44f-463d-99a8-eb665ff1dc13-kube-api-access-v5tcw\") pod \"maas-api-595cc648c-stwhf\" (UID: \"90d10f07-e44f-463d-99a8-eb665ff1dc13\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-stwhf"
Nov 03 22:10:58.374647 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:58.374619    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90d10f07-e44f-463d-99a8-eb665ff1dc13-openshift-service-ca\") pod \"maas-api-595cc648c-stwhf\" (UID: \"90d10f07-e44f-463d-99a8-eb665ff1dc13\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-stwhf"
Nov 03 22:10:58.376749 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:58.376723    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90d10f07-e44f-463d-99a8-eb665ff1dc13-metrics-certs\") pod \"maas-api-595cc648c-stwhf\" (UID: \"90d10f07-e44f-463d-99a8-eb665ff1dc13\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-stwhf"
Nov 03 22:10:58.376863 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:58.376843    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90d10f07-e44f-463d-99a8-eb665ff1dc13-maas-api-tls\") pod \"maas-api-595cc648c-stwhf\" (UID: \"90d10f07-e44f-463d-99a8-eb665ff1dc13\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-stwhf"
Nov 03 22:10:58.387907 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:58.387882    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5tcw\" (UniqueName: \"kubernetes.io/projected/90d10f07-e44f-463d-99a8-eb665ff1dc13-kube-api-access-v5tcw\") pod \"maas-api-595cc648c-stwhf\" (UID: \"90d10f07-e44f-463d-99a8-eb665ff1dc13\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-stwhf"
Nov 03 22:10:58.480169 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:58.480037    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-595cc648c-stwhf"
Nov 03 22:10:58.764033 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:58.764007    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-595cc648c-stwhf"]
Nov 03 22:10:58.766109 ip-10-0-128-183 kubenswrapper[5077]: W1103 22:10:58.766082    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90d10f07_e44f_463d_99a8_eb665ff1dc13.slice/crio-aaf31b6abded76b0ad38ed1e388fb2626ac7c2cba399345c439ecbe0d6f3c215 WatchSource:0}: Error finding container aaf31b6abded76b0ad38ed1e388fb2626ac7c2cba399345c439ecbe0d6f3c215: Status 404 returned error can't find the container with id aaf31b6abded76b0ad38ed1e388fb2626ac7c2cba399345c439ecbe0d6f3c215
Nov 03 22:10:59.160997 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:10:59.160946    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-595cc648c-stwhf" event={"ID":"90d10f07-e44f-463d-99a8-eb665ff1dc13","Type":"ContainerStarted","Data":"aaf31b6abded76b0ad38ed1e388fb2626ac7c2cba399345c439ecbe0d6f3c215"}
Nov 03 22:10:59.925652 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:10:59.925615    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:11:00.169945 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:00.169912    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-595cc648c-stwhf" event={"ID":"90d10f07-e44f-463d-99a8-eb665ff1dc13","Type":"ContainerStarted","Data":"350b782d227b3ca72d2e193823e7dc90c05c11051fae48014962fdc9a7c20e1f"}
Nov 03 22:11:00.170344 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:00.170030    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-595cc648c-stwhf"
Nov 03 22:11:00.193396 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:00.193296    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-595cc648c-stwhf" podStartSLOduration=1.692928905 podStartE2EDuration="2.193241218s" totalImagesPullingTime="500.312313ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:10:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:11:00.192291609 +0000 UTC m=+1553.595953035" watchObservedRunningTime="2026-11-03 22:11:00.193241218 +0000 UTC m=+1553.596902648"
Nov 03 22:11:06.181707 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:06.181678    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-595cc648c-stwhf"
Nov 03 22:11:06.237387 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:06.237354    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"]
Nov 03 22:11:06.237675 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:06.237645    5077 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp" podUID="5e911317-2a54-4fad-88cc-9364d92a11d5" containerName="maas-api" containerID="cri-o://b5278ebdb505643e93b99b20666e5ca76da6e032726290146c6a39261fea5ee1" gracePeriod=30
Nov 03 22:11:07.613784 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:07.613750    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"
Nov 03 22:11:07.745863 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:07.745803    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5e911317-2a54-4fad-88cc-9364d92a11d5-kube-api-access-mg4t7\" (UniqueName: \"kubernetes.io/projected/5e911317-2a54-4fad-88cc-9364d92a11d5-kube-api-access-mg4t7\") pod \"5e911317-2a54-4fad-88cc-9364d92a11d5\" (UID: \"5e911317-2a54-4fad-88cc-9364d92a11d5\") "
Nov 03 22:11:07.746047 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:07.745897    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5e911317-2a54-4fad-88cc-9364d92a11d5-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e911317-2a54-4fad-88cc-9364d92a11d5-maas-api-tls\") pod \"5e911317-2a54-4fad-88cc-9364d92a11d5\" (UID: \"5e911317-2a54-4fad-88cc-9364d92a11d5\") "
Nov 03 22:11:07.746047 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:07.745936    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5e911317-2a54-4fad-88cc-9364d92a11d5-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e911317-2a54-4fad-88cc-9364d92a11d5-metrics-certs\") pod \"5e911317-2a54-4fad-88cc-9364d92a11d5\" (UID: \"5e911317-2a54-4fad-88cc-9364d92a11d5\") "
Nov 03 22:11:07.746047 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:07.746007    5077 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5e911317-2a54-4fad-88cc-9364d92a11d5-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e911317-2a54-4fad-88cc-9364d92a11d5-openshift-service-ca\") pod \"5e911317-2a54-4fad-88cc-9364d92a11d5\" (UID: \"5e911317-2a54-4fad-88cc-9364d92a11d5\") "
Nov 03 22:11:07.746962 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:07.746925    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e911317-2a54-4fad-88cc-9364d92a11d5-openshift-service-ca" pod "5e911317-2a54-4fad-88cc-9364d92a11d5" (UID: "5e911317-2a54-4fad-88cc-9364d92a11d5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 22:11:07.754904 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:07.754843    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e911317-2a54-4fad-88cc-9364d92a11d5-maas-api-tls" pod "5e911317-2a54-4fad-88cc-9364d92a11d5" (UID: "5e911317-2a54-4fad-88cc-9364d92a11d5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 22:11:07.755168 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:07.755127    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e911317-2a54-4fad-88cc-9364d92a11d5-metrics-certs" pod "5e911317-2a54-4fad-88cc-9364d92a11d5" (UID: "5e911317-2a54-4fad-88cc-9364d92a11d5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 22:11:07.755390 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:07.755366    5077 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e911317-2a54-4fad-88cc-9364d92a11d5-kube-api-access-mg4t7" pod "5e911317-2a54-4fad-88cc-9364d92a11d5" (UID: "5e911317-2a54-4fad-88cc-9364d92a11d5"). InnerVolumeSpecName "kube-api-access-mg4t7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:11:07.849229 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:07.849123    5077 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mg4t7\" (UniqueName: \"kubernetes.io/projected/5e911317-2a54-4fad-88cc-9364d92a11d5-kube-api-access-mg4t7\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:11:07.849229 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:07.849165    5077 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e911317-2a54-4fad-88cc-9364d92a11d5-maas-api-tls\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:11:07.849229 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:07.849186    5077 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e911317-2a54-4fad-88cc-9364d92a11d5-metrics-certs\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:11:07.849229 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:07.849202    5077 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e911317-2a54-4fad-88cc-9364d92a11d5-openshift-service-ca\") on node \"ip-10-0-128-183.us-east-2.compute.internal\" DevicePath \"\""
Nov 03 22:11:08.292353 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:08.289205    5077 generic.go:356] "Generic (PLEG): container finished" podID="5e911317-2a54-4fad-88cc-9364d92a11d5" containerID="b5278ebdb505643e93b99b20666e5ca76da6e032726290146c6a39261fea5ee1" exitCode=0
Nov 03 22:11:08.292353 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:08.289386    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp" event={"ID":"5e911317-2a54-4fad-88cc-9364d92a11d5","Type":"ContainerDied","Data":"b5278ebdb505643e93b99b20666e5ca76da6e032726290146c6a39261fea5ee1"}
Nov 03 22:11:08.292353 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:08.289440    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp" event={"ID":"5e911317-2a54-4fad-88cc-9364d92a11d5","Type":"ContainerDied","Data":"91e0bb8df01be51daecdc31978f031908e11fc8e19d056d28b01a94d499f3c40"}
Nov 03 22:11:08.292353 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:08.289474    5077 scope.go:122] "RemoveContainer" containerID="b5278ebdb505643e93b99b20666e5ca76da6e032726290146c6a39261fea5ee1"
Nov 03 22:11:08.292353 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:08.289644    5077 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"
Nov 03 22:11:08.407796 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:08.396793    5077 scope.go:122] "RemoveContainer" containerID="b5278ebdb505643e93b99b20666e5ca76da6e032726290146c6a39261fea5ee1"
Nov 03 22:11:08.413492 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:11:08.413456    5077 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5278ebdb505643e93b99b20666e5ca76da6e032726290146c6a39261fea5ee1\": container with ID starting with b5278ebdb505643e93b99b20666e5ca76da6e032726290146c6a39261fea5ee1 not found: ID does not exist" containerID="b5278ebdb505643e93b99b20666e5ca76da6e032726290146c6a39261fea5ee1"
Nov 03 22:11:08.413774 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:08.413742    5077 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5278ebdb505643e93b99b20666e5ca76da6e032726290146c6a39261fea5ee1"} err="failed to get container status \"b5278ebdb505643e93b99b20666e5ca76da6e032726290146c6a39261fea5ee1\": rpc error: code = NotFound desc = could not find container \"b5278ebdb505643e93b99b20666e5ca76da6e032726290146c6a39261fea5ee1\": container with ID starting with b5278ebdb505643e93b99b20666e5ca76da6e032726290146c6a39261fea5ee1 not found: ID does not exist"
Nov 03 22:11:08.436367 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:08.436310    5077 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"]
Nov 03 22:11:08.438425 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:08.438398    5077 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-4qbxp"]
Nov 03 22:11:08.752957 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:08.752910    5077 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5e911317-2a54-4fad-88cc-9364d92a11d5" path="/var/lib/kubelet/pods/5e911317-2a54-4fad-88cc-9364d92a11d5/volumes"
Nov 03 22:11:29.928010 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:11:29.927920    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:11:59.188484 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:59.188453    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-2cp8m_924ab530-dbeb-446a-8069-ad634ab44e49/manager/0.log"
Nov 03 22:11:59.858321 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:11:59.858285    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8f6bb67b9-scb4p_ab73c329-b80c-4253-be63-15748b8d2442/manager/0.log"
Nov 03 22:11:59.926303 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:11:59.926268    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:12:00.081163 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:00.081137    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-58jdx_51ec143b-216f-4314-8997-8170d60a0804/server/0.log"
Nov 03 22:12:00.247125 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:00.247046    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-f87fcf56c-rmbn6_78e28086-24fc-42d6-ac43-3a5967c67012/manager/0.log"
Nov 03 22:12:01.107973 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:01.107946    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77f6458f94-sj6tx_ca796c19-6509-4ead-93b3-c5b55f2702cb/copy-manifests/0.log"
Nov 03 22:12:01.133994 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:01.133963    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77f6458f94-sj6tx_ca796c19-6509-4ead-93b3-c5b55f2702cb/manager/0.log"
Nov 03 22:12:01.330493 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:01.330468    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-7d94f55f4b-kmlh8_5021d4ab-90a2-414f-aab6-947fc6e922a0/proxy/0.log"
Nov 03 22:12:02.266342 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:02.266310    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-595cc648c-stwhf_90d10f07-e44f-463d-99a8-eb665ff1dc13/maas-api/0.log"
Nov 03 22:12:05.684258 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:05.684214    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d6dd76dc-qx8vw_21f88430-9b16-4a1c-88dc-5f26f5983884/manager/0.log"
Nov 03 22:12:05.863378 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:05.863344    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65bfd79598-m92st_87c1c751-dd4a-412b-bfb8-716e76f8ccbf/manager/0.log"
Nov 03 22:12:06.234640 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:06.234610    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-57bb9bfff-lvzzp_2cf8aa60-6887-4243-a9b7-bb33143336df/manager/0.log"
Nov 03 22:12:06.648414 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:06.648389    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-856dd584c5-zpzht_b6435da6-942d-4238-9e4a-41db53bf3a39/manager/0.log"
Nov 03 22:12:07.407073 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:07.407049    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-8f76c657-jb84k_4193750a-8017-49b3-b520-3b1fa02a68e3/istio-proxy/0.log"
Nov 03 22:12:07.946392 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:07.946364    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65998dd86f-s5ch5_df967c38-9228-48fb-8aed-90749175ab1c/kube-auth-proxy/0.log"
Nov 03 22:12:08.304444 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:08.304365    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-4vtdz_1c3d0988-497b-45b2-961e-5ce3fb3e6eeb/istio-proxy/1.log"
Nov 03 22:12:09.225140 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:09.225112    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-f74lr_45431ac6-acc8-449c-8ed0-27975d792116/istio-proxy/0.log"
Nov 03 22:12:09.406383 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:09.406354    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-j4nv8_9a556d4c-2e33-47b3-9d99-25d4f88acfd6/istio-proxy/0.log"
Nov 03 22:12:09.772888 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:09.772861    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-wbrrh_3d061d55-2d2d-4686-a694-4b2f1f7e4b35/istio-proxy/0.log"
Nov 03 22:12:09.965447 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:09.965409    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-wlkwf_ba0fd87d-78b8-4a24-9e33-4904dafbbb63/payload-pre-processing/0.log"
Nov 03 22:12:10.123063 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:10.123032    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-xqtpq_851f4598-e261-4024-8a45-a831aa9dd4a4/payload-processing/0.log"
Nov 03 22:12:10.306204 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:10.306175    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b77b9dbdf-rbjh5_d6afb4de-bd45-4038-a6a9-9ff8671eb430/router/0.log"
Nov 03 22:12:10.714262 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:10.714219    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-4vtdz_1c3d0988-497b-45b2-961e-5ce3fb3e6eeb/istio-proxy/0.log"
Nov 03 22:12:11.228933 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:11.228908    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx_752408a7-a3d9-41e1-9187-729b9e575c7a/main/0.log"
Nov 03 22:12:11.404743 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:11.404710    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-pzn78_3d775b45-9909-405d-a7f4-49a16ee311ed/main/0.log"
Nov 03 22:12:11.753459 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:11.753430    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-8w46m_06ba5990-697e-4c7d-b759-35b5da881b81/main/0.log"
Nov 03 22:12:12.114417 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:12.114394    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr_562ac3f4-ea83-486b-9422-04e1006b7bc4/main/0.log"
Nov 03 22:12:22.193564 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:22.193526    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-2cp8m_924ab530-dbeb-446a-8069-ad634ab44e49/manager/0.log"
Nov 03 22:12:22.809123 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:22.809092    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8f6bb67b9-scb4p_ab73c329-b80c-4253-be63-15748b8d2442/manager/0.log"
Nov 03 22:12:23.026429 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:23.026401    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-58jdx_51ec143b-216f-4314-8997-8170d60a0804/server/0.log"
Nov 03 22:12:23.219078 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:23.219002    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-f87fcf56c-rmbn6_78e28086-24fc-42d6-ac43-3a5967c67012/manager/0.log"
Nov 03 22:12:24.061503 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:24.061477    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77f6458f94-sj6tx_ca796c19-6509-4ead-93b3-c5b55f2702cb/copy-manifests/0.log"
Nov 03 22:12:24.088054 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:24.088030    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77f6458f94-sj6tx_ca796c19-6509-4ead-93b3-c5b55f2702cb/manager/0.log"
Nov 03 22:12:24.295353 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:24.295324    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-7d94f55f4b-kmlh8_5021d4ab-90a2-414f-aab6-947fc6e922a0/proxy/0.log"
Nov 03 22:12:24.991573 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:24.991540    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-595cc648c-stwhf_90d10f07-e44f-463d-99a8-eb665ff1dc13/maas-api/0.log"
Nov 03 22:12:28.016787 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:28.016757    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d6dd76dc-qx8vw_21f88430-9b16-4a1c-88dc-5f26f5983884/manager/0.log"
Nov 03 22:12:28.206124 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:28.206093    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65bfd79598-m92st_87c1c751-dd4a-412b-bfb8-716e76f8ccbf/manager/0.log"
Nov 03 22:12:28.541824 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:28.541790    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-57bb9bfff-lvzzp_2cf8aa60-6887-4243-a9b7-bb33143336df/manager/0.log"
Nov 03 22:12:28.955327 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:28.955298    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-856dd584c5-zpzht_b6435da6-942d-4238-9e4a-41db53bf3a39/manager/0.log"
Nov 03 22:12:29.492367 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:29.492335    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-8f76c657-jb84k_4193750a-8017-49b3-b520-3b1fa02a68e3/istio-proxy/0.log"
Nov 03 22:12:29.930725 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:12:29.930687    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:12:30.044219 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:30.044190    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65998dd86f-s5ch5_df967c38-9228-48fb-8aed-90749175ab1c/kube-auth-proxy/0.log"
Nov 03 22:12:30.400808 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:30.400783    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-4vtdz_1c3d0988-497b-45b2-961e-5ce3fb3e6eeb/istio-proxy/1.log"
Nov 03 22:12:31.339513 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:31.339485    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-f74lr_45431ac6-acc8-449c-8ed0-27975d792116/istio-proxy/0.log"
Nov 03 22:12:31.517518 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:31.517490    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-j4nv8_9a556d4c-2e33-47b3-9d99-25d4f88acfd6/istio-proxy/0.log"
Nov 03 22:12:31.881943 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:31.881909    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-wbrrh_3d061d55-2d2d-4686-a694-4b2f1f7e4b35/istio-proxy/0.log"
Nov 03 22:12:32.046147 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:32.046121    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-wlkwf_ba0fd87d-78b8-4a24-9e33-4904dafbbb63/payload-pre-processing/0.log"
Nov 03 22:12:32.211697 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:32.211611    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-xqtpq_851f4598-e261-4024-8a45-a831aa9dd4a4/payload-processing/0.log"
Nov 03 22:12:32.383483 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:32.383456    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b77b9dbdf-rbjh5_d6afb4de-bd45-4038-a6a9-9ff8671eb430/router/0.log"
Nov 03 22:12:32.894772 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:32.894740    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-m5gbx_752408a7-a3d9-41e1-9187-729b9e575c7a/main/0.log"
Nov 03 22:12:33.065099 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:33.065072    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-pzn78_3d775b45-9909-405d-a7f4-49a16ee311ed/main/0.log"
Nov 03 22:12:33.423105 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:33.423070    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-8w46m_06ba5990-697e-4c7d-b759-35b5da881b81/main/0.log"
Nov 03 22:12:33.772909 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:12:33.772802    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-6sxcr_562ac3f4-ea83-486b-9422-04e1006b7bc4/main/0.log"
Nov 03 22:12:59.925125 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:12:59.925040    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:13:10.559418 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:13:10.559387    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8f6bb67b9-scb4p_ab73c329-b80c-4253-be63-15748b8d2442/manager/0.log"
Nov 03 22:13:10.818843 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:13:10.818763    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8f6bb67b9-scb4p_ab73c329-b80c-4253-be63-15748b8d2442/manager/0.log"
Nov 03 22:13:11.539300 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:13:11.539227    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-xqtpq_851f4598-e261-4024-8a45-a831aa9dd4a4/payload-processing/0.log"
Nov 03 22:13:11.715591 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:13:11.715557    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-xqtpq_851f4598-e261-4024-8a45-a831aa9dd4a4/payload-processing/0.log"
Nov 03 22:13:29.938646 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:13:29.938604    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:13:56.609156 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:13:56.609124    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8f6bb67b9-scb4p_ab73c329-b80c-4253-be63-15748b8d2442/manager/0.log"
Nov 03 22:13:56.877644 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:13:56.877504    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8f6bb67b9-scb4p_ab73c329-b80c-4253-be63-15748b8d2442/manager/0.log"
Nov 03 22:13:57.580988 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:13:57.580961    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-xqtpq_851f4598-e261-4024-8a45-a831aa9dd4a4/payload-processing/0.log"
Nov 03 22:13:57.753506 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:13:57.753477    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-xqtpq_851f4598-e261-4024-8a45-a831aa9dd4a4/payload-processing/0.log"
Nov 03 22:13:59.925270 ip-10-0-128-183 kubenswrapper[5077]: E1103 22:13:59.925221    5077 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7fmc" containerName="extractor"
Nov 03 22:14:01.215783 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:01.215748    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dndpk_7b1bc67e-f876-4fec-b9bf-a3a8906d8d94/global-pull-secret-syncer/0.log"
Nov 03 22:14:01.330014 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:01.329985    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-f5kct_e5a6f4cf-6f6f-4195-8304-aa0648e43ad9/connection-checker/0.log"
Nov 03 22:14:01.358637 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:01.358611    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-p7l88_b53d4190-50d2-4994-b730-a593c5133702/connection-checker/0.log"
Nov 03 22:14:01.388549 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:01.388525    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-wd97l_439cdf28-89f2-47eb-9a61-b63f4db9237b/connection-checker/0.log"
Nov 03 22:14:01.478637 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:01.478558    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mrf9j_eb453169-964e-4e16-a300-a54f2f3e74a2/konnectivity-agent/0.log"
Nov 03 22:14:01.539950 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:01.539892    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-183.us-east-2.compute.internal_512504a651dea6eb0e990f68b3a9a61c/haproxy/0.log"
Nov 03 22:14:08.540700 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:08.540646    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d6dd76dc-qx8vw_21f88430-9b16-4a1c-88dc-5f26f5983884/manager/0.log"
Nov 03 22:14:08.568006 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:08.567980    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65bfd79598-m92st_87c1c751-dd4a-412b-bfb8-716e76f8ccbf/manager/0.log"
Nov 03 22:14:08.655796 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:08.655739    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-57bb9bfff-lvzzp_2cf8aa60-6887-4243-a9b7-bb33143336df/manager/0.log"
Nov 03 22:14:08.770807 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:08.770776    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-856dd584c5-zpzht_b6435da6-942d-4238-9e4a-41db53bf3a39/manager/0.log"
Nov 03 22:14:10.268345 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:10.268308    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-wvc4j_ddc108c9-ccd3-462a-8694-2421004791cd/cluster-monitoring-operator/0.log"
Nov 03 22:14:10.454593 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:10.454564    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7zfdb_e6d83909-5c30-4707-8e6d-d1d6dc9188d6/node-exporter/0.log"
Nov 03 22:14:10.479873 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:10.479842    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7zfdb_e6d83909-5c30-4707-8e6d-d1d6dc9188d6/kube-rbac-proxy/0.log"
Nov 03 22:14:10.505798 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:10.505775    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7zfdb_e6d83909-5c30-4707-8e6d-d1d6dc9188d6/init-textfile/0.log"
Nov 03 22:14:10.981662 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:10.981625    5077 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"]
Nov 03 22:14:10.982227 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:10.982204    5077 cpu_manager.go:414] "containerMap: removing container" podUID="5e911317-2a54-4fad-88cc-9364d92a11d5" containerName="maas-api"
Nov 03 22:14:10.982424 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:10.982405    5077 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5e911317-2a54-4fad-88cc-9364d92a11d5" containerName="maas-api"
Nov 03 22:14:10.982667 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:10.982647    5077 memory_manager.go:365] "RemoveStaleState removing state" podUID="5e911317-2a54-4fad-88cc-9364d92a11d5" containerName="maas-api"
Nov 03 22:14:10.985963 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:10.985944    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"
Nov 03 22:14:10.992587 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:10.992558    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-69rm6\"/\"kube-root-ca.crt\""
Nov 03 22:14:10.993555 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:10.993138    5077 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-69rm6\"/\"openshift-service-ca.crt\""
Nov 03 22:14:10.993555 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:10.993400    5077 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-69rm6\"/\"default-dockercfg-wv8q7\""
Nov 03 22:14:10.994856 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:10.994838    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"]
Nov 03 22:14:11.023873 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:11.023843    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-qzpgw_e897dcc8-aa9a-42b2-8d2b-d56d43316f49/prometheus-operator/0.log"
Nov 03 22:14:11.048336 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:11.048309    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-qzpgw_e897dcc8-aa9a-42b2-8d2b-d56d43316f49/kube-rbac-proxy/0.log"
Nov 03 22:14:11.095531 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:11.095497    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1b7e9d4-7876-418e-8319-85a6c322558a-sys\") pod \"perf-node-gather-daemonset-p52tz\" (UID: \"b1b7e9d4-7876-418e-8319-85a6c322558a\") " pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"
Nov 03 22:14:11.095748 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:11.095557    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mbmw\" (UniqueName: \"kubernetes.io/projected/b1b7e9d4-7876-418e-8319-85a6c322558a-kube-api-access-2mbmw\") pod \"perf-node-gather-daemonset-p52tz\" (UID: \"b1b7e9d4-7876-418e-8319-85a6c322558a\") " pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"
Nov 03 22:14:11.095748 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:11.095659    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b1b7e9d4-7876-418e-8319-85a6c322558a-podres\") pod \"perf-node-gather-daemonset-p52tz\" (UID: \"b1b7e9d4-7876-418e-8319-85a6c322558a\") " pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"
Nov 03 22:14:11.095748 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:11.095711    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b1b7e9d4-7876-418e-8319-85a6c322558a-proc\") pod \"perf-node-gather-daemonset-p52tz\" (UID: \"b1b7e9d4-7876-418e-8319-85a6c322558a\") " pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"
Nov 03 22:14:11.095910 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:11.095810    5077 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1b7e9d4-7876-418e-8319-85a6c322558a-lib-modules\") pod \"perf-node-gather-daemonset-p52tz\" (UID: \"b1b7e9d4-7876-418e-8319-85a6c322558a\") " pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"
Nov 03 22:14:11.096363 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:11.096340    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-b4kn2_897eaea3-a154-4b83-ad26-35bf4b5fa782/prometheus-operator-admission-webhook/0.log"
Nov 03 22:14:11.196961 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:11.196926    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1b7e9d4-7876-418e-8319-85a6c322558a-sys\") pod \"perf-node-gather-daemonset-p52tz\" (UID: \"b1b7e9d4-7876-418e-8319-85a6c322558a\") " pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"
Nov 03 22:14:11.197151 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:11.196971    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mbmw\" (UniqueName: \"kubernetes.io/projected/b1b7e9d4-7876-418e-8319-85a6c322558a-kube-api-access-2mbmw\") pod \"perf-node-gather-daemonset-p52tz\" (UID: \"b1b7e9d4-7876-418e-8319-85a6c322558a\") " pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"
Nov 03 22:14:11.197151 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:11.197010    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b1b7e9d4-7876-418e-8319-85a6c322558a-podres\") pod \"perf-node-gather-daemonset-p52tz\" (UID: \"b1b7e9d4-7876-418e-8319-85a6c322558a\") " pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"
Nov 03 22:14:11.197151 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:11.197038    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b1b7e9d4-7876-418e-8319-85a6c322558a-proc\") pod \"perf-node-gather-daemonset-p52tz\" (UID: \"b1b7e9d4-7876-418e-8319-85a6c322558a\") " pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"
Nov 03 22:14:11.197151 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:11.197071    5077 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1b7e9d4-7876-418e-8319-85a6c322558a-lib-modules\") pod \"perf-node-gather-daemonset-p52tz\" (UID: \"b1b7e9d4-7876-418e-8319-85a6c322558a\") " pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"
Nov 03 22:14:11.197151 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:11.197072    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1b7e9d4-7876-418e-8319-85a6c322558a-sys\") pod \"perf-node-gather-daemonset-p52tz\" (UID: \"b1b7e9d4-7876-418e-8319-85a6c322558a\") " pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"
Nov 03 22:14:11.197403 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:11.197156    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b1b7e9d4-7876-418e-8319-85a6c322558a-podres\") pod \"perf-node-gather-daemonset-p52tz\" (UID: \"b1b7e9d4-7876-418e-8319-85a6c322558a\") " pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"
Nov 03 22:14:11.197403 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:11.197172    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b1b7e9d4-7876-418e-8319-85a6c322558a-proc\") pod \"perf-node-gather-daemonset-p52tz\" (UID: \"b1b7e9d4-7876-418e-8319-85a6c322558a\") " pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"
Nov 03 22:14:11.197403 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:11.197194    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1b7e9d4-7876-418e-8319-85a6c322558a-lib-modules\") pod \"perf-node-gather-daemonset-p52tz\" (UID: \"b1b7e9d4-7876-418e-8319-85a6c322558a\") " pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"
Nov 03 22:14:11.209032 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:11.209002    5077 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mbmw\" (UniqueName: \"kubernetes.io/projected/b1b7e9d4-7876-418e-8319-85a6c322558a-kube-api-access-2mbmw\") pod \"perf-node-gather-daemonset-p52tz\" (UID: \"b1b7e9d4-7876-418e-8319-85a6c322558a\") " pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"
Nov 03 22:14:11.303949 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:11.303865    5077 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"
Nov 03 22:14:11.582960 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:11.582935    5077 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"]
Nov 03 22:14:11.585063 ip-10-0-128-183 kubenswrapper[5077]: W1103 22:14:11.585035    5077 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb1b7e9d4_7876_418e_8319_85a6c322558a.slice/crio-48b244dbaef8434ee6ddfc9b11718d3e7eb24fc2385b7d2eb2a47603e2aec3e3 WatchSource:0}: Error finding container 48b244dbaef8434ee6ddfc9b11718d3e7eb24fc2385b7d2eb2a47603e2aec3e3: Status 404 returned error can't find the container with id 48b244dbaef8434ee6ddfc9b11718d3e7eb24fc2385b7d2eb2a47603e2aec3e3
Nov 03 22:14:12.386482 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:12.386445    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz" event={"ID":"b1b7e9d4-7876-418e-8319-85a6c322558a","Type":"ContainerStarted","Data":"a5088f8f1c5f0fcff85c7755e74f4b4e29f9b4dea73321a49009f776a9688319"}
Nov 03 22:14:12.386892 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:12.386506    5077 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz" event={"ID":"b1b7e9d4-7876-418e-8319-85a6c322558a","Type":"ContainerStarted","Data":"48b244dbaef8434ee6ddfc9b11718d3e7eb24fc2385b7d2eb2a47603e2aec3e3"}
Nov 03 22:14:12.386892 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:12.386535    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"
Nov 03 22:14:12.406389 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:12.406340    5077 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz" podStartSLOduration=2.406325185 podStartE2EDuration="2.406325185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:14:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:14:12.405002794 +0000 UTC m=+1745.808664224" watchObservedRunningTime="2026-11-03 22:14:12.406325185 +0000 UTC m=+1745.809986641"
Nov 03 22:14:12.645273 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:12.645185    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-fv6vx_3ebc2e42-6892-480b-a793-4f224d09f45d/networking-console-plugin/0.log"
Nov 03 22:14:13.186015 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:13.185967    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pspgs_36598f65-5a1d-43e3-acc2-71c1e56f112c/console-operator/1.log"
Nov 03 22:14:13.191116 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:13.191096    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pspgs_36598f65-5a1d-43e3-acc2-71c1e56f112c/console-operator/2.log"
Nov 03 22:14:13.707145 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:13.707106    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6dd789c8b7-7v4vz_1488e0c3-5c2e-46a2-874b-c00dcabc4d33/download-server/0.log"
Nov 03 22:14:14.312088 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:14.312063    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-5w6h4_45862374-6557-46b1-9982-4b77670216df/volume-data-source-validator/0.log"
Nov 03 22:14:15.446967 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:15.446936    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bmvnd_289044f0-b173-489e-971f-3dff8aaf9aaa/dns/0.log"
Nov 03 22:14:15.473953 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:15.473924    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bmvnd_289044f0-b173-489e-971f-3dff8aaf9aaa/kube-rbac-proxy/0.log"
Nov 03 22:14:15.622381 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:15.622349    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4jznx_a4982959-0762-44eb-a382-a510881805aa/dns-node-resolver/0.log"
Nov 03 22:14:16.390471 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:16.390387    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b8dfd77d5-z4wdd_12db04ea-e25c-4de4-ba08-2cbc02d9550d/registry/0.log"
Nov 03 22:14:16.470133 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:16.470104    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-txllc_736d15ff-56b5-40cf-b19a-38564c93d8b2/node-ca/0.log"
Nov 03 22:14:17.655266 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:17.655223    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-8f76c657-jb84k_4193750a-8017-49b3-b520-3b1fa02a68e3/istio-proxy/0.log"
Nov 03 22:14:18.225439 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:18.225412    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65998dd86f-s5ch5_df967c38-9228-48fb-8aed-90749175ab1c/kube-auth-proxy/0.log"
Nov 03 22:14:18.291702 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:18.291678    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-4vtdz_1c3d0988-497b-45b2-961e-5ce3fb3e6eeb/istio-proxy/0.log"
Nov 03 22:14:18.292741 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:18.292722    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-4vtdz_1c3d0988-497b-45b2-961e-5ce3fb3e6eeb/istio-proxy/1.log"
Nov 03 22:14:18.403625 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:18.403598    5077 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-69rm6/perf-node-gather-daemonset-p52tz"
Nov 03 22:14:18.459603 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:18.459573    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-f74lr_45431ac6-acc8-449c-8ed0-27975d792116/istio-proxy/0.log"
Nov 03 22:14:18.490717 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:18.490640    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-j4nv8_9a556d4c-2e33-47b3-9d99-25d4f88acfd6/istio-proxy/0.log"
Nov 03 22:14:18.558210 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:18.558177    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-wbrrh_3d061d55-2d2d-4686-a694-4b2f1f7e4b35/istio-proxy/0.log"
Nov 03 22:14:18.587456 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:18.587429    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-wlkwf_ba0fd87d-78b8-4a24-9e33-4904dafbbb63/payload-pre-processing/0.log"
Nov 03 22:14:18.616905 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:18.616877    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-xqtpq_851f4598-e261-4024-8a45-a831aa9dd4a4/payload-processing/0.log"
Nov 03 22:14:18.651458 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:18.651431    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b77b9dbdf-rbjh5_d6afb4de-bd45-4038-a6a9-9ff8671eb430/router/0.log"
Nov 03 22:14:19.673293 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:19.673268    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tqldf_5cbdd163-bfdd-4fda-8141-21b969a3aa08/serve-healthcheck-canary/0.log"
Nov 03 22:14:20.258627 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:20.258598    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-kmt8d_3a3d055a-397e-436d-99bd-e82541b4ce57/insights-operator/1.log"
Nov 03 22:14:20.259523 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:20.259506    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-kmt8d_3a3d055a-397e-436d-99bd-e82541b4ce57/insights-operator/2.log"
Nov 03 22:14:20.453793 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:20.453757    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x7fmc_c61b4b48-0d5d-4c17-9218-c38bf3581e98/kube-rbac-proxy/0.log"
Nov 03 22:14:20.478630 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:20.478606    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x7fmc_c61b4b48-0d5d-4c17-9218-c38bf3581e98/exporter/0.log"
Nov 03 22:14:20.505482 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:20.505458    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x7fmc_c61b4b48-0d5d-4c17-9218-c38bf3581e98/extractor/0.log"
Nov 03 22:14:20.547036 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:20.546960    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_periodic-gathering-w9lrd-jxl8h_7c66a68b-cfcb-4c04-91de-604994b1a6d3/insights-gathering/0.log"
Nov 03 22:14:21.664882 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:21.664853    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-8f76c657-jb84k_4193750a-8017-49b3-b520-3b1fa02a68e3/istio-proxy/0.log"
Nov 03 22:14:22.197371 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:22.197346    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65998dd86f-s5ch5_df967c38-9228-48fb-8aed-90749175ab1c/kube-auth-proxy/0.log"
Nov 03 22:14:22.237757 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:22.237722    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-4vtdz_1c3d0988-497b-45b2-961e-5ce3fb3e6eeb/istio-proxy/0.log"
Nov 03 22:14:22.238659 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:22.238639    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-4vtdz_1c3d0988-497b-45b2-961e-5ce3fb3e6eeb/istio-proxy/1.log"
Nov 03 22:14:22.327621 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:22.327590    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-f74lr_45431ac6-acc8-449c-8ed0-27975d792116/istio-proxy/0.log"
Nov 03 22:14:22.349844 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:22.349816    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-j4nv8_9a556d4c-2e33-47b3-9d99-25d4f88acfd6/istio-proxy/0.log"
Nov 03 22:14:22.390939 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:22.390914    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-wbrrh_3d061d55-2d2d-4686-a694-4b2f1f7e4b35/istio-proxy/0.log"
Nov 03 22:14:22.405463 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:22.405430    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-wlkwf_ba0fd87d-78b8-4a24-9e33-4904dafbbb63/payload-pre-processing/0.log"
Nov 03 22:14:22.423151 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:22.423124    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-xqtpq_851f4598-e261-4024-8a45-a831aa9dd4a4/payload-processing/0.log"
Nov 03 22:14:22.445161 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:22.445138    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b77b9dbdf-rbjh5_d6afb4de-bd45-4038-a6a9-9ff8671eb430/router/0.log"
Nov 03 22:14:23.472023 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:23.471994    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-2cp8m_924ab530-dbeb-446a-8069-ad634ab44e49/manager/0.log"
Nov 03 22:14:23.773859 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:23.773781    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8f6bb67b9-scb4p_ab73c329-b80c-4253-be63-15748b8d2442/manager/0.log"
Nov 03 22:14:23.798413 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:23.798371    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-58jdx_51ec143b-216f-4314-8997-8170d60a0804/server/0.log"
Nov 03 22:14:23.885391 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:23.885357    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-f87fcf56c-rmbn6_78e28086-24fc-42d6-ac43-3a5967c67012/manager/0.log"
Nov 03 22:14:24.017474 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:24.017447    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-8f76c657-jb84k_4193750a-8017-49b3-b520-3b1fa02a68e3/istio-proxy/0.log"
Nov 03 22:14:24.166109 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:24.166070    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77f6458f94-sj6tx_ca796c19-6509-4ead-93b3-c5b55f2702cb/manager/0.log"
Nov 03 22:14:24.186965 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:24.186937    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77f6458f94-sj6tx_ca796c19-6509-4ead-93b3-c5b55f2702cb/copy-manifests/0.log"
Nov 03 22:14:24.219411 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:24.219386    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-7d94f55f4b-kmlh8_5021d4ab-90a2-414f-aab6-947fc6e922a0/proxy/0.log"
Nov 03 22:14:24.582494 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:24.582469    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65998dd86f-s5ch5_df967c38-9228-48fb-8aed-90749175ab1c/kube-auth-proxy/0.log"
Nov 03 22:14:24.619177 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:24.619143    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-4vtdz_1c3d0988-497b-45b2-961e-5ce3fb3e6eeb/istio-proxy/0.log"
Nov 03 22:14:24.620289 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:24.620270    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-4vtdz_1c3d0988-497b-45b2-961e-5ce3fb3e6eeb/istio-proxy/1.log"
Nov 03 22:14:24.707629 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:24.707599    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-f74lr_45431ac6-acc8-449c-8ed0-27975d792116/istio-proxy/0.log"
Nov 03 22:14:24.726846 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:24.726814    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-j4nv8_9a556d4c-2e33-47b3-9d99-25d4f88acfd6/istio-proxy/0.log"
Nov 03 22:14:24.762164 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:24.762134    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-66db998887-wbrrh_3d061d55-2d2d-4686-a694-4b2f1f7e4b35/istio-proxy/0.log"
Nov 03 22:14:24.776864 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:24.776841    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-wlkwf_ba0fd87d-78b8-4a24-9e33-4904dafbbb63/payload-pre-processing/0.log"
Nov 03 22:14:24.792830 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:24.792803    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-xqtpq_851f4598-e261-4024-8a45-a831aa9dd4a4/payload-processing/0.log"
Nov 03 22:14:24.812510 ip-10-0-128-183 kubenswrapper[5077]: I1103 22:14:24.812487    5077 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b77b9dbdf-rbjh5_d6afb4de-bd45-4038-a6a9-9ff8671eb430/router/0.log"